Principal Software Engineer, Rack-Scale System Software - CSP Engagements

We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams to ensure they can deploy, monitor, and operate these systems reliably at fleet scale. In this role, you will collaborate with NVIDIA's cross-functional rack-scale system SW/FW engineering teams with dedicated CSP-facing technical leadership. Your focus is on the system-level software that manages, monitors, and recovers the rack as a whole - fabric management, GPU/NVSwitch error handling and recovery, health telemetry APIs, firmware update orchestration, and SW-driven serviceability.

You will drive work streams with CSP engineering teams to build shared understanding of the architecture, incorporate their operational feedback, and ensure integration readiness. What you'll be doing: Drive rack-scale SW/FW architecture alignment across CSP engagements - including fabric management software, link health monitoring, GPU/NVSwitch error handling, SW/FW serviceability features (e.g., hot-plug support, component isolation, firmware-driven recovery), and multi-component firmware orchestration Drive technical work streams with CSP engineering teams on rack-scale system software - ensuring they deeply understand fabric management, NVSwitch behavior, error handling and recovery policies, health telemetry APIs, and SW/FW-controlled recovery operation Capture and synthesize CSP engineering feedback on rack-scale system software - health monitoring APIs, SW-driven serviceability workflows, firmware update orchestration, and error recovery behavior - champion that feedback into NVIDIA's architecture decisions Collaborate with multi-functional teams to ensure customer operational requirements are reflected in system software and firmware development Identify cross-CSP patterns in rack-scale SW/FW issues, error handling behavior, and system configuration practices - drive documentation, tooling, and test strategy improvements as a result Collaborate with execution teams on left-shift strategy - ensuring customer-side SW/FW integration work is identified early and completed ahead of hardware availability Make critical technical decisions on rack-scale system SW/FW tradeoffs and mitigate execution risks through early engagement with CSP engineering teams What we need to see: 15+ years of experience in system software, platform firmware, or large-scale distributed systems engineering. BS or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience) Deep understanding of rack-scale system software challenges: multi-component coordination, error propagation, health monitoring, and serviceability / reliability Experience with fabric management software, cluster management, or system-level orchestration frameworks

Familiarity with firmware architectures and update lifecycle management (multi-component update sequencing, rollback, recovery) Understanding of error handling and recovery design patterns in distributed systems - fault isolation, retry policies, graceful degradation Experience with health monitoring and telemetry systems: health scoring, event correlation, API design for fleet-level observability Understanding of GPU or accelerator system software (drivers, device management, power management) is a strong plus Customer obsession - genuine passion for understanding how CSPs operate sophisticated systems at fleet scale and simplifying their experience Proven success providing technical leadership across organizational boundaries and influencing system software design without direct authority. Strong communication - ability to translate complex system software architecture into actionable mentorship for customer engineering teams Ways to stand out from the crowd: Experience with NVIDIA NVSwitch, NVOS, or GPU fabric management software Background in system software for large-scale clusters at a hyperscaler (cluster management, fleet orchestration, health platforms) Experience crafting error handling and recovery frameworks for multi-component systems (hundreds or thousands of coordinating devices) Familiarity with GPU or accelerator fleet operations - driver lifecycle, firmware rollout strategies, health-based scheduling Understanding of how system software decisions impact serviceability, availability, and operational cost at fleet scale NVIDIA's invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern deep learning - the next era of computing - with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world.

Today, we are increasingly known as "the AI computing company." We're looking to grow our company and establish teams with the most thoughtful people in the world. Are you ready to change the next generation of computing. Join us at the forefront of technological advancement

NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. These platforms bring together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

The base salary range is 272,000 USD - 431,250 USD. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until October 15, 2026.

This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.

As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Back to blog

Other Jobs To Apply

Equipment Coordinator (Fulfillment Center)

Inventory Attendant

Warehouse Associate (Part-Time)

Join Amazon in Columbus as a Fulfillment Center-Warehouse Packer

Fulfillment Center-Warehouse(Gig)-Fremont

Lead Ramp Agent — Ground Ops Leader (DailyPay)

Flexible Part-Time Fulfillment Center Order Picker in Phoenix

Salt Lake City-based 3rd Shift Weekend Operations Driver Opening

Part-Time Job at Amazon:Fulfillment Center

$21.25/hr Inventory Control Associate-Grand Rapids(PT)

Part-Time Fulfillment Center Logistics Associate(Austin)

Amazon Delivery Driver

Amazon Step Van Driver

2025 Field Engineering Trainee (Various Locations)

Now Hiring San Bernardino:Fulfillment Center-Outbound Ship Dock

Virginia Beach Hiring:Part-Time Fulfillment Center-Package Sorter

Kitchen Helper/Dishwasher (Full-Time)

[Remote] Member Contact Center Sales Associates (FT & PT)

Field Service Professional - Plainfield, NJ

Call Center Specialist [Work From Home - Night Shift - Full Time]

Remote BDR – Dental SaaS Outreach

Manager, Design Engineering - Optical

Customer Service Agent (PT or FT)

Remote Customer Service Contractor for Fortune 500 Companies

Join Today: Online Jobs for Teens: Content Creator & Virtual

Remote Data Entry Representative – Flexible Home‑Based Role for Male & Female Candidates, Customer Support & Survey Assistance – $20‑$25 per Hour

Medical Transcription Training and Work-From-Home Opportunity

Online Job for Student & Fresher (Data entry) – Job ID- 505 Job ID- 2688

Entry-Level Remote Chat Moderator – Flexible Part‑Time/Full‑Time, $25–$35/hr, No Phone Calls, Join arenaflex’s Growing Online Community

Teen Editorial Team Member for Girl-led International Magazine

Remote Coder II — Medical Coding & Denials Specialist

[Remote] Pharmacy Tech/CSR

Help Desk Specialist

Technical Support Engineer 2

YouTube Content Moderator $16/Hour (reputed company)

Work From Home

Apple Home Jobs: Stelle als Mitarbeiter von zu Hause aus

Watch Netflix (Tagger): $12-$46

Medical Review Nurse (RN)- Remote

National Account Executive/National Account Executive-Senior

Returns Processing Associate(Reverse Logistics)Vacancy in New York

Part-Time Job at Amazon:Fulfillment Center

Biller I at Monument Health Inc.: 100% Remote (FL, GA, KY, OH, SC, TN, TX, WY, SD)

Paid Focus Group Panelist - No Experience, Work From Home

Remote Part-Time and Full-Time Positions Available

Urgent Part-Time:Fulfillment Center-Order Picker(Knoxville)

Online Jobs That Are Legit - Trusted Live Chat Agent Roles, $25-$35/hr

Entry‑Level Remote Chat Support Specialist – Flexible Part‑Time Role with No Experience Required, Earn $35/hr, Grow Your Career at arenaflex

Remote Administrative Assistant-Behavioural Health

Benefits Account Specialist (Fully Remote)