Senior Product Architect

Nvidia
US, CA, Santa Clara / Remote - US2026-05-14remote_local

About the job

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We’re on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you’ll design and shape the architectures that connect the world’s most powerful AI clusters. As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos!

Responsibilities

Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts

Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements

Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance

Iterate and refine designs based on feedback, testing results, and evolving requirements

Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems

Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision

Provide comprehensive documentation for product designs, including technical specifications and user guides

Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

Qualifications

Minimum

12+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent

Bachelors degree in computer science or related field (or equivalent experience).

Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage

Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments

Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation

Exceptional communication skills, with the ability to translate complex technical details for diverse audiences

A passion for staying updated with the latest technological advancements in AI and related fields

Preferred

Prior first-hand experience on having built large scale AI infrastructure

Advanced certifications or publications in AI, deep learning, or related fields

Experience leading high-impact projects or initiatives in cutting-edge tech domains