Senior HPC and AI Network Software Architect
Primary stack
Job description
About the Position
Senior HPC and AI Network Software Architect
NVIDIA is seeking a Senior HPC and AI Network Software Architect to develop scalable software systems for distributed AI training and inference.
Responsibilities
- Build and evolve the architecture of scalable software systems for distributed AI training and inference, focusing on throughput, latency, resiliency, and memory efficiency across cluster-scale deployments.
- Develop and evaluate next-generation communication and runtime capabilities in libraries such as NCCL, UCX, and UCC.
- Partner with AI framework teams (TensorFlow, PyTorch, JAX) and internal platform teams to build integrations and improve performance and reliability.
- Collaborate on hardware and system-level features across GPUs, DPUs, and interconnects to enhance data movement and capabilities for training, inference, and model serving at scale.
- Drive innovation across runtime systems, communication libraries, and AI-specific protocol layers, turning new ideas into practical capabilities and implementations.
Requirements
- Ph.D. or equivalent industry experience in computer science, computer engineering, or a related field.
- 5+ years of experience in systems programming, parallel or distributed computing, high-performance networking, or large-scale data movement.
- Strong programming skills in C++, Python, and ideally CUDA or other GPU programming models.
- Extensive hands-on experience with AI frameworks such as PyTorch, TensorFlow, and JAX.
- Demonstrated success in developing high-throughput, low-latency systems with understanding of software stacks, hardware capabilities, and system bottlenecks.
- Strong collaboration skills in a multi-national, interdisciplinary environment.
We Offer
- Highly competitive salaries.
- Comprehensive benefits package.
About the Company
NVIDIA is a technology company with over 25 years of experience in computer graphics, PC gaming, and accelerated computing. The company focuses on AI to define the next era of computing, involving GPUs as central components in computers, robots, and self-driving cars. The role is part of a team building software and hardware for AI at a large scale.
© Czy Jest Eldorado?. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
Recruitment & HR Tech
About the Company Czy Jest Eldorado? is the largest job search engine for IT jobs in Poland. It indexes job offers in real-time from job boards, Applicant Tracking Systems (ATS), and company career pages, ensuring no duplicates. The platform aims to increase candidates' chances of securing the first interview by providing timely and comprehensive job listings. Products, Services & Tech Stack Core Solutions: Job search engine for IT professionals. Technologies & Frameworks: Python JavaScript PHP Java Kubernetes GCP Terraform AWS SQL REST DevOps CI/CD Git React UiPath FastAPI Flask Scala MongoDB Hibernate PyTorch RabbitMQ Big Data Maven FastAPI Redis GraphQL IoT Next.js .NET AI Engineer Analytics Engineer Android Developer Angular Developer Application Security Engineer Backend Developer BI Developer Blockchain Developer Business Analyst C# Developer C++ Developer Cloud Administrator Cloud Architect Cloud Engineer Cloud Security Engineer COBOL Developer Computer Vision Engineer CRM Specialist CTO / Chief Technology Officer Data Analyst Data Engineer Data Scientist Database Administrator (DBA) Delivery Manager DevOps Administrator DevOps Engineer DevSecOps Engineer Dynamics 365 Developer Embedded Engineer Engineering Manager Enterprise Architect ERP Consultant ERP Developer Flutter Developer FPGA Engineer Frontend Developer Fullstack Developer Game Developer Golang Developer Hardware Engineer Helpdesk Specialist Incident Response Engineer iOS Developer IT Support IT Teacher / Nauczyciel IT IT Trainer Java Developer JavaScript Developer Kotlin Developer Low-Code / No-Code Developer Machine Learning Engineer Manual Tester MLOps Engineer Mobile Developer Network Engineer NLP Engineer Node.js Developer Penetration Tester PHP Developer Platform Engineer PLC Programmer Pre-Sales Architect Product Designer Product Manager Product Owner Project Manager Prompt Engineer Python Developer QA Engineer R Developer React Developer Robotics Engineer Ruby Developer Rust Developer Sales Engineer Salesforce Administrator Salesforce Architect Salesforce Consultant Salesforce Developer SAP Consultant SAP Developer Scala Developer Scrum Master Security Architect ServiceNow Developer Site Reliability Engineer (SRE) Smart Contract Engineer SOC Analyst Software Architect Software Engineer Solution Architect Swift Developer System Administrator System Analyst Tech Lead Technical Analyst Test Automation Engineer TypeScript Developer Unity Developer Unreal Developer UX/UI Designer Vue Developer WordPress Developer
More at Czy Jest Eldorado?
All 236 rolesDeveloper C# lub ASP.NET / Programista/-ka C# lub ASP.NET
Czy Jest Eldorado? · Poland
Senior M365 Administrator (L3) - IT Contracting
Czy Jest Eldorado? · Poland +1
Senior Android Developer - Freelance
Czy Jest Eldorado? · Poland +1
UX Researcher (m/f/d)
Czy Jest Eldorado? · Poland +1