
Senior C++ Software Engineer with CUDA/GPU/TPU
Primary stack
Nice to have's
Job description
About the Position
We are looking for a Senior C++ Software Engineer with CUDA/GPU/TPU to join a team building the next generation of computers for artificial intelligence. The company brings together experts in computer architecture, ASIC design, advanced systems, and neural network compilers, with the team focused on the compiler and neural network stack, including LLMs and CNNs. This is a key developer role within the ML & AI team.
Responsibilities
- Write kernels in C++ for various operations used across AI and ML workloads
- Develop and optimize the compiler and neural network stack supporting LLMs and CNNs
- Collaborate with experts in computer architecture, ASIC design, and advanced systems to build next-generation computing solutions
- Design and implement AI/ML kernel operations tailored to GPU/AI-accelerator architectures
- Build and maintain ML models using PyTorch or TensorFlow
- Ensure kernel-level performance and correctness across modern neural network architectures such as transformers
- Take ownership of key technical decisions as a lead developer within the ML & AI team
Requirements
- 5+ years of experience in software engineering with a focus on ML/AI
- 5+ years of experience in C++ and CUDA/kernel programming
- Knowledge in GPU/AI-accelerator architectures
- Experience in building and working with ML models in PyTorch or TensorFlow
- Understanding of modern ML model architectures such as transformers
- English proficiency at B2 level or higher
Nice to Have
- Proficiency in Python programming with hands-on experience in developing, training, and fine-tuning deep learning models
- Proven LLM experience
- Skills in designing, implementing, and iterating on neural network architectures to achieve optimal performance on diverse tasks
- Capability to investigate and troubleshoot model performance issues including gaps in compilation steps and kernels
- Demonstrated experience in designing, training, and deploying neural networks for various applications
- Solid understanding of machine learning fundamentals including supervised and unsupervised learning techniques
We Offer
We gather like-minded people: Top tech minds driving innovation in AI, cloud, and digital platform modernization. Supportive team and agile, startup-like culture. Hybrid by design mode and opportunity to work remotely within Poland. Chance to work abroad for up to 60 days annually. Business-driven relocation opportunities.
We provide growth opportunities: Career development programs, thought leadership, mentoring, soft skills, and well-being programs. Certification (Anthropic, Gemini, GCP, Azure, AWS). English classes.
We cover it all: Stable pay. Participation in the Employee Stock Purchase Plan with a 15% discount. Benefits package (health insurance, multisport, shopping vouchers). Referral bonuses up to $2,000. Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee, and more. Corporate, social, and well-being events.
Please, note: Benefits listed above are available to employees only. We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually. We will reach out to selected candidates exclusively.
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.
More at EPAM
All 3011 roles
Solution Architect - HCL Commerce
EPAM · India

Lead Java Automation Test Engineer with AI
EPAM · India

Lead Software Developer - Java with AWS Cloud
EPAM · India

Solution Architect – Java Full Stack
EPAM · India