Senior GPU Compute & AI Kernel Engineer

About the Position

We are seeking a Senior GPU Compute & AI Kernel Engineer to optimize high-performance kernels for modern deep learning workloads in Serbia.

Responsibilities

• Design, implement, and optimize high-performance compute kernels for GPUs and AI accelerators using modern C++ and one or more of CUDA, SYCL, OpenCL, Triton, or Apple Metal
• Profile, analyze, and tune parallel algorithms for performance and memory efficiency, identifying and removing bottlenecks across compute, bandwidth, and occupancy
• Accelerate machine learning workloads in PyTorch or TensorFlow, including the implementation of custom operators and kernels for Transformer, LLM, and CNN architectures
• Map deep learning operators onto target accelerator architectures, taking advantage of memory hierarchies, tensor units, and vendor-specific execution models
• Collaborate with compiler engineers on kernel code generation and lowering paths, working with technologies such as LLVM and MLIR
• Partner with hardware and architecture teams to evaluate performance characteristics of new accelerators and inform hardware/software co-design decisions
• Establish and maintain performance benchmarking, regression tracking, and profiling methodology for kernel and workload performance
• Debug complex correctness and performance issues spanning framework, runtime, compiler, and hardware layers
• Contribute to accelerator software stacks, runtimes, and framework integrations, upstream where applicable
• Apply and uphold software engineering best practices across Linux development environments - version control, code review, automated testing, and CI/CD
• Document design decisions, optimization techniques, and performance findings, and share knowledge across compiler, hardware, and ML engineering teams

Requirements

• 5+ years of software development experience with modern C++ (C++17/20 preferred)
• Strong experience developing high-performance compute kernels
• Hands-on GPU programming experience with one or more of CUDA, SYCL, OpenCL, Triton, or Apple Metal
• Solid understanding of GPU and AI accelerator architectures
• Experience optimizing parallel algorithms for performance and memory efficiency
• Experience developing or optimizing machine learning workloads using PyTorch or TensorFlow
• Good understanding of modern deep learning architectures, including Transformers, LLMs, and CNNs
• Familiarity with compiler technologies such as LLVM and/or MLIR
• Knowledge of High Performance Computing (HPC) concepts and performance optimization techniques
• Experience working with low-level hardware or processor architectures (RISC-V an advantage)
• Strong debugging, profiling, and performance analysis skills
• Ability to work across the software stack in close collaboration with compiler, hardware, and ML engineers
• Experience with Linux development environments and software engineering best practices (Git, CI/CD, code reviews)

Nice to Have

• Experience with AI accelerator software stacks
• Experience implementing custom ML operators or kernels
• Knowledge of distributed AI training or inference
• Experience contributing to compiler, runtime, or framework development
• Background in embedded systems or computer architecture
• Familiarity with tensor compilers and graph optimization frameworks

We Offer

• Diverse multicultural, multi-functional, and multilingual work environment
• Global scope, international projects in different business domains: life sciences and healthcare, retail, and distribution, software and hi-tech, etc.
• Outstanding career development opportunities with a transparent career path and a roadmap to accelerate your journey
• Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications
• Knowledge-sharing with colleagues from EPAM's global tech communities
• 25 days holiday per annum
• 5 days of sick leave without medical certification
• Private health insurance for employees and discount for private health insurance for family members
• Discount for Fit Pass program
• Comfortable modern offices in Belgrade and Novi Sad or remote work from any location in Serbia
• Regular corporate, social, and wellbeing events (parties, sport events, advanced CSR programs, etc.)

About the Company

[Company description if present]