Evolve Squads logo

Remote Director of Infrastructure Engineering

Evolve Squads·Salary not specified

Primary stack

DevOpsAI

Job description

About the Position

... create world-changing products using God-given talents . ..

Our client is an AI Developer Cloud. More than one million developers, from indie researchers to teams running frontier models in production. The platform has processed more than 20 billion inference requests. We closed a $100M Series A in June 2026. We're at an inflection point for AI infrastructure, and we're building the platform the next generation of developers will depend on. We're a small, remote-first team. We take ownership seriously, move fast, and ship work that more than a million developers rely on every day. We're looking for people who care deeply, build with urgency, and want to matter at scale.

Responsibilities

  • Own Core Infrastructure & SRE: Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage. Establish rigorous SRE practices, driving SLA/SLO definitions, incident response, observability, and automated remediation.
  • Architect HPC & Global Networking: Oversee the design, scaling, and operation of our global network backbone, as well as ultra-low-latency HPC cluster networks. Drive the implementation and optimization of InfiniBand and RDMA over Converged Ethernet (RoCE) to support massive, multi-node GPU training workloads.
  • Drive Storage Engine Innovation: Direct the architecture and performance tuning of highly scalable, distributed storage systems. Ensure our storage engines can deliver the massive IOPS and throughput required to keep high-end GPUs fed with data during deep learning tasks.
  • Build a High-Output Org: Hire, mentor, and grow highly technical engineering managers and senior ICs (network architects, systems engineers, SREs). Create a culture of ownership, operational excellence, and craft in a remote-first environment.
  • Translate Scale into Strategy: Partner with Program Management and Product to forecast capacity requirements, shape technical roadmaps, and convert massive scale challenges into clear technical scopes, milestones, and measurable outcomes.
  • Continuously Improve Systems & Flow: Drive measurable improvements in infrastructure reliability and delivery metrics, such as deployment frequency, MTTR (Mean Time To Recovery), infrastructure as code (IaC) coverage, and system uptime.
  • Architectural Stewardship: Provide architectural oversight for bare-metal provisioning, virtualization layers, network fabrics, and storage clusters, ensuring seamless scalability without becoming a bottleneck for your teams.
  • Cross-Functional Partnership: Coordinate cleanly with product delivery and platform teams to ensure the infrastructure primitives they rely on are robust, well-documented, and highly available.

Requirements

  • Engineering Leadership Experience: 7+ years leading software, infrastructure, SRE, or networking teams, including managing managers and multiple squads, with a proven record of scaling high-availability cloud environments.
  • Deep Infrastructure Expertise: 8+ years building and operating large-scale distributed systems, bare-metal infrastructure, or public/private cloud platforms.
  • HPC & Advanced Networking: Proven hands-on background or strong architectural understanding of ultra-low latency networking. Deep familiarity with InfiniBand and/or RoCE, spine-leaf architectures, and global WAN routing protocols (BGP).
  • Storage Systems Knowledge: Experience building, operating, or tuning high-performance distributed storage systems and parallel file systems (e.g., Ceph, Lustre, Weka, NVMe-oF) capable of handling heavy AI/ML I/O loads.
  • SRE / DevOps Culture: Strong foundation in reliability engineering, infrastructure-as-code (Terraform, Ansible), container orchestration (Kubernetes), and modern observability stacks.
  • Remote-First Operating Excellence: Experience building culture, accountability, and momentum across distributed technical teams.
  • Communication & Collaboration: Clear written and verbal communication, strong stakeholder management, and calm, decisive leadership during high-stakes operational incidents.
  • Background Check: Successful completion of a background check.

Nice to Have

  • Direct experience architecting and operating infrastructure specifically optimized for massive GPU clusters and AI/ML workloads.
  • Deep understanding of hardware architectures, GPU interconnects (NVLink), and datacenter topology.
  • Track record of scaling infrastructure teams in hyper-growth startup environments.
  • Open-source contributions or active recognition within the infrastructure, networking, or Kubernetes communities.

We Offer

  • Meaningful equity in a fast-growing company- everyone on the team receives stock options - your impact drives our growth, and you share in the upside.
  • Generous medical, dental & vision plans.
  • Flexible PTO- take the time you need to recharge.
  • Most roles are remote work first with an inclusive, collaborative teams utilizing Slack as the main form of internal communication.
  • Join a passionate team on the cutting edge of AI infrastructure - where culture, learning, and ownership are at the heart of how we scale.
  • $1,200 Home Office & Equipment Stipend- We set you up for success from day one with gear and support to create your ideal workspace.

About the Company

We're at an inflection point for AI infrastructure, and we're building the platform the next generation of developers will depend on. We're a small, remote-first team. We take ownership seriously, move fast, and ship work that more than a million developers rely on every day. We're looking for people who care deeply, build with urgency, and want to matter at scale.

© Evolve Squads. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

Headquartered in the State of Washington, Evolve Squads was founded due to the over commoditization of software outsourcing companies, traditional staff augmentation companies and consulting services.Technical hiring managers are continuously inundated from recruiters around the globe with hot candidates coming off a job board or the bench trying to fit a “round peg” developer into a “square box” requirement.Our Professional Fulfilment Network consists of several thousand senior level developers from Central and Eastern Europe including Ukraine, Belarus, Poland, Hungary and Georgia...

More at Evolve Squads

All 41 roles

Popular searches