Senior Software Development Engineer, EC2 Trainium AI Infra

Saved job description

Are you excited about building the infrastructure that powers the next generation of AI workloads? As a Senior Software Development Engineer on the EC2 UltraServer Provisioning team, you will lead technical strategy, design, and operation of infrastructure services — including provisioning and availability of AWS Trainium-based AI servers. You will architect large-scale systems, build microservices, and collaborate cross-functionally with capacity management, hardware engineering, and datacenter teams to manage AI/ML infrastructure at scale.

Key job responsibilities

- Lead the design and development of infrastructure systems that support AI workloads on UltraServers, ensuring reliability and performance at scale.

- Own your team's architectural direction for provisioning systems, influencing technical decisions across dependent systems and driving alignment with partner teams.

- Collaborate with capacity management, hardware engineering, and datacenter teams to improve provisioning workflows and operate efficiently at scale.

- Mentor and coach engineers on the team, driving adoption of engineering best practices and raising the technical bar across the organization.

- Investigate complex performance challenges, develop solutions, and publish actionable best practices to internal and external stakeholders.

A day in the life

You might start your morning reviewing operational metrics for provisioning pipelines, then shift into a design review with hardware engineering partners on an upcoming server configuration. After lunch, you could be deep in code — prototyping a new microservice or refactoring a critical path in the provisioning workflow. Throughout the day, you balance hands-on technical work with mentoring teammates, unblocking cross-team dependencies, and contributing to architectural decisions that shape how AI infrastructure scales.

About the team

The EC2 UltraServer Provisioning team is responsible for delivering AWS Trainium-based UltraServer infrastructure at scale. We manage end-to-end provisioning workflows from host ingestion through testing, repair, and recovery. Our mission is to ensure that AI/ML customers have reliable, high-performance compute infrastructure ready when they need it. We are a collaborative engineering team that values technical depth, operational excellence, and building systems that grow with customer demand.

Requirements: - 5+ years of non-internship professional software development experience

- 5+ years of programming with at least one software programming language experience

- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience

- Experience as a mentor, tech lead or leading an engineering team