Find your next role

Description

Are you passionate about building the serverless infrastructure that powers analytics for hundreds of thousands of AWS customers? AWS Athena and Glue ETL is looking for a Principal Engineer to own components of the serverless platform — the multi-tenant compute layer that orchestrates how queries, jobs, and interactive sessions are launched, routed, executed and managed across AWS's analytics stack.

Our services process billions of queries per week, serving customers who rely on Amazon Athena for interactive SQL and Spark analytics, AWS Glue ETL for serverless data integration, and Zero-ETL for automated replication pipelines.

As a Principal Engineer, you will own significant components of the platform end-to-end and drive novel solutions and optimizations. You will define the technical vision, contribute to the most critical system components, and drive architectural convergence across AWS analytics services.

Key job responsibilities
- Own components of the platform end-to-end: compute orchestration, multi-provider routing, telemetry, etc.

- Drive compute latency optimization: architect and deliver sub-second startup including VPC connectivity across all workload types and compute options.

- Optimize compute utilization: design intelligent workload placement and pool sharing strategies that balance the fundamental tension between low latency and efficient resource utilization.

- Architect platform convergence: drive enhancements for Athena and Glue, replacing and enhancing tech stacks, and align across AWS analytics services over time.

- Drive operational excellence.

- Adoption new hardware platforms: deliver customer price/performance improvements across the compute fleet.

- Contribute to critical system components: design and implement solutions for the most complex and impactful areas of compute orchestration, latency optimization, and workload routing.

- Lead cross-team technical alignment: drive architectural consensus across multiple analytics service teams. Represent the team in senior technical reviews and forums.

- Mentor and develop engineers: establish engineering standards, lead design reviews, and help senior engineers grow in strategic thinking and organizational influence.

- Deliver engineering velocity improvements: drive development process transformation to accelerate the pace of innovation across the organization.


A day in the life
You start your morning reviewing platform metrics — operational, latency and utilization rates across interactive SQL queries, Spark sessions, and batch jobs. You identify opportunities for improvements.

Mid-morning, you lead a design review on platform telemetry improvements, defining what observability data is needed to improve operational excellence. A senior engineer proposes a new approach to compute provider routing — you ask probing questions, help them think through failure modes under load, and guide them toward a solution that balances latency guarantees with cost efficiency.

After lunch, you join an architecture discussion with a partner analytics team about their requirements for adopting a project. You then dive into the details of a latency regression in session startup times, working through the system to identify root cause and design a fix.

Later in the afternoon, you collaborate with peer Principal Engineers to align on an upcoming platform change that affects multiple services. You then spend time mentoring one of your senior engineers who is preparing a technical proposal for cross-account warm pool sharing — coaching them on how to frame the trade-offs, anticipate objections from security reviewers, and build consensus across teams.

Throughout the day, you balance deep technical work with broad organizational influence, serving as the technical owner of AWS's analytics services for hundreds of thousands of customers.

About the team
The AWS Athena and Glue ETL organization builds and operates core analytics and data processing infrastructure for AWS. We own Amazon Athena (serverless interactive query and analytics), AWS Glue ETL (serverless data integration with Apache Spark), Data Management and Quality, Drivers, Connectors, and Zero-ETL Integrations. Our services collectively process billions of queries per week for hundreds of thousands of active customers.

We are building the future of serverless analytics — converging our compute infrastructure onto a unified platform, shipping next-generation Spark-based analytics with modern pricing models, and competing directly with the industry's leading analytics platforms.

You will work alongside a strong Principal Engineer community with support and technical guidance from Senior Principal Engineers. The team hubs are in East Palo Alto and Bellevue, with additional engineering presence in New York.

We value builders who combine technical depth with customer obsession. Our team culture emphasizes ownership, operational excellence, and the belief that the best architectures emerge from engineers who understand the customer experience and think long-term about how systems evolve.