Principal Software Engineer, Audible AI Foundations
Technology | Job ID 2923368Job Summary
ABOUT THIS ROLE
This is a rare opportunity to shape the future of audio content discovery and understanding at a massive scale. As the PE for Audible's AI Foundations, you will be at the forefront of designing next-generation infrastructure and capabilities that will directly impact the daily entertainment experience of millions of customers.
You will have the chance to work with AI technologies, including large language models, multi-modal representation learning, and real-time personalization systems. By architecting the core AI services that power Audible's content discovery, recommendation, and conversational experiences, your work will be at the heart of delivering innovative and engaging experiences to users. Beyond the technical challenges, this role offers the unique ability to influence the strategic direction of Audible's AI initiatives, collaborating closely with cross-functional teams and driving the evolution of the company's AI capabilities. If you're passionate about building robust, scalable, and innovative AI systems that can transform the way customers interact with digital content, this is an unparalleled opportunity to make a lasting impact.
ABOUT THE TEAM
Our team is responsible for the foundational AI infrastructure and services that power Audible's key customer experiences, including content discovery, personalization, and conversational AI. We oversee the development and operation of a diverse portfolio of systems that sit at the intersection of machine learning, natural language processing, and large-scale distributed architectures. The current state of our existing systems reflects both the progress we've made and the challenges we now face as we strive to deliver increasingly sophisticated AI capabilities to our customers. Our core offerings include:
Content AI Infrastructure:
• Semantic search and content understanding systems that need evolution to better handle audio-centric content
• Content processing pipelines for attribute extraction and organization from various sources including customer reviews and metadata
• Machine learning serving infrastructure for recommendation and personalization models requiring optimization for real-time, interactive AI experiences
AI Foundation Services:
• Large language model integration services for conversational AI and content understanding
• Content understanding pipelines for processing multi-modal data and creating rich content representations
• Feature management infrastructure for machine learning model support
ABOUT YOU
You’re in your element when you’re being challenged, and you’re always eager to share your ideas, take on responsibility and keep developing at an exciting pace. We look for people who show initiative, set their standards high and see every failure as an opportunity to learn. You’re looking for an environment where you can thrive and help your team reach their potential. With opportunities to challenge yourself and lead a talented team to success, you’ll find what you’re looking for at Audible.
As a Lead Software Development Engineer, you will be responsible for:
o Architecture & Design:
Designing the scalable, low-latency architecture for integrating large language models (LLMs) into our conversational AI and content understanding systems. This includes optimizing for streaming responses, efficient context management, and robust prompt engineering frameworks.
Creating the next-generation content processing and representation learning pipelines that can seamlessly handle the multi-modal nature of Audible's catalog, including text, audio, and associated metadata.
Defining the overarching integration patterns and service mesh architecture that will enable the smooth flow of data and features across our diverse AI-powered systems.
o Infrastructure Evolution:
Architecting the high-performance, real-time feature computation infrastructure that will power our personalization and recommendation models, ensuring sub-millisecond latency and consistent data freshness.
Designing the evaluation and quality assurance frameworks that will be used to assess the performance, accuracy, and reliability of our AI systems, including mechanisms for model versioning, A/B testing, and continuous monitoring.
Establishing the technical governance structure and best practices that will guide the development and deployment of Audible's AI foundation services across the organization.
o Technical Strategy:
Crafting the long-term technical roadmap for the evolution of Audible's AI platform, aligning it with the company's strategic vision and customer experience goals.
Influencing and collaborating with cross-functional teams in Data Science, Product, and Engineering to ensure the seamless integration of AI capabilities into Audible's overall technology strategy.
Defining the architectural standards, design patterns, and implementation guidelines that will be used to maintain consistency and reliability across Audible's AI infrastructure.
o Operational Excellence
The Principal Engineer will be a key driver of operational excellence across Audible's AI foundation services, establishing robust frameworks and best practices for system reliability, performance, and scalability. They will architect comprehensive monitoring and observability solutions to ensure early detection of potential issues, implement sophisticated alerting mechanisms, and design automated recovery processes.
The PE will be responsible for creating resilient systems that maintain high availability while managing complex dependencies across the AI infrastructure. This includes establishing SLAs, defining performance metrics, and building automated testing frameworks to validate system behavior under various conditions. They will need to implement efficient capacity planning strategies, optimize resource utilization, and ensure cost-effective scaling of AI services. Additionally, the PE will establish incident management protocols, lead post-mortem analyses, and drive continuous improvement initiatives to enhance system reliability and operational efficiency. Their focus on operational excellence will be crucial in maintaining the high-performance, reliable infrastructure necessary to serve millions of customers while enabling rapid innovation and deployment of new AI capabilities.
ABOUT AUDIBLE
Audible is the leading producer and provider of audio storytelling. We spark listeners’ imaginations, offering immersive, cinematic experiences full of inspiration and insight to enrich our customers daily lives. We are a global company with an entrepreneurial spirit. We are dreamers and inventors who are passionate about the positive impact Audible can make for our customers and our neighbors. This spirit courses throughout Audible, supporting a culture of creativity and inclusion built on our People Principles and our mission to build more equitable communities in the cities we call home.
For basic qualifications enter as freeform, no *
Bachelors degree in Computer Science, Electrical Engineering, or a related STEM field
10+ years in software engineering
Previous experience with on-device AI/ML optimization, including model deployment, quantization, and performance tuning
Same for preferred
Distributed Systems Architecture: A deep understanding of distributed systems design patterns, including scalable data storage, efficient caching strategies, and robust failure handling mechanisms. This expertise will be crucial in architecting the next-generation of Audible's content processing and ML serving infrastructureMachine Learning Infrastructure: Extensive experience in building and operating large-scale ML platforms, with expertise in areas such as model versioning, automated deployment, feature management, and real-time inference. This knowledge will be critical in evolving Audible's ML platform to support the growing demands of AI-powered content discovery and personalization.Natural Language Processing: Solid grasp of NLP techniques and architectures, particularly in the context of content understanding, semantic search, and multi-modal representation learning. The PE must be well-versed in the latest advancements in LLM integration, prompt engineering, and cross-modal alignment to drive Audible's content understanding capabilities.Real-time Serving Systems: Proficiency in designing low-latency, high-throughput serving systems capable of handling the stringent performance requirements of Audible's customer-facing AI features. This includes expertise in areas like load balancing, caching, and dynamic model routing.Content Recommendation Systems: Deep understanding of content personalization and recommendation architectures, with the ability to create innovative approaches to model content relationships, capture user preferences, and drive engaging content discovery experiences.
Basic Qualifications
* 10+ years in software engineering
* Previous experience with on-device AI/ML optimization, including model deployment, quantization, and performance tuning
Preferred Qualifications
* Machine Learning Infrastructure: Extensive experience in building and operating large-scale ML platforms, with expertise in areas such as model versioning, automated deployment, feature management, and real-time inference. This knowledge will be critical in evolving Audible's ML platform to support the growing demands of AI-powered content discovery and personalization.
* Natural Language Processing: Solid grasp of NLP techniques and architectures, particularly in the context of content understanding, semantic search, and multi-modal representation learning. The PE must be well-versed in the latest advancements in LLM integration, prompt engineering, and cross-modal alignment to drive Audible's content understanding capabilities.
* Real-time Serving Systems: Proficiency in designing low-latency, high-throughput serving systems capable of handling the stringent performance requirements of Audible's customer-facing AI features. This includes expertise in areas like load balancing, caching, and dynamic model routing.
* Content Recommendation Systems: Deep understanding of content personalization and recommendation architectures, with the ability to create innovative approaches to model content relationships, capture user preferences, and drive engaging content discovery experiences.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Related Jobs
- Software Development Engineer, Consumer Domains Newark, New Jersey Technology
- Software Development Engineer, Consumer Domains Newark, New Jersey Technology
- IT Support Associate II Newark, New Jersey Technology
Audible Success Profile
Audible is built on a strong foundation as an Amazon subsidiary, so you’ll get to leverage all of Amazon's technologies while still being on a small team with an entrepreneurial spirit. We’re looking for someone who knows how to use data to provide our customers with engaging and inspiring experiences.
-
- Curious You are open to others’ perspectives and ideas. When faced with challenges, you stay inquisitive, collaborating and testing different approaches.
- Imaginative You imagine freely and support your colleagues’ own imagining. You ask “What if…?” and employ original thinking in your work.
- Customer Centric You are passionate about creating delightful experiences. Whether you’re working with creators, customers, or colleagues you aim to exceed their expectations in every way.
-
- Inventive You express ideas and navigate complex and ambiguous situations in novel ways, even creating new paradigms or structures for others to follow.
- Socially Conscious You’re mindful of the impact we have on each other and apply empathy into your work with colleagues, communities, and customers.
- Effective Communicator By adapting complex information for your audience, you’re able to foster collaboration and have a positive impact on outcomes
What we can offer you
We are a community of brilliant minds, brimming with fresh ideas and working shoulder to shoulder to achieve greatness. And because of this, we think it’s only fair that we offer some nice little perks to everyone who goes the extra mile at Audible.
Flexible Work
We promote flexibility in how and where we work with our Hub+Home hybrid workplace model.
Health
Dental and vision plans, life insurance, and the medical plan options that suit individual needs.
Savings
Plan for your future with employer-matched savings accounts.
Stock
We grant our employees restricted stock units, because we want them to think and act like owners.
Time Off
We love what we do but everyone needs the opportunity to hit the refresh button. Take advantage of vacation days, sick days, and personal days to rejuvenate.
Community
We are committed to building and sustaining a diverse and inclusive culture and community. Audible’s Impact Groups encourage an environment where you can be you, and bring your whole self to work.
Amazon Discount
As part of the Amazon family, Audible employees are entitled to a discount on products on Amazon.
Learning & Development
We want to help you grow with learning and development programs, leadership training and tuition reimbursement.
Audible's People Principles celebrate who we are and where we've been, and guide the way we work shoulder to shoulder to enhance the lives of our millions of customers around the world. They reflect and apply to everyone who works at Audible—the entrepreneurs and operators, the dreamers and the doers, those who have worked here for 25 years and those who have arrived in the past few weeks and months.
View all Our People Principles
Community Impact
At Audible, we seek to exemplify what a company can mean beyond what it does. We recruit and cultivate local talent, and we drive forward a wide range of initiatives focused on returning Newark to its roots as a hub of innovation. Our global offices embrace the same principle, and our employees around the world volunteer and serve in their communities in addition to seeding and growing the local creative economy.
Learn more

Location Benefits
Our Newark office is at the heart of the audio revolution. We stay inspired by visiting creatives, guest speakers, professional development, and community engagement. We fuel our ideas with daily catered lunch and then take in local culture or hang out with colleagues at weekly happy hours. Getting here is easy with free parking or transit perks, and employees who move to the neighborhood enjoy our monthly Live Local housing subsidy.
Learn more
Related Content
-
LinkedIn Top Companies 2022: Media & Entertainment
We're proud to be recognized in LinkedIn's List of #LinkedInTopCompanies in Media & Entertainment for 2022.
-
Audible Named Among 100 Best Workplaces for Innovators by Fast Company
We’re proud to be recognized as a place where inventive minds and diverse experiences are valued, and where employees are actively encouraged to use their ideas and talents to improve our customers’ lives.
-
Audible Wins 2021 Digiday Worklife Award
This year’s Worklife Awards winners capture responses and new directions, and exemplify how companies worked to adapt to these changes and more. The organizations the judges have selected adjusted to a series of new norms across 2021...