Social
Conversational AI

A quick guide to Amazon’s 40-plus papers at ICASSP

Topics such as code generation, commonsense reasoning, and self-learning complement the usual focus on speech recognition and acoustic-event classification.

By Staff writer
June 2, 2023
6 min read
Share

As usual at the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), a plurality of Amazon’s accepted papers concentrate on automatic speech recognition — with, this year, a particular emphasis on personalized speech recognition. The topics of acoustic-event detection, keyword spotting, and signal processing are also well represented.

But as is also usual, some of the Amazon papers wander farther afield, to topics like commonsense reasoning, self-learning, query rewriting, and general machine learning techniques. Below is a quick guide to Amazon’s more than 40 papers at the conference.

Acoustic-event classification

FedRPO: Federated relaxed Pareto optimization for acoustic event classification
Meng Feng, Chieh-Chi Kao, Qingming Tang, Amit Solomon, Viktor Rozgic, Chao Wang

Multiscale audio spectrogram transformer for efficient audio classification
Wentao Zhu, Mohamed Omar

Transformer-based bioacoustic sound event detection on few-shot learning tasks
Liwen You, Erika Pelaez Coyotl, Suren Gunturu, Maarten Van Segbroeck

Weight-sharing supernet for searching specialized acoustic event classification networks across device constraints
Guan-Ting Lin, Qingming Tang, Chieh-Chi Kao, Viktor Rozgic, Chao Wang

Automatic speech recognition

Cross-utterance ASR rescoring with graph-based label propagation
Srinath Tankasala, Long Chen, Andreas Stolcke, Anirudh Raju, Shally Deng, Chander Chandak, Aparna Khare, Roland Maas, Venkatesh Ravichandran

Dynamic chunk convolution for unified streaming and non-streaming Conformer ASR
Xilai Li, Goeric Huybrechts, Srikanth Ronanki, Jeff Farris, Sravan Bodapati

Domain adaptation with external off-policy acoustic catalogs for scalable contextual end-to-end automated speech recognition
David M. Chan, Shalini Ghosh, Ariya Rastrow, Björn Hoffmeister

Gated contextual adapters for selective contextual biasing in neural transducers
Anastasios Alexandridis, Kanthashree Mysore Sathyendra, Grant Strimel, Feng-Ju (Claire) Chang, Ariya Rastrow, Nathan Susanj, Athanasios Mouchtaris

Mask the bias: Improving domain-adaptive generalization of CTC-based ASR with internal language model estimation
Nilaksh Das, Monica Sunkara, Sravan Bodapati, Jason Cai, Devang Kulshreshtha, Jeff Farris, Katrin Kirchhoff

On-the-fly text retrieval for end-to-end ASR adaptation
Bolaji Yusuf, Aditya Gourav, Ankur Gandhe, Ivan Bulyko

Robust acoustic and semantic contextual biasing in neural transducers for speech recognition
Xuandi Fu, Kanthashree Mysore Sathyendra, Ankur Gandhe, Jing Liu, Grant Strimel, Ross McGowan, Athanasios Mouchtaris

Code generation

Conversational text-to-SQL: An odyssey into state-of-the-art and challenges ahead
Sree Hari Krishnan Parthasarathi, Lu Zeng, Dilek Hakkani-Tür

Conversational text-to-SQL.png
A proposed text-to-SQL system has three parts: (a) multitasking on coherent tasks with discrete prompts; (b) constrained decoding; and (c) N-best list reranking with a query plan model and a schema linking algorithm. From "Conversational text-to-SQL: An odyssey into state-of-the-art and challenges ahead".

Commonsense reasoning

CLICKER: Attention-based cross-lingual commonsense knowledge transfer
Ruolin Su, Zhongkai Sun, Sixing Lu, Chengyuan Ma, Chenlei Guo

Continual learning

Quantifying catastrophic forgetting in continual federated learning
Christophe Dupuy, Jimit Majmudar, Jixuan Wang, Tanya Roosta, Rahul Gupta, Clement Chung, Jie Ding, Salman Avestimehr

Endpoint detection

Adaptive endpointing with deep contextual multi-armed bandits
Do June Min, Andreas Stolcke, Anirudh Raju, Colin Vaz, Di He, Venkatesh Ravichandran, Viet Anh Trinh

Towards accurate and real-time end-of-speech estimation
Yifeng Fan, Colin Vaz, Di He, Jahn Heymann, Viet Anh Trinh, Zhe Zhang, Venkatesh Ravichandran

Keyword spotting

Dual-attention neural transducers for efficient wake word spotting in speech recognition
Saumya Sahai, Jing Liu, Thejaswi Muniyappa, Kanthashree Mysore Sathyendra, Anastasios Alexandridis, Grant Strimel, Ross McGowan, Ariya Rastrow, Feng-Ju Chang, Athanasios Mouchtaris, Siegfried Kunzmann

Dual-attention transducers.png
From "Dual-attention neural transducers for efficient wake word spotting in speech recognition".

Fixed-point quantization aware training for on-device keyword-spotting
Sashank Macha, Om Oza, Alex Escott, Francesco Caliva, Robbie Armitano, Santosh Kumar Cheekatmalla, Sree Hari Krishnan Parthasarathi, Yuzong Liu

Self-supervised speech representation learning for keyword-spotting with light-weight transformers
Chenyang Gao, Yue Gu, Francesco Caliva, Yuzong Liu

Small-footprint slimmable networks for keyword spotting
Zuhaib Akhtar, Mohammad Omar Khursheed, Dongsu Du, Yuzong Liu

Language learning

Phonetic RNN-transducer for mispronunciation diagnosis
Daniel Zhang, Soumya Saha, Sarah Campbell

Machine learning

Prune then distill: Dataset distillation with importance sampling
Anirudh Sundar, Gokce Keskin, Chander Chandak, I-Fan Chen, Pegah Ghahremani, Shalini Ghosh

Role of bias terms in dot-product attention
Mahdi Namazifar, Devamanyu Hazarika, Dilek Hakkani-Tür

Natural-language understanding

Distill-quantize-tune: Leveraging large teachers for low-footprint efficient multilingual NLU on edge
Pegah Kharazmi, Zhewei Zhao, Clement Chung, Samridhi Choudhary

Pyramid dynamic inference: Encouraging faster inference via early exit boosting
Ershad Banijamali, Pegah Kharazmi, Sepehr Eghbali, Jixuan Wang, Clement Chung, Samridhi Choudhary

Personalized speech recognition

Dialog-act-guided adaptor.png
From "Dialog act guided contextual adapter for personalized speech recognition".

Dialog act guided contextual adapter for personalized speech recognition
Feng-Ju (Claire) Chang, Thejaswi Muniyappa, Kanthashree Mysore Sathyendra, Kai Wei, Grant Strimel, Ross McGowan

PROCTER: Pronunciation-aware contextual adapter for personalized speech recognition in neural transducers
Rahul Pandey, Roger Ren, Qi Luo, Jing Liu, Ariya Rastrow, Ankur Gandhe, Denis Filimonov, Grant Strimel, Andreas Stolcke, Ivan Bulyko

Slot-triggered contextual biasing for personalized speech recognition using neural transducers
Sibo Tong, Philip Harding, Simon Wiesler

Query rewriting

KG-ECO: Knowledge graph enhanced entity correction for query rewriting
Jason Cai, Mingda Li, Ziyan Jiang, Eunah Cho, Zheng Chen, Yang Liu, Xing Fan, Chenlei Guo

KG-ECO.png
From "KG-ECO: Knowledge graph enhanced entity correction for query rewriting".

Self-learning

Federated self-learning with weak supervision for speech recognition
Milind Rao, Gopinath Chennupati, Gautam Tiwari, Anit Kumar Sahu, Anirudh Raju, Ariya Rastrow, Jasha Droppo

Self-healing through error detection, attribution, and retraining
Ansel MacLaughlin, Anna Rumshisky, Rinat Khaziev, Anil Ramakrishna, Yuval Merhav, Rahul Gupta

Signal processing

A framework for unified real-time personalized and non-personalized speech enhancement
Zhepei Wang, Ritwik Giri, Devansh Shah, Jean-Marc Valin, Michael M. Goodwin, Paris Smaragdis

Augmentation robust self-supervised learning for human activity recognition
Cong Xu, Yuhang Li, Dae Lee, Andrew Park, Hongda Mao, Huyen Do, Jonathan Chung, Dinesh Nair

Retraction.png
The concept of retraction, mapping a point in the tangent space back to the manifold. From "Generative modeling based manifold learning for adaptive filtering guidance".

Generative modeling based manifold learning for adaptive filtering guidance
Karim Helwani, Paris Smaragdis, Michael M. Goodwin

SPADE: Self-supervised pretraining for acoustic disentanglement
John Harvill, Jarred Barber, Arun Nair, Ramin Pishehvar

Spoken-language understanding

End-to-end spoken language understanding using joint CTC loss and self-supervised, pretrained acoustic encoders
Jixuan Wang, Martin Radfar, Kai Wei, Clement Chung

Exploring subgroup performance in end-to-end speech models
Alkis Koudounas, Eliana Pastor, Giuseppe Attanasio, Vittorio Mazzia, Manuel Giollo, Thomas Gueudre, Luca Cagliero, Luca de Alfaro, Elena Baralis, Daniele Amberti

Multilingual end-to-end spoken language understanding for ultra-low footprint applications
Markus Mueller, Anastasios Alexandridis, Zach Trozenski, Joel Whiteman, Grant Strimel, Nathan Susanj, Athanasios Mouchtaris, Siegfried Kunzmann

Text-to-speech

Framewise WaveGAN: High speed adversarial vocoder in time domain with very low computational complexity
Ahmed Mustafa, Jean-Marc Valin, Jan Buethe, Paris Smaragdis, Mike Goodwin

Modelling low-resource accents without accent-specific TTS frontend
Georgi Tinchev, Marta Czarnowska, Kamil Deja, Kayoko Yanagisawa, Marius Cotescu

Video

ModEFormer: Modality-preserving embedding for audio-video synchronization using transformers
Akash Gupta, Rohun Tripathi, Wondong Jang

Multi-scale compositional constraints for representation learning on videos
Georgios Paraskevopoulos, Chandrashekhar Lavania, Lovish Chum, Shiva Sundaram

Voice communication

Low-bitrate redundancy coding of speech using a rate-distortion-optimized variational autoencoder
Jean-Marc Valin, Jan Buethe, Ahmed Mustafa

Research areas
Tags
About the Author
Staff writer

Related content

Work with us

See more jobs See more jobs
Applied Scientist, Neuron ARG, Annapurna ML
US, WA, Seattle
Are you a PhD interested in machine learning, natural language processing, computer vision, automated reasoning, robotics, or quantum technologies? We are looking for skilled scientists capable of putting theory into practice through experimentation and invention, leveraging science techniques and implementing systems to work on massive datasets in an effort to tackle never-before-solved problems. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Scientist, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Key job responsibilities Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Our scientists use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science.
Applied Scientist, Catalog System Services Science
US, WA, Seattle
At Amazon Selection and Catalog Systems (ASCS), our mission is to power the online buying experience for customers worldwide so they can find, discover, and buy any product they want. We innovate on behalf of our customers to ensure uniqueness and consistency of product identity and to infer relationships between products in Amazon Catalog to drive the selection gateway for the search and browse experiences on the website. We're solving a fundamental AI challenge: establishing product relevant information at unprecedented scale with Frontier Models and Agents. The scale is staggering: billions of products, petabytes of multimodal data, millions of sellers, dozens of languages, and infinite product diversity ranging from electronics to groceries to digital content. The research challenges are immense. GenAI and VLMs hold transformative promise for catalog understanding, but we operate where traditional methods fail: ambiguous problem spaces, incomplete and noisy data, inherent uncertainty, reasoning across both images and textual data, and explaining decisions at scale. Enriching product information requires sophisticated models that reason across text, images, and structured data, all while maintaining accuracy and trust for high-stakes business decisions affecting millions of customers daily. Amazon's Catalog System Services Science team is looking for an innovative and customer-focused applied scientist to help us make the world's best product catalog even better. In this role, you will partner with technology and business leaders to build new state-of-the-art algorithms, models, and services. You will pioneer advanced GenAI solutions that power next-generation agentic shopping experiences, working in a collaborative environment where you can experiment with massive data from the world's largest product catalog, tackle problems at the frontier of AI research, rapidly implement and deploy your algorithmic ideas at scale, across millions of customers. Key job responsibilities - Formulate novel research problems at the intersection of GenAI, multimodal learning, and large-scale information retrieval. In essence, translating ambiguous business challenges into tractable scientific frameworks - Design and implement leading models leveraging frontier models, and agentic architectures to enrich catalog information at billion-product scale - Pioneer explainable AI methodologies that balance model performance with scalability requirements for production systems impacting millions of daily customer decisions - Own end-to-end ML pipelines from research ideation to production deployment, processing petabytes of multimodal data with rigorous evaluation frameworks - Represent the team in the broader science community - publishing findings, delivering tech talks, and staying at the forefront of GenAI, VLM, and agentic system research
Senior Applied Scientist, Amazon Connect
US, NY, New York
Are you excited about applying machine learning and statistical modeling to real-world systems that serve millions of customers? Amazon Connect is a cloud-based contact center service that helps businesses deliver personal, efficient customer experiences. Our team of scientists and engineers builds the AI and ML capabilities that power contact center operations and optimization. We are looking for a Senior Applied Scientist to tackle scientifically complex challenges in areas such as stochastic modeling, queueing theory, anomaly detection, and optimization. In this role, you will design and deploy novel ML models and algorithms that directly improve how businesses interact with their customers. You will work at the intersection of research and production, turning ambiguous problems into scalable solutions that shape the future of cloud-based customer service. Key job responsibilities - Design and deploy novel machine learning models and algorithms to solve complex problems in contact center operations, including forecasting, routing optimization, and anomaly detection. - Lead the scientific agenda for your team by identifying new research opportunities, proposing initiatives, and driving them from concept through production deployment. - Collaborate with engineering teams to architect and implement scalable ML systems, personally contributing significant portions of the critical scientific components. - Mentor fellow scientists and engineers through code reviews, design discussions, and scientific guidance, raising the overall technical bar of the team. - Evaluate and advance the team's ML methodology by benchmarking against current academic and industry research, and by publishing findings internally and externally when appropriate. A day in the life You might start your morning reviewing experiment results from a new forecasting model, then join a design session with engineers to discuss how to integrate it into the production pipeline. After lunch, you could be whiteboarding a novel approach to a queueing optimization problem with a fellow scientist, followed by a code review for a teammate. You will regularly present your research findings to stakeholders across the organization and contribute to the team's publication efforts. About the team Our team within Amazon Connect focuses on building intelligent, ML-driven capabilities that help businesses run their contact centers more effectively. We work closely with product, engineering, and science partners to turn research ideas into features that customers rely on every day. We value curiosity, collaboration, and scientific rigor, and we are investing in new AI capabilities that will continue to transform the customer service industry. If you want to see your research make a tangible impact at scale, this is the place to do it.
Applied Scientist, SCOT FO - SnT
ES, B, Barcelona
How does Amazon decide which fulfillment center ships your order, which truck carries it, and how to keep promises across hundreds of millions of packages daily? How does it decide how many trucks and how much labor are required to ship orders across the network? SCOT Fulfillment Optimization (FO) owns the optimization and forecasting science behind these decisions. We are seeking Applied Scientists to join the FO Science & Tech team in Barcelona (alternatively: Luxembourg or London) with a strong academic background in optimization, machine learning, and/or time-series forecasting. • You will design and build state-of-the-art machine learning and optimization models that power Amazon's fulfillment decisions at an unprecedented scale across two core scientific pillars: • Large-Scale Optimization and Planning: Designing planning systems for order assignment and resource utilization, while balancing multi-objective cost-speed tradeoffs to enable controllers to steer millions of shipments per hour optimally. • Demand Forecasting & Predictive ML: Developing time-series forecasts for customer demand, incorporating contextual information (weather, sales, order properties), and modeling uncertainty for core planning systems. Basic qualifications • PhD in Operations Research, Applied Mathematics, Computer Science, or related field (or equivalent experience) • Strong programming skills (Python preferred; experience with optimization solvers a plus) • Research experience in one or more: • Large-scale mathematical programming (LP, MIP, decomposition methods) • Combinatorial optimization (assignment, scheduling, network flows) • Multi-objective optimization and control • Large-scale time-series forecasting (GenAI models, probabilistic forecasting, uncertainty quantification) • Causal inference (spatiotemporal causal modeling, offline policy evaluation) Preferred qualifications • Experience building optimization systems that run in production at scale • Being comfortable with ambiguity and fast iteration cycles • Publications in relevant venues Key job responsibilities Design and implement optimization and forecasting models for large-scale fulfillment problems, from order assignment to network flow control. Build research prototypes end-to-end: from problem formulation through scalable implementation to production validation. Analyse complex tradeoffs (cost, speed, capacity, accuracy) and translate findings into actionable recommendations for leadership and operations teams. Collaborate with engineers to bring science solutions into production systems serving millions of customer orders daily. A day in the life You formulate an optimization or forecasting problem on a whiteboard with teammates, then prototype it in Python with real data by the afternoon. You run experiments against production-scale datasets, iterate on the model, and present results to stakeholders who will use them to make network decisions next week. Some days you dive deep into solver performance; other days you're explaining a Pareto frontier to an operations leader. You collaborate with large engineering and product teams to bring your solutions into systems serving millions of customers. Alongside fast-turnaround prototypes, you own long-term research bets, the kind that reshape how Amazon's fulfillment network operates at scale. Your work goes live. About the team SCOT Fulfillment Optimization Science & Tech (FO SnT) is the applied research team behind Amazon's fulfillment decision-making systems. We decide how orders get assigned to warehouses, how capacity is allocated across the network, and how cost and speed tradeoffs are managed in real time, at global scale. Our models influence billions of euros in annual operational spend. They protect sites from overload during peak, reduce transportation costs and CO2 emissions, and ensure customers receive their packages when promised. Leadership relies on our science to make investment decisions worth hundreds of millions. We are practitioners of large-scale optimization: MIP formulations, decomposition methods, approximation algorithms, and parallelisation. We use machine learning where it sharpens our decisions, including forecasting, learned heuristics, and multi-armed bandits. We pick the right tool for the problem, not the fashionable one. You will work alongside Senior and Principal scientists, and collaborate with Amazon Scholars and academic partners who bring frontier research into our applied problems. We code our prototypes to be production-ready and collaborate with large engineering teams to ship systems, not papers. Above all, we have fun solving hard real-world problems at real-world speed, failing, learning, and shipping along the way.
Applied Scientist, Customer360
US, WA, Seattle
What happens when you give AI the ability to remember? Not cached responses — real structured memory that compounds over time and transfers across contexts. We're building the science behind this, and we need researchers who want to own the problem end-to-end. This is a founding role on a new team. You won't inherit models or maintain someone else's pipeline. You'll define the research direction, run experiments at scale, and ship what works directly to production. Key job responsibilities As an Applied Scientist in our team, you will be responsible for the research, design, and development of new AI technologies for knowledge acquisition and retrieval. You will adopt or invent new machine learning and analytical techniques in the realm of information retrieval, knowledge representation, and large language models. Specific responsibilities include: 1. Design and implement novel approaches to knowledge extraction from heterogeneous, unstructured data sources at organizational scale. 2. Build retrieval systems that match intent to relevant knowledge across domains — solving the "right memory at the right time" problem. 3. Own the quality of memory generation: what to capture, how to structure it, when to surface it, and when to let it decay. 4. Run large-scale experiments using Amazon's compute infrastructure and massive real-world datasets. 5. Develop evaluation frameworks for a system where "quality" means something new — right knowledge, right context, right confidence level. 6. Collaborate with engineers to move from research prototype to production system in weeks, not quarters. 7. Invent new approaches to temporal knowledge management — how memories age, conflict, and compound over time. 8. Publish and patent novel approaches to knowledge acquisition and retrieval at top-tier venues. A day in the life You will solve real-world problems by getting and analyzing large amounts of data, generate insights and opportunities, execute experiments, and develop statistical and ML models. The team is driven by business needs, which requires collaboration with other Scientists, Engineers, and Product Managers across the organization. You get to influence stakeholders with clear communication skills. You innovate on behalf of the customer and strategically build features. You will mentor junior members and help them grow. About the team We're a new team within Personalization, focused on a different kind of recommendation: not "what product should this customer see" but "what knowledge should this AI use right now." Same scale, same rigor, entirely new problem space. The science is at the intersection of information retrieval, knowledge representation, and LLM reasoning — and the right approach hasn't been established yet. The team values innovation and offers a safe place to try, fail, and learn while fostering a culture of continuous improvement. Everyone is a leader and owner for everything we do as a team. We offer creative space with an entrepreneurial work environment focusing on customer obsession.
Applied Scientist I, Amazon Shipping
IN, HR, Gurugram
Building large-scale forecasting and optimization systems that power Amazon’s global transportation network and directly impact customer experience and cost. Key job responsibilities 1. Guide model and system design across a range of techniques, including tree-based models, deep learning (LSTMs, transformers), LLMs, and reinforcement learning. 2. Ensure models are production-ready, scalable, and robust through close partnership with stakeholders. 3. Partner with Product, Operations, and Engineering leaders to enable proactive decision-making and corrective actions. 4 Own end-to-end business metrics, directly influencing customer experience, cost optimization, and network reliability. 5. Help contribute to the broader ML community through publications, conference submissions, and internal knowledge sharing.
Applied Scientist, Prime Video - Content Reasoning, Enrichment & Localization
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video subscriptions such as Apple TV+, HBO Max, Peacock, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video team member, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you!
Senior Applied Scientist, Real-Time Conversational AI , AGI
US, CA, Sunnyvale
We are looking for a Senior Applied Scientist to help drive the research and development of real-time multimodal conversational AI. You will contribute across two focus areas: advancing foundation models for speech and audio, and building the post-training systems (reward modeling, reinforcement learning) that shape natural, human-like conversational behavior. You will own a significant research area and contribute across the full model lifecycle — from pre-training and architecture design through post-training alignment and real-time deployment. You will work at the frontier of what’s possible in conversational AI, with the compute, data, and runway to pursue problems that few teams in the world have the resources to tackle. As a Senior Scientist, you will drive the technical execution of your research area, contribute to the team’s roadmap, and work closely with inference engineers to ensure your models are designed for real-time production deployment. Key job responsibilities What You’ll Do Foundation Model Scaling - Help build and train large-scale multimodal foundation models for real-time speech and audio generation, from architecture design through production-scale training - Advance the scaling and efficiency of conversational models, including the relationship between data, model size, and real-time performance - Design model architectures informed by hardware constraints and inference requirements, working with inference engineers to ensure models are servable from inception - Develop training methodologies for multimodal models that jointly process and generate speech, language, and audio in real-time streaming contexts - Contribute to the state of the art on efficient architectures and training methods for conversational AI at scale Post-Training & Reinforcement Learning - Design and build reward models and reward functions for speech systems — capturing naturalness, fluency, conversational quality, and real-time responsiveness - Develop and apply reinforcement learning methods to shape conversational behavior — teaching models natural timing, responsiveness, and fluid interaction - Build parts of the post-training pipeline from SFT through RL alignment, optimized for real-time multimodal outputs rather than text-only generation - Design evaluation frameworks that capture the quality dimensions unique to real-time conversation (latency sensitivity, audio quality, prosody, interaction naturalness) Real-Time Perception & Generation - Advance the team’s capabilities in real-time perception — the ability of the model to process incoming audio/speech while simultaneously generating responses - Develop techniques for natural interactive systems where the model handles concurrent input and output with human-like timing - Work at the intersection of model architecture and production constraints to ensure multimodal capabilities function within hard real-time latency budgets
Applied Scientist II, Amazon Supply Chain
US, WA, Seattle
As part of the AWS Applied AI Solutions organization, we have a vision to provide business applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are no-brainers to buy and easy to use. We are looking for an Applied Scientist to join our team that is building enterprise applications leveraging machine learning, generative AI, and agentic AI to help millions of companies worldwide manage their day-to-day supply chain operations. Our mission is to accelerate our customers' businesses through intuitive, differentiated technology solutions that solve enduring supply chain challenges. We blend strategic vision with curiosity and Amazon's real-world operational experience to build opinionated, turnkey solutions that make the 'buy versus build' decision a no-brainer for our customers. As an Applied Scientist, you will design and develop machine learning models and algorithms that power intelligent supply chain applications at global scale. You will work at the intersection of research and real-world product impact, translating scientific advances into production systems that serve millions of customers. We operate like a startup within AWS, offering you the opportunity to tackle complex challenges while working with the latest technologies in deep learning, large language models, and optimization. If you are passionate about pushing the boundaries of applied science, thrive in ambiguous problem spaces, and want to shape the future of supply chain intelligence while having the backing of AWS's extensive resources, we want to hear from you. Key job responsibilities - Design, develop, and deploy machine learning models for demand forecasting, inventory optimization, anomaly detection, and supply chain decision-making. - Develop generative AI and agentic AI solutions that automate complex supply chain workflows and deliver intelligent, adaptive recommendations to customers. - Formulate real-world business problems as machine learning problems; define data requirements, model architectures, evaluation metrics, and experimentation frameworks. - Drive end-to-end applied science projects from ideation through experimentation, offline evaluation, A/B testing, and production deployment at scale. - Collaborate with engineering, product management, and business stakeholders to translate scientific capabilities into customer-facing product features, and mentor other scientists to raise the team's technical bar. A day in the life You will start many mornings reviewing experiment results and model metrics before joining a science sync where you and your teammates discuss progress, debug tricky modeling issues, and brainstorm new approaches. From there, you may spend focused time writing and testing model code in Python or PyTorch, running offline evaluations, or preparing an A/B test for a new forecasting algorithm. Expect regular working sessions with software engineers to integrate your models into production services, and occasional deep-dive reviews where you present your scientific approach and findings to the broader team. About the team The AWS Applied AI Solutions team builds enterprise applications that leverage Amazon's operational expertise to solve real-world supply chain challenges for millions of companies. We operate like a startup within AWS, moving fast and shipping iteratively with modern AI technologies. We invest in your growth through mentorship from experienced scientists, conference publication support, and internal science reading groups. If your career hasn't followed a traditional path, we encourage you to apply — we value varied experiences and perspectives.
Data Scientist II, Device Economics
US, CA, Sunnyvale
We are seeking Data Scientist II with strong science application skills to join our Device Economics team. This role will focus primarily on Amazon's innovative devices and services (e.g. Echo Family of Devices), working at the intersection of economic modeling, forecasting science, and business strategy. The ideal candidate will be responsible for pre-launch forecasts, annualized overall forecasts, identifying substitution patterns, and partnering closely with product managers and marketing managers to understand the evolution of the Devices portfolio. Key job responsibilities Forecasting & Modeling 1. Develop and maintain pre-launch forecasts and annualized overall forecasts for Amazon Devices 2. Identify and model substitution patterns across the device portfolio 3. Build economic and financial models to support demand planning and business decisions 4. Formulate relevant analytical frameworks to address key economic issues in device forecasting Science Communication & Collaboration 1. Explain complex science models and methodologies to non-technical stakeholders including product managers and marketing managers 2. Collaborate with economists, data scientists, and applied scientists across Decision Science 3. Present results of analyses to cross-functional teams and leadership 4. Build trust in science models and forecast outputs with product teams Innovation & Strategic Thinking 1. Think creatively about ways that leading-edge analytics and emerging data sources can address Devices' most pressing business challenges 2. Help internal teams leverage analytic tools to better manage innovation 3. Conduct empirical studies and perform quantitative and qualitative research 4. Identify opportunities to improve forecasting accuracy and business impact Cross-Functional Partnership 1. Work closely with product managers and marketing managers to understand portfolio evolution and business strategy 2. Support DSO leadership in quarterly business reviews and strategic planning A day in the life Your days will be split between refining and building models and working with business leaders to interpret them. You own science-based forecasts that can directly impact Amazon's bottom line on the order of multi-million dollar decisions. - You will perform model refreshes or updates to analyses as needed; and, - You will be expected to develop new techniques to process large data sets, address quantitative problems, and contribute to design of automated systems. About the team The Decision Science team within DSO (Device Supply Organization) is responsible for forecasting and demand planning initiatives across Amazon Devices. The DSO team of 300+ engineers, scientists, and PMs applies quantitative methods and data-driven approaches to replace judgment-based decisions with science-driven forecasts. Decision Science focuses on lifetime demand forecasting using econometric and machine learning models for rapid reforecasting, mix adjustments, and portfolio management for new product launches. We also inform to go/no-go investment decision for new product initiatives
See more jobs
View from space of a connected network around planet Earth representing the Internet of Things.
Get more from Amazon Science
Subscribe to our newsletter

Amazon.com | Conditions of Use | Privacy | © 1996-2026 Amazon.com, Inc. or its affiliates

Social