25 years of QIP

As the major quantum computing conference celebrates its anniversary, we ask the conference chair and the head of Amazon’s quantum computing program to take stock.

In 1981, at a conference in Boston, the physicist Richard Feynman suggested that a computer that harnessed quantum-mechanical phenomena could easily perform computations that would be difficult — even prohibitively difficult — for a classical computer.

QIP 25.png
Thomas Vidick (left), a professor of computing and mathematical sciences at Caltech and chair of the 25th Annual Conference on Quantum Information Processing, and Simone Severini (right), director of quantum computing for Amazon Web Services.

In 1994, the Bell Labs mathematician Peter Shor showed that a quantum computer — still an entirely hypothetical device — could factor numbers exponentially faster than a classical computer can. “Shor’s algorithm constituted the killer app that got everybody interested,” the MIT quantum computing researcher Seth Lloyd once said.

Three years later, in 1998, the first Conference on Quantum Information Processing (QIP) was held in Aarhus, Denmark. Since then, quantum computing has become a major research initiative at leading tech companies, and QIP has become the premier conference in the field of quantum information processing.

Related content
Researchers affiliated with Amazon Web Services' Center for Quantum Computing are presenting their work this week at the Conference on Quantum Information Processing.

To mark QIP’s 25th anniversary, Amazon Science asked two prominent quantum information scientists — Thomas Vidick, a professor of computing and mathematical science at Caltech and chair of this year’s QIP, and Simone Severini, director of quantum computing at Amazon Web Services — a pair of questions about how far the field has come in the last 25 years and how far it still has to go.

What’s surprised you most about what we’ve learned about quantum information science in the past 25 years?

Thomas Vidick: Well, honestly, that we can run a 20-qubit quantum algorithm, and it actually looks like it is going as planned. While my whole research is premised on the assumption that quantum mechanics is a sufficiently accurate description of nature that it makes sense to study its consequences for computation, truly "seeing" such a computation take place was a revelation. (I need to use quotes because of course we can't see a quantum computation take place without affecting it. But for small computations we can plot outcome statistics in a very detailed way.) For me, the revelation came when I saw the results of an implementation of Simon's algorithm for a four-bit secret a few years ago, by the Monroe group working with ion traps. I couldn't believe it: it sampled exactly the right strings.

Related content
New method enables entanglement between vacancy centers tuned to different wavelengths of light.

Going back not even 25 years, but 15 years, which is when I first learned, while studying for a master’s, that quantum computation was a thing, the fact that it could become a reality was absolutely not on my radar, nor I believe on most theorists', let alone experimentalists'. I think that learning that quantum computing works, as opposed to believing that it does, is having a major impact on how we approach quantum information science.

Simone Severini: Quantum information science contributed to a rich interplay between physics, mathematics, and computation. That interplay gave rise to new techniques that cross the boundaries of these fields.

Severini@QIP01.jpg
Ernesto F. Galvão, leader of the Quantum and Linear-Optical Computation group at the International Iberian Nanotechnology Laboratory; Iordanis Kerenidis, head of quantum algorithms for QC Ware, a senior researcher at the French National Center for Scientific Research, and director of the Paris Center for Quantum Computing; and Severini at the fourth QIP, in Amsterdam, 2001.
Courtesy of Simone Severini

A beautiful example is the application of quantum complexity theory to solve in the negative the Connes embedding problem, by Ji, Natarajan, Vidick, Wright, and Yuen, in 2020. Connes’ embedding problem is a problem in abstract algebra, where an “algebra” is a combination of a set, a group of operators, and axioms that describe how the operators are applied. The real numbers are one example of a set, and the arithmetic operators are one example of a group of operators, but in abstract algebra, these could be anything.

Connes’ problem asks whether one class of algebras is contained in another class. Alain Connes formulated it in 1976 in a paper that led to his Fields Medal in 1982. Since then, the problem has been reformulated in several different branches of mathematics; multiple conferences have been dedicated to just this problem.

Related content
New approach reduces the number of ancillary qubits required to implement the crucial T gate by at least an order of magnitude.

The result of Ji et al. is a surprising case where notions and techniques that are part of the quantum information science toolbox turned out to be impactful in other areas of mathematics and the natural sciences. And it’s just one of many exciting examples.

What do you see as the biggest remaining challenge in the field?

Thomas Vidick: The obvious challenges faced by the field are, on the experimental front, realizing a quantum computer, and in particular reducing error rates while scaling up system sizes, and on the theoretical front, finding applications for such a computer. While as a theorist I tend to think of the first as a hard, but definitely solvable, engineering challenge, I am less confident in the eventual outcome of the second: beyond niche applications in quantum simulation and the widespread deployment of post-quantum cryptography, will quantum computers make their way into daily consumer life?

This is the billion-dollar question; but to be honest, it's not the one I'm most preoccupied about. Closer to my heart, and perhaps less obvious, is the challenge of maintaining the coherence, vitality, and impact that quantum information science has had over the past quarter-century, all the way through the next quarter-century (and more!). When I look back to the first QIP programs, there was little concern for near-term applicability of the theoretical results. In contrast, I am probably not overestimating much by asserting that nearly half the scientific program of QIP in the past couple years has had some "near-term" motivation.

In the complex and fast-paced world of today, we should not forget that fundamental science is still the root of future innovation.
Simone Severini

This evolution reflects a genuine and justified enthusiasm for the potential practical impact of our work as researchers, which 25 years ago was such a distant prospect that it wasn't even in the back of our minds. What consequences this evolution will have on the health and diversity of our field remains to be seen. Will QIP split into "applied" and "theoretical" QIPs, and if so, will this split be done in a manner that maintains strong interaction between the two components? Will theoretical work in quantum information retain its strength and stature within the computer science community, independently of the success or failure of experimental approaches?

Related content
The noted physicist answers 3 questions about the challenges of quantum computing and why he’s excited to be part of a technology development project.

Researchers in our field have always fought, with great success, for demonstrating the importance of the ideas of quantum information, much more so than its possible practical relevance. Now that the latter is becoming reality, we should not forget the former.

Simone Severini: It’s gripping to observe how quantum information science has overflowed from academia into industry. The broader interest that we are seeing today in this field is a great opportunity, but there are risks. I believe that the biggest nontechnical challenge for the field is to grow organically and steadily in an environment that tries to balance scientific research and engineering, while proposing commercial routes with future impact. In the complex and fast-paced world of today, we should not forget that fundamental science is still the root of future innovation. To realize the long-term promises of quantum technologies, like processors and communication devices that can outperform classical engineering, it’s important to set the right expectations today. In this context, it's essential to support education and scientific discovery and stress the need for long-term visions.

Research areas

Related content

US, NY, New York
We are seeking a Human-Robot Interaction (HRI) Research Scientist to develop cutting-edge interactions that make robots feel alive, personal, and fun. In this role, you will focus on verbal and non-verbal conversational systems, social dynamics, memory, and long-term relationship formation between robots, their environments, and the people they interact with. Your contributions will be essential in advancing robotics by enabling expressive, socially intelligent, and trustworthy interactions between robots and humans.
US, WA, Seattle
Are you a PhD interested in machine learning, natural language processing, computer vision, automated reasoning, robotics, or quantum technologies? We are looking for skilled scientists capable of putting theory into practice through experimentation and invention, leveraging science techniques and implementing systems to work on massive datasets in an effort to tackle never-before-solved problems. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Scientist, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Key job responsibilities Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Our scientists use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science.
US, MA, North Reading
Amazon Robotics is transforming warehouse automation through edge AI and machine learning applied to real-world robotics challenges. We're seeking a Research Scientist to advance our mobile manipulation capabilities by developing novel learning-based approaches that enable robots to navigate and manipulate objects in dynamic fulfillment environments. This role offers the opportunity to conduct original research and translate state-of-the-art findings into production systems operating at Amazon's unprecedented scale. Key job responsibilities Research and Algorithm Development: Formulate novel research problems in robot learning and manipulation, design new model architectures, validate hypotheses through rigorous experimentation, and advance the state of the art in learning-based robotics. Data Strategy and Pipeline Design: Define data requirements for research initiatives, design scalable collection and curation strategies, establish governance and provenance standards, and build reusable pipelines ensuring data quality and reproducibility. Experimentation and Scientific Validation: Design and execute experiments in simulation and real-world embodiments, develop evaluation methodologies and benchmarks, perform ablation studies and statistical analyses, and iterate systematically to advance model performance. Prototyping and Research Infrastructure: Develop clean, well-documented research codebases, build experimentation frameworks and evaluation tooling, contribute to shared training infrastructure, and implement interfaces for broader robotics integration. Scientific Leadership and Publication: Drive an independent research agenda aligned with team objectives, publish at top-tier venues (e.g., RSS, CoRL, ICRA, NeurIPS), identify research gaps through literature reviews, and present findings via technical reports and talks. Cross-Functional Collaboration: Partner with scientists, engineers, and leaders across teams to translate research into deployable solutions, mentor junior researchers, contribute to the team's scientific culture, and support integration with robotics hardware teams. A day in the life If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply! About the team Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart, collaborative team of enthusiastic doers that work passionately to apply innovative advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even image yet. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun!
US, WA, Seattle
What happens when you give AI the ability to remember? Not cached responses — real structured memory that compounds over time and transfers across contexts. We're building the science behind this, and we need researchers who want to own the problem end-to-end. This is a founding role on a new team. You won't inherit models or maintain someone else's pipeline. You'll define the research direction, run experiments at scale, and ship what works directly to production. Key job responsibilities As an Applied Scientist in our team, you will be responsible for the research, design, and development of new AI technologies for knowledge acquisition and retrieval. You will adopt or invent new machine learning and analytical techniques in the realm of information retrieval, knowledge representation, and large language models. Specific responsibilities include: 1. Design and implement novel approaches to knowledge extraction from heterogeneous, unstructured data sources at organizational scale. 2. Build retrieval systems that match intent to relevant knowledge across domains — solving the "right memory at the right time" problem. 3. Own the quality of memory generation: what to capture, how to structure it, when to surface it, and when to let it decay. 4. Run large-scale experiments using Amazon's compute infrastructure and massive real-world datasets. 5. Develop evaluation frameworks for a system where "quality" means something new — right knowledge, right context, right confidence level. 6. Collaborate with engineers to move from research prototype to production system in weeks, not quarters. 7. Invent new approaches to temporal knowledge management — how memories age, conflict, and compound over time. 8. Publish and patent novel approaches to knowledge acquisition and retrieval at top-tier venues. A day in the life You will solve real-world problems by getting and analyzing large amounts of data, generate insights and opportunities, execute experiments, and develop statistical and ML models. The team is driven by business needs, which requires collaboration with other Scientists, Engineers, and Product Managers across the organization. You get to influence stakeholders with clear communication skills. You innovate on behalf of the customer and strategically build features. You will mentor junior members and help them grow. About the team We're a new team within Personalization, focused on a different kind of recommendation: not "what product should this customer see" but "what knowledge should this AI use right now." Same scale, same rigor, entirely new problem space. The science is at the intersection of information retrieval, knowledge representation, and LLM reasoning — and the right approach hasn't been established yet. The team values innovation and offers a safe place to try, fail, and learn while fostering a culture of continuous improvement. Everyone is a leader and owner for everything we do as a team. We offer creative space with an entrepreneurial work environment focusing on customer obsession.
ES, B, Barcelona
How does Amazon decide which fulfillment center ships your order, which truck carries it, and how to keep promises across hundreds of millions of packages daily? How does it decide how many trucks and how much labor are required to ship orders across the network? SCOT Fulfillment Optimization (FO) owns the optimization and forecasting science behind these decisions. We are seeking Applied Scientists to join the FO Science & Tech team in Barcelona (alternatively: Luxembourg or London) with a strong academic background in optimization, machine learning, and/or time-series forecasting. • You will design and build state-of-the-art machine learning and optimization models that power Amazon's fulfillment decisions at an unprecedented scale across two core scientific pillars: • Large-Scale Optimization and Planning: Designing planning systems for order assignment and resource utilization, while balancing multi-objective cost-speed tradeoffs to enable controllers to steer millions of shipments per hour optimally. • Demand Forecasting & Predictive ML: Developing time-series forecasts for customer demand, incorporating contextual information (weather, sales, order properties), and modeling uncertainty for core planning systems. Basic qualifications • PhD in Operations Research, Applied Mathematics, Computer Science, or related field (or equivalent experience) • Strong programming skills (Python preferred; experience with optimization solvers a plus) • Research experience in one or more: • Large-scale mathematical programming (LP, MIP, decomposition methods) • Combinatorial optimization (assignment, scheduling, network flows) • Multi-objective optimization and control • Large-scale time-series forecasting (GenAI models, probabilistic forecasting, uncertainty quantification) • Causal inference (spatiotemporal causal modeling, offline policy evaluation) Preferred qualifications • Experience building optimization systems that run in production at scale • Being comfortable with ambiguity and fast iteration cycles • Publications in relevant venues Key job responsibilities Design and implement optimization and forecasting models for large-scale fulfillment problems, from order assignment to network flow control. Build research prototypes end-to-end: from problem formulation through scalable implementation to production validation. Analyse complex tradeoffs (cost, speed, capacity, accuracy) and translate findings into actionable recommendations for leadership and operations teams. Collaborate with engineers to bring science solutions into production systems serving millions of customer orders daily. A day in the life You formulate an optimization or forecasting problem on a whiteboard with teammates, then prototype it in Python with real data by the afternoon. You run experiments against production-scale datasets, iterate on the model, and present results to stakeholders who will use them to make network decisions next week. Some days you dive deep into solver performance; other days you're explaining a Pareto frontier to an operations leader. You collaborate with large engineering and product teams to bring your solutions into systems serving millions of customers. Alongside fast-turnaround prototypes, you own long-term research bets, the kind that reshape how Amazon's fulfillment network operates at scale. Your work goes live. About the team SCOT Fulfillment Optimization Science & Tech (FO SnT) is the applied research team behind Amazon's fulfillment decision-making systems. We decide how orders get assigned to warehouses, how capacity is allocated across the network, and how cost and speed tradeoffs are managed in real time, at global scale. Our models influence billions of euros in annual operational spend. They protect sites from overload during peak, reduce transportation costs and CO2 emissions, and ensure customers receive their packages when promised. Leadership relies on our science to make investment decisions worth hundreds of millions. We are practitioners of large-scale optimization: MIP formulations, decomposition methods, approximation algorithms, and parallelisation. We use machine learning where it sharpens our decisions, including forecasting, learned heuristics, and multi-armed bandits. We pick the right tool for the problem, not the fashionable one. You will work alongside Senior and Principal scientists, and collaborate with Amazon Scholars and academic partners who bring frontier research into our applied problems. We code our prototypes to be production-ready and collaborate with large engineering teams to ship systems, not papers. Above all, we have fun solving hard real-world problems at real-world speed, failing, learning, and shipping along the way.
US, NY, New York
Want to work on building a Amazon Ads billion dollar business, innovate on a new product, and have a positive impact on millions of views while working with industry-leading technologies? We're growing a team to support the Sponsored Ads business that powers the advertising experience for millions of viewers and advertisers daily. Amazon is investing heavily in building a world-class advertising business and developing a collection of self-service performance advertising products that drive discovery and sales. We deliver billions of ad impressions and millions of clicks daily and are constantly challenging ourselves to create world-class products and an unparalleled shopping experience for our hundreds of millions of customers worldwide. Key job responsibilities We are building the next-gen smart ads campaign. At its core is an Intelligence Flywheel — an architecture where every component's output is designed to train models that improve every other component. The Model Layer that is meant to power every capability currently has no dedicated science ownership. As the Senior Applied Scientist on this team, you own the science that makes the flywheel turn. You will turn static, threshold-based logic into self-improving, closed-loop intelligence, and define the decision policies that let the system act autonomously with advertiser trust. Concretely, you will: * Build predictive issue-detection models that identify under-delivery, over-delivery, and performance degradation from campaign signals before they materially impact advertisers. * Design the intervention-selection policy — which autonomous action to take — framed as a contextual bandit: choose, observe, update. Engineers implement action execution; you define the policy that selects actions. * Establish causal attribution for autonomous optimization, separating the effect of our interventions from organic performance change, so improvements can be attributed and advertiser trust in autonomy can be earned. * Integrate and adapt cross-model signals. Combine creative-quality, product-relevance, and budget signals into a unified advertiser-intelligence picture, and adapt general-purpose partner models to our product reality via fine-tuning, re-ranking, or thin adaptation layers. * Close recommendation and grading feedback loops — define reward schemas for accept/reject and performance-vs-baseline signals, correlate creative-quality scores with real campaign outcomes, and feed empirical findings back to both our product and partner science teams. You will work backwards from ambiguous business problems, set the science roadmap for the Model Layer, and partner closely with the team's software engineers — who own the services, pipelines, and execution infrastructure — so that model artifacts you produce are deployed and served in production. This is a high-leverage, high-autonomy role: your outputs are consumed by multiple engineering workstreams at once, and you set the abstractions the team builds on. About the team We are focused on goal-oriented, AI powered workflows that help advertisers achieve their marketing objectives. We collect campaign goals, surface relevant data at key decision points, and provide reporting that validates decision-making. Our product suite guides advertisers in building campaigns with optimal targeting, creative formats, inventory, and bid models that are highly likely to hit their goals — reducing the need for manual intervention.
US, WA, Seattle
At Amazon Selection and Catalog Systems (ASCS), our mission is to power the online buying experience for customers worldwide so they can find, discover, and buy any product they want. We innovate on behalf of our customers to ensure uniqueness and consistency of product identity and to infer relationships between products in Amazon Catalog to drive the selection gateway for the search and browse experiences on the website. We're solving a fundamental AI challenge: establishing product relevant information at unprecedented scale with Frontier Models and Agents. The scale is staggering: billions of products, petabytes of multimodal data, millions of sellers, dozens of languages, and infinite product diversity ranging from electronics to groceries to digital content. The research challenges are immense. GenAI and VLMs hold transformative promise for catalog understanding, but we operate where traditional methods fail: ambiguous problem spaces, incomplete and noisy data, inherent uncertainty, reasoning across both images and textual data, and explaining decisions at scale. Enriching product information requires sophisticated models that reason across text, images, and structured data, all while maintaining accuracy and trust for high-stakes business decisions affecting millions of customers daily. Amazon's Catalog System Services Science team is looking for an innovative and customer-focused applied scientist to help us make the world's best product catalog even better. In this role, you will partner with technology and business leaders to build new state-of-the-art algorithms, models, and services. You will pioneer advanced GenAI solutions that power next-generation agentic shopping experiences, working in a collaborative environment where you can experiment with massive data from the world's largest product catalog, tackle problems at the frontier of AI research, rapidly implement and deploy your algorithmic ideas at scale, across millions of customers. Key job responsibilities - Formulate novel research problems at the intersection of GenAI, multimodal learning, and large-scale information retrieval. In essence, translating ambiguous business challenges into tractable scientific frameworks - Design and implement leading models leveraging frontier models, and agentic architectures to enrich catalog information at billion-product scale - Pioneer explainable AI methodologies that balance model performance with scalability requirements for production systems impacting millions of daily customer decisions - Own end-to-end ML pipelines from research ideation to production deployment, processing petabytes of multimodal data with rigorous evaluation frameworks - Represent the team in the broader science community - publishing findings, delivering tech talks, and staying at the forefront of GenAI, VLM, and agentic system research
US, NY, New York
Are you excited about applying machine learning and statistical modeling to real-world systems that serve millions of customers? Amazon Connect is a cloud-based contact center service that helps businesses deliver personal, efficient customer experiences. Our team of scientists and engineers builds the AI and ML capabilities that power contact center operations and optimization. We are looking for a Senior Applied Scientist to tackle scientifically complex challenges in areas such as stochastic modeling, queueing theory, anomaly detection, and optimization. In this role, you will design and deploy novel ML models and algorithms that directly improve how businesses interact with their customers. You will work at the intersection of research and production, turning ambiguous problems into scalable solutions that shape the future of cloud-based customer service. Key job responsibilities - Design and deploy novel machine learning models and algorithms to solve complex problems in contact center operations, including forecasting, routing optimization, and anomaly detection. - Lead the scientific agenda for your team by identifying new research opportunities, proposing initiatives, and driving them from concept through production deployment. - Collaborate with engineering teams to architect and implement scalable ML systems, personally contributing significant portions of the critical scientific components. - Mentor fellow scientists and engineers through code reviews, design discussions, and scientific guidance, raising the overall technical bar of the team. - Evaluate and advance the team's ML methodology by benchmarking against current academic and industry research, and by publishing findings internally and externally when appropriate. A day in the life You might start your morning reviewing experiment results from a new forecasting model, then join a design session with engineers to discuss how to integrate it into the production pipeline. After lunch, you could be whiteboarding a novel approach to a queueing optimization problem with a fellow scientist, followed by a code review for a teammate. You will regularly present your research findings to stakeholders across the organization and contribute to the team's publication efforts. About the team Our team within Amazon Connect focuses on building intelligent, ML-driven capabilities that help businesses run their contact centers more effectively. We work closely with product, engineering, and science partners to turn research ideas into features that customers rely on every day. We value curiosity, collaboration, and scientific rigor, and we are investing in new AI capabilities that will continue to transform the customer service industry. If you want to see your research make a tangible impact at scale, this is the place to do it.
IN, HR, Gurugram
Building large-scale forecasting and optimization systems that power Amazon’s global transportation network and directly impact customer experience and cost. Key job responsibilities 1. Guide model and system design across a range of techniques, including tree-based models, deep learning (LSTMs, transformers), LLMs, and reinforcement learning. 2. Ensure models are production-ready, scalable, and robust through close partnership with stakeholders. 3. Partner with Product, Operations, and Engineering leaders to enable proactive decision-making and corrective actions. 4 Own end-to-end business metrics, directly influencing customer experience, cost optimization, and network reliability. 5. Help contribute to the broader ML community through publications, conference submissions, and internal knowledge sharing.
US, CA, Sunnyvale
We are looking for a Senior Applied Scientist to help drive the research and development of real-time multimodal conversational AI. You will contribute across two focus areas: advancing foundation models for speech and audio, and building the post-training systems (reward modeling, reinforcement learning) that shape natural, human-like conversational behavior. You will own a significant research area and contribute across the full model lifecycle — from pre-training and architecture design through post-training alignment and real-time deployment. You will work at the frontier of what’s possible in conversational AI, with the compute, data, and runway to pursue problems that few teams in the world have the resources to tackle. As a Senior Scientist, you will drive the technical execution of your research area, contribute to the team’s roadmap, and work closely with inference engineers to ensure your models are designed for real-time production deployment. Key job responsibilities What You’ll Do Foundation Model Scaling - Help build and train large-scale multimodal foundation models for real-time speech and audio generation, from architecture design through production-scale training - Advance the scaling and efficiency of conversational models, including the relationship between data, model size, and real-time performance - Design model architectures informed by hardware constraints and inference requirements, working with inference engineers to ensure models are servable from inception - Develop training methodologies for multimodal models that jointly process and generate speech, language, and audio in real-time streaming contexts - Contribute to the state of the art on efficient architectures and training methods for conversational AI at scale Post-Training & Reinforcement Learning - Design and build reward models and reward functions for speech systems — capturing naturalness, fluency, conversational quality, and real-time responsiveness - Develop and apply reinforcement learning methods to shape conversational behavior — teaching models natural timing, responsiveness, and fluid interaction - Build parts of the post-training pipeline from SFT through RL alignment, optimized for real-time multimodal outputs rather than text-only generation - Design evaluation frameworks that capture the quality dimensions unique to real-time conversation (latency sensitivity, audio quality, prosody, interaction naturalness) Real-Time Perception & Generation - Advance the team’s capabilities in real-time perception — the ability of the model to process incoming audio/speech while simultaneously generating responses - Develop techniques for natural interactive systems where the model handles concurrent input and output with human-like timing - Work at the intersection of model architecture and production constraints to ensure multimodal capabilities function within hard real-time latency budgets