David Schuster and colleagues' Nature 2004 paper (left) "Strong coupling of a single photon to a superconducting qubit using circuit quantum electrodynamics" helped spawn a new field, circuit quantum electrodynamics. Schuster and colleagues' American Physical Society 2007 paper (right) "Charge-insensitive qubit design derived from the Cooper pair box", introduced a new type of superconducting quantum circuit.
David Schuster and colleagues' Nature, 2004, paper (left) "Strong coupling of a single photon to a superconducting qubit using circuit quantum electrodynamics" helped spawn a new field, circuit quantum electrodynamics. Schuster and colleagues' American Physical Society, 2007, paper (right) "Charge-insensitive qubit design derived from the Cooper pair box", introduced a new type of superconducting quantum circuit.

David Schuster’s quest to make practical quantum computers a reality

With quantum computers poised to take a big step forward, we speak to an Amazon Scholar who has spent two decades driving the technology to realize its enormous potential.

To become a foundational player in the creation of a potentially world-changing technology requires the happy conjunction of talent and timing. Both can be found in physicist David Schuster, who is pioneering the technology underpinning quantum computers.

Amazon Scholar David Schuster is seen inside his lab
Amazon Scholar David Schuster joined the AWS Center for Quantum Computing in October 2020.

Schuster became an Amazon Scholar in October 2020, joining the newly established AWS Center for Quantum Computing. Passionate about computers and physics, it was during Schuster’s undergrad studies at Brown University in the early 2000s that he became aware of the nascent field of quantum computing.

“As soon as I heard about it, I was taken with the idea that I could be involved in building a completely new type of computer,” says Schuster. He saw this chance for what it was, a colossal stroke of right-place-right-time good fortune. “The opportunity to make an impact at such a fundamental level was very exciting.”

To appreciate why quantum computing has such potential, compare it to regular, or “classical”, computers. A classical computer uses digital bits to perform computations, with each bit representing either 0 or 1 at any given time. In simplistic terms, increasing the number of bits available to interact with each other increases the computational power of a computer in an additive, linear fashion. A top-end laptop will boast 32 gigabytes of RAM, which is 256,000,000,000 bits.

Related content
New phase estimation technique reduces qubit count, while learning framework enables characterization of noisy quantum systems.

A quantum computer, by contrast, uses quantum bits (qubits) to perform calculations. Each qubit can be in a simultaneously 0 and 1 at any given time. As a result of this “quantum superposition” – which only occurs at the tiniest scales – increasing the qubits results in an exponential explosion in computational power. It is estimated that a fully functional quantum computer with as little as 100 qubits could outsmart today’s most powerful supercomputers for appropriately chosen problems.

Because of the tiny scale and extreme conditions at which qubits exist, it is very difficult to create and control them, but they can nevertheless be made by harnessing a variety of quantum particles, including charged atoms, the directional spin of electrons, and photons.

But it was an experiment published just as Schuster entered grad school at Yale University that demonstrated that a superconducting circuit could be turned into a qubit, though the quantum effect lasted for less than a nanosecond. “In those early days there was a small number of people working in the field,” he recalls, “and a fundamental question was whether you could even make a circuit quantum. They were able to see it as a direct observation!”

Our approach was unique in that we leveraged powerful ideas from atomic physics and mapped them onto circuits, to build circuits that behaved like atoms
David Schuster

Duly inspired, during his PhD research in physics at Yale, Schuster and his colleagues had bold ideas about how to improve the quantum circuit and create new ways of measuring its quantum state. “Our approach was unique in that we leveraged powerful ideas from atomic physics and mapped them onto circuits, to build circuits that behaved like atoms.”

The circuit-based qubit they created contained cavities and could trap and interact, or couple, with a single microwave photons to create a two-level quantum system, with the levels representing 0s and 1s. Published in Nature in 2004, the landmark paper helped to create a new field — circuit quantum electrodynamics.

Related content
New method enables entanglement between vacancy centers tuned to different wavelengths of light.

Using such circuits as the basis of a qubit has many benefits, says Schuster. One of those is that the cavities help to protect the fragile quantum state against external interference while also allowing the qubits to interact strongly with each other, which is essential for computation.

In 2007, Schuster and his colleagues published another landmark paper, this time in Physical Review A. In it, they introduced a new type of superconducting quantum circuit, coining the term “transmon”. More cunning physics had resulted in a drastic reduction in sensitivity to external noise and an increase in the qubit-photon coupling, while maintaining the ability to control the qubits. The relatively simple transmon has become an industry standard, forming the basis of efforts at Amazon and other computing giants. Some consider the transmon the “transistor” of superconducting quantum computers.

In 2010, Schuster moved to the University of Chicago, where he set up his lab, which explores and develops a range of quantum technologies. This year, for example, the Schuster Lab team published research revealing what they dubbed a “quantum flute”, a piece of hardware able to control multiple microwave photons simultaneously. The team called the work an important step towards efficient quantum RAM and quantum processors.

A tour of David Schuster's quantum computing lab

This year, Schuster is moving to the applied physics department at Stanford University, with the rest of his lab joining him there in 2023. For the rest of 2022, however, most of Schuster’s time will be spent working at the Center for Quantum Computing.

One of the key challenges of quantum systems is that quantum states are incredibly fragile. Consider a regular computer, in which a single bit might consist of a billion electrons sloshing back and forth, with their location representing a 0 or a 1.

“If some electrons get lost, that’s OK. And redundancy is built in. But in the case of a qubit, there’s just one photon and no redundancy,” says Schuster. “And beside the possibility of losing the photon altogether, the slightest noise from the environment can disturb the quantum superposition, creating errors.” This risk of noise is one of the reasons quantum computing typically requires superconducting materials and temperatures very near absolute zero to operate at all.

And the fact that quantum states can only be maintained for a very brief time compounds the error problem.

Related content
The head of Amazon Web Services’ quantum communication program on the Nobel winners’ influence on her field.

“I like to joke that my goal is to make qubits last for the blink of an eye,” says Schuster. Right now, state-of-the-art devices with multiple qubits might boast decoherence times of around 100 microseconds (0.0001 seconds), he says.

Decoherence means the loss of the fragile quantum state. This loss of information results in small computation errors that can quickly multiply, potentially making any output useless. And the more qubits in play, the more quickly errors can accumulate. With leading quantum processors currently containing up to a few hundred qubits (of a variety of natures), we are in what Caltech theoretical physicist and Amazon Scholar John Preskill termed the “noisy intermediate-scale quantum” (NISQ) era.

“By the time we get about 100 qubits interacting with each other, the errors become so great you can't really do much, so there's no point making a 1000-qubit system yet,” says Schuster.

Decoherence is a tractable problem, though, and it is being relentlessly addressed by researchers including Schuster and members of his lab. Fortunately, however, decoherence does not need to be totally overcome before quantum computers can successfully scale up.

Already, the accuracy of the qubits in Schuster’s quantum systems is well over 99%. In fact, as a scientific field the accuracy is getting so high that a threshold is approaching, says Schuster, beyond which sophisticated error-correcting algorithms will be able to counteract the remaining problems caused by the fragility of the qubits.

Related content
How an Amazon quantum computing scientist won the first-ever quantum chess tournament.

“Once we get our error rate low enough, scaling up will actually result in even fewer errors,” he says. “Amazon's effort is focused on getting to this goal of error correction, because then we can truly make a large-scale quantum computer.”

Schuster is two decades into his quantum journey. Is it getting any easier?

“When I started it all felt impossible, but we just tried it anyway,” he says. “Now, the problems no longer necessarily seem impossible, but they are still extremely difficult.”

So why join Amazon now?

Amazon’s efforts are experimental and bold — they are trying different approaches. I think Amazon understands the true magnitude of the challenge and the ultimate value of quantum computing.
David Schuster

“The quality of the team was very appealing,” he says, “and Amazon’s efforts are experimental and bold — they are trying different approaches. I think Amazon understands the true magnitude of the challenge and the ultimate value of quantum computing to their customers through Amazon Web Services, so they are patient.”

It is well known that the arrival of quantum computing will have enormous implications for online security and encryption, because the highest levels of protection currently being employed to protect online data will not stand up to the sheer power of quantum computers. Quantum computing will bring with it uncrackable encryption.

Security implications aside, what other useful applications might we expect? There are entire classes of scientific problems that are intractable to classical computers that should succumb to quantum efforts, says Schuster. He is personally excited about the potential to better understand materials in which quantum mechanics plays an important role.

“Many special materials involve complex quantum interactions that we don't understand and, right now, about 30% of supercomputer capacity goes to solving quantum mechanical problems,” he says.

It is inefficient to solve quantum mechanical problems on a classical computer, he adds. “Very small quantum systems that involve 20 particles or states, you could maybe solve on a laptop. But if it involves 50, even the world's biggest supercomputer can't really do very much with it.”

Such research carried out on quantum computers could have big impacts on the discovery of new materials for renewable energy, computing, chemistry, medicines, and more.

There are also some surprising possibilities for Schuster’s quantum circuits.

“I never would have expected this, but I ended up getting involved in searching for dark matter,” he says. There is a type of proposed dark matter — low mass bosons — that would occasionally interact with ordinary matter, resulting in the production of a single microwave photon. And as luck would have it, Schuster’s qubit circuits are able to trap and measure these photons.

“We can use our qubits to detect these newly created photons,” he explains, “making the search for this type of dark matter about 1000 times faster!”

Research areas

Related content

ES, B, Barcelona
Are you interested in defining the science strategy that enables Amazon to market to millions of customers based on their lifecycle needs rather than one-size-fits-all campaigns? We are seeking a Applied Scientist to lead the science strategy for our Lifecycle Marketing Experimentation roadmap within the PRIMAS (Prime & Marketing analytics and science) team. The position is open to candidates in Amsterdam and Barcelona. In this role, you will own the end-to-end science approach that enables EU marketing to shift from broad, generic campaigns to targeted, cohort-based marketing that changes customer behavior. This is a high-ambiguity, high-impact role where you will define what problems are worth solving, build the science foundation from scratch, and influence senior business leaders on marketing strategy. You will work directly with Business Directors and channel leaders to solve critical business problems: how do we win back customers lost to competitors, convert Young Adults to Prime, and optimize marketing spend by de-averaging across customer cohorts. Key job responsibilities Science Strategy & Leadership: 1. Own the end-to-end science strategy for lifecycle marketing, defining the roadmap across audience targeting, behavioral modeling, and measurement 2. Navigate high ambiguity in defining customer journey frameworks and behavioral models – our most challenging science problem with no established playbook 3. Lead strategic discussions with business leaders translating business needs into science solutions and building trust across business and tech partners 4. Mentor and guide a team of 2-3 scientists and BIEs on technical execution while contributing hands-on to the hardest problems Advanced Customer Behavior Modeling: 1. Build sophisticated propensity models identifying customer cohorts based on lifecycle stage and complex behavioral patterns (e.g., Bargain hunters, Young adults Prime prospects) 2. Define customer journey frameworks using advanced techniques (Hidden Markov Models, sequential decision-making) to model how customers transition across lifecycle stages 3. Identify which customer behaviors and triggers drive lifecycle progression and what messaging/levers are most effective for each cohort 4. Integrate 1P behavioral data with 2P survey insights to create rich, actionable audience definitions Measurement & Cross-Workstream Integration: 1. Partner with measurement scientist to design experiments (RCTs) that isolate audience targeting effects from creative effects 2. Ensure audience definitions, journey models, and measurement frameworks work coherently across Meta, LiveRamp, and owned channels 3. Establish feedback loops connecting measurement insights back to model improvements About the team The PRIMAS (Prime & Marketing Analytics and Science) is the team that support the science & analytics needs of the EU Prime and Marketing organization, an org that supports the Prime and Marketing programs in European marketplaces and comprises 250-300 employees. The PRIMAS team, is part of a larger tech tech team of 100+ people called WIMSI (WW Integrated Marketing Systems and Intelligence). WIMSI core mission is to accelerate marketing technology capabilities that enable de-averaged customer experiences across the marketing funnel: awareness, consideration, and conversion.
IN, KA, Bengaluru
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Mentor other scientists and engineers in the use of ML techniques
ES, M, Madrid
At Amazon, we are committed to being the Earth's most customer-centric company. The European International Technology group (EU INTech) owns the enhancement and delivery of Amazon's engineering to all the varied customers and cultures of the world. We do this through a combination of partnerships with other Amazon technical teams and our own innovative new projects. You will be joining the Tamale team to work on Haul. As part of EU INTech and Haul, Tamale strives to create a discovery-driven shopping experience using challenging machine learning and ranking solutions. You will be exposed to large-scale recommendation systems, multi-objective optimization, and state-of-the-art deep learning architectures, and you'll be part of a key effort to improve our customers' browsing experience by building next-generation ranking models for Amazon Haul's endless scroll experience. We are looking for a passionate, talented, and inventive Scientist with a strong machine learning background to help build industry-leading ranking solutions. We strongly value your hard work and obsession to solve complex problems on behalf of Amazon customers. Key job responsibilities We look for applied scientists who possess a wide variety of skills. As the successful applicant for this role, you will work closely with your business partners to identify opportunities for innovation. You will apply machine learning solutions to optimize multi-objective ranking, improve discovery engagement through contextual signals, and scale ranking systems across multiple marketplaces. You will work with business leaders, scientists, and product managers to translate business and functional requirements into concrete deliverables, including the design, development, testing, and deployment of highly scalable distributed ranking services. You will be part of a team of scientists and engineers working on solving ranking and personalization challenges at scale. You will be able to influence the scientific roadmap of the team, setting the standards for scientific excellence. You will be working with state-of-the-art architectures and real-time feature serving systems. Your work will improve the experience of millions of daily customers using Amazon Haul worldwide. You will have the chance to have great customer impact and continue growing in one of the most innovative companies in the world. You will learn a huge amount - and have a lot of fun - in the process!
IN, HR, Gurugram
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced ML systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real-world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning team for International Emerging Stores (IES). Machine Learning, Big Data and related quantitative sciences have been strategic to Amazon from the early years. Amazon has been a pioneer in areas such as recommendation engines, ecommerce fraud detection and large-scale optimization of fulfillment center operations. As Amazon has rapidly grown and diversified, the opportunity for applying machine learning has exploded. We have a very broad collection of practical problems where machine learning systems can dramatically improve the customer experience, reduce cost, and drive speed and automation. These include product bundle recommendations for millions of products, safeguarding financial transactions across by building the risk models, improving catalog quality via extracting product attribute values from structured/unstructured data for millions of products, enhancing address quality by powering customer suggestions We are developing state-of-the-art machine learning solutions to accelerate the Amazon India growth story. Amazon is an exciting place to be at for a machine learning practitioner. We have the eagerness of a fresh startup to absorb machine learning solutions, and the scale of a mature firm to help support their development at the same time. As part of the International Machine Learning team, you will get to work alongside brilliant minds motivated to solve real-world machine learning problems that make a difference to millions of our customers. We encourage thought leadership and blue ocean thinking in ML. Key job responsibilities Use machine learning and analytical techniques to create scalable solutions for business problems Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes Design, develop, evaluate and deploy, innovative and highly scalable ML models Work closely with software engineering teams to drive real-time model implementations Work closely with business partners to identify problems and propose machine learning solutions Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model maintenance Work proactively with engineering teams and product managers to evangelize new algorithms and drive the implementation of large-scale complex ML models in production Leading projects and mentoring other scientists, engineers in the use of ML techniques About the team International Machine Learning Team is responsible for building novel ML solutions across International Emerging Store (India, MENA, Far-East, LatAm) problems and impact the bottom-line and top-line of India business. Learn more about our team from https://www.amazon.science/working-at-amazon/how-rajeev-rastogis-machine-learning-team-in-india-develops-innovations-for-customers-worldwide
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, WA, Bellevue
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.