A graphic shows a simulation of what a VR guided experience might look like, it features colored circles, a humanoid face, and other features
TRIPP is an Alexa Fund portfolio company that is exploring how virtual reality can be combined with meditation. The company's CEO and co-founder Nanea Reeves noted that the VR experiences "are deliberately psychedelic. You find yourself inside an atom or floating in space."
TRIPP

TRIPP explores the potential of virtual reality–powered meditation

Alexa Fund portfolio company’s science-led program could change how we approach mental wellness — and how we use VR.

(Editor’s note: This article is the latest installment in a series by Amazon Science delving into the science behind products and services of companies in which Amazon has invested. The Alexa Fund participated in TRIPP’s $11.2M Series A extension funding round in June 2022.)

With meditation soaring in popularity and the virtual reality (VR) industry booming, Alexa Fund portfolio company TRIPP is at the confluence of two powerful trends: mental well-being and VR. TRIPP is a digital wellness program that uses VR headsets to immerse users in breathing meditation experiences.

The idea to meld meditation and VR first occurred to TRIPP CEO and co-founder Nanea Reeves in 2017 when she, a lifelong practitioner of meditation with a 15-year career in the gaming industry, was experimenting with the medium by building a solitaire game in VR.

This graphic shows a potential visualization from the VR app TRIPP, it includes a planet floating in space against a background featuring stars and bright colors
TRIPP CEO Nanea Reeves said she was inspired by the work of Giuseppe Riva, a neuropsychologist. “We wondered if we could create environments that make you go, ‘Oh, wow!’ and give you a lift,” Reeves explains.
TRIPP

“The way I felt exploring VR was even more interesting to me than the actual development,” Reeves says. Her interest developed into a deep curiosity about the psychological effects of VR, and she began searching the scientific literature.

In addition to studying VR in medical and mental health use cases, she discovered work by Giuseppe Riva, a neuropsychologist whose research has shown that VR can elicit emotions such as awe and, in turn, influence people’s well-being, agency, and perceptions of themselves.

“Inspired by Giuseppe’s research, we wondered if we could create environments that make you go, ‘Oh, wow!’ and give you a lift,” Reeves explains. That became her impetus to found TRIPP in 2017, pursuing the hypothesis that, by stimulating experiences through VR, people may gain some agency over their emotions.

Riva’s work identified several aspects of VR that made it particularly effective for evoking awe, including its immersive nature and the complexity and scale of virtual environments.

“We started leaning into that, and we started to play with scale in our designs,” says Reeves.

In 2019, TRIPP launched its award-winning wellness application, TRIPP, in VR. The application offers immersive mindfulness experiences and, to date, has delivered nearly 6 million wellness sessions. TRIPP continues to work closely with neuroscience and psychiatry advisors through PsyAssist to design and evaluate their experiences and with a host of researchers who are studying its potential uses.

A recent clinical trial suggested that TRIPP might positively influence well-being and mood in cancer patients, and ongoing projects are assessing whether TRIPP can help people in recovery from substance use disorders or anxiety and pain control, among other initiatives.

“With some of the early data coming in, it seems very promising that tools like TRIPP might have a positive impact,” Reeves says, “but we are still only at the beginning of what may be possible with VR.”

Amazon Science spoke with Reeves about the motivation for TRIPP, its roots in science, and the implications for what it can achieve with VR.

  1. Q. 

    Why take meditation virtual?

    A. 

    It’s actually a super native case for VR, because the immersive quality allows you to unplug. You can’t look at your phone by nature of the immersion. I was blown away by how I felt moving in and out of VR — the feeling of respite.

    A lot of the early VR experiences simulated environments that made you terrified, like walking a plank or standing at the edge of a cliff. And it occurred to me: if we could scare people so easily, could we trigger other emotional changes that are beneficial?

    Our approach is to use immersion to drive a deeper connection to self-contemplative thoughts. You’re immersed in this psychologically safe container that is designed to capture your awareness, to allow you to be present and connect to self. With VR, it’s not just an audio file guiding you toward connecting with your breath. We can show you your breath, like star crystals coming in and out of your mouth.

    Some of the early offerings thought VR was really only for gaming. When we first got TRIPP on Oculus, they didn’t know where to put us because they didn’t have a relaxation genre then. We were pretty buried in the store. But we started to get a little bit of traction, and we soon had surprisingly regular usage over time. VR has this problem where you go in, you go, “Wow, that was amazing!” and then it's in your closet. You never pick it up again. When we were designing the product, we knew we had to build for repeat usage. So, we built it procedurally, and now we can update it from the server and add new content regularly.

  2. Q. 

    How is science leading the design and development of TRIPP?

    A. 

    I started by looking at the research investigating VR’s effect on the brain, largely by neuroscientists and behavioral therapists exploring mental health and medical use cases for VR. Most of them focused on simulation, like simulated exposure therapy. But I wondered if, instead of simulating something, could we stimulate responses? I took that question to the researchers working on VR and its effects on mental well-being. We started digging into the research and then, based on the research data, designed VR experiences intended to trigger states of wonder and awe. We tried them out on people and captured some physiological data like heart rate and EEG to see if the experiences were directionally achieving the effect we wanted.

    We stay very grounded in research-driven design choices. We’re a bit edgy. Rather than mimicking natural environments, the experiences are deliberately psychedelic. You find yourself inside an atom or floating in space. First, we tried things like a waterfall or a beach, but when we tested them, they didn’t feel good. I found some research describing how sensory dissonance in synthetic natural environments can create a stress response. Your brain goes, “Well, it looks like a beach, but I don’t smell the ocean. So what’s wrong with this environment?” We realized we had to create environments for which you have no mental model. So we said, “OK, let’s put you in a cosmic flotation tank, whatever that means, because no one knows what space smells like.”

    We’re also starting an enterprise program to support employee wellness and team-building with a hybrid workforce, but also with a focus on using the metaverse for driving ideation and innovation. Can we use these otherworldly environments to spark creativity?
    Nanea Reeves

    After we launched, we started collecting data on mood and emotional state in the live user sessions via self-reported surveys that are based on what they use in mental health research. We bookended our sessions with users, basically asking “How do you feel?” before and after each session. We did things like randomizing the order of the response selections to control against position bias. Now, we have data collected from close to 6 million sessions that we can slice and dice by the time of day and, for a percentage of our audience who opted in, age, gender, and location. It’s become a meaningful body of data that we can share with researchers once it has been de-identified. We also work with researchers who want to study TRIPP and its potential applications. It’s been fascinating to work with that community.

    One example is this group in Germany working with cancer patients undergoing surgery, looking at the effects of TRIPP sessions on their quality of life, well-being, and mood. This study was published in Nature’s Scientific Reports. Participation was good, and patients who used TRIPP had lower heart rates and breathing rates after their sessions. They had improved scores on their mood and emotion surveys after the sessions too. What the study shows us is that VR-based relaxation is a viable option and may be beneficial for cancer patients undergoing surgery. Of course, we don’t make any therapeutic claims until we have a tremendous amount of evidence to support those claims.

    You can find other published data and scientific reports examining TRIPP’s effects on adolescents and its use in palliative care. And we’re working with researchers who are looking at whether TRIPP could help people experiencing addiction and rehab, chemotherapy, severe mental illness, anxiety, and pain. Researchers are also using TRIPP to ease anxiety and help people prepare for ketamine-assisted therapy, so they get the most out of their treatment. I feel very motivated to see how we can help and participate in these research initiatives.

  3. Q. 

    How might TRIPP change how we use VR, beyond its medical applications?

    A. 

    Earlier this year, we acquired EvolVR, which holds live group meditations. Several hundred avatars attend the most popular conversations. People really open up. Skip Rizzo, PhD, a renowned researcher in the field and an advisor to TRIPP, did a pilot study and found that people suffering from PTSD were more open and honest with an avatar. We want to further investigate this as there’s something about the “digital veil” of VR where you don’t feel the judgment of being seen by other people. I think this is a wonderful use case for the metaverse.

    We’re also starting an enterprise program to support employee wellness and team-building with a hybrid workforce, but also with a focus on using the metaverse for driving ideation and innovation. Can we use these otherworldly environments to spark creativity?

    It’s also fascinating to think about the gig economy that could emerge from the metaverse — similar to what first emerged from mobile computing. For example, I met a woman at one of our live group meditation events in the metaverse who’s earning a living as one of the top world-builders in Altspace VR. She’s a mother of five who has never worked in tech before. She’s now a programmer, building these virtual worlds.

    We’re only beginning to explore the potential of VR. It’s like the early days of mobile. Initially, no one thought we’d want to play games or even text message on our cell phones. Now, for the past decade, we have been walking around with our heads down staring at these phone screens nonstop. What kind of innovation will happen in a future when XR glasses are ubiquitous and allow us to experience the world around us in an entirely new and adaptive way?

Related content

  • Staff writer
    December 29, 2025
    From foundation model safety frameworks and formal verification at cloud scale to advanced robotics and multimodal AI reasoning, these are the most viewed publications from Amazon scientists and collaborators in 2025.
  • Staff writer
    December 29, 2025
    From quantum computing breakthroughs and foundation models for robotics to the evolution of Amazon Aurora and advances in agentic AI, these are the posts that captured readers' attention in 2025.
  • Staff writer
    February 4, 2026
    An early meeting between Amazon scientists and Stanford researchers led to cvc5, an open-source tool now powering approximately one billion automated-reasoning checks across AWS every day.
ES, B, Barcelona
Are you interested in defining the science strategy that enables Amazon to market to millions of customers based on their lifecycle needs rather than one-size-fits-all campaigns? We are seeking a Applied Scientist to lead the science strategy for our Lifecycle Marketing Experimentation roadmap within the PRIMAS (Prime & Marketing analytics and science) team. The position is open to candidates in Amsterdam and Barcelona. In this role, you will own the end-to-end science approach that enables EU marketing to shift from broad, generic campaigns to targeted, cohort-based marketing that changes customer behavior. This is a high-ambiguity, high-impact role where you will define what problems are worth solving, build the science foundation from scratch, and influence senior business leaders on marketing strategy. You will work directly with Business Directors and channel leaders to solve critical business problems: how do we win back customers lost to competitors, convert Young Adults to Prime, and optimize marketing spend by de-averaging across customer cohorts. Key job responsibilities Science Strategy & Leadership: 1. Own the end-to-end science strategy for lifecycle marketing, defining the roadmap across audience targeting, behavioral modeling, and measurement 2. Navigate high ambiguity in defining customer journey frameworks and behavioral models – our most challenging science problem with no established playbook 3. Lead strategic discussions with business leaders translating business needs into science solutions and building trust across business and tech partners 4. Mentor and guide a team of 2-3 scientists and BIEs on technical execution while contributing hands-on to the hardest problems Advanced Customer Behavior Modeling: 1. Build sophisticated propensity models identifying customer cohorts based on lifecycle stage and complex behavioral patterns (e.g., Bargain hunters, Young adults Prime prospects) 2. Define customer journey frameworks using advanced techniques (Hidden Markov Models, sequential decision-making) to model how customers transition across lifecycle stages 3. Identify which customer behaviors and triggers drive lifecycle progression and what messaging/levers are most effective for each cohort 4. Integrate 1P behavioral data with 2P survey insights to create rich, actionable audience definitions Measurement & Cross-Workstream Integration: 1. Partner with measurement scientist to design experiments (RCTs) that isolate audience targeting effects from creative effects 2. Ensure audience definitions, journey models, and measurement frameworks work coherently across Meta, LiveRamp, and owned channels 3. Establish feedback loops connecting measurement insights back to model improvements About the team The PRIMAS (Prime & Marketing Analytics and Science) is the team that support the science & analytics needs of the EU Prime and Marketing organization, an org that supports the Prime and Marketing programs in European marketplaces and comprises 250-300 employees. The PRIMAS team, is part of a larger tech tech team of 100+ people called WIMSI (WW Integrated Marketing Systems and Intelligence). WIMSI core mission is to accelerate marketing technology capabilities that enable de-averaged customer experiences across the marketing funnel: awareness, consideration, and conversion.
IN, KA, Bengaluru
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Mentor other scientists and engineers in the use of ML techniques
ES, M, Madrid
At Amazon, we are committed to being the Earth's most customer-centric company. The European International Technology group (EU INTech) owns the enhancement and delivery of Amazon's engineering to all the varied customers and cultures of the world. We do this through a combination of partnerships with other Amazon technical teams and our own innovative new projects. You will be joining the Tamale team to work on Haul. As part of EU INTech and Haul, Tamale strives to create a discovery-driven shopping experience using challenging machine learning and ranking solutions. You will be exposed to large-scale recommendation systems, multi-objective optimization, and state-of-the-art deep learning architectures, and you'll be part of a key effort to improve our customers' browsing experience by building next-generation ranking models for Amazon Haul's endless scroll experience. We are looking for a passionate, talented, and inventive Scientist with a strong machine learning background to help build industry-leading ranking solutions. We strongly value your hard work and obsession to solve complex problems on behalf of Amazon customers. Key job responsibilities We look for applied scientists who possess a wide variety of skills. As the successful applicant for this role, you will work closely with your business partners to identify opportunities for innovation. You will apply machine learning solutions to optimize multi-objective ranking, improve discovery engagement through contextual signals, and scale ranking systems across multiple marketplaces. You will work with business leaders, scientists, and product managers to translate business and functional requirements into concrete deliverables, including the design, development, testing, and deployment of highly scalable distributed ranking services. You will be part of a team of scientists and engineers working on solving ranking and personalization challenges at scale. You will be able to influence the scientific roadmap of the team, setting the standards for scientific excellence. You will be working with state-of-the-art architectures and real-time feature serving systems. Your work will improve the experience of millions of daily customers using Amazon Haul worldwide. You will have the chance to have great customer impact and continue growing in one of the most innovative companies in the world. You will learn a huge amount - and have a lot of fun - in the process!
IN, HR, Gurugram
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced ML systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real-world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning team for International Emerging Stores (IES). Machine Learning, Big Data and related quantitative sciences have been strategic to Amazon from the early years. Amazon has been a pioneer in areas such as recommendation engines, ecommerce fraud detection and large-scale optimization of fulfillment center operations. As Amazon has rapidly grown and diversified, the opportunity for applying machine learning has exploded. We have a very broad collection of practical problems where machine learning systems can dramatically improve the customer experience, reduce cost, and drive speed and automation. These include product bundle recommendations for millions of products, safeguarding financial transactions across by building the risk models, improving catalog quality via extracting product attribute values from structured/unstructured data for millions of products, enhancing address quality by powering customer suggestions We are developing state-of-the-art machine learning solutions to accelerate the Amazon India growth story. Amazon is an exciting place to be at for a machine learning practitioner. We have the eagerness of a fresh startup to absorb machine learning solutions, and the scale of a mature firm to help support their development at the same time. As part of the International Machine Learning team, you will get to work alongside brilliant minds motivated to solve real-world machine learning problems that make a difference to millions of our customers. We encourage thought leadership and blue ocean thinking in ML. Key job responsibilities Use machine learning and analytical techniques to create scalable solutions for business problems Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes Design, develop, evaluate and deploy, innovative and highly scalable ML models Work closely with software engineering teams to drive real-time model implementations Work closely with business partners to identify problems and propose machine learning solutions Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model maintenance Work proactively with engineering teams and product managers to evangelize new algorithms and drive the implementation of large-scale complex ML models in production Leading projects and mentoring other scientists, engineers in the use of ML techniques About the team International Machine Learning Team is responsible for building novel ML solutions across International Emerging Store (India, MENA, Far-East, LatAm) problems and impact the bottom-line and top-line of India business. Learn more about our team from https://www.amazon.science/working-at-amazon/how-rajeev-rastogis-machine-learning-team-in-india-develops-innovations-for-customers-worldwide
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, WA, Bellevue
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.