A city crew truck is seen driving down a flooded street in a downpour
Lise St. Denis, a research scientist at the University of Colorado’s Earth Lab, has spent the past half-decade figuring out how to find useful information on social media in the wake of natural disasters like the flooding seen here.
Mario Beauregard/Adobe

Finding critical information during disasters

Lise St. Denis, a research scientist at the University of Colorado, says social media can be useful for responders. Now she's helping them separate truly useful info from the noise.

Twitter, apart from being a place to catch up on niche topics and post personal takes on the latest news, can be a useful source of vital information during disasters.

Lise St. Denis, a research scientist at the University of Colorado’s Earth Lab, notes social media sites of all stripes can be useful in storms, but also in wildfires, floods, hurricanes, and other natural disasters — because fast, local information is essential in these situations. However, separating truly useful info from the noise is key, which is what St. Denis has been working on for the past half-decade.

“My big vision is that emergency response teams and communities impacted by disasters could get the best possible information out in real time so communities can be optimally informed about what's happening,” she says.

This kind of work requires a marriage of creative thinking and technology, something St. Denis, a 2019 AWS Machine Learning Research Award recipient, has pursued since the beginning of her career.

Lise St. Denis is seen wearing a mask and standing, on the left, while teaching a recent graduate seminar. There is a display screen behind her and two students, also masked, are seen sitting.
Lise St. Denis is seen standing while teaching a recent graduate seminar. After earning her PhD at the University of Colorado in 2016, St. Denis stayed on and is now a research scientist at Earth Lab
Courtesy of Lise St. Denis

At least as far back as college, St. Denis has had a variety of interests she took seriously, despite their seeming disparity. Her undergrad degrees from Colorado State University are in fine arts and computer science. That brought her to illustration and software engineering in her early working life, first at Hewlett Packard. HP supported her graduate work in human factors engineering at the University of Idaho.

She took a break when she had children in the early 2000s, and when she was ready to return to the workforce, she realized she wanted to refine her skills. “I still had a lot of the same interests, but with a different life perspective — I was older. I wanted to do something that I felt like I was making a difference,” says St. Denis. So she went back to graduate school in 2011 initially for a masters in computer science, which led her to the University of Colorado where she discovered Project EPIC (Empowering the Public with Information in Crisis) where she decided to pursue an interdisciplinary doctorate in crisis informatics.

As part of the work for her degree, she met a group of emergency responders, became fascinated by their work, and set out to learn more. She realized that one big challenge they faced was getting the word out to the public. Could, she wondered, social media sites help gather and distribute information?

So when she heard about a plan in New Mexico to adapt the idea of digital volunteerism to emergency risk response — the volunteers in this case would be emergency responders — she went to learn from them.

At the time, social media wasn’t widely embraced within the emergency response field; St. Denis even knew government officials who risked their jobs using social media at work. “A lot of emergency response organizations just saw social media, not as useful, but as more of a hotbed for misinformation and rumor,” says St. Denis.

Even in light of that, some emergency managers remained interested: “As social media gained popularity, they knew this is where they needed to provide updates, engage with a growing audience, and look for breaking information,” recalls St. Denis.

“They formed this network of teams that were called Virtual Operational Support Teams. These teams are known ahead of time and activated through formal emergency protocols and procedures. The first emergency trial of the concept was during the 2011 Shadow Lake Fire in Eastern Oregon. I ended up studying the innovations of this network of teams, and I worked within this community, alongside them, to understand what they were doing,” she explained.

Their work made sense to St. Denis, and so, instead of getting that master’s in computer science, she ended up using what she had learned in New Mexico as a basis for her cross-disciplinary PhD, which included computer science, but also incorporated classes in communication and sociology of disaster.

In 2014, St. Denis was asked to bring her reporting and analysis social media skills to the Carlton Complex fire in Eastern Washington. That fire burned through several communities with a high number of structures lost and very short evacuation windows. Unable to keep up with the speed of the fire’s impact, locals had no way to get their questions answered and there was, understandably, a lot of frustration.

“That convinced me that there had to be a better strategy for filtering and getting to the most relevant information needed during these events,” she says.

She was also wrangling data and doing analysis, and consolidating that information for the teams she was supporting. As part of her research, St. Denis was a part of close to 100 emergency response activations. “I studied the integration of social media into emergency response through virtual teams,” she explains. “And I kept asking myself, ‘What does it mean to integrate them?’”

Fast forward to today and she’s still researching that basic question. After earning her PhD at the University of Colorado in 2016, St. Denis stayed on at the university and is now a research scientist at Earth Lab. “We have all this existing information from all these different sources, and we want to do a better job of making it available so scientists can leverage it and make use of it for hazards analysis.”

Thus far, Twitter has shown the most promise for what St. Denis hopes to implement. The idea is that an emergency manager would receive a live stream of truly useful content, including selected tweets from reliable sources. “The managers could keep an eye on that as part of their emergency management response,” says St. Denis.

This is extremely practical, real-world information, that can help save lives because it is personalized, says St. Denis. The information is coming from community members who are directly impacted by these disasters. “It's not the media coverage or the broad outside information,” says St. Denis. “It contains new information such as what roads are passable or where fuel outages exist” or where information gaps exist such as, ‘I don't know where to evacuate my livestock,’ or ‘I need to know who has gas,’ or ‘Is my water supply safe to drink?’”

And while her research hasn’t yet translated into an actual tool for emergencies, St. Denis sees the light around the corner. She recently became part of the Pandemic Hyper-Accelerator for Science and Technology (PHAST). “As part of the PHAST program I have been paired with skilled entrepreneurs who are helping me to look at my problem from a systematic, opportunity-driven perspective,” she explains. “We’ve been interviewing emergency response and crisis response professionals across different contexts to understand specifics about the tools they are using, as well as the specific values of or consequences for information when it is found or not found.”

Utilizing machine learning

St. Denis first realized she would need to utilize machine learning when studying data from the Carlton Complex fire. “I realized that I had some intuition for how I could take the noise off the top to get to the information that I wanted. But the only way that was going to matter is if I could do that in near real time — which would require machine learning,” she says. So she applied for an AWS Machine Learning Research Award and received it in 2019.

She and her team used AWS Lambda and AWS Fargate to query the Twitter API for relevant tweets, and stored the raw data in Amazon S3. St. Denis also used standard machine learning libraries to build her prototype because she wanted everything to be open source. “We're hoping, as we move forward, to move into more sophisticated data collection and AWS tools,” she says.

St. Denis and her team have published two papers on the design of the work done so far, and proved that the prototype they’ve built works equally well across multiple types of hazards. They’ve even used it for work they did examining US-based public response to stay-at-home orders at the onset of the COVID-19 pandemic.

“I have spent over a decade working with some of the most innovative responders in the field, but fundamentally nothing has changed in terms of tools,” she says. “I think that this social media-based tool has a lot of potential, and so it's been really exciting. Now that I have this starter funding, it could go pretty quickly.”

Related content

US, CA, Pasadena
The Amazon Center for Quantum Computing in Pasadena, CA, is looking to hire a Fabrication R&D Scientist with experience in semiconductor process development who will aid in Amazon’s effort to bring cloud quantum computing services to its worldwide customer base. You will join a multi-disciplinary team of scientists, and hardware and software engineers working at the forefront of quantum computing. Through your work inside and outside of the cleanroom environment in the fabrication research and development group, you will solve problems related to developing next-generation quantum processors. Key job responsibilities Candidates must have a demonstrated background in sound scientific and engineering principles, and must have excellent data analysis, bias for action, problem solving, and communication skills, and be highly motivated and curious to research and learn new technical topics as needed. As a Fab R&D scientist you will be expected to work on new ideas and stay abreast of novel approaches in fabricating and packaging superconducting quantum processors. Working effectively within a team environment is critical. A day in the life The candidate will develop novel technologies using micro-/nano-fabrication techniques inside the cleanroom (independently or in collaboration with other scientists and engineers) for next-generation quantum computing. Outside the cleanroom, the candidate will plan experiments, analyze data, and conceive future innovations. About the team Candidates must have a demonstrated background in sound scientific and engineering principles, and must have excellent data analysis, bias for action, problem solving, and communication skills, and be highly motivated and curious to research and learn new technical topics as needed. As a Fab R&D scientist you will be expected to work on new ideas and stay abreast of novel approaches in fabricating and packaging superconducting quantum processors. Working effectively within a team environment is critical. Diverse Experiences Amazon values diverse experiences. Even if you do not meet all the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Work/Life Balance Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Export Control Requirement Due to applicable export control laws and regulations, candidates must be either a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum, or be able to obtain a US export license. If you are unsure if you meet these requirements, please apply and Amazon will review your application for eligibility. Key job responsibilities Responsibilities include developing and optimizing processes to fabricate high-coherence superconducting qubits; developing advanced 3DI interconnect and routing technologies for integrating superconducting quantum technologies; analyzing inline metrology and electrical test data; developing and maintaining integration documentation, design rules, and standard operating procedures; interacting with project leads to provide feedback that continuously improves different processes; staying updated with the latest advancements and industry trends in process integration and apply knowledge to improve processes and drive innovation providing technical guidance and support to junior colleagues, fostering a collaborative and knowledge-sharing work environment.
US, NY, New York
Sponsored Products and Brands at Amazon Ads is reimagining the advertising landscape through industry-leading generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of reinventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle, from ad creation and optimization to performance analysis and customer insights. We deliver billions of ad impressions and millions of clicks daily, and are breaking fresh ground to improve both the shopper and advertiser experience. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. The General Shopping Intelligence (GSI) team is a highly motivated, collaborative, and fun-loving group with a strong entrepreneurial spirit and bias for action. We provide advanced real-time machine learning services that connect shoppers with the right ads across all platforms and surfaces worldwide. Through deep understanding of both shoppers and products, we help shoppers discover new products they love, enable advertisers to reach their customers most efficiently, and help Amazon continuously innovate on behalf of all customers. We are seeking a motivated Applied Scientist who loves to innovate at the intersection of customer experience, deep learning, generative AI and high-scale machine learning systems. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. Key job responsibilities As an Applied Scientist, you will: * Conduct deep data analysis to derive insights to the business, and identify gaps and new opportunities * Develop scalable and effective machine-learning models and Generative AI solutions to solve business problems * Run regular A/B experiments, gather data, and perform statistical analysis * Work closely with software engineers to deliver end-to-end solutions into production * Improve the scalability, efficiency and automation of large-scale data analytics, model training, deployment and serving * Conduct research on new generative AI modeling to optimize all aspects of Sponsored Products and Brands business About the team We are pioneers in applying advanced machine learning and generative AI algorithms in Sponsored Products and Brands business. We empower every customer with a customized discovery experiences from back-end optimization (such as customized response prediction models) to front-end CX innovation (such as widgets), to help shoppers feel understood and shop efficiently on and off Amazon.
US, WA, Seattle
Amazon Leo is a constellation of Low Earth Orbit satellites that will provide low-latency, high-speed broadband network connectivity to unserved and underserved communities around the world. We are looking for an Applied Scientist to be a founding scientist on the Engineering and R\&D team within Leo Infrastructure and IP Security. The team defends the manufacturing lines, launch sites, and global ground infrastructure behind the constellation from the most sophisticated threat actors on the planet. These requirements create open scientific problems at the intersection of agentic AI, real-time stream processing, graph-based reasoning, and behavioral analytics. You will build the science behind a neurosymbolic reasoning platform and the models that detect the behavior of sophisticated threat actors. This is an R\&D role with a production mandate, where you define the problem rather than solve a pre-scoped one, and every model, detection, and agent workflow you build becomes the system Leo's security teams use to protect the constellation. #### Export Control Requirement Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities - Design and implement scalable, production-grade neurosymbolic systems that integrate symbolic reasoning over graph-based knowledge representations with LLM agents to deliver reliable, verifiable security outcomes. - Design and run reinforcement learning and fine-tuning pipelines (GRPO, PPO, DPO) to optimize language models for security reasoning, triage, and detection-authoring tasks. - Build behavioral and statistical models that detect threat actor behavior, and design the evaluation frameworks that measure model performance against that behavior before trusting a model in production. - Design and build multi-agent systems that autonomously triage, enrich, and contain security events, including the constrained reasoning, safety guardrails, and validation mechanisms that make automated decisions trustworthy at scale. - Own the end-to-end science lifecycle, from research and experimentation through production deployment, defining the metrics that measure system performance and real-world security impact. - Advance the state of the art through publications at top-tier venues, patents, or open-source contributions, and shape the scientific agenda and research culture from day one. A day in the life You will move between research and production in the same week: framing an ambiguous security problem as a scientific question, prototyping an approach, and partnering with software engineers to ship it as a capability the platform runs continuously. Security engineers on your team translate threat intelligence into the adversary behaviors that matter; you build the models that detect those behaviors and evaluate model performance against them. You will obsess over the two latencies that define the platforms, the time from event to detection and the time from detection to containment action, and design agents and detections that drive both down. You will backtest candidate detections against retained telemetry, review evaluation results before a model or agent capability graduates to automated execution, and deliver scientific artifacts that ship. About the team Leo Infrastructure and IP Security protects the people, facilities, hardware, and supply chain behind a global satellite constellation. The Engineering and R\&D team within this organization builds the platforms and tooling the security pillar teams operate on, moving security operations from manual triage to correlation-based detection, automated response, and agentic AI. The team is composed of applied scientists, software engineers, and security engineers working across physical and digital security domains. #### Inclusive Team Culture In Amazon Security, it's in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness. Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices. #### Training & Career Growth We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional. #### Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there's nothing we can't achieve.
US, NY, New York
The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through cutting-edge generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. Key job responsibilities - Define and lead science initiatives from problem framing through production deployment in a high-ambiguity environment - Develop and deploy models spanning computer vision, language, and search and retrieval that operate on multimodal inputs at scale - Design and analyze large-scale online experiments to measure impact on shopper and advertiser outcomes - Collaborate with engineering, product, and design to ship science into production A day in the life As an Applied Scientist on the Sponsored Videos team, you will tackle problems at the intersection of computer vision, generative AI, search and retrieval, and personalization. You'll own the full science lifecycle from research and experimentation through online testing and production deployment, working closely with engineering, product, and design partners to bring ideas to market. You should be comfortable working with multimodal signals, building models that operate at scale, and measuring impact through rigorous experimentation. Your work will directly influence the experience of hundreds of millions of shoppers and the outcomes of tens of thousands of advertisers. About the team The Sponsored Videos team within Sponsored Products and Brands develops the science and systems behind video advertising experiences that connect advertisers and shoppers across Amazon. We are on a mission to make Amazon the best-in-class destination for shoppers to discover, engage with, and build affinity with brands through videos.
US, WA, Bellevue
Are you passionate about shaping the future of Amazon's long-term success with Generative AI and Reinforcement Learning (RL)? We are looking for a strong Applied Scientist to join Long-Term Planning and Forecasting (LTPF) within Supply Chain Optimization Technologies (SCOT). Our mission is to accelerate the Amazon flywheel and ensure Amazon's long-term success by leveraging GenAI and RL to build the forecasting, optimization, and analytics products that plan Amazon's Topline, Inventory, and Fulfillment Capacity and Topology. In this role, you will develop our next-generation forecasting, planning and insight generation products powered by GenAI and reinforcement learning. You will design and implement novel, sophisticated scientific solutions to large-scale problems that directly shape how Amazon plans for the years ahead. You will collaborate closely with applied scientists, research scientists, economists, product managers, and software engineers. We are seeking innovative thinkers who can balance theoretical rigor with practical implementation. Your ability to communicate complex technical concepts and drive data-driven decisions at massive scale will be crucial to your success.
US, WA, Seattle
Data Scientist We are seeking a talented Data Scientist to join our growing science team. In this role, you will leverage your analytical and technical expertise to extract valuable insights from complex datasets, develop machine learning models, and drive data-informed decision-making across the organization. Key Responsibilities: Design and execute end-to-end data science projects, from problem definition to solution deployment Develop and implement machine learning models to solve business problems and improve operational efficiency Create and maintain data pipelines for model training and deployment Conduct exploratory data analysis to uncover patterns and trends Collaborate with stakeholders to understand business requirements and translate them into technical solutions Present findings and recommendations to technical and non-technical audiences Monitor and optimize model performance Key job responsibilities We are looking for talented Data Scientists who are adept at predictive modeling, reinforcement learning, recommendations, and familiarity with LLMs, latent diffusion, or related foundational models that will accelerate our plans to dynamically optimize ad creatives on behalf of advertisers. Every member of the team is expected to build customer (advertiser) facing features, contribute to the collaborative spirit within the team, publish, patent, and raise the research bar within the team. * Rapidly design, prototype and test many possible hypotheses in a high-ambiguity environment, perform hands-on analysis and modeling of enormous data sets to develop insights that improve shopper experiences and merchandise sales * Drive end-to-end Machine Learning projects that have a high degree of ambiguity, scale, complexity. * Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production; work closely with software engineers to assist in productionizing your ML models. * Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving. * Research new and innovative machine learning approaches. * Promote the culture of experimentation and data science at Amazon About the team Our team, CreativeX Optimization, is responsible for personalizing the visual experience of ads in real time. We apply advanced machine learning and generative AI to help advertisers build, identify, and understand what ad creatives work with their audiences. We develop customized CTR and CVR prediction models to help advertisers efficiently connect with shoppers across the web. We develop generative models to understand shopper preferences across text, images, and videos. We have a broad mandate to experiment and innovate, as we seek to leapfrog the competition and impact billions of impressions daily.
US, WA, Seattle
Data Scientist We are seeking a talented Data Scientist to join our growing science team. In this role, you will leverage your analytical and technical expertise to extract valuable insights from complex datasets, develop machine learning models, and drive data-informed decision-making across the organization. Key Responsibilities: Design and execute end-to-end data science projects, from problem definition to solution deployment Develop and implement machine learning models to solve business problems and improve operational efficiency Create and maintain data pipelines for model training and deployment Conduct exploratory data analysis to uncover patterns and trends Collaborate with stakeholders to understand business requirements and translate them into technical solutions Present findings and recommendations to technical and non-technical audiences Monitor and optimize model performance Key job responsibilities We are looking for talented Data Scientists who are adept at predictive modeling, reinforcement learning, recommendations, and familiarity with LLMs, latent diffusion, or related foundational models that will accelerate our plans to dynamically optimize ad creatives on behalf of advertisers. Every member of the team is expected to build customer (advertiser) facing features, contribute to the collaborative spirit within the team, publish, patent, and raise the research bar within the team. * Rapidly design, prototype and test many possible hypotheses in a high-ambiguity environment, perform hands-on analysis and modeling of enormous data sets to develop insights that improve shopper experiences and merchandise sales * Drive end-to-end Machine Learning projects that have a high degree of ambiguity, scale, complexity. * Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production; work closely with software engineers to assist in productionizing your ML models. * Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving. * Research new and innovative machine learning approaches. * Promote the culture of experimentation and data science at Amazon About the team Our team, CreativeX Optimization, is responsible for personalizing the visual experience of ads in real time. We apply advanced machine learning and generative AI to help advertisers build, identify, and understand what ad creatives work with their audiences. We develop customized CTR and CVR prediction models to help advertisers efficiently connect with shoppers across the web. We develop generative models to understand shopper preferences across text, images, and videos. We have a broad mandate to experiment and innovate, as we seek to leapfrog the competition and impact billions of impressions daily.
CA, BC, Vancouver
Success in any organization begins with its people and having a comprehensive understanding of our workforce and how we best utilize their unique skills and experience is paramount to our future success. WISE (Workforce Intelligence powered by Scientific Engineering) delivers the scientific and engineering foundation that powers Amazon's enterprise-wide workforce planning ecosystem. Addressing the critical need for precise workforce planning, WISE enables a closed-loop mechanism essential for ensuring Amazon has the right workforce composition, organizational structure, and geographical footprint to support long-term business needs with a sustainable cost structure. We are looking for a Sr. Applied Scientist to join our ML/AI team to work on Advanced Optimization and LLM solutions. You will partner with Software Engineers, Machine Learning Engineers, Data Engineers and other Scientists, TPMs, Product Managers and Senior Management to help create world-class solutions. We're looking for people who are passionate about innovating on behalf of customers, demonstrate a high degree of product ownership, and want to have fun while they make history. You will leverage your knowledge in machine learning, advanced analytics, metrics, reporting, and analytic tooling/languages to analyze and translate the data into meaningful insights. You will have end-to-end ownership of operational and technical aspects of the insights you are building for the business, and will play an integral role in strategic decision-making. Further, you will build solutions leveraging advanced analytics that enable stakeholders to manage the business and make effective decisions, partner with internal teams to identify process and system improvement opportunities. As a tech expert, you will be an advocate for compelling user experiences and will demonstrate the value of automation and data-driven planning tools in the People Experience and Technology space. Key job responsibilities * Engineering execution - drive crisp and timely execution of milestones, consider and advise on key design and technology trade-offs with engineering teams * Priority management - manage diverse requests and dependencies from teams * Process improvements – define, implement and continuously improve delivery and operational efficiency * Stakeholder management – interface with and influence your stakeholders, balancing business needs vs. technical constraints and driving clarity in ambiguous situations * Operational Excellence – monitor metrics and program health, anticipate and clear blockers, manage escalations To be successful on this journey, you love having high standards for yourself and everyone you work with, and always look for opportunities to make our services better.
US, WA, Seattle
Join us at the forefront of Amazon's sustainability initiatives to work on environmental and social advancements that support Amazon's long-term worldwide sustainability strategy. At Amazon, we're working to be the most customer-centric company on earth. To get there, we need exceptionally talented, bright, and driven people. We are looking for a Research Scientist to join our growing Sustainability team to drive the science behind value chain decarbonization. This role will establish Amazon's scientific methodologies for sector- and cross-sectoral decarbonization mechanisms, and establish benchmarks for automated validation and risk assessment. As a Research Scientist, you will be responsible for independently leading assessments of environmental issues across the full spectrum of Amazon businesses and evaluating sustainability impacts across the value chain. You will independently develop quality frameworks and methodologies that enable Amazon to scale procurement of high-quality environmental interventions while maintaining scientific rigor and environmental integrity. Key job responsibilities - Develop quality assessment frameworks for complex environmental interventions, baseline-setting approaches, and measurement methodologies - Build quantitative benchmark and statistical models that enable scalable evaluation across heterogeneous data sources - Create attribution methodologies for supply chain interventions across Amazon's diverse footprint - Develop social and environmental safeguard criteria that integrate community impact assessments - Collaborate with cross-functional teams including procurement, sustainability operations, and business units to translate scientific methodologies into operational requirements - Work under the direction of senior business leaders while acting as lead Subject Matter Expert for value chain decarbonization science, including designing and leading research, data collection, modeling, documentation, interpretation, and validation About the team Diverse Experiences: World Wide Sustainability values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Inclusive Team Culture: It’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (inclusive diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth: We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
US, NY, New York
We are seeking an Research Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance. You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection. The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems. Key job responsibilities - Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios - Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies - Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs - Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection - Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection - Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack - Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers