Sense, Act, and Scale
The path to improving building energy efficiency can be paved with the framework of sense, act, and scale say authors Bharathan Balaji, an Amazon senior research scientist within the company's Devices organization, and Rob Aldrich, an Amazon Web Services senior sustainability strategist.

Creating sustainable, data-driven buildings

As office buildings become smarter, it is easier to configure them with sustainability management in mind.

Editor’s note: This article is adapted from a keynote presentation Bharathan Balaji , an Amazon senior research scientist within the company’s Devices organization, delivered in June at the 17th International Conference on Intelligent Environments . It is further informed by the book "IP-Enabled Energy Management, A Proven Strategy for Administering Energy as a Service " and its author, Rob Aldrich, Amazon Web Services senior sustainability strategist.

Buildings generate about 28% of the global greenhouse gas emissions today. The United Nations Global Status Report projects that buildings need to be at least 30% more energy efficient to achieve Paris Agreement goals.

How can we achieve that 30% energy efficiency target?

The path to reducing our emissions by improving building energy efficiency can be paved with the framework of sense, act, and scale. We need to sense to ascertain efficiency gaps within buildings. We need solutions that act on the information to achieve energy savings. And finally, we need to scale solutions so they get implemented broadly. Here is how this proposed framework can help us achieve our goals.

Sense

For office buildings that are smart and connected, the data set is rich and has much of the granular, sustainability data needed to drive change. Electricity and gas meters tell us how much energy is being consumed by a building, occupancy sensors tell us the number of people in the building, and temperature sensors tell us how much energy we need to cool a room. Sensors are the source of our information and the key to unlocking energy efficiency gaps. Even simple dashboards with such data can motivate users to save energy.

These types of sensors are abundant in modern buildings. However, many of them are wired sensors that are part of the building’s original design, and it is expensive to modify or install new sensors. Office buildings have a life of 50+ years, and sensor technology advances far more rapidly. Wireless sensors undoubtedly reduce communications costs, but they still need to be powered through wires, or use batteries that significantly increase maintenance costs at scale (imagine changing the batteries in every room of an office building).

New sensor options provide for ambient energy harvesting. These wireless sensors work by scavenging energy from the environment such as using ambient light, ventilation air flow, or hot water pipes. These sensors can minimize both energy and communications costs, but scavenged energy is insufficient to sense 24x7. We can improve reliability by predicting the environmental patterns and judiciously using the available energy.

A recent paper in SenSys (coauthored by Bharathan, lead author of this article) showed that reinforcement-learning-based scheduling of energy harvesting sensors can detect 93% of events in a real-world deployment. While the small percentage of missed events make these sensors ineligible for use in essential services, we can use the data from these inexpensive sensors opportunistically to create a rich information layer that helps save energy.

Information Bottleneck: Senors

This new, rich information layer can drive the return on investment (ROI) that has been lacking in many sensor installations. Energy and data managers can provide the missing link between top-end sustainability initiatives and the many different sensor options that exist in buildings. Furthermore, the cost of sensor architectures can be reduced by focusing only on the key data sources that support a given use case. 

For this article we chose to focus primarily on building sustainability data: energy, occupancy, emissions, air and water. This focus helps enable an estimated ROI because you already have a use case that defines how you will act on the information available. The use case for sustainability is to reduce wasted energy while moving to low greenhouse gas (GhG) fuel sources.  Informed by sensor data, the actions taken in support of these goals can be the mechanism by which savings are achieved.

Act

The traditional way to make buildings more energy efficient is to inspect the equipment, install sensors to measure baseline energy consumption, fix faults, upgrade equipment, and optimize equipment configuration. Heating, ventilation and air conditioning (HVAC) systems typically comprise the largest portion of building energy use, and many of the efficiency measures target HVAC improvements. These methods work, and can lead to more than 10% reductions in building energy use. The entire process is often referred to as building retrofitting through performance contracting.

However, two issues with the above approach typically block adoption. First, there is an upfront cost to hire experts and upgrade equipment. The ROI can take years. Second, there is limited scope for innovation beyond the template followed during commissioning. Building innovation is stifled by vertically integrated systems and an inability to easily deploy third-party applications. One of the primary reasons for the explosive growth in the computing industry is a standard interface and ease of application installation. An analogous system for buildings will create new opportunities to save energy. The innovation opportunities with a standardized building information system is highlighted with three use cases below. It is easy to create such a system with current technologies; the figure below shows a high-level architecture.

Building information system architecture

Occupancy-based control

The idea is simple: if we shut off systems that aren’t required when people aren’t present, we save energy. However, detecting occupancy reliably in a privacy-preserving manner is challenging, and most buildings today keep the lights (and HVAC) on even when no one is present. A paper published in SenSys (coauthored by Bharathan) showed that it is possible to infer occupancy using WiFi data, building floor plans, and personnel office room assignments. Among the study participants, peak building occupancy was just 60% (see figure below), and occupancy-based control saved 18% of HVAC electricity use by controlling one-quarter of the building area. The proposed solution simply leverages existing building infrastructure and is inexpensive to deploy. This type of solution is possible only because the information across different systems is exchanged freely.

Building Occupancy Trends

Fault detection

Fixing faults is core to building maintenance, but it is challenging to identify energy-wasting faults as they are difficult to notice, unlike a leak or an uncomfortable temperature. Typical building-fault detection relies on protocols established by experts, but these rules do not provide sufficient prioritization information, nor how much energy they waste.

Sophisticated fault detection algorithms have been published in literature, yet these are not deployed in practice because of vendor- locked systems. Using one year of building data, researchers (Bharathan was a coauthor) developed a simple machine learning algorithm that looks for rooms that do not follow typical temperature patterns. The algorithm identified 88 faults within the building’s HVAC system after an expert fixed all the faults found during an inspection. Many of these faults had existed for years, and resulted in estimated 410.3MWh/year savings. Again, the key component to this solution: easy access to building data.

Software thermostat

The thermostat is the only interface between building occupants and the energy-intensive HVAC system. And yet, in most buildings, occupants don’t know where the thermostat is or how to use it. The HVAC system’s primary function is to keep occupants comfortable so that they can be productive. But without thermostat feedback, occupants can end up being uncomfortable and waste energy.

With the building information system, researchers (Bharathan and collaborators) built a software version of the thermostat to address these concerns (screenshot below). The application was an instant hit and remains popular eight years after its launch. The resulting user study published in Ubicomp showed that users were frustrated with the old thermostat. In fact, one user actually taped a manila envelope on the vent to stop cold air from blowing. The software thermostat helped users precisely control their environment and send complaints if needed. The HVAC maintenance personnel were worried that the interface would lead to a flood of complaints that they weren’t staffed to handle. Usage data showed that most users were happy to use the application without giving any feedback. The few complaints received led to identification of major faults, such as a thermostat being blocked by a computer.

Software thermostat

The three use cases above didn’t require additional sensor installations and simply leveraged existing information. With low-cost solutions, we can attract building owners to adopt solutions that save energy. But we need additional incentives within the building industry to create these low-cost solutions that can have large-scale impact.

These use cases demonstrate that sustainable design doesn’t stop at the brick and mortar of the building. It should carry through to how the energy, emissions, air, water and waste can be managed as systems across buildings. As companies worldwide embark on making their buildings more sustainable, it will be critical to have a data-driven measure of success. The sense and act steps allow each company to look at what is common in the data model today, get started, assess the value, and scale as needed using open-source tools.

Scale

Even when an attractive energy-saving solution is available, it is difficult to deploy the solution at scale. This is because each building is unique, from its infrastructure and how it is used, to the software used to manage daily operations, and how it changes over time. While the fundamental components of a building remain the same (e.g., rooms, smoke sensors, ventilation fans), each vendor treats them differently. When we try to deploy a solution to a building, the discrepancies between vendor representations become difficult to resolve automatically.

In the computing industry, on other hand, it is easy for us to install an application without worrying about the manufacturer or provider because of the use of specifications (e.g., standard protocols for WiFi) and programming interfaces (e.g., Android OS for the phone). Researchers (including Bharathan) created such a standard interface for buildings with the Brick schema, where the building components and their connections to each other are represented through a knowledge graph. The figure below shows a Brick representation of a toy building with two rooms and a few sensors. Brick is now an industry consortium with growing demand, and is in the process of being integrated into building standards.

Given a standard representation such as Brick, we still have the task of representing the existing building in this new format, which can take manual effort and be slow to deploy. Using machine-learning techniques in natural language processing, we can automate this translation and minimize manual effort. The algorithm’s performance improves as more buildings are mapped to Brick and it learns from representation patterns across buildings.

The Brick schema

With the sense, act and scale framework, we envision a day when it will be as easy to configure a building as it is our phones today. We can improve the information available to building managers by using low-cost sensors, use the available information to develop innovations that save energy, and deploy the solution to many buildings with use of a knowledge graph.

Getting started

We are seeing early success in using the sense, act, scale approach in our AWS Sustainability Services practice to optimize how buildings report their sustainability data through the cloud.  It solves several problems by providing a simple framework to plan how our top-level sustainability strategy can be supported by specific building-optimization steps, underpinned by a semi-standardized data model.

The lack of standardization across building management systems has resulted in difficulties in accessing the data. Now that those data acquisition problems are being solved through advances in IoT and API, it opens up new opportunities to expose, analyze and report data that was previously difficult or costly to acquire.  With new advances like the Brick schema, we are making advances in how we can manage building assets at scale, just like servers, laptops and phones.

We are starting to see the potential to move the world from a building management systems approach; one building, one manager to a building systems management approach; many buildings, one manager. Energy efficiency gains of 30% or more are more feasible when we automate energy-control policies across all buildings at the push of a button.

Research areas

Related content

US, MA, Boston
We are looking for researchers who aim to build super-intelligent AI systems that leverage proof assistants to guide learning and reasoning. Our neuro-symbolic AI technology is applied across a wide range of science and engineering domains within Amazon, and you will join the team at the forefront of this research. As an Applied Scientist, you will play a pivotal role in shaping the definition, vision, and development of product features from beginning to end. You will: - Define and implement new neuro-symbolic applications that employ scalable and efficient approaches to solve complex problems. - Work in an agile, startup-like development environment, where you are always working on the most important stuff. - Deliver high-quality scientific artifacts. About the team We work closely with academia. Our team includes an Amazon Scholar in mathematics, and we maintain active research collaborations with faculty at leading CS departments (MIT, Berkeley, CMU).
IN, KA, Bengaluru
RBS (Retail Business Services) Tech team works towards enhancing the customer experience (CX) and their trust in product data by providing technologies to find and fix Amazon CX defects at scale. Our platforms help in improving the CX in all phases of customer journey, including selection, discoverability & fulfilment, buying experience and post-buying experience (product quality and customer returns). The team also develops GenAI platforms for automation of Amazon Stores Operations. As a Sciences team in RBS Tech, we focus on foundational ML research and develop scalable state-of-the-art ML solutions to solve the problems covering customer experience (CX) and Selling partner experience (SPX). We work to solve problems related to multi-modal understanding (text and images), task automation through multi-modal LLM Agents, supervised and unsupervised techniques, multi-task learning, multi-label classification, aspect and topic extraction for Customer Anecdote Mining, image and text similarity and retrieval using NLP and Computer Vision for product groupings and identifying duplicate listings in product search results. Key job responsibilities As an Applied Scientist, you will be responsible to design and deploy scalable GenAI, NLP and Computer Vision solutions that will impact the content visible to millions of customer and solve key customer experience issues. You will develop novel LLM, deep learning and statistical techniques for task automation, text processing, image processing, pattern recognition, and anomaly detection problems. You will define the research and experiments strategy with an iterative execution approach to develop AI/ML models and progressively improve the results over time. You will partner with business and engineering teams to identify and solve large and significantly complex problems that require scientific innovation. You will help the team leverage your expertise, by coaching and mentoring. You will contribute to the professional development of colleagues, improving their technical knowledge and the engineering practices. You will independently as well as guide team to file for patents and/or publish research work where opportunities arise. The RBS org deals with problems that are directly related to the selling partners and end customers and the ML team drives resolution to organization level problems. Therefore, the Applied Scientist role will impact the large product strategy, identifies new business opportunities and provides strategic direction which is very exciting.
US, NJ, Newark
At Audible, we believe stories have the power to transform lives. It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global listeners. We are dreamers and inventors who come from a wide range of backgrounds and experiences to empower and inspire each other. Imagine your future with us. ABOUT THIS ROLE We are seeking a data scientist builder to join the Audible economics team. Our group of economists, data scientists, and analysts tackles a wide range of questions, including pricing, experimentation science, data-driven product strategy/optimizations, internal productivity/incentives, audience science, and impact/ROI measurement. The ideal candidate will enjoy wearing many hats, possess an economist's mindset and a strong ability to effectively translate business questions into tractable quantitative frameworks, and excel at leveraging AI to build and scale robust, interpretable, and production-ready models/systems/tools. We're looking for someone who automates the repetitive, builds tools that force-multiply the team's output/influence, and treats AI as a core part of their workflow - not a side project. If you are passionate about leveraging data to shape the future of digital media, we encourage you to apply and be a part of our dynamic team. As a Data Scientist, you will... - Collaborate with economists, analysts, and other data scientists to build and scale econometric/ML models and quantitative tools - owning end-to-end scoping, data pipelining, feature engineering, model development/refinement, production-grade deployment, impact measurement, and adoption - Research and evaluate emerging tools and techniques (AI-driven and otherwise), and identify novel data sources to leverage in quantitative work – both from within Audible/Amazon and from 3P sources - Collaborate closely with Product, Content, and Marketing partners to drive broad impact and ensure that solutions are integrated into cross-functional workflows and executive decision-making - Represent the team in a range of settings - from reviews with senior Amazon scientists to reviews with senior Audible/Amazon business leaders - Mentor junior scientists and raise the bar for a new generation of scalable, AI-enabled science/analytical work, both within Audible and across the broader Amazon community ABOUT AUDIBLE Audible is the leading producer and provider of audio storytelling. We spark listeners’ imaginations, offering immersive, cinematic experiences full of inspiration and insight to enrich our customers daily lives. We are a global company with an entrepreneurial spirit. We are dreamers and inventors who are passionate about the positive impact Audible can make for our customers and our neighbors. This spirit courses throughout Audible, supporting a culture of creativity and inclusion built on our People Principles and our mission to build more equitable communities in the cities we call home. Key job responsibilities
IN, KA, Bengaluru
Are you passionate about giving customers the richest, most inspiring experience in their shopping journey? Do you like to dive deep to understand how customer-centric solutions drive measurable results? Do you enjoy working closely with the business and software engineers to design rigorous experiments, build the data infrastructure behind them, and translate results into decisions? You are in the right place! Come join our Prime & Marketing Analytics and Science (PRIMAS) team, where your work will directly impact millions of customers. The EU Marketing & Prime organization is looking for a Data Scientist to join the PRIMAS team. This role sits at the intersection of applied statistics and large-scale analytics — you'll design experiments and causal models, and also own the data pipelines, metrics, and reporting infrastructure that make those results usable across the business. The PRIMAS team provides a comprehensive understanding of customer segments, affinities, and lifetime value. We use data science tools and advanced statistical techniques to study customer purchase and engagement behaviors, and generate actionable insights on where, when, and how we deliver products and programs to customers. We help increase customer engagement, sales, and marketing efficiency, and our systems are built entirely in-house on automated large-scale analytics infrastructure. You will design, launch, and measure experiments across marketing channels (SEM/SEO, Affiliates, Display, Social, Mobile, Email, Onsite, etc.), engagement products, and customer segments. You will improve our understanding of customer behavior, run rigorous power and minimum detectable effect (MDE) analyses to size experiments correctly, and build the causal and conversion models that value and target our marketing — then build the pipelines and dashboards that keep those signals flowing reliably to stakeholders and downstream systems. You will work at the forefront of consumer analytics, tackling some of the hardest measurement problems in the industry alongside strong scientists, statisticians, and software engineers. Key job responsibilities 1. Design and implement scalable, statistically rigorous experiments (A/B, geo, holdout, quasi-experiments) to measure marketing incrementality across channels. 2. Perform power analysis and minimum detectable effect (MDE) calculations to determine experiment sample sizes, durations, and design trade-offs before launch. 3. Build causal and treatment-effect models that produce conversion and valuation signals consumed by downstream bidding and budgeting systems. 4. Building the ETL, metric definitions, and datasets that make results scalable, extensible, and repeatable rather than one-off analyses. 5. Develop measurement frameworks that quantify the true, platform-independent contribution of marketing over time, and build the dashboards and reporting that keep those metrics visible to the business. 6. Apply statistical, mathematical, and machine learning techniques to solve ambiguous business problems where the right approach isn't obvious. 7. Analyze experiment results for validity — inspecting distributions, checking for sample ratio mismatch, exploring covariate balance, and tracking down the source of anomalies. 8. Communicate experiment design, results, and trade-offs clearly to business and leadership audiences, including inputs into business reviews, and influence decisions and technical direction across teams. 9. Establish scalable, repeatable processes and best practices for experiment design, data modeling, and analysis.
US, WA, Seattle
We are looking for an Applied Scientist II to build the AI behind Auto Optimization: agentic systems that automatically optimize advertisers' campaigns on their behalf. Guided by an advertiser's standing instructions, these agents observe how a campaign is performing, reason about what to change, and act on it continuously as conditions in the marketplace shift. Optimizing a campaign well is a collection of decisions. It means working across every control an advertiser has at once: the keywords and products they target, the bids they set, the budgets they allocate, and where their ads appear, all aligned with the preferences of the advertiser. These choices are connected, since a change to targeting changes the right bid, and a change in bids changes how budget should be spent. You will build agents that make these decisions together rather than one lever at a time, and that adapt across many different campaign types and advertiser goals, from growing sales on established products to reaching new customers and launching new ones. Working backwards from the needs of millions of advertisers, you will solve ambiguous problems, invent new methods, and deliver them into a live product that manages real campaigns. You will stay deeply hands-on with the hardest technical problems, collaborate with product and engineering partners on approach, and help raise the quality of the team's science. Key job responsibilities - Build agentic systems that automatically optimize campaigns on an advertiser's behalf, working holistically across every control they have (targeting, bids, budgets, and placements) rather than one lever at a time, and generalizing across many campaign types and advertiser goals, from scaling a proven product to reaching new customers and launching something new. - Encode the dynamics of the auction and marketplace into how the agent reasons, balancing advertiser return, shopper experience, and marketplace health. - Turn raw signal into intelligence by defining and curating the datasets that train and evaluate these agents, from campaign and marketplace data to auction and bid/budget signals, impressions, clicks, conversions, and search-term performance. - Push the frontier of agent design, building the core of the agent itself: planning, tool use (for example, auction simulation, ML models, and optimization routines), and long-horizon reasoning across decisions that interact, and writing the production-quality, critical-path code that carries it from prototype to launch. - Set the bar for trust by developing the evaluation and safety methods that make it trustworthy to let an agent act on live campaigns and real budgets. - Grow with a team that grows the field: contribute to our scientific agenda, learn alongside strong scientists and engineers, and share your work with the broader community. About the team The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through the latest generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. This team within Sponsored Products and Brands is focused on guiding and supporting millions of advertisers to meet their advertising needs of creating and managing ad campaigns. At this scale, the complexity of diverse advertiser goals, campaign types, and market dynamics creates both a massive technical challenge and a transformative opportunity: even small improvements in guidance systems can have outsized impact on advertiser success and Amazon's retail ecosystem. Our vision is to build a highly personalized, context-aware agentic advertiser guidance system that leverages LLMs together with tools such as auction simulations, ML models, and optimization algorithms. This agentic framework will operate across both chat and non-chat experiences in the ad console, scaling to natural language queries as well as autonomously managing campaigns based on deep understanding of the advertiser. To execute this vision, we collaborate closely with stakeholders across Ad Console, Sales, and Marketing to identify opportunities, from high-level product guidance down to granular keyword recommendations, and deliver them through a tailored, personalized experience. Our work is grounded in state-of-the-art agent architectures, tool integration, reasoning frameworks, and model customization approaches (including tuning, MCP, and preference optimization), ensuring our systems are both scalable and adaptive.
US, NY, New York
We are seeking a Human-Robot Interaction (HRI) Research Scientist to develop cutting-edge interactions that make robots feel alive, personal, and fun. In this role, you will focus on verbal and non-verbal conversational systems, social dynamics, memory, and long-term relationship formation between robots, their environments, and the people they interact with. Your contributions will be essential in advancing robotics by enabling expressive, socially intelligent, and trustworthy interactions between robots and humans.
US, MA, North Reading
Amazon Robotics is transforming warehouse automation through edge AI and machine learning applied to real-world robotics challenges. We're seeking a Research Scientist to advance our mobile manipulation capabilities by developing novel learning-based approaches that enable robots to navigate and manipulate objects in dynamic fulfillment environments. This role offers the opportunity to conduct original research and translate state-of-the-art findings into production systems operating at Amazon's unprecedented scale. Key job responsibilities Research and Algorithm Development: Formulate novel research problems in robot learning and manipulation, design new model architectures, validate hypotheses through rigorous experimentation, and advance the state of the art in learning-based robotics. Data Strategy and Pipeline Design: Define data requirements for research initiatives, design scalable collection and curation strategies, establish governance and provenance standards, and build reusable pipelines ensuring data quality and reproducibility. Experimentation and Scientific Validation: Design and execute experiments in simulation and real-world embodiments, develop evaluation methodologies and benchmarks, perform ablation studies and statistical analyses, and iterate systematically to advance model performance. Prototyping and Research Infrastructure: Develop clean, well-documented research codebases, build experimentation frameworks and evaluation tooling, contribute to shared training infrastructure, and implement interfaces for broader robotics integration. Scientific Leadership and Publication: Drive an independent research agenda aligned with team objectives, publish at top-tier venues (e.g., RSS, CoRL, ICRA, NeurIPS), identify research gaps through literature reviews, and present findings via technical reports and talks. Cross-Functional Collaboration: Partner with scientists, engineers, and leaders across teams to translate research into deployable solutions, mentor junior researchers, contribute to the team's scientific culture, and support integration with robotics hardware teams. A day in the life If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply! About the team Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart, collaborative team of enthusiastic doers that work passionately to apply innovative advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even image yet. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun!
US, NY, New York
Want to work on building a Amazon Ads billion dollar business, innovate on a new product, and have a positive impact on millions of views while working with industry-leading technologies? We're growing a team to support the Sponsored Ads business that powers the advertising experience for millions of viewers and advertisers daily. Amazon is investing heavily in building a world-class advertising business and developing a collection of self-service performance advertising products that drive discovery and sales. We deliver billions of ad impressions and millions of clicks daily and are constantly challenging ourselves to create world-class products and an unparalleled shopping experience for our hundreds of millions of customers worldwide. Key job responsibilities We are building the next-gen smart ads campaign. At its core is an Intelligence Flywheel — an architecture where every component's output is designed to train models that improve every other component. The Model Layer that is meant to power every capability currently has no dedicated science ownership. As the Senior Applied Scientist on this team, you own the science that makes the flywheel turn. You will turn static, threshold-based logic into self-improving, closed-loop intelligence, and define the decision policies that let the system act autonomously with advertiser trust. Concretely, you will: * Build predictive issue-detection models that identify under-delivery, over-delivery, and performance degradation from campaign signals before they materially impact advertisers. * Design the intervention-selection policy — which autonomous action to take — framed as a contextual bandit: choose, observe, update. Engineers implement action execution; you define the policy that selects actions. * Establish causal attribution for autonomous optimization, separating the effect of our interventions from organic performance change, so improvements can be attributed and advertiser trust in autonomy can be earned. * Integrate and adapt cross-model signals. Combine creative-quality, product-relevance, and budget signals into a unified advertiser-intelligence picture, and adapt general-purpose partner models to our product reality via fine-tuning, re-ranking, or thin adaptation layers. * Close recommendation and grading feedback loops — define reward schemas for accept/reject and performance-vs-baseline signals, correlate creative-quality scores with real campaign outcomes, and feed empirical findings back to both our product and partner science teams. You will work backwards from ambiguous business problems, set the science roadmap for the Model Layer, and partner closely with the team's software engineers — who own the services, pipelines, and execution infrastructure — so that model artifacts you produce are deployed and served in production. This is a high-leverage, high-autonomy role: your outputs are consumed by multiple engineering workstreams at once, and you set the abstractions the team builds on. About the team We are focused on goal-oriented, AI powered workflows that help advertisers achieve their marketing objectives. We collect campaign goals, surface relevant data at key decision points, and provide reporting that validates decision-making. Our product suite guides advertisers in building campaigns with optimal targeting, creative formats, inventory, and bid models that are highly likely to hit their goals — reducing the need for manual intervention.
US, WA, Seattle
At Amazon Selection and Catalog Systems (ASCS), our mission is to power the online buying experience for customers worldwide so they can find, discover, and buy any product they want. We innovate on behalf of our customers to ensure uniqueness and consistency of product identity and to infer relationships between products in Amazon Catalog to drive the selection gateway for the search and browse experiences on the website. We're solving a fundamental AI challenge: establishing product relevant information at unprecedented scale with Frontier Models and Agents. The scale is staggering: billions of products, petabytes of multimodal data, millions of sellers, dozens of languages, and infinite product diversity ranging from electronics to groceries to digital content. The research challenges are immense. GenAI and VLMs hold transformative promise for catalog understanding, but we operate where traditional methods fail: ambiguous problem spaces, incomplete and noisy data, inherent uncertainty, reasoning across both images and textual data, and explaining decisions at scale. Enriching product information requires sophisticated models that reason across text, images, and structured data, all while maintaining accuracy and trust for high-stakes business decisions affecting millions of customers daily. Amazon's Catalog System Services Science team is looking for an innovative and customer-focused applied scientist to help us make the world's best product catalog even better. In this role, you will partner with technology and business leaders to build new state-of-the-art algorithms, models, and services. You will pioneer advanced GenAI solutions that power next-generation agentic shopping experiences, working in a collaborative environment where you can experiment with massive data from the world's largest product catalog, tackle problems at the frontier of AI research, rapidly implement and deploy your algorithmic ideas at scale, across millions of customers. Key job responsibilities - Formulate novel research problems at the intersection of GenAI, multimodal learning, and large-scale information retrieval. In essence, translating ambiguous business challenges into tractable scientific frameworks - Design and implement leading models leveraging frontier models, and agentic architectures to enrich catalog information at billion-product scale - Pioneer explainable AI methodologies that balance model performance with scalability requirements for production systems impacting millions of daily customer decisions - Own end-to-end ML pipelines from research ideation to production deployment, processing petabytes of multimodal data with rigorous evaluation frameworks - Represent the team in the broader science community - publishing findings, delivering tech talks, and staying at the forefront of GenAI, VLM, and agentic system research
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video subscriptions such as Apple TV+, HBO Max, Peacock, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video team member, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you!