Social
Computer vision

How some of AWS's most innovative customers are using computer vision technologies

From counting fish to identifying touchdowns, AWS customers are utilizing computer vision and pattern recognition technologies to improve business processes and customer experiences.

By Staff writer
June 18, 2020
9 min read
Share

Computer vision, the automatic recognition and description of images and video, has applications that are far-reaching, from identifying defects in high speed assembly lines and its use in autonomous robots, to the analysis of medical images, and the identification of products and people in social media. This week, in line with the IEEE Computer Vision and Pattern Recognition (CVPR) conference, we’ve rounded up examples of how some of AWS's most innovative customers are utilizing computer vision and pattern recognition technologies to improve business processes and customer experiences. This includes approaches such as data scientists building custom vision models using Amazon SageMaker, and application developers using Amazon Rekognition and Amazon Textract to embed computer vision into their applications.

Advertising

REA Group image
REA Group has developed an image compliance system that automatically detects any noncompliance and notifies home sellers.
fstop123/Getty Images

In advertising and other online media, computer vision can automate content moderation. REA Group, a multinational digital advertising company specializing in property and real estate, provides search-based portals that enable property sellers to upload images of properties on the market to deliver a wide, searchable selection to their consumers. REA Group discovered that images uploaded to their portal often weren’t compliant with their usage terms. Some images included trademarks or contact details of the sellers, which created lead attribution challenges. They set up a dedicated team of individuals to manually review the images for unapproved content, but the large volume of daily uploads and the additional review process delayed the property listing time by several days. The REA team developed an image compliance system that automatically detects any noncompliance and notifies sellers. To augment their existing machine learning models, they're using Amazon Rekognition Text in Image, which detects and extracts text in images, enabling them to increase the accuracy of detecting noncompliance and reduce false positives by more than 56 percent. They added business rules that factored in a variety of predictions from their own models, and from Amazon Rekognition, to enable automated decision-making.

Agriculture

fin.png
Aquabyte's machine learning algorithms can estimate how much a fish weighs while still in the water.

Agriculture has also benefited from computer vision. Fish farming is one of the most efficient sources of protein, since a pound of feed equates to nearly a pound of protein. But the cold, dark waters of fish habitats make it nearly impossible to effectively manage these farms from the surface. Historically, fish farmers have had to randomly scoop fish out of the water to measure their weight and check for disease. Aquabyte’s machine learning solution reimagines this process by using underwater cameras that keep tabs on the fish and compare photos of them over time. The machine learning algorithms, running on Amazon SageMaker, can estimate how much each fish weighs while it’s still in the water. The system can also monitor the fish for sea lice, a parasite that is a major problem in salmon farms, and the subject of significant regulation in Norway, where the bulk of Aquabyte’s client base currently operates. Without a solution like Aquabyte, managing sea lice amounts to nearly a quarter of the cost of operating a salmon farm. Aquabyte’s cameras have counted 2 million sea lice to date, the result of billions of images being captured. The Aquabyte team has been working on methods that would allow farmers to track individual fish for growth-tracking and breeding purposes. In the future, machine learning might even help automate elements of the farms by intelligently distributing fish feed, for example.

Autonomous driving

grid.png
DeepMap is focused on solving the mapping and localization challenge for autonomous vehicles.

Industries like autonomous driving wouldn’t even be possible without the help of computer vision. Perhaps you think the world is already sufficiently mapped. With the advent of satellite images and Google Street View, it seems like every square inch of the globe is represented in data. But for autonomous vehicles, much of the world is uncharted territory. That’s because the maps designed for humans “can’t be consumed by robots,” says Tom Wang, the director of engineering at DeepMap, a Palo Alto startup focused on solving the mapping and localization challenge for autonomous vehicles. According to Wang, these new kinds of vehicles need higher precision maps with richer semantics, things like the traffic signals, a lot of different traffic signs, driving boundaries, and connecting lanes. For DeepMap computer vision is critical. DeepMap needs to run a vast volume of image detections to automatically generate a comprehensive list of map features and detect dynamic road changes. Using Amazon SageMaker, DeepMap updates training models within a day and runs image detection on tens of millions of images on a daily basis to keep up with ever-changing conditions.

Education

Certipass, a UNI ISO standards accredited body for the certification of digital skills
Certipass was able to build their solution in under 30 days, enabling all their testing centers to test candidates online during the COVID-19 pandemic.
fizkes/Getty Images/iStockphoto

In the wake of the COVID-19 pandemic, many educational institutions needed to quickly pivot to the online proctoring of exams, leading to a need for new ways to verify identification. Certipass, a UNI ISO standards accredited body for the certification of digital skills, is the primary provider of the international digital competency certification –European Informatics Passport (EIPASS).

Since the EIPASS Certification is an international standard, Certipass has made it their mission to ensure maximum security, objectiveness, transparency, and fairness during the entire online evaluation process. Certipass used Amazon Rekognition for automated candidate identity verification during tests that are in line with e-Competence Framework for Information and Communication Technology (CEN) and The Digital Competence Framework for Citizens (Joint Research Centre). They were able to build the solution in under 30 days to enable all their testing centers to test candidates online during COVID-19.

Financial services

Aella Credit
Aella Credit provides easy access to credit in emerging markets using biometric, employer, and mobile phone data
Victor Karanja/Getty Images

In financial services, Aella Credit provides easy access to credit in emerging markets using biometric, employer, and mobile phone data. For those in emerging markets, identity verification and validation is one of the major challenges to accessing retail banking services. How can you know that people are who they say they are in communities that don't have proper identification systems? Aella Credit uses Amazon Rekognition to analyze images to verify a customer’s identity and give them access to financial and healthcare services with minimal friction. Amazon Rekognition helps to automate video and image analysis, with no machine learning expertise required. What would have taken days to verify someone’s identity manually, now happens in seconds. Customers can actually receive their loan in their account in less than five minutes, broadening access to credit.

Financial technology

To make sure users are getting the largest possible tax refund, Intuit incorporates machine learning throughout the TurboTax experience to help users file their taxes more efficiently. TurboTax uses machine learning to shorten the filing process, which takes an average of 13 hours.

Taxes image for AWS customer success story
TurboTax utilizes machine learning to shorten the filing process.
simpson33/Getty Images/iStockphoto

With Intuit’s computer vision capabilities supported by Amazon Textract, entering information from tax forms like W2s or 1099s takes seconds. Rather than a user having to enter form fields manually, the service scans pictures of the forms and digitizes them. Then, using contextual data from TurboTax’s existing database of tax codes and compliance forms, Amazon Textract verifies accuracy and identifies any anomalies or missing data for the user.

Healthcare

face.png
By combining the power of machine learning and computer vision, an interdisciplinary team of researchers at Duke University has created a faster, less expensive, more reliable, and more accessible system to screen children for autism spectrum disorder.

Machine learning plays a key role in many health-related realms - from providers and payers looking to expedite the care continuum to pharma and biotech researchers looking to reduce costs and speed up the drug discovery and disease detection process. Researchers at Duke Center for Autism and Brain Development are using machine learning to screen for autism spectrum disorder (ASD) in children. It’s critically important to diagnose ASD as early in a child’s development as possible — starting treatment for ASD at an age of 18 to 24 months can increase a child’s IQ by up to 17 points—in some cases moving them into the “average” child IQ range of 90-110 (or above it)—and, in turn, significantly improving their quality of life. Currently, the wait time for children to receive a diagnosis could be well after the child’s third birthday. By combining the power of machine learning and computer vision, powered by AWS, an interdisciplinary team of researchers at Duke University have created a faster, less expensive, more reliable, and more accessible system to screen children for ASD.

Media and entertainment

Computer vision technology is helping sports organizations like the National Football League (NFL) improve the game for fans. The NFL works with AWS to develop real-time, state-of-the-art cloud technology leveraging machine learning and artificial intelligence to increase the efficiency and pace of the game.

For example, deep learning and computer vision technologies are being explored to aid game officiating including real-time football tracking. Within days, AWS and NFL scientists were able to create custom training data sets of thousands of images extracted from NFL broadcast game footage using Amazon SageMaker Ground Truth.

NFL football
Deep learning and computer vision technologies are being explored by the NFL to aid game officiating, including real-time football tracking.
CREDIT: National Foottball League

Working with the Amazon ML Solutions Lab, Amazon SageMaker and GluonCV with MXNet were used to train and optimize several state-of-the-art deep learning-based object detection models such as Faster-RCNN and Yolov3, to accurately detect the football across video frames. This led to a first-of-its-kind football tracking model that performs well in a number of complex scenarios, such as when the ball is highly occluded or is partially visible in different camera angles.

The NFL also uses computer vision to more easily and quickly search through thousands of media assets. The NFL photo team, official photographers of the NFL, has millions of photos in archive and generates 500,000 photos each season. Manually, they were able to tag 50,000 images over 18 months. By using Amazon Rekognition custom face collection, text in image, object detection, and Custom Labels, an automated machine learning object detection service, they were able to apply detailed tags for players, teams, objects, action, jerseys, location, etc. to their entire photo collection in a fraction of time it took previously. This allowed them to make these photos searchable and usable to everyone in the company in ways that weren't possible before.

For Sportradar, the global provider of sports and intelligence for the betting and media industries providing data coverage from more than 200,000 events annually, advances in computer vision are an opportunity to expand the depth of sports data offered to customers and reduce the costs of data collection through automation.

Sports betting image for AWS customer success story
For Sportradar, advances in computer vision are an opportunity to expand the depth of sports data offered to customers and reduce the costs of data collection through automation.
scyther5/Getty Images/iStockphoto

Sportradar is investing in computer vision research both through internal development and external partnerships to build computer vision data collection capabilities with an initial focus on tennis, soccer and snooker. Working with the Amazon ML Solutions Lab, Sportradar is exploring the application of state-of-the-art deep learning models for automated match event detection in soccer, moving beyond player and ball localization to understanding the intent of the play in terms of what is happening in the game.

To bring this technology into production as it matures, Sportradar is leveraging AWS services including Amazon SageMaker, EKS, MSK, FSx and Amazon’s broad range of GPU and CPU compute instances for its computer vision processing pipeline. This infrastructure allows Sportradar's researchers to test and validate computer vision models at scale and bring models from the lab to production with minimal effort while delivering the low latency, reliability and scalability needed for live sports betting use cases.

You can find more ways that AWS customers are innovating with computer vision here. More information about Amazon's participation at CVPR is available here.

Research areas
Tags
About the Author
Staff writer

Related content

Work with us

See more jobs See more jobs
Applied Scientist II, Alexa Sensitive Content Intelligence (ASCI)
US, WA, Bellevue
The Mission Build AI safety systems that protect millions of Alexa customers every day. As conversational AI evolves, you'll solve challenging problems in Responsible AI by ensuring LLMs provide safe, trustworthy responses, building AI systems that understand nuanced human values across cultures, and maintaining customer trust at scale. What You'll Build You'll pioneer breakthrough solutions in Responsible AI at Amazon's scale. Imagine training models that set new safety standards, designing automated testing systems that hunt for vulnerabilities before they surface, and certifying the systems that power millions of daily conversations. You'll create intelligent evaluation systems that judge responses with human-level insight, build models that truly understand what makes interactions safe and delightful, and craft feedback mechanisms that help Alexa+ grasp the nuances of complex customer conversations. Here's where it gets even more exciting: you'll build AI agents that act as your team's safety net—automatically detecting and fixing production issues in real-time, often before anyone notices there was a problem. Your innovations won't just improve Alexa+; they'll fundamentally shape how it learns, evolves, and earns customer trust. As Alexa+ continues to delight customers, your work ensures it becomes more trustworthy, safer, and deeply aligned with customer needs and expectations. Your work directly protects customer trust at Amazon's scale. Every innovation you create—from novel safety mechanisms to sophisticated evaluation techniques—shapes how millions of people interact with AI confidently. You're not just building products; you're defining industry standards for responsible AI. This is frontier research with immediate real-world impact. You'll tackle problems that require innovative solutions: training models that remain truthful and grounded across diverse contexts, building reward models that capture the nuanced spectrum of human values across cultures and languages, and creating automated systems that continuously discover and address potential issues before customers encounter them. You'll collaborate with world-class scientists, product managers, and engineers to transform state-of-the-art ideas into production systems serving millions. What We're Looking For * Deep expertise in state-of-the-art NLP and Large Language Models * Track record of building scalable ML systems * Passion for impactful research—where frontier science meets real-world responsibility at scale * Excitement about solving problems that will shape the future of AI Ready to work on AI safety challenges that define the industry? Join us. Key job responsibilities This is where you'll make your mark. You'll architect breakthrough Responsible AI solutions that become industry benchmarks, pioneering algorithms that eliminate false information, designing frameworks that hunt down vulnerabilities before bad actors find them, and developing models that understand human values across every culture we serve. Working with world-class engineers and scientists, you'll push the boundaries of model training—transforming bold research into production systems that protect millions of customers daily while withstanding attacks and delivering exceptional experiences. But here's what makes this role truly special: you'll shape the future. You'll lead certification processes, advance optimization techniques, build evaluation systems that reason like humans, and mentor the next generation of AI safety experts. Every innovation you drive will set new standards for trustworthy AI at the world's largest scale. A day in the life As a Responsible AI Scientist, you're at the frontier of AI safety—experimenting with breakthrough techniques that push the boundaries of what's possible. You partner with engineering to transform research into production-ready solutions, tackling complex optimization challenges. You brainstorm with Product teams, translating ambitious visions into concrete objectives that drive real impact. Your expertise shapes critical deployment decisions as you review impactful work and guide go/no-go calls. You mentor the next generation of AI safety leaders, watching ideas spark and capabilities grow. This is where science meets impact—building AI that's not just intelligent, but trustworthy and aligned with human values. About the team Our team pioneers Responsible AI for conversational assistants. We ensure Alexa delivers safe, trustworthy experiences across all devices, modalities, and languages worldwide. We work on frontier AI safety challenges—and we're looking for scientists who want to help shape the future of trustworthy AI.
Senior Applied Scientist, Alexa Sensitive Content Intelligence (ASCI)
US, WA, Bellevue
The Mission Build AI safety systems that protect millions of Alexa customers every day. As conversational AI evolves, you'll solve challenging problems in Responsible AI by ensuring LLMs provide safe, trustworthy responses, building AI systems that understand nuanced human values across cultures, and maintaining customer trust at scale. What You'll Build You'll pioneer breakthrough solutions in Responsible AI at Amazon's scale. Imagine training models that set new safety standards, designing automated testing systems that hunt for vulnerabilities before they surface, and certifying the systems that power millions of daily conversations. You'll create intelligent evaluation systems that judge responses with human-level insight, build models that truly understand what makes interactions safe and delightful, and craft feedback mechanisms that help Alexa+ grasp the nuances of complex customer conversations. Here's where it gets even more exciting: you'll build AI agents that act as your team's safety net—automatically detecting and fixing production issues in real-time, often before anyone notices there was a problem. Your innovations won't just improve Alexa+; they'll fundamentally shape how it learns, evolves, and earns customer trust. As Alexa+ continues to delight customers, your work ensures it becomes more trustworthy, safer, and deeply aligned with customer needs and expectations. Your work directly protects customer trust at Amazon's scale. Every innovation you create—from novel safety mechanisms to sophisticated evaluation techniques—shapes how millions of people interact with AI confidently. You're not just building products; you're defining industry standards for responsible AI. This is frontier research with immediate real-world impact. You'll tackle problems that require innovative solutions: training models that remain truthful and grounded across diverse contexts, building reward models that capture the nuanced spectrum of human values across cultures and languages, and creating automated systems that continuously discover and address potential issues before customers encounter them. You'll collaborate with world-class scientists, product managers, and engineers to transform state-of-the-art ideas into production systems serving millions. What We're Looking For * Deep expertise in state-of-the-art NLP and Large Language Models * Track record of building scalable ML systems * Passion for impactful research—where frontier science meets real-world responsibility at scale * Excitement about solving problems that will shape the future of AI Ready to work on AI safety challenges that define the industry? Join us. Key job responsibilities This is where you'll make your mark. You'll architect breakthrough Responsible AI solutions that become industry benchmarks, pioneering algorithms that eliminate false information, designing frameworks that hunt down vulnerabilities before bad actors find them, and developing models that understand human values across every culture we serve. Working with world-class engineers and scientists, you'll push the boundaries of model training—transforming bold research into production systems that protect millions of customers daily while withstanding attacks and delivering exceptional experiences. But here's what makes this role truly special: you'll shape the future. You'll lead certification processes, advance optimization techniques, build evaluation systems that reason like humans, and mentor the next generation of AI safety experts. Every innovation you drive will set new standards for trustworthy AI at the world's largest scale. A day in the life As a Responsible AI Scientist, you're at the frontier of AI safety—experimenting with breakthrough techniques that push the boundaries of what's possible. You partner with engineering to transform research into production-ready solutions, tackling complex optimization challenges. You brainstorm with Product teams, translating ambitious visions into concrete objectives that drive real impact. Your expertise shapes critical deployment decisions as you review impactful work and guide go/no-go calls. You mentor the next generation of AI safety leaders, watching ideas spark and capabilities grow. This is where science meets impact—building AI that's not just intelligent, but trustworthy and aligned with human values. About the team Our team pioneers Responsible AI for conversational assistants. We ensure Alexa delivers safe, trustworthy experiences across all devices, modalities, and languages worldwide. We work on frontier AI safety challenges—and we're looking for scientists who want to help shape the future of trustworthy AI.
Senior Applied Scientist, Off-Search, Sponsored Products and Brands
US, WA, Seattle
The Sponsored Products and Brands (SPB) team at Amazon Ads is re-imagining the advertising landscape through state-of-the-art generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. Curious about our advertising solutions? Discover more about Sponsored Products and Sponsored Brands to see how we’re helping businesses grow on Amazon.com and beyond! Key job responsibilities This role will redesign how ads create personalized, relevant shopping experiences with customer value at the forefront. Key responsibilities include: - Design and develop solutions using GenAI, deep learning, multi-objective optimization and/or reinforcement learning to transform ad retrieval, auctions, whole-page relevance, and shopping experiences. - Partner with scientists, engineers, and product managers to build scalable, production-ready science solutions. - Apply industry advances in GenAI, Large Language Models (LLMs), and related fields to create innovative prototypes and concepts. - Improve the team's scientific and technical capabilities by implementing algorithms, methodologies, and infrastructure that enable rapid experimentation and scaling. - Mentor junior scientists and engineers to build a high-performing, collaborative team. A day in the life As an Applied Scientist on the Sponsored Products and Brands Off-Search team, you will contribute to the development in Generative AI (GenAI) and Large Language Models (LLMs) to revolutionize our advertising flow, backend optimization, and frontend shopping experiences. This is a rare opportunity to redefine how ads are retrieved, allocated, and/or experienced—elevating them into personalized, contextually aware, and inspiring components of the customer journey. You will have the opportunity to fundamentally transform areas such as ad retrieval, ad allocation, whole-page relevance, and differentiated recommendations through the lens of GenAI. By building novel generative models grounded in both Amazon’s rich data and the world’s collective knowledge, your work will shape how customers engage with ads, discover products, and make purchasing decisions. If you are passionate about applying frontier AI to real-world problems with massive scale and impact, this is your opportunity to define the next chapter of advertising science. About the team The Off-Search team within Sponsored Products and Brands (SPB) is focused on building delightful ad experiences across various surfaces beyond Search on Amazon—such as product detail pages, the homepage, and store-in-store pages—to drive monetization. Our vision is to deliver highly personalized, context-aware advertising that adapts to individual shopper preferences, scales across diverse page types, remains relevant to seasonal and event-driven moments, and integrates seamlessly with organic recommendations such as new arrivals, basket-building content, and fast-delivery options. To execute this vision, we work in close partnership with Amazon Stores stakeholders to lead the expansion and growth of advertising across Amazon-owned and -operated pages beyond Search. We operate full stack—from backend ads-retail edge services, ads retrieval, and ad auctions to shopper-facing experiences—all designed to deliver meaningful value.
Applied Scientist, Sponsored Products Off-Search Sourcing
US, CA, Palo Alto
The Sponsored Products and Brands (SPB) team at Amazon Ads is re-imagining the advertising landscape through state-of-the-art generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. Curious about our advertising solutions? Discover more about Sponsored Products and Sponsored Brands to see how we’re helping businesses grow on Amazon.com and beyond! Key job responsibilities This role will be pivotal in redesigning how ads contribute to a personalized, relevant, and inspirational shopping experience, with the customer value proposition at the forefront. Key responsibilities include, but are not limited to: - Contribute to the design and development of GenAI, deep learning, multi-objective optimization and/or reinforcement learning empowered solutions to transform ad retrieval, auctions, whole-page relevance, and/or bespoke shopping experiences. - Collaborate cross-functionally with other scientists, engineers, and product managers to bring scalable, production-ready science solutions to life. - Stay abreast of industry trends in GenAI, LLMs, and related disciplines, bringing fresh and innovative concepts, ideas, and prototypes to the organization. - Contribute to the enhancement of team’s scientific and technical rigor by identifying and implementing best-in-class algorithms, methodologies, and infrastructure that enable rapid experimentation and scaling. - Mentor and grow junior scientists and engineers, cultivating a high-performing, collaborative, and intellectually curious team. A day in the life As an Applied Scientist on the Sponsored Products and Brands Off-Search team, you will contribute to the development in Generative AI (GenAI) and Large Language Models (LLMs) to revolutionize our advertising flow, backend optimization, and frontend shopping experiences. This is a rare opportunity to redefine how ads are retrieved, allocated, and/or experienced—elevating them into personalized, contextually aware, and inspiring components of the customer journey. You will have the opportunity to fundamentally transform areas such as ad retrieval, ad allocation, whole-page relevance, and differentiated recommendations through the lens of GenAI. By building novel generative models grounded in both Amazon’s rich data and the world’s collective knowledge, your work will shape how customers engage with ads, discover products, and make purchasing decisions. If you are passionate about applying frontier AI to real-world problems with massive scale and impact, this is your opportunity to define the next chapter of advertising science. About the team The Off-Search team within Sponsored Products and Brands (SPB) is focused on building delightful ad experiences across various surfaces beyond Search on Amazon—such as product detail pages, the homepage, and store-in-store pages—to drive monetization. Our vision is to deliver highly personalized, context-aware advertising that adapts to individual shopper preferences, scales across diverse page types, remains relevant to seasonal and event-driven moments, and integrates seamlessly with organic recommendations such as new arrivals, basket-building content, and fast-delivery options. To execute this vision, we work in close partnership with Amazon Stores stakeholders to lead the expansion and growth of advertising across Amazon-owned and -operated pages beyond Search. We operate full stack—from backend ads-retail edge services, ads retrieval, and ad auctions to shopper-facing experiences—all designed to deliver meaningful value.
Applied Scientist II, Foundation Model, Industrial Robotics Group
US, CA, Sunnyvale
Industrial Robotics Group is seeking exceptional talent to help develop the next generation of advanced robotics systems that will transform automation at Amazon's scale. We're building revolutionary robotic systems that combine innovative AI, sophisticated control systems, and advanced mechanical design to create adaptable automation solutions capable of working safely alongside humans in dynamic environments. This is a unique opportunity to shape the future of robotics and automation at unprecedented scale, working with world-class teams pushing the boundaries of what's possible in robotic manipulation, locomotion, and human-robot interaction. This role presents an opportunity to shape the future of robotics through innovative applications of deep learning and large language models. We leverage advanced robotics, machine learning, and artificial intelligence to solve complex operational challenges at unprecedented scale. Our fleet of robots operates across hundreds of facilities worldwide, working in sophisticated coordination to fulfill our mission of customer excellence. We are pioneering the development of robotics foundation models that: - Enable unprecedented generalization across diverse tasks - Integrate multi-modal learning capabilities (visual, tactile, linguistic) - Accelerate skill acquisition through demonstration learning - Enhance robotic perception and environmental understanding - Streamline development processes through reusable capabilities The ideal candidate will contribute to research that bridges the gap between theoretical advancement and practical implementation in robotics. You will be part of a team that's revolutionizing how robots learn, adapt, and interact with their environment. Join us in building the next generation of intelligent robotics systems that will transform the future of automation and human-robot collaboration. As an Applied Scientist, you will develop and improve machine learning systems that help robots perceive, reason, and act in real-world environments. You will leverage state-of-the-art models (open source and internal research), evaluate them on representative tasks, and adapt/optimize them to meet robustness, safety, and performance needs. You will invent new algorithms where gaps exist. You’ll collaborate closely with research, controls, hardware, and product-facing teams, and your outputs will be used by downstream teams to further customize and deploy on specific robot embodiments. Key job responsibilities As an Applied Scientist in the Foundations Model team, you will: - Leverage state-of-the-art models for targeted tasks, environments, and robot embodiments through fine-tuning and optimization. - Execute rapid, rigorous experimentation with reproducible results and solid engineering practices, closing the gap between sim and real environments. - Build and run capability evaluations/benchmarks to clearly profile performance, generalization, and failure modes. - Contribute to the data and training workflow: collection/curation, dataset quality/provenance, and repeatable training recipes. - Write clean, maintainable, well commented and documented code, contribute to training infrastructure, create tools for model evaluation and testing, and implement necessary APIs - Stay current with latest developments in foundation models and robotics, assist in literature reviews and research documentation, prepare technical reports and presentations, and contribute to research discussions and brainstorming sessions. - Work closely with senior scientists, engineers, and leaders across multiple teams, participate in knowledge sharing, support integration efforts with robotics hardware teams, and help document best practices and methodologies.
Applied Science Manager, Alexa Ads
IN, KA, Bengaluru
Alexa+ is the world’s best Generative AI powered personal assistant / agent for consumers. We are seeking an experienced Applied Science Manager to build and lead a new team of scientists in India dedicated to Alexa Conversational Ads and Personalization. As the leader of this team, you will shape both the scientific roadmap and the product strategy, working closely with global product stakeholders to ensure your team is delivering high-impact, scalable solutions. Key job responsibilities - Hire, develop, and mentor a high-performing team of applied scientists. - Partner with product management and engineering leadership to define the mid-to-long-term scientific roadmap for conversational ads and personalization. - Manage the execution of complex ML projects, ensuring rigorous experimental design, high modeling standards, and on-time delivery. - Bridge the gap between science, engineering, and product, translating business metrics into scientific goals and vice versa. - Establish best practices for ML lifecycle management, code quality, and technical documentation within the team.
Senior Applied Scientist, Alexa Ads
IN, KA, Bengaluru
Alexa+ is the world’s best Generative AI powered personal assistant / agent for consumers. We are looking for a Senior Applied Scientist to provide technical leadership for our Alexa Conversational Ads and Personalization initiatives. You will be responsible for tackling our most ambiguous scientific challenges, setting the technical architecture for new ML systems, and pushing the boundaries of what is possible in voice-based advertising. Key job responsibilities - Define the scientific vision and lead the technical execution for complex, multi-quarter ML projects in conversational ads and personalization. - Architect end-to-end machine learning systems that operate at Alexa's massive scale. - Mentor and guide junior scientists on modeling techniques, experimental design, and best practices. - Partner closely with product and engineering stakeholders to translate ambiguous business requirements into rigorous scientific problem statements. - Contribute to the broader scientific community through internal technical papers and external publications.
Applied Scientist, Alexa Ads
IN, KA, Bengaluru
Alexa+ is the world’s best Generative AI powered personal assistant / agent for consumers. We are seeking an Applied Scientist to join our newly expanding team in India focused on Alexa Conversational Ads and Personalization. In this role, you will build machine learning models that seamlessly and naturally integrate relevant advertising into the Alexa experience while deeply personalizing user interactions. You will work closely with other scientists, engineers, and product managers to take models from conception to production. Key job responsibilities - Design, develop, and evaluate innovative machine learning and deep learning models for natural language processing (NLP), recommendation systems, and personalization. - Conduct hands-on data analysis and build scalable ML pipelines. - Design and run A/B experiments to measure the impact of new models on customer experience and ad performance. - Collaborate with software development engineers to deploy models into high-scale, real-time production environments.
Applied Scientist, Design and Simulation, Center for Quantum Computing
US, CA, San Francisco
The Amazon Center for Quantum Computing (CQC) is a multi-disciplinary team of scientists, engineers, and technicians, all working to innovate in quantum computing for the benefit of our customers. We are looking to hire an Applied Scientist to design and model novel superconducting quantum devices (including qubits), readout and control schemes, and advanced quantum processors. The ideal candidate will have a track record of original scientific contributions, strong engineering principles, and/or software development experience. Resourcefulness, as well as strong organizational and communication skills, is essential. About the team About the team The Amazon Center for Quantum Computing (CQC) is a multi-disciplinary team of scientists, engineers, and technicians, on a mission to develop a fault-tolerant quantum computer. Inclusive Team Culture Here at Amazon, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. Diverse Experiences Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Export Control Requirement Due to applicable export control laws and regulations, candidates must be either a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum, or be able to obtain a US export license. If you are unsure if you meet these requirements, please apply and Amazon will review your application for eligibility. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be either a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum, or be able to obtain a U.S export license. If you are unsure if you meet these requirements, please apply and Amazon will review your application for eligibility.
Applied Scientist II, Industrial Robotics Group
US, MA, N.reading
Amazon Industrial Robotics Group is seeking exceptional talent to help develop the next generation of advanced robotics systems that will transform automation at Amazon's scale. We're building revolutionary robotic systems that combine cutting-edge AI, sophisticated control systems, and advanced mechanical design to create adaptable automation solutions capable of working safely alongside humans in dynamic environments. This is a unique opportunity to shape the future of robotics and automation at an unprecedented scale, working with world-class teams pushing the boundaries of what's possible in robotic dexterous manipulation, locomotion, and human-robot interaction. This role presents an opportunity to shape the future of robotics through innovative applications of deep learning and large language models. At Amazon Industrial Robotics Group we leverage advanced robotics, machine learning, and artificial intelligence to solve complex operational challenges at an unprecedented scale. Our fleet of robots operates across hundreds of facilities worldwide, working in sophisticated coordination to fulfill our mission of customer excellence. The ideal candidate will contribute to research and implementation that bridges the gap between theoretical advancement and practical implementation in robotics. You will be part of a team that's revolutionizing how robots learn, adapt, and interact with their environment. Join us in building the next generation of intelligent robotics systems that will transform the future of automation and human-robot collaboration. Key job responsibilities - Implement and optimize control algorithms for robot locomotion - Support development of behaviors that enable robots to traverse diverse terrain - Contribute to methods that integrate stability, locomotion, and manipulation tasks - Help create dynamics models and simulations that enable sim2real transfer of algorithms - Collaborate effectively with multi-disciplinary teams on hardware and algorithms for loco-manipulation
See more jobs
View from space of a connected network around planet Earth representing the Internet of Things.
Get more from Amazon Science
Subscribe to our monthly newsletter

Amazon.com | Conditions of Use | Privacy | © 1996-2026 Amazon.com, Inc. or its affiliates

Social