Sunita Mishra, left, chief medical officer at Amazon Health Services, listens as Katrina Armstrong, right, dean of Columbia's Faculties of Health Sciences and the Vagelos College of Physicians and Surgeons, speaks at an October 2023 symposium hosted by Columbia University. Both are sitting, Katrina is holding a mic and gesturing with her left hand, there is also a person somewhat visible in the foreground.
Sunita Mishra, left, chief medical officer at Amazon Health Services, listens as Katrina Armstrong, right, dean of Columbia's Faculties of Health Sciences and the Vagelos College of Physicians and Surgeons, speaks at an October 2023 symposium hosted by Columbia University.

How Amazon and Columbia University are collaborating to advance AI in healthcare

Amazon Health Services' Sunita Mishra and Columbia University’s Katrina Armstrong discuss technology's potential role in medical settings.

Since 2020, Amazon and Columbia University have worked together on challenges in artificial intelligence (AI) through the Columbia Center of Artificial Intelligence Technology. The collaboration extends to healthcare, where AI can lend support to both clinicians and patients. In October 2023, the university hosted a symposium that fostered conversations about the role of AI in healthcare, including how to enable trustworthy and responsible technology.

Sunita Mishra, chief medical officer at Amazon Health Services, and Katrina Armstrong, dean of Columbia's Faculties of Health Sciences and the Vagelos College of Physicians and Surgeons, recently shared their thoughts on how AI could change healthcare for the better.

  1. Q. 

    How are Amazon and Columbia University collaborating on healthcare issues?

    A. 

    Mishra: At Amazon Health Services, our mission is to make it easier for people to find the products and services that they need to get and stay healthy. We believe that the experience of accessing care just needs to be a lot easier. Collaborating with one of the nation's top-tier universities is a great opportunity to expand our exploration of artificial intelligence and large language models as tools for some of the things that we're setting out to do.

    Armstrong: We share a very clear commitment to using digital tools to improve access, quality, and equity in healthcare. Building upon existing partnerships with the engineering school here, Amazon and Columbia have an opportunity to develop new ways to study how we can improve healthcare access with digital tools; to understand the ways to build trust and enhance communication; and to really become a model of a partnership between an academic medical center, a university, and a tech giant that is able to disseminate the knowledge we can create to almost everyone.

  2. Q. 

    What does each side bring to the table?

    A. 

    Armstrong: We at Columbia bring this innovative energy of young, bright physicians and scientists who are actually at the front lines of healthcare issues. And then Amazon has an extraordinary ability to think broadly about how to scale their incredible vision for what it can mean to create a digital world that we all live in. Any great idea that we can co-develop has the opportunity to have the greatest possible impact.

    Mishra: Collaborations like this one with Columbia are not unusual at Amazon, and they're valuable, because they open up the opportunity to collaborate with people or institutions that have a whole different set of expertise than we do. At the symposium in October, there were participants from Columbia's medical college, their business school, and their engineering school. To be there with people who were all looking at a similar area with a different lens was super energizing.

  3. Q. 

    How can AI help solve problems in healthcare?

    A. 

    Mishra: AI is among the most transformational technologies of our time, and I believe generative AI can support the transformation of the healthcare experience. One of the areas I am most interested in is how we can use artificial intelligence tools and large language models to make the job of the clinician easier. This would allow clinicians to spend more time building relationships with patients and not on the administrative tasks that we know can take up nearly 50 percent of their day.

    At Amazon Pharmacy, we have applied large language models to improve the transparency of price so you're never surprised by the cost of what you've been prescribed. That approach would be really valuable in other aspects of care, where you could help people understand what their copay is or how much of their deductible is remaining.

    At the symposium, the team at Columbia brought up that we could use predictive analytics to really understand the waxing and waning of demand from patients and use that to make sure we're staffed up appropriately.

    Armstrong: Over the last 30 years in medicine and in science, we've made amazing advances in what we can offer patients. The problem is, we haven't been able to get all of that out to the people who really need it. So what we've been thinking about for the last decade is, how do we take these tools and create new models that are going to get everybody access to the information they need to make the right decisions and then build upon that with new models of delivery?

    Recently there was a new gene therapy approved for sickle cell anemia. Imagine if we could create tools that identify and inform candidates for treatment. Then we could use AI and other tools to identify how best to do that, to follow patients, and to make better decisions as we go forward.

    So that's what I'm excited about. It's not AI on its own. It's really about how this helps us address this fundamental crisis that's driven me forever, which is: Why on Earth can't we help more people?

  4. Q. 

    How do you see AI's role evolving in healthcare?

    A. 

    Armstrong: We have faculty who have been studying, working, and living everything about AI for decades. What is remarkable now is that we've democratized it. So, as opposed to a small group of individuals testing and advancing it, we're at this point where AI in healthcare is becoming something that we're thinking about across every aspect of what we do.

    My sense is that we are going to see many parts of healthcare — particularly how we manage and use data — move fairly quickly to better models, whether that's how we collect information from patients, how we provide information to patients, or how we use that information for quality and safety efforts in hospitals and physician practices.

    I think it's going to take longer for it to really become part of how we do medical education, which is where I spend a lot of time. And it's going to take some really Innovative people to come up with ways that AI truly transforms our ability to address the fundamental challenges of healthcare access, quality, and cost. That's going to take some big, bold moves.

    Mishra: The potential is huge; AI is a very powerful tool, and in many ways, Amazon is already improving customers’ lives with practical, useful generative AI innovations. When it comes to AI in healthcare, I'm optimistic about it, and I have been impressed with the care and thought with which people in the industry are approaching solutions.

    Amazon is a place where you can make a significant impact on the lives of customers, and to be able to help make it easier for people to engage with their health is tremendously meaningful work. Most primary care clinicians will see their patients a couple of times a year. We have people who visit the Amazon Store much more frequently. That relationship gives us an opportunity to surface things that are important for their health and to close care gaps. For example, what if we could remind people about checkups or screenings that they may be due for, or just make it easier to schedule appointments or refill their prescriptions? That will make a huge difference. That's what gets me out of bed every day.

Related content

US, MA, Boston
Our team is involved with pre-silicon design verification for custom IP. A critical requirement of the verification flow is the requirement of legal and realistic stimulus of a custom Machine Learning Accelerator Chip. Content creation is built using formal methods that model legal behavior of the design and then solving the problem to create the specific assembly tests. The entire frame work for creating these custom tests is developed using a SMT solver and custom software code to guide the solution space into templated scenarios. This highly visible and innovative role requires the design of this solving framework and collaborating with design verification engineers, hardware architects and designers to ensure that interesting content can be created for the projects needs. Key job responsibilities Develop an understanding for a custom machine learning instruction set architecture. Model correctness of instruction streams using first order logic. Create custom API's to allow control over scheduling and randomness. Deploy algorithms to ensure concurrent code is safely constructed. Create coverage metrics to ensure solution space coverage. Use novel methods like machine learning to automate content creation. About the team Utility Computing (UC) AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services. Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world.
IN, KA, Bengaluru
Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like the Kindle family of products, Fire Tablets, Fire TV, Health Wellness, Amazon Echo & Astro products. This is an exciting opportunity to join Amazon in developing state-of-the-art techniques that bring Gen AI on edge for our consumer products. We are looking for exceptional scientists to join our Applied Science team and help develop the next generation of edge models, and optimize them while doing co-designed with custom ML HW based on a revolutionary architecture. Work hard. Have Fun. Make History. Key job responsibilities - Quantize, prune, distill, finetune Gen AI models to optimize for edge platforms - Fundamentally understand Amazon’s underlying Neural Edge Engine to invent optimization techniques - Analyze deep learning workloads and provide guidance to map them to Amazon’s Neural Edge Engine - Use first principles of Information Theory, Scientific Computing, Deep Learning Theory, Non Equilibrium Thermodynamics - Train custom Gen AI models that beat SOTA and paves path for developing production models - Collaborate closely with compiler engineers, fellow Applied Scientists, Hardware Architects and product teams to build the best ML-centric solutions for our devices - Publish in open source and present on Amazon's behalf at key ML conferences - NeurIPS, ICLR, MLSys.
US, CA, Culver City
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Applied Scientist III Job Location: Culver City, California Job Number: AMZ10564141 Position Responsibilities: Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for machine learning (ML) and/or natural language (NL) applications. Develop and/or apply statistical modeling techniques (e.g. Bayesian models and deep neural networks), optimization methods, and other ML techniques to different applications in business and engineering. Routinely build and deploy ML models on available data, and run and analyze experiments in a production environment. Identify new opportunities for research in order to meet business goals. Research and implement novel ML and statistical approaches to add value to the business. Mentor junior engineers and scientists. 40 hours / week, 8:00am-5:00pm, Salary Range: $167,100/year to $226,100/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.#0000
IN, KA, Bengaluru
Amazon Prime Video is looking for passionate, talented, and inventive Applied Scientists with a strong machine learning background to help build industry-leading Audio, Video and Language technology using GenAI. As part of the AI team in Amazon Prime Video, you will work on developing and fine-tuning LLMs and developing new large multimodal models to advance state-of-the-art in the translation, transcription and generation of multingual cinematic content. You will use the latest GenAI techniques to create and assess cinematic content like videos, audio, and captions, and more. You will design novel approaches to integrate speech, vision, and text for holistic understanding and generation of content, and Collaborate cross-functionally with product managers, engineers, and domain experts to define and deliver high-impact solutions. Your work will directly impact millions of our customers in the form of products and services that make use of speech and language technology on Prime Video content. Key job responsibilities We are looking to hire a top notch scientist with strong machine learning background, sharp research acumen and a hunger for solving ambiguous and challenging science problems. This person will work on developing and fine-tuning LLMs and developing new large multimodal models to advance state-of-the-art in the translation, transcription and generation of multingual cinematic content. They will be required to use the latest GenAI advancements to create and assess cinematic content like videos, audio, and captions, and more. Flavor of problems we are trying to solve: a) generating high quality subtitles in many languages meeting high customer satisfaction bar, b) developing foundation model capable of enabling many down stream tasks in localization and accessibility space, c) generating captions with plot pertinency, character identification etc. d) developing solution for assessing quality of subtitles, captions and metadata unified across different content types, linguistic vs non-linguistic aspects, different languages, and which mimics end user satisfaction while at the same time is explainable. About the team By 2027, Prime Video (PV) aspires to be the primary destination for customers to watch and the primary channel for partners to distribute premium cinematic content. The Content Reasoning, Enrichment & Localization (CoREL) science team’s mission is to develop AI to deeply understand the diverse facets of Prime Video's content across multiple languages, and to create content that power immersive, cinematic experiences. To drive this mission and delight our customers, the CoREL Science Bangalore team addresses the localization and accessibility aspects by a) understanding fine-grained information contained in content to enable generation of localized assets in different languages, b) generating subtitles and accessibility assets like captions across different content types and languages, c) assessing quality of generated (1P) and partner submitted (3P) assets and metadata to ensure defect free customer experience on PV.
US, CA, San Francisco
If you are interested in this position, please apply on Twitch's Career site https://www.twitch.tv/jobs/en/ About Us: Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day. We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We’re on a quest to empower live communities, so if this sounds good to you, see what we’re up to on LinkedIn and X, and discover the projects we’re solving on our Blog. Be sure to explore our Interviewing Guide to learn how to ace our interview process. About the Role We are looking for an Applied Scientist to solve challenging and open-ended problems in the domain of Creators and content contextual signals. As an Applied Scientist on Twitch's GTM Science team, you will use applied machine learning to tackle ambiguous business problems across problem areas such as Ads, Brand Safety, Creator Sponsorship and Content Understanding. You will lead high profile projects where you will use a wide toolbox of ML tools to handle multiple types of data, including user behavior, metadata, and user generated content such as text and video. You will collaborate with a team of passionate scientists, engineers, and product stakeholders to develop these models, prototype and put them into production, where they can help Twitch's creators and viewers succeed and build communities. You will report to our Senior Data Science Manager for GTM. This position is located in San Francisco, CA. You Will - Build machine learning products to enrich Twitch’s content understanding and help creators and viewers build and discover their communities. - Propose, design, and oversee execution for high-impact projects that work backwards from customer problems to develop the right solution for the job. Know when to use a classical ML model versus a state-of-the-art one. - Collaborate with cross-functional engineering and product teams to prototype and deploy your models into flexible data pipelines and ML-based services. - Bring innovation and help drive science culture on the team by staying up to date and experimenting with new techniques in LLM, computer vision, inference and model evaluation. Perks * Medical, Dental, Vision & Disability Insurance * 401(k) * Maternity & Parental Leave * Flexible PTO * Amazon Employee Discount
IN, KA, Bengaluru
Interested to build the next generation Financial systems that can handle billions of dollars in transactions? Interested to build highly scalable next generation systems that could utilize Amazon Cloud? Massive data volume + complex business rules in a highly distributed and service oriented architecture, a world class information collection and delivery challenge. Our challenge is to deliver the software systems which accurately capture, process, and report on the huge volume of financial transactions that are generated each day as millions of customers make purchases, as thousands of Vendors and Partners are paid, as inventory moves in and out of warehouses, as commissions are calculated, and as taxes are collected in hundreds of jurisdictions worldwide. Key job responsibilities • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. A day in the life • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. About the team The FinAuto TFAW(theft, fraud, abuse, waste) team is part of FGBS Org and focuses on building applications utilizing machine learning models to identify and prevent theft, fraud, abusive and wasteful(TFAW) financial transactions across Amazon. Our mission is to prevent every single TFAW transaction. As a Machine Learning Scientist in the team, you will be driving the TFAW Sciences roadmap, conduct research to develop state-of-the-art solutions through a combination of data mining, statistical and machine learning techniques, and coordinate with Engineering team to put these models into production. You will need to collaborate effectively with internal stakeholders, cross-functional teams to solve problems, create operational efficiencies, and deliver successfully against high organizational standards.
US, NY, New York
Fauna Robotics is building capable, safe, and delightful robots for everyday life, and voice is one of the most natural ways people will interact with them. Cloud speech and language models are good and getting better, but they can only work with the audio they receive, and a robot is a hard place to listen. Its microphones sit beside motors, fans, and moving joints. It speaks through its own loudspeaker while people talk over it. It moves, turns, and shares a room with several people at once. We are hiring a Principal Audio Scientist to be Fauna's technical authority on how our robots hear. You will design, prototype, and ship the hardest algorithms in the robot's audio system. You will set the audio architecture that other engineers build on, shape hardware decisions across robot generations, mentor the engineers and scientists working on audio, and be the person teams come to when the robot can't hear. Key job responsibilities - Set the long-range science roadmap and technical architecture for the robot's audio system, and serve as Fauna's primary technical authority on robot hearing - Design and implement suppression of the robot's own noise from motors, fans, and moving joints - Design and implement echo cancellation for the robot's own voice, so people can interrupt it naturally - Develop multi-microphone processing that holds up as the robot and the people around it move, including locating who is speaking so the robot can turn toward them - Make on-robot listening decisions robust to internal and external noise sources: wake word, voice activity, and whether speech is directed at the robot - Drive microphone and speaker placement, enclosure acoustics, and vibration isolation decisions with mechanical, electrical, and industrial design, backed by your own measurements - Design the robot-specific data collection and evaluation methods to validate the performance of our audio design - Present audio science and its tradeoffs to senior leadership and partner teams - Mentor scientists and engineers, raising the scientific bar for audio across the organization through design reviews, code reviews, and hiring
US, NY, New York
We are seeking a Robotics/AI Motor Control Scientist to develop cutting-edge machine learning algorithms for motor control systems in robots. In this role, you will focus on creating and optimizing intelligent motor control strategies to enable robots to perform complex, whole-body tasks. Your contributions will be essential in advancing robotics by enabling fluid, reliable, and safe interactions between robots and their environments. Key job responsibilities - Develop controllers that leverage reinforcement learning, imitation learning, or other advanced AI techniques to achieve natural, robust, and adaptive motor behaviors - Collaborate with multi-disciplinary teams to integrate motor control systems with robotic hardware, ensuring alignment with real-world constraints such as actuator dynamics and energy efficiency - Use simulation and real-world testing to refine and validate control algorithms - Stay updated on advancements in robotics, AI, and control systems to apply advanced techniques to robotic motion challenges - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers - Bridge research initiatives with practical engineering implementation About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you. an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, CA, Sunnyvale
Amazon's Artificial General Intelligence (AGI) organization is seeking an Applied Scientist III to advance the science of Responsible AI evaluation for large language models and generative AI. In this role, you will lead the design and development of rigorous evaluation methods, benchmarks, and metrics that measure the safety, fairness, robustness, and trustworthiness of frontier models. You will work with large-scale datasets, modern deep learning frameworks, and world-class scientists and engineers to turn research into evaluation systems that shape model launch decisions at Amazon scale. Key job responsibilities - Lead the design and implementation of evaluation frameworks, benchmarks, and metrics for responsible AI, including safety, fairness, robustness, and harmful content. - Build scalable automated evaluation pipelines for large language models, including model-based and human-in-the-loop evaluation. - Partner with pretraining, post-training, and product teams to translate evaluation results into model improvements and launch decisions. - Conduct rigorous experimentation and statistical analysis, and publish research at top venues. - Mentor junior scientists and help raise the scientific bar of the team. - Champion responsible AI practices across the model development lifecycle. About the team The AGI Responsible AI (RAI) team builds the science and systems that make Amazon's large language models safe, fair, and trustworthy. We work on problems spanning safety evaluation, content moderation, watermarking, bias mitigation, and alignment. Our team values scientific rigor, customer obsession, and rapid iteration, and we collaborate closely with pretraining, post-training, and product teams across AGI.
CH, Zurich
RIVR, an Amazon company, is building Physical AI by deploying autonomous robots for real-world doorstep delivery. Operating daily in diverse urban environments, RIVR's robots continuously learn from and navigate the millions of scenarios encountered during deliveries. By owning the full stack from software to hardware, RIVR is purpose-built for safety, reliability, and the customer from day one. Reinforcement learning is transforming our robotic intelligence, enabling autonomous behavior without human guidance. We are seeking a Senior AI Engineer with deep expertise in reinforcement learning and deep learning, including supervised and self-supervised learning with a focus on dexterous manipulation. Your role will involve leveraging both simulated and real-world data to address practical challenges in dynamic grasping, contact-rich manipulation, and object interaction. If you are passionate about advancing AI and developing innovative solutions, join us in shaping the future of intelligent robotics. Key job responsibilities Develop cutting-edge reinforcement learning algorithms to enable robust, contact-rich dexterous manipulation, translating vision, depth, tactile, and proprioceptive sensor input into precise end-effector and joint-level motor commands. Design, test, and refine algorithms to solve complex real-world manipulation challenges, such as handling diverse package form factors, dynamic hand-offs, and operating door handles or latches. Collaborate with the foundation model team to innovate methods that leverage both simulated and real-world data.