Anton van den Hengel is seen smiling into the camera, with some office buildings in the background
Anton van den Hengel

Anton van den Hengel’s journey from intellectual property law to computer vision pioneer

Amazon’s director of applied science in Adelaide, Australia, believes the economic value of computer vision has “gone through the roof".

Anton van den Hengel, an international pioneer in computer vision and its many applications, departed the University of Adelaide in South Australia to join Amazon as director of applied science in April 2020. He is creating a new, world-class machine-learning hub in Adelaide and supporting Amazon’s business through the development and application of state-of-the-art computer vision and scalable machine learning.

Related content
Senior principal scientist Aleix M. Martinez on why computer vision research has only begun to scratch the surface.

In 2018, van den Hengel was the founding director of the Australian Institute for Machine Learning (AIML), Australia’s first institute dedicated to machine learning research. When he left to join Amazon, AIML was 140 people strong and near the top of the institutional world rankings in terms of computer vision research. He remains the part-time director of AIML’s new Centre for Augmented Reasoning, whose mission is to build core Artificial Intelligence (AI) capability in Australia.

Van den Hengel has authored more than 300 research papers, commercialized eight patents, and been chief investigator on research projects funded by many Fortune 500 companies.

But it could all have been so different. The young van den Hengel first got into computer science simply to support his efforts to become an intellectual property lawyer. In fact, he completed his law degree.

Amazon in Australia
Research teams in Adelaide are developing state-of-the-art, large-scale machine learning methods and applications involving terabytes of data. They work on applying ML, and particularly computer vision, to a wide spectrum of areas.

“I’d bought the suit, tie, and bright white shirt and was all ready to start my first day as an entry level lawyer,” he recalls. “Then, instead, I turned around and went straight back into the University of Adelaide. I spent the next couple of decades there.”

What followed was a master’s, then PhD in computer science and, ultimately, building up the University of Adelaide’s forerunner to AIML, the Australian Centre for Visual Technologies.

The chance to have an impact

What turned van den Hengel around was the chance to study computer vision.

“I saw the opportunity to engage with something that I realized was going to have incredible impact,” he says. Computer vision and its applications are everywhere today, but in the early 1990s, things were very different. “It's hard to believe now but at the time there were maybe 1000 people in the world working on computer vision, at a time when there weren't any digital cameras,” he reminisces. “Most papers in CV were at least half about how people had taken the images.”

[In the early 90s] there were maybe 1000 people in the world working on computer vision, at a time when there weren't any digital cameras. Most papers in CV were at least half about how people had taken the images.
Anton van den Hengel

Van den Hengel understood that humans are primarily visual animals and he clearly saw the inevitability of computers using vision to sense, and ultimately interact with, the world. “But back then, having a computer that could actually either measure or impact upon the real world was virtually unbelievable,” he says.

Since then, he says, computer vision has transformed from a heavily mathematical field with 300 people at every conference who all knew each other, to conferences of many thousands of people and auditoria full of companies trying to attract staff and sell things.

“The economic value of computer vision has gone through the roof,” he says.

Computer vision is a fundamental technology, van den Hengel says, because it relates the real world to symbols. “Humans reason about things in terms of symbols, so ‘cat’, ‘sky’, ‘car’, ‘road’, and ‘fish’ are all symbols, right? Computer vision takes visual signals from the real world and relates those signals to symbols,” he says.

That's been the critical missing piece of the puzzle. For decades it was predicted that by the year 2000 we would have robots doing the housework and many other ‘magical’ things, but we came up short because there's an infinite variation of things out there in the real world and it's much harder to get a computer to reason about our physical environment than anybody imagined.”

Looking for answers

This missing piece is tackled by a subfield of computer vision known as visual question answering (VQA). The idea is to enable computers not only to understand the content of an image (or video/livestream) in a more semantic, human-like way, but also to answer questions posed in natural language about that image. For example, “Where was this photo taken?”, “Does it look like the person on the picnic blanket is expecting someone?”, “What’s the color of the dog nearest the stop sign?”.

Van den Hengel is the world’s most-cited researcher in VQA by an enormous margin, with close to 22,000 citations.

Fireside chat: Anton van den Hengel and Simon Lucey

“I got into it very early because I saw it as a threshold change in the way that artificial intelligence works,” van den Hengel says. “What's interesting about VQA is that you ask the question at run-time and need the answer immediately, so it needs to be very flexible, unlike current machine learning applications, which are often fixed, single-purpose solutions to specific problems.”

In other words, it needs to be closer to true artificial intelligence – often referred to as artificial general intelligence.

In that vein, imagine a robot that could follow natural-language instructions, based on a greater understanding of what it sees around itself. It’s a sci-fi dream, but for how much longer?

In 2018, using a vision-and-language process similar to VQA, Van den Hengel and a team of colleagues from across Australia developed a simulator that uses imagery taken from the inside of real buildings to teach virtual agents to successfully navigate using visually grounded instructions, such as: “Head upstairs and walk past the piano through an archway directly in front. Turn right when the hallway ends at pictures and table. Wait by the moose antlers hanging on the wall.” It is only a matter of time before we can talk to our self-driving cars in a similar manner when necessary, says van den Hengel.

The power of neural networks

Rapid developments in machine learning are behind the recent supercharging of computer vision research.

“In the last 10 years of computer vision, we have essentially trained deep-learning neural networks to replace all of these lovely computer-vision algorithms that we'd previously come up with for solving a whole bunch of problems,” he says. “In fact, neural networks are so much better at it, they went from being just an interesting solution to a puzzle to being a practical solution to some of the core challenges we face.”

While at the University of Adelaide, van den Hengel has applied advances in ML and computer vision to make the world better in a variety of ways. These include working with Adelaide-based medical technology company LBT Innovations in creating an automated pathology machine called APAS (Automated Plate Assessment System) Independence, which can screen and interpret high volumes of pathology plates.

“There's a shortage of trained pathologists, partly because it's not a lot of fun sitting all day doing chemistry and looking at samples. APAS does the drudge work of the visual inspection process,” he says. The device was FDA approved in 2019.

Beyond computer vision, van den Hengel is currently the chief investigator for the Australian National Health and Medical Research Council’s Centre of Research Excellence in Healthy Housing, which is using ML to help deliver better outcomes within the Australian housing system, not only in terms of housing, but also in terms of health.

“People who are homeless suffer diseases and injuries, which put them into hospital, and homelessness can see people spiral into a set of difficult conditions that are very expensive for society to address,” he says. “It's actually cheaper to house somebody than to fix the impact of homelessness. So where can we intervene in the housing process in a way that benefits everybody and also saves money?”

Not all of van den Hengel’s work is quite so serious, however.

The paper I'm most happy about but that gets the least recognition is one that tells you how to build real Lego models of objects in images,” he says. “It’s got brilliant maths in it; some of my favorite maths. And it incorporates gravity, structural considerations and, you know, fantastic maths.” And did he mention the maths?

Van den Hengel has even used ML to design an IPA beer.

“Collecting the data was a real trauma: we had to drink, and rate, a lot of beer,” he laments. He named the resulting ale The Rodney, in homage to the Australian AI researcher and roboticist Rodney Brooks, whose work resulted in the Roomba vacuum cleaner.

Joining Amazon

Always an advocate for Australia on the world stage, van den Hengel was keen to play a leading role in Amazon’s research push into the country. “It was a fantastic opportunity to start a new group in Australia for a company like Amazon.”

Typically, when academics transition to Amazon, they talk about the increase in pace from academia to industry. Van den Hengel bucks that trend.

“I was running a group with 140 people, trying to make enough money to pay them, keep the doors open, deliver on projects for tens of millions of dollars, doing PR, you name it,” he says. “Here, I've got about 25 world-class people with PhDs who work for me and 12 interns.”

Van den Hengel noted that Amazon is a results-focused environment. “At Amazon you are expected to deliver, but you do it with an engineering team and support systems all geared towards delivering customer benefit.”

So what is van den Hengel delivering on? A current project is applying visual inspection methods to help to make sure that Amazon customers get the best fresh produce possible.

I think the whole retail field is moving towards a better understanding of the nature of objects in the world and how humans relate to those objects, or products. And that's something that computer vision is particularly well-placed to deliver.
Anton van den Hengel

“Visual inspection is a magnificent challenge and a core problem in computer vision,” he says,” and addressing it means we can make sure that when a customer receives a delivery of, say, tomatoes, they are as perfect as can be.”

Another key project involves using computer vision and ML to understand in a deeper way the hundreds of millions of items in the ever-changing Amazon catalogue. The catalogue has a trove of information, both in the word-based product descriptions and the images supplied by sellers.

“Making the most of the information contained in these two sources of information – which is essentially what humans do – is an interesting challenge, because it relies on the relationships between visual signals and symbols,” he explains, adding that cracking this challenge will help customers who are using Amazon search find the product that best matches their need “even if they're not entirely sure how best to specify it themselves.”

Despite the considerable demands of managing a growing team, van den Hengel is determined to remain hands-on with his own research. “Amazon's an innovative company, and really, truly innovating in a way that's going to provide something of value to customers that nobody else can means that you need managers who deeply understand where the technology can go,” he says.

So where is the technology going?

“I think the whole retail field is moving towards a better understanding of the nature of objects in the world and how humans relate to those objects, or products,” he says. “And that's something that computer vision is particularly well-placed to deliver.”

Browse through the open science positions in Amazon's Australia offices.

Research areas

Related content

IN, TS, Hyderabad
Welcome to the Worldwide Returns & ReCommerce team (WWR&R) at Amazon.com. WWR&R is an agile, innovative organization dedicated to ‘making zero happen’ to benefit our customers, our company, and the environment. Our goal is to achieve the three zeroes: zero cost of returns, zero waste, and zero defects. We do this by developing products and driving truly innovative operational excellence to help customers keep what they buy, recover returned and damaged product value, keep thousands of tons of waste from landfills, and create the best customer returns experience in the world. We have an eye to the future – we create long-term value at Amazon by focusing not just on the bottom line, but on the planet. We are building the most sustainable re-use channel we can by driving multiple aspects of the Circular Economy for Amazon – Returns & ReCommerce. Amazon WWR&R is comprised of business, product, operational, program, software engineering and data teams that manage the life of a returned or damaged product from a customer to the warehouse and on to its next best use. Our work is broad and deep: we train machine learning models to automate routing and find signals to optimize re-use; we invent new channels to give products a second life; we develop highly respected product support to help customers love what they buy; we pilot smarter product evaluations; we work from the customer backward to find ways to make the return experience remarkably delightful and easy; and we do it all while scrutinizing our business with laser focus. You will help create everything from customer-facing and vendor-facing websites to the internal software and tools behind the reverse-logistics process. You can develop scalable, high-availability solutions to solve complex and broad business problems. We are a group that has fun at work while driving incredible customer, business, and environmental impact. We are backed by a strong leadership group dedicated to operational excellence that empowers a reasonable work-life balance. As an established, experienced team, we offer the scope and support needed for substantial career growth. Amazon is earth’s most customer-centric company and through WWR&R, the earth is our customer too. Come join us and innovate with the Amazon Worldwide Returns & ReCommerce team!
GB, MLN, Edinburgh
We’re looking for a Machine Learning Scientist in the Personalization team for our Edinburgh office experienced in generative AI and large models. You will be responsible for developing and disseminating customer-facing personalized recommendation models. This is a hands-on role with global impact working with a team of world-class engineers and scientists across the Edinburgh offices and wider organization. You will lead the design of machine learning models that scale to very large quantities of data, and serve high-scale low-latency recommendations to all customers worldwide. You will embody scientific rigor, designing and executing experiments to demonstrate the technical efficacy and business value of your methods. You will work alongside a science team to delight customers by aiding in recommendations relevancy, and raise the profile of Amazon as a global leader in machine learning and personalization. Successful candidates will have strong technical ability, focus on customers by applying a customer-first approach, excellent teamwork and communication skills, and a motivation to achieve results in a fast-paced environment. Our position offers exceptional opportunities for every candidate to grow their technical and non-technical skills. If you are selected, you have the opportunity to make a difference to our business by designing and building state of the art machine learning systems on big data, leveraging Amazon’s vast computing resources (AWS), working on exciting and challenging projects, and delivering meaningful results to customers world-wide. Key job responsibilities Develop machine learning algorithms for high-scale recommendations problems. Rapidly design, prototype and test many possible hypotheses in a high-ambiguity environment, making use of both quantitative analysis and business judgement. Collaborate with software engineers to integrate successful experimental results into large-scale, highly complex Amazon production systems capable of handling 100,000s of transactions per second at low latency. Report results in a manner which is both statistically rigorous and compellingly relevant, exemplifying good scientific practice in a business environment.
US, WA, Seattle
Amazon Advertising operates at the intersection of eCommerce and advertising, and is investing heavily in building a world-class advertising business. We are defining and delivering a collection of self-service performance advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long-term growth. We deliver billions of ad impressions and millions of clicks daily and are breaking fresh ground to create world-class products to improve both shopper and advertiser experience. With a broad mandate to experiment and innovate, we grow at an unprecedented rate with a seemingly endless range of new opportunities. The Ad Response Prediction team in Sponsored Products organization build advanced deep-learning models, large-scale machine-learning pipelines, and real-time serving infra to match shoppers’ intent to relevant ads on all devices, for all contexts and in all marketplaces. Through precise estimation of shoppers’ interaction with ads and their long-term value, we aim to drive optimal ads allocation and pricing, and help to deliver a relevant, engaging and delightful ads experience to Amazon shoppers. As the business and the complexity of various new initiatives we take continues to grow, we are looking for talented Applied Scientists to join the team. Key job responsibilities As a Applied Scientist II, you will: * Conduct hands-on data analysis, build large-scale machine-learning models and pipelines * Work closely with software engineers on detailed requirements, technical designs and implementation of end-to-end solutions in production * Run regular A/B experiments, gather data, perform statistical analysis, and communicate the impact to senior management * Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving * Provide technical leadership, research new machine learning approaches to drive continued scientific innovation * Be a member of the Amazon-wide Machine Learning Community, participating in internal and external MeetUps, Hackathons and Conferences
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video technologist, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! In Prime Video READI, our mission is to automate infrastructure scaling and operational readiness. We are growing a team specialized in time series modeling, forecasting, and release safety. This team will invent and develop algorithms for forecasting multi-dimensional related time series. The team will develop forecasts on key business dimensions with optimization recommendations related to performance and efficiency opportunities across our global software environment. As a founding member of the core team, you will apply your deep coding, modeling and statistical knowledge to concrete problems that have broad cross-organizational, global, and technology impact. Your work will focus on retrieving, cleansing and preparing large scale datasets, training and evaluating models and deploying them to production where we continuously monitor and evaluate. You will work on large engineering efforts that solve significantly complex problems facing global customers. You will be trusted to operate with complete independence and are often assigned to focus on areas where the business and/or architectural strategy has not yet been defined. You must be equally comfortable digging in to business requirements as you are drilling into design with development teams and developing production ready learning models. You consistently bring strong, data-driven business and technical judgment to decisions. You will work with internal and external stakeholders, cross-functional partners, and end-users around the world at all levels. Our team makes a big impact because nothing is more important to us than delivering for our customers, continually earning their trust, and thinking long term. You are empowered to bring new technologies to your solutions. If you crave a sense of ownership, this is the place to be.
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video team member, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! Key job responsibilities As an Applied Scientist in the Content Understanding Team, you will lead the end-to-end research and deployment of video and multi-modal models applied to a variety of downstream applications. More specifically, you will: - Work backwards from customer problems to research and design scientific approaches for solving them - Work closely with other scientists, engineers and product managers to expand the depth of our product insights with data, create a variety of experiments to determine the high impact projects to include in planning roadmaps - Stay up-to-date with advancements and the latest modeling techniques in the field - Publish your research findings in top conferences and journals About the team Our Prime Video Content Understanding team builds holistic media representations (e.g. descriptions of scenes, semantic embeddings) and apply them to new customer experiences supply chain problems. Our technology spans the entire Prime Video catalogue globally, and we enable instant recaps, skip intro timing, ad placement, search, and content moderation.
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video team member, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! Key job responsibilities As an Applied Scientist in the Content Understanding Team, you will lead the end-to-end research and deployment of video and multi-modal models applied to a variety of downstream applications. More specifically, you will: - Work backwards from customer problems to research and design scientific approaches for solving them - Work closely with other scientists, engineers and product managers to expand the depth of our product insights with data, create a variety of experiments to determine the high impact projects to include in planning roadmaps - Stay up-to-date with advancements and the latest modeling techniques in the field - Publish your research findings in top conferences and journals About the team Our Prime Video Content Understanding team builds holistic media representations (e.g. descriptions of scenes, semantic embeddings) and apply them to new customer experiences supply chain problems. Our technology spans the entire Prime Video catalogue globally, and we enable instant recaps, skip intro timing, ad placement, search, and content moderation.
US, WA, Seattle
Do you want to re-invent how millions of people consume video content on their TVs, Tablets and Alexa? We are building a free to watch streaming service called Fire TV Channels (https://techcrunch.com/2023/08/21/amazon-launches-fire-tv-channels-app-400-fast-channels/). Our goal is to provide customers with a delightful and personalized experience for consuming content across News, Sports, Cooking, Gaming, Entertainment, Lifestyle and more. You will work closely with engineering and product stakeholders to realize our ambitious product vision. You will get to work with Generative AI and other state of the art technologies to help build personalization and recommendation solutions from the ground up. You will be in the driver's seat to present customers with content they will love. Using Amazon’s large-scale computing resources, you will ask research questions about customer behavior, build state-of-the-art models to generate recommendations and run these models to enhance the customer experience. You will participate in the Amazon ML community and mentor Applied Scientists and Software Engineers with a strong interest in and knowledge of ML. Your work will directly benefit customers and you will measure the impact using scientific tools.
US, MA, Boston
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Applied Scientist with a strong deep learning background, to build industry-leading technology with Large Language Models (LLMs) and multi-modal systems. You will support projects that work on technologies including multi-modal model alignment, moderation systems and evaluation. Key job responsibilities As an Applied Scientist with the AGI team, you will support the development of novel algorithms and modeling techniques, to advance the state of the art with LLMs. Your work will directly impact our customers in the form of products and services that make use of speech and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in generative artificial intelligence (GenAI). You are also expected to publish in top tier conferences. About the team The AGI team has a mission to push the envelope in LLMs and multimodal systems. Specifically, we focus on model alignment with an aim to maintain safety while not denting utility, in order to provide the best-possible experience for our customers.
IN, HR, Gurugram
We're on a journey to build something new a green field project! Come join our team and build new discovery and shopping products that connect customers with their vehicle of choice. We're looking for a talented Senior Applied Scientist to join our team of product managers, designers, and engineers to design, and build innovative automotive-shopping experiences for our customers. This is a great opportunity for an experienced engineer to design and implement the technology for a new Amazon business. We are looking for a Applied Scientist to design, implement and deliver end-to-end solutions. We are seeking passionate, hands-on, experienced and seasoned Senior Applied Scientist who will be deep in code and algorithms; who are technically strong in building scalable computer vision machine learning systems across item understanding, pose estimation, class imbalanced classifiers, identification and segmentation.. You will drive ideas to products using paradigms such as deep learning, semi supervised learning and dynamic learning. As a Senior Applied Scientist, you will also help lead and mentor our team of applied scientists and engineers. You will take on complex customer problems, distill customer requirements, and then deliver solutions that either leverage existing academic and industrial research or utilize your own out-of-the-box but pragmatic thinking. In addition to coming up with novel solutions and prototypes, you will directly contribute to implementation while you lead. A successful candidate has excellent technical depth, scientific vision, project management skills, great communication skills, and a drive to achieve results in a unified team environment. You should enjoy the process of solving real-world problems that, quite frankly, haven’t been solved at scale anywhere before. Along the way, we guarantee you’ll get opportunities to be a bold disruptor, prolific innovator, and a reputed problem solver—someone who truly enables AI and robotics to significantly impact the lives of millions of consumers. Key job responsibilities Architect, design, and implement Machine Learning models for vision systems on robotic platforms Optimize, deploy, and support at scale ML models on the edge. Influence the team's strategy and contribute to long-term vision and roadmap. Work with stakeholders across , science, and operations teams to iterate on design and implementation. Maintain high standards by participating in reviews, designing for fault tolerance and operational excellence, and creating mechanisms for continuous improvement. Prototype and test concepts or features, both through simulation and emulators and with live robotic equipment Work directly with customers and partners to test prototypes and incorporate feedback Mentor other engineer team members. A day in the life - 6+ years of building machine learning models for retail application experience - PhD, or Master's degree and 6+ years of applied research experience - Experience programming in Java, C++, Python or related language - Experience with neural deep learning methods and machine learning - Demonstrated expertise in computer vision and machine learning techniques.
IN, HR, Gurugram
Our customers have immense faith in our ability to deliver packages timely and as expected. A well planned network seamlessly scales to handle millions of package movements a day. It has monitoring mechanisms that detect failures before they even happen (such as predicting network congestion, operations breakdown), and perform proactive corrective actions. When failures do happen, it has inbuilt redundancies to mitigate impact (such as determine other routes or service providers that can handle the extra load), and avoids relying on single points of failure (service provider, node, or arc). Finally, it is cost optimal, so that customers can be passed the benefit from an efficiently set up network. Amazon Shipping is hiring Applied Scientists to help improve our ability to plan and execute package movements. As an Applied Scientist in Amazon Shipping, you will work on multiple challenging machine learning problems spread across a wide spectrum of business problems. You will build ML models to help our transportation cost auditing platforms effectively audit off-manifest (discrepancies between planned and actual shipping cost). You will build models to improve the quality of financial and planning data by accurately predicting ship cost at a package level. Your models will help forecast the packages required to be pick from shipper warehouses to reduce First Mile shipping cost. Using signals from within the transportation network (such as network load, and velocity of movements derived from package scan events) and outside (such as weather signals), you will build models that predict delivery delay for every package. These models will help improve buyer experience by triggering early corrective actions, and generating proactive customer notifications. Your role will require you to demonstrate Think Big and Invent and Simplify, by refining and translating Transportation domain-related business problems into one or more Machine Learning problems. You will use techniques from a wide array of machine learning paradigms, such as supervised, unsupervised, semi-supervised and reinforcement learning. Your model choices will include, but not be limited to, linear/logistic models, tree based models, deep learning models, ensemble models, and Q-learning models. You will use techniques such as LIME and SHAP to make your models interpretable for your customers. You will employ a family of reusable modelling solutions to ensure that your ML solution scales across multiple regions (such as North America, Europe, Asia) and package movement types (such as small parcel movements and truck movements). You will partner with Applied Scientists and Research Scientists from other teams in US and India working on related business domains. Your models are expected to be of production quality, and will be directly used in production services. You will work as part of a diverse data science and engineering team comprising of other Applied Scientists, Software Development Engineers and Business Intelligence Engineers. You will participate in the Amazon ML community by authoring scientific papers and submitting them to Machine Learning conferences. You will mentor Applied Scientists and Software Development Engineers having a strong interest in ML. You will also be called upon to provide ML consultation outside your team for other problem statements. If you are excited by this charter, come join us!