Amazon Advertising call for proposals — summer 2021

Breakthroughs in online advertising

About this CFP

Amazon Advertising helps grow businesses and brands of all sizes. Its scientists apply machine learning, optimization, causal modeling, and game theory at scale to enhance the shopper experience, help advertisers reach relevant audiences, and support brand building.

Amazon Advertising logo

This mission includes (1) measuring the audience journey and helping brands move the needle on them, (2) achieving synergy among actions to reach the right audience at the right time, (3) leveraging online assets through machine learning, and (4) enabling advertisers.

We welcome proposals related to these themes and offer the following examples of research questions within each theme.

Theme 1: Funnel metrics and how marketing can move the needle

Examples of research questions include:

  • What is an appropriate conceptual blueprint of how advertising products across the purchase funnel work together?
  • How do advertisers evaluate currently upper- and mid-funnel efforts and how can these measures be improved?
  • For jumpstarting growth (cold start) versus sustained growth, to what extent should advertisers focus on upper-funnel, mid-funnel or lower-funnel metrics? What does it take to grow at an unusually high rate?
  • How do proposed funnel metrics react to marketing and convert into sales?
  • How can single-item metrics (such as searches or detail page views) be weighted and optimized for the advertiser usefulness criteria of sales conversion, marketing responsiveness, stickiness and potential (see Hanssens et al. Marketing Science 2004)?

Theme 2: Modeling cross-channel effects of online advertising on consumer behaviors

Examples of research questions include:

  • Understanding the effect of online advertising on the customer journey and particularly the upper funnel part of the customer journey.
  • What is the reach of upper-funnel ads in online retail, and how does this compare to a brand’s offline, paid search, and social media advertising reach?
  • What are the long-term effects of online advertising?
  • Does online advertising show synergy with other marketing activity (such as social media, TV ads, out-of-home) and what are the implications for optimal marketing budget and allocation?
  • How does this synergy change when the category is changing rapidly or the brand has a new product launch? How can this inspire agile marketing?

Theme 3: Deep learning applications for online assets

Examples of research questions include:

  • Understanding and leveraging the interplay between online reviews, influencers, and online advertising.
  • Leveraging machine learning to understand how online shoppers react to marketing stimuli.
  • Leveraging machine learning to help advertisers reach audiences more effectively.
  • Metrics and methods for designing, piloting, and evaluating systems that mitigate against adverse biases, including the use of human-machine collaboration and decision support.
  • Deep learning applications to music technology.
  • How does online retail experimentation help advertisers get the most out of online assets?

Theme 4: Helping advertisers take action based on online assets

Examples of research questions include:

  • How can a model learn about specific advertisers’ objectives based on their online actions?
  • How does giving advertisers specific recommendations on ad products increase their performance? How does this vary by advertiser?
  • How does giving broader education to advertisers on ad products increase advertiser performance?
  • Do advertisers prefer automated (self-serve) or guided interpretation of their performance? How does this vary by advertiser and type of analytics/insight?

Timeline

The submission period has closed and proposals are being reviewed.
Decision letters will be sent out September 2021.

Award details

Selected principal investigators (PIs) may receive the following:

  • Unrestricted funds, no more than $80,000 USD on average
  • AWS Promotional Credits, no more than $20,000 USD on average
  • Training resources, including AWS tutorials and hands-on sessions with Amazon scientists and engineers

Awards are structured as one-year unrestricted gifts. The budget should include a list of expected costs specified in USD, and should not include administrative overhead costs. The final award amount will be determined by the awards panel.

Eligibility requirements

Please refer to the ARA Program rules on the FAQ page.

Proposal requirements

Proposals should be prepared according to the proposal template. In addition, to submit a proposal for this CFP, please also include the following information:

  1. Please list the open-source tools you plan to contribute to.
  2. Please list the AWS ML tools you plan to use and data you plan to obtain.

Selection criteria

ARA will make the funding decisions based on the potential impact to the research community, quality of the scientific content, and relevance for Amazon Advertising customers.

Expectations from recipients

To the extent deemed reasonable, Award recipients should acknowledge the support from ARA. Award recipients will inform ARA of publications, presentations, code and data releases, blogs/social media posts, and other speaking engagements referencing the results of the supported research or the Award. Award recipients are expected to provide updates and feedback to ARA via surveys or reports on the status of their research. Award recipients will have an opportunity to work with ARA on an informational statement about the awarded project that may be used to generate visibility for their institutions and ARA.

Related content

IN, KA, Bangalore
Are you passionate about transforming the digital reading and publishing landscape? Team is at the forefront of revolutionizing the publishing and reading experience for millions worldwide. We are seeking innovative Applied Scientists to join us at the forefront of the digital transformation in the publishing industry. Our team is dedicated to enhancing the book publishing and reading experience using cutting-edge AI technology. We strive to streamline the publishing lifecycle, improve digital reading, and empower book publishers through innovative AI tools and solutions to grow their business on Amazon. We are building a holistic team focused on leveraging advances in AI to improve the Reading experience for Kindle customers, and the Publishing experience for book content creators and distributors; and this role is specifically for an Applied Scientist who will focus on making publishers lives easier through AI. We are building a Publishing & Reading Science team and looking for Scientists, who are passionate about Reading and are willing to take Reading to the next level. Every Book is a complex structure with different entities, layout, format and semantics, with more than 17MM eBooks in our catalog across different publishers. We are looking for experts in all domains like core NLP, Generative AI, CV and Deep Learning Techniques for unlocking capabilities like analysis, enhancement, curation, moderation, translation, transformation and generation in Books based on Content structure, features, Intent, Synthesis and publisher details. Scientists will focus on Inside the book content and semantically learn the different entities to enhance the Reading and publishing experience overall (Kindle & beyond). They have an opportunity to influence in 3 major phases of life-cycle - Publishing (Creation of Books process), Reading experience (building engaging features & representation in the book thereby driving reading engagement) and Reporting (improvement through their sales & business growth). Key job responsibilities - Inspect AI initiatives across Amazon to identify how these can be applied and scaled to book publishers or publishing workflows. - Participate in team design, scoping and prioritization discussions. You must be able to map a business goal to a scientific problem, and map business metrics to technical metrics. - Spearhead the design and implementation of new features and algorithms based on thorough research and collaboration with cross-functional teams. - You have expertise in one of the applied science disciplines, such as machine learning, natural language processing, computer vision, Deep learning - You are able to use reasonable assumptions, data, and customer requirements to solve problems. - You initiate the design, development, execution, and implementation of smaller components with input and guidance from team members. - You work with SDEs to deliver solutions into production to benefit customers or an area of the business. - You assume responsibility for the code in your components. You write secure, stable, testable, maintainable code with minimal defects. - You understand basic data structures, algorithms, model evaluation techniques, performance, and optimality tradeoffs. - You follow engineering and scientific method best practices. You get your designs, models, and code reviewed. You test your code and models thoroughly - You participate in team design, scoping and prioritization discussions. You are able to map a business goal to a scientific problem and map business metrics to technical metrics. - You invent, refine and develop your solutions to ensure they are meeting customer needs and team goals. You keep current with research trends in your area of expertise and scrutinize your results. - Experience in mentoring junior scientists A day in the life You will be working with a group of talented scientists on researching algorithm and running experiments to test solutions to improve our experience. This will involve collaboration with partner teams including engineering, PMs, data annotators, and other scientists to discuss data quality, model development and productionizing the same. You will mentor other scientists, review and guide their work, help develop roadmaps for the team.
US, WA, Seattle
Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products and solutions are strategically important to enable our Retail and Marketplace businesses to drive long-term growth. We deliver billions of ad impressions and millions of clicks and break fresh ground in product and technical innovations every day! As an Applied Science Manager in Machine Learning, you will: - Directly manage and lead a cross-functional team of Applied Scientists, Data Scientists, Economists, and Business Intelligence Engineers. - Develop and manage a research agenda that balances short term deliverables with measurable business impact as well as long term investments. - Lead marketplace design and development based on economic theory and data analysis. - Provide technical and scientific guidance to team members. - Rapidly design, prototype and test many possible hypotheses in a high-ambiguity environment, making use of both quantitative and business judgment - Advance the team's engineering craftsmanship and drive continued scientific innovation as a thought leader and practitioner. - Develop science and engineering roadmaps, run annual planning, and foster cross-team collaboration to execute complex projects. - Perform hands-on data analysis, build machine-learning models, run regular A/B tests, and communicate the impact to senior management. - Collaborate with business and software teams across Amazon Ads. - Stay up to date with recent scientific publications relevant to the team. - Hire and develop top talent, provide technical and career development guidance to scientists and engineers within and across the organization. Why you will love this opportunity: Amazon is investing heavily in building a world-class advertising business. This team defines and delivers a collection of advertising products that drive discovery and sales. Our solutions generate billions in revenue and drive long-term growth for Amazon’s Retail and Marketplace businesses. We deliver billions of ad impressions, millions of clicks daily, and break fresh ground to create world-class products. We are a highly motivated, collaborative, and fun-loving team with an entrepreneurial spirit - with a broad mandate to experiment and innovate. Impact and Career Growth: You will invent new experiences and influence customer-facing shopping experiences to help suppliers grow their retail business and the auction dynamics that leverage native advertising; this is your opportunity to work within the fastest-growing businesses across all of Amazon! Define a long-term science vision for our advertising business, driven from our customers' needs, translating that direction into specific plans for research and applied scientists, as well as engineering and product teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding. Team video ~ https://youtu.be/zD_6Lzw8raE
US, WA, Seattle
The Private Brands Discovery team designs innovative machine learning solutions to drive customer awareness for Amazon’s own brands and help customers discover products they love. Private Brands Discovery is an interdisciplinary team of Scientists and Engineers, who incubate and build disruptive solutions using cutting-edge technology to solve some of the toughest science problems at Amazon. To this end, the team employs methods from Natural Language Processing, Deep learning, multi-armed bandits and reinforcement learning, Bayesian Optimization, causal and statistical inference, and econometrics to drive discovery across the customer journey. Our solutions are crucial for the success of Amazon’s own brands and serve as a beacon for discovery solutions across Amazon. This is a high visibility opportunity for someone who wants to have business impact, dive deep into large-scale problems, enable measurable actions on the consumer economy, and work closely with scientists and engineers. As a scientist, you bring business and industry context to science and technology decisions. You set the standard for scientific excellence and make decisions that affect the way we build and integrate algorithms. Your solutions are exemplary in terms of algorithm design, clarity, model structure, efficiency, and extensibility. You tackle intrinsically hard problems, acquiring expertise as needed. You decompose complex problems into straightforward solutions.. With a focus on bias for action, this individual will be able to work equally well with Science, Engineering, Economics and business teams. Key job responsibilities - Drive applied science projects in machine learning end-to-end: from ideation over prototyping to launch. For example, starting from deep scientific thinking about new ways to support customers’ journeys through discovery, you analyze how customers discover, review and purchase Private Brands to innovate marketing and merchandising strategies. - Propose viable ideas to advance models and algorithms, with supporting argument, experiment, and eventually preliminary results. - Invent ways to overcome technical limitations and enable new forms of analyses to drive key technical and business decisions. - Present results, reports, and data insights to both technical and business leadership. - Constructively critique peer research and mentor junior scientists and engineers. - Innovate and contribute to Amazon’s science community and external research communities.
US, WA, Seattle
The Private Brands Discovery team designs innovative machine learning solutions to drive customer awareness for Amazon’s own brands and help customers discover products they love. Private Brands Discovery is an interdisciplinary team of Scientists and Engineers, who incubate and build disruptive solutions using cutting-edge technology to solve some of the toughest science problems at Amazon. To this end, the team employs methods from Natural Language Processing, Deep learning, multi-armed bandits and reinforcement learning, Bayesian Optimization, causal and statistical inference, and econometrics to drive discovery across the customer journey. Our solutions are crucial for the success of Amazon’s own brands and serve as a beacon for discovery solutions across Amazon. This is a high visibility opportunity for someone who wants to have business impact, dive deep into large-scale problems, enable measurable actions on the consumer economy, and work closely with scientists and engineers. As a scientist, you bring business and industry context to science and technology decisions. You set the standard for scientific excellence and make decisions that affect the way we build and integrate algorithms. Your solutions are exemplary in terms of algorithm design, clarity, model structure, efficiency, and extensibility. You tackle intrinsically hard problems, acquiring expertise as needed. You decompose complex problems into straightforward solutions.. With a focus on bias for action, this individual will be able to work equally well with Science, Engineering, Economics and business teams. Key job responsibilities - Drive applied science projects in machine learning end-to-end: from ideation over prototyping to launch. For example, starting from deep scientific thinking about new ways to support customers’ journeys through discovery, you analyze how customers discover, review and purchase Private Brands to innovate marketing and merchandising strategies. - Propose viable ideas to advance models and algorithms, with supporting argument, experiment, and eventually preliminary results. - Invent ways to overcome technical limitations and enable new forms of analyses to drive key technical and business decisions. - Present results, reports, and data insights to both technical and business leadership. - Constructively critique peer research and mentor junior scientists and engineers. - Innovate and contribute to Amazon’s science community and external research communities.
US, CA, Santa Clara
AWS AI/ML is looking for world class scientists and engineers to join its AI Research and Education group working on foundation models, large-scale representation learning, and distributed learning methods and systems. At AWS AI/ML you will invent, implement, and deploy state of the art machine learning algorithms and systems. You will build prototypes and innovate on new representation learning solutions. You will interact closely with our customers and with the academic and research communities. You will be at the heart of a growing and exciting focus area for AWS and work with other acclaimed engineers and world famous scientists. Large-scale foundation models have been the powerhouse in many of the recent advancements in computer vision, natural language processing, automatic speech recognition, recommendation systems, and time series modeling. Developing such models requires not only skillful modeling in individual modalities, but also understanding of how to synergistically combine them, and how to scale the modeling methods to learn with huge models and on large datasets. Join us to work as an integral part of a team that has diverse experiences in this space. We actively work on these areas: * Hardware-informed efficient model architecture, training objective and curriculum design * Distributed training, accelerated optimization methods * Continual learning, multi-task/meta learning * Reasoning, interactive learning, reinforcement learning * Robustness, privacy, model watermarking * Model compression, distillation, pruning, sparsification, quantization About Us Inclusive Team Culture Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Work/Life Balance Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives. Mentorship & Career Growth Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.
DE, BE, Berlin
Are you fascinated by revolutionizing Alexa user-experience with LLM? The Artificial General Intelligence (AGI) team is looking for an Applied Scientist with background in Large Language Model, Natural Language Process, Machine/Deep learning. You will be at the heart of the Alexa LLM transition working with a team of applied and research scientists to enhance existing features and explore new possibilities with LLM. You will interact in a cross-functional capacity with science, product and engineering leaders. Key job responsibilities * Work on core LLM technologies (supervised fine tuning, prompt optimization, etc.) to enable Alexa use cases * Research and develop novel metrics and algorithms for LLM evaluation * Communicating effectively with leadership team as well as with colleagues from science, engineering and business backgrounds.
US, WA, Seattle
Do you want to join an innovative team of scientists who use deep learning, natural language processing, large language models to help Amazon provide the best seller experience across the entire Seller life cycle, including recruitment, growth, support and provide the best customer and seller experience by automatically mitigating risk? Do you want to build advanced algorithmic systems that help manage the trust and safety of millions of customer interactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Are you excited by the opportunity to leverage GenAI and innovate on top of the state-of-the-art large language models to improve customer and seller experience? Do you like to build end-to-end business solutions and directly impact the profitability of the company? Do you like to innovate and simplify processes? If yes, then you may be a great fit to join the Machine Learning Accelerator team in the Amazon Selling Partner Services (SPS) group. Key job responsibilities The scope of an Applied Scientist II in the SPS Machine Learning Accelerator (MLA) team is to research and prototype Machine Learning applications that solve strategic business problems across SPS domains. Additionally, the scientist collaborates with project leaders, engineers and business partners to design and implement solutions at scale. The scientist focuses on components of large-scale projects, systems and products and can work independently and with the team to deliver successful solutions with medium to large business impact. The scientist helps our team evolve by actively participating in discussions, team planning, and by staying current on the latest techniques arising from both the scientist community in SPS, the larger Amazon-wide community, and beyond. The scientist develops and introduces tools and practices that streamline the work of the team, and he mentors junior team members and participates in hiring.
US, CA, Palo Alto
Amazon is investing heavily in building a world class advertising business and developing a collection of self-service performance advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses for driving long-term growth. We deliver billions of ad impressions and millions of clicks daily and are breaking fresh ground to create world-class products. We are highly motivated, collaborative and fun-loving with an entrepreneurial spirit and bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities. We are seeking a technical lead for our Supply Science team. This team is within the Sponsored Product team, and works on complex engineering, optimization, econometric, and user-experience problems in order to deliver relevant product ads on Amazon search and detail pages world-wide. The team operates with the dual objective of enhancing the experience of Amazon shoppers and enabling the monetization of our online and mobile page properties. Our work spans ML and Data science across predictive modeling, reinforcement learning (Bandits), adaptive experimentation, causal inference, data engineering. Key job responsibilities Search Supply and Experiences, within Sponsored Products, is seeking an Applied Scientist to join a fast growing team with the mandate of creating new ads experience that elevates the shopping experience for our hundreds of millions customers worldwide. We are looking for a top analytical mind capable of understanding our complex ecosystem of advertisers participating in a pay-per-click model– and leveraging this knowledge to help turn the flywheel of the business. As an Applied Scientist on this team you will: --Act as the technical leader in Machine Learning and drive full life-cycle Machine Learning projects. --Lead technical efforts within this team and across other teams. --Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production. --Run A/B experiments, gather data, and perform statistical analysis. --Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving. --Work closely with software engineers to assist in productionizing your ML models. --Research new machine learning approaches. --Recruit Applied Scientists to the team and act as a mentor to other junior scientists on the team. A day in the life The successful candidate will be a self-starter comfortable with ambiguity, with strong attention to detail, and with an ability to work in a fast-paced, high-energy and ever-changing environment. The drive and capability to shape the direction is a must. About the team We are a customer-obsessed team of engineers, technologists, product leaders, and scientists. We are focused on continuous exploration of contexts and creatives where advertising delivers value to customers and advertisers. We specifically work on new ads experiences globally with the goal of helping shoppers make the most informed purchase decision. We obsess about our customers and we are continuously innovating on their behalf to enrich their shopping experience on Amazon
US, WA, Bellevue
We are a part of Amazon Artificial General Intelligence (AGI) organization where our mission is “delight customers through contextual and personalized proactive experiences that keep customers informed, engaged, and productive without cognitive burden”. We are developing advanced systems to deliver engaging, intuitive, and adaptive content recommendations across all Amazon surfaces. We aim to facilitate seamless reasoning and customer experiences, surpassing the capabilities of previous machine learning models. We are looking for a passionate, talented, and resourceful Senior Applied Scientist in the field of Natural Language Processing (NLP), Large Language Model (LLM), Recommender Systems and/or Information Retrieval, to invent and build scalable solutions for a state-of-the-art context-aware personal assistant. A successful candidate will have strong machine learning background and a desire to push the envelope in one or more of the above areas. The ideal candidate would also enjoy operating in dynamic environments, be self-motivated to take on challenging problems to deliver big customer impact, shipping solutions via rapid experimentation and then iterating on user feedback and interactions. Key job responsibilities As a Senior Applied Scientist, you will leverage your technical expertise and experience to demonstrate leadership in tackling large complex problems, setting the direction and collaborating with applied scientists and engineers to develop novel algorithms and modeling techniques to enable timely, relevant and delightful recommendations and conversations. Your work will directly impact our customers in the form of products and services that make use of various machine learing, deep learning and language model technologies. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in the state of art.
US, WA, Bellevue
We are a part of Amazon Alexa Devices organization with the mission “delight customers through contextual and personalized proactive experiences that keep customers informed, engaged, and productive without cognitive burden”. We are developing an advanced system using Large Language Model (LLM) technologies to deliver engaging, intuitive, and adaptive content recommendations across all Amazon surfaces. We aim to facilitate seamless reasoning and customer experiences, surpassing the capabilities of previous machine learning models. We are looking for a passionate, talented, and resourceful Applied Scientist in the field of Natural Language Processing (NLP), Recommender Systems and/or Information Retrieval, to invent and build scalable solutions for a state-of-the-art context-aware speech assistant. A successful candidate will have strong machine learning background and a desire to push the envelope in one or more of the above areas. The ideal candidate would also enjoy operating in dynamic environments, be self-motivated to take on challenging problems to deliver big customer impact, shipping solutions via rapid experimentation and then iterating on user feedback and interactions. Key job responsibilities As an Applied Scientist on the team, you will collaborate with other applied scientists and engineers to develop novel algorithms to enable timely, relevant and delightful recommendations and conversations. Your work will directly impact our customers in the form of products and services that make use of various machine learning, deep learning and language model technologies. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in the state of art.
Amazon Research Awards.jpg

Amazon Research Awards

Collaborating with scientists around the world to fund research, share knowledge and encourage innovation.