Economics.svg
Research Area

Economics

Developing sophisticated approaches and systems to deliver the broadest selection of products and services at the lowest prices.

Recent publications

View All View All
  • Shinpei Nakamura-Sakai, Yuhe Gao, Chi-Hui Yen, Christoph Scheidiger, Jasjeet Sekhon
    AAAI 2025 Workshop on AI for Social Impact
    2025
    To the best of our knowledge, this work introduces the first framework for clustering longitudinal data by leveraging time-dependent causal representation learning. Clustering longitudinal data has gained significant attention across various fields, yet traditional methods often overlook the causal structures underlying observed patterns. Understanding how covariates influence outcomes is critical for policymakers
  • Yao Zhao, Kwang-Sung Jun, Tanner Fiez, Lalit Jain
    2023 Conference on Digital Experimentation @ MIT (CODE@MIT), NeurIPS 2024
    2024
    This paper introduces the confounded pure exploration transductive linear bandit (CPET-LB) problem. As a motivating example, often online services cannot directly assign users to specific control or treatment experiences either for business or practical reasons. In these settings, naively comparing treatment and control groups that may result from self-selection can lead to biased estimates of underlying
  • Paula Meloni, Stefan Hut, Mahnaz Islam
    2024 Conference on Digital Experimentation @ MIT (CODE@MIT)
    2024
    There are different reasons why experimenters may want to randomize their experiment at a region level. In some cases, treatments cannot be turned on or off at the individual level, therefore requiring randomization at a group level, for which regions can be a good candidate. In other cases, experimenters may worry about network effects or other types of spillovers within a geographic area, and opt to randomize
  • 2024 Conference on Digital Experimentation @ MIT (CODE@MIT)
    2024
    Online sites typically evaluate the impact of new product features on customer behavior using online controlled experiments (or A/B tests). For many business applications, it is important to detect heterogeneity in these experiments [1], as new features often have a differential impact by customer segment, product group, and other variables. Understanding heterogeneity can provide key insights into causal
  • 2024 Conference on Digital Experimentation @ MIT (CODE@MIT)
    2024
    Many data-driven companies measure the impact of product groups and allocate resources across them based 2 on the estimated impacts of features they launch via A/B tests. In this doc, we show that, when based on a standard 3 frequentist estimator of the impact of features, this practice can significantly overstate the impact of product groups and 4 distort the allocation of resources. When this practice

Related content

US, WA, Seattle
The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal. We are looking for an economist with expertise in applying causal inference methods, especially experimental design to topics in labor, personnel, education, or behavioral economics. We are particularly interested in candidates with experience applying these skills to strategic problems with significant business and/or social policy impact. The candidate will work with economists and engineers to estimate and validate their models on large scale data, and will help business partners turn the results of their analysis into policies, programs, and actions that have a major impact on Amazon’s business and its workforce. We are looking for a creative thinker who can combine a strong economic toolbox with a desire to learn from others, and who knows how to execute and deliver on big ideas. Ideal candidates will own key inputs to all stages of research projects, including model development, survey administration, experimental design, and data analysis. They will be customer-centric, working closely with business partners to define key research questions, communicate scientific approaches and findings, listen to and incorporate partner feedback, and deliver successful solutions.
US, NY, New York
We are hiring a manager for a cross-functional team that builds ML-based products to help AWS sellers understand customers and optimize sales strategies. This manager will be an important member of the AWS Central Economics and Science team and help set the science and product direction for their team and, by extension, a large part of the org due to within-org collaboration. Specifically, we’re looking for someone to help define a growth- and business-focused vision for the team. An ideal candidate will think big and understands how to use science to drive measurable incremental business impact by taking insights all the way through to actions that manifest in the real economy. This will be a great opportunity to utilize both causal/econ and ML chops. Someone who has worked on embedded teams or on central science teams with policy implementation involvement is ideal. This role lends itself to increased scope and career growth over time. Key job responsibilities This role with interface directly with product owners, scientists/economists, and leadership to create multi-year research and product agendas that drive step change growth for the business. The role will also be an important collaborator with other science teams at AWS. A day in the life Our team takes big swings and works on hard cross organizational problems where the optimal success rate is not 100%. We also ask people to grow their skills and stretch and make sure we do it in a supportive and fun environment. It’s about empirically measured impact, advancement, and fun on our team. We work hard during work hours but we also don’t encourage working at nights or on weekends except in very rare, high stakes cases. Burn out isn’t a successful long run strategy. Because we invest in the long run success of our group it’s important to have hobbies, relax and then come to work refreshed and excited. It makes for bigger impact, faster skill accrual and thus career advancement. About the team Our group is technically rigorous and encourages ongoing academic conference participation and publication. Our leaders are here for you and to enable you to be successful. We believe in being servant leaders focused on influence: good data work has little value if it doesn’t translate into actionable insights that are rolled out and impact the real economy. We are communication centric since being able to explain what we do ensures high success rates and lowers administrative churn. Also: we laugh a lot. If it’s not fun, what’s the point?
US, WA, Seattle
Amazon's Devices Economic Value team enables measurement and optimization of Amazon Devices long-term value to help Amazon build better products for their customers. Delivering lasting value to customers is in Amazon's DNA and we are at the core of how the Devices business prioritizes its investments in innovation and optimization on behalf of customers. Join us to be a part of the team that is at the core of understanding how Amazon Devices drive deeper customer engagement and helps the business make decisions about how to optimize and balance between short term monetization and long term value creation for Amazon Device users. We are seeking a skilled Senior Economist to build the future of long term value measurement and optimization for Amazon Devices. Key job responsibilities We are looking for a talented Senior Economist to drive the science evolution within the Devices Economic Value space (DEV). The Senior Economist will be responsible for evolving the DEV paradigm towards driving direct business value via actionable business levers and influencing the Devices org business strategy through a better understanding of the DEV drivers. They will be responsible for science solutions to better align DEV product and engineering systems towards direct value generation through production systems. We expect the Senior Economist to drive Economic Value innovation, leveraging current advances in causal inference and machine learning. About the team DEV Science team’s mission is to drive measurement and optimization of long term economic value of the devices business that balances short term and long term tradeoffs across product lifecycle, and drive clear value for Amazon shoppers. We leverage science advancements across causal inference, structural modeling and machine learning, to solve challenging business problems in Amazon Devices. The team spans scientists across a wide range of seniority, tenure and specialization, including economists, data and applied scientists, with dedicated product and engineering partners.
US, VA, Arlington
The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal. We are looking for an economist with expertise in applying causal inference methods, especially experimental design to topics in labor, personnel, education, or behavioral economics. We are particularly interested in candidates with experience applying these skills to strategic problems with significant business and/or social policy impact. The candidate will work with economists and engineers to estimate and validate their models on large scale data, and will help business partners turn the results of their analysis into policies, programs, and actions that have a major impact on Amazon’s business and its workforce. We are looking for a creative thinker who can combine a strong economic toolbox with a desire to learn from others, and who knows how to execute and deliver on big ideas. Ideal candidates will own key inputs to all stages of research projects, including model development, survey administration, experimental design, and data analysis. They will be customer-centric, working closely with business partners to define key research questions, communicate scientific approaches and findings, listen to and incorporate partner feedback, and deliver successful solutions.
US, WA, Seattle
Amazon’s Customer Behavior Analytics org is looking for an Economist to spearhead the rapid growth of our Marketing Measurement solutions. The team focuses on building scalable ML and causal inference solutions to estimate the effectiveness of Amazon marketing efforts and provide actionable insights to the various marketing teams within Amazon. We work closely with business stakeholders and strive to continuously produce tangible impact on the company’s strategic and tactical planning and operations. A successful candidate will be a self-starter, comfortable with ambiguity, able to think big and be creative, while still paying careful attention to detail. You will apply your econometrics expertise to identify opportunities for further research and to provide insights that drive larger initiatives. You should be able to translate how data represents the customer journey, be comfortable dealing with large and complex data sets, and have experience using machine/deep learning at scale to solve business problems. You should have strong analytical and communication skills, be able to work with product managers and software teams to define key business questions and work with the analytics team to solve them. You will join a highly collaborative and diverse working environment that will empower you to shape the future of Amazon marketing, as well allow you to be part of the large science community within the Customer Behavior Analytics (CBA) organization. Key job responsibilities The main responsibilities for this position include: - Apply your expertise in causal modeling and ML to develop systems that describe how Amazon’s marketing campaigns impact customers’ actions - Own the end-to-end development of novel causal inference models that address the most pressing needs of our business stakeholders and help guide their future actions - Improve upon and simplify our existing solutions and frameworks - Review and audit modeling processes and results from other economists/scientists, both junior and senior - Work with marketing leadership to align our measurement plan with business strategy - Formalize assumptions about how our models are expected to behave and explain why they are reasonable - Identify new opportunities that are suggested by the data insights - Bring a department-wide perspective into decision making - Develop and document scientific research to be shared with the greater science community at Amazon About the team The Customer Behavior Analytics (CBA) organization owns Amazon’s insights pipeline, from data collection to deep analytics. We aspire to be the place where Amazon teams come for answers, a trusted source for data and insights that empower our systems and business leaders to make better decisions. Our outputs shape Amazon product and marketing teams’ decisions and thus how Amazon customers see, use, and value their experience.
US, WA, Seattle
We are hiring a Senior Economist with the ability to disambiguate very challenging structural problems in two and multi-sided markets. The right hire will be able to dive deep into the data to come up with stylized facts, build reduced form models that motivate structural assumptions, and build to more complex structural models. The main use case will be understanding how the incremental effects of subsidies to a two sided market relate to sales motions characterized by principal agent problems. Key job responsibilities This role with interface directly with product owners, scientists/economists, and leadership to create multi-year research agendas that drive step change growth for the business. This role is important for the development of the strategic direction of the AWS Central Economics and Science team. The role will also be an important collaborator with other science teams at AWS. A day in the life Our team takes big swings and works on hard cross organizational problems where the optimal success rate is not 100%. We also ask people to grow their skills and stretch and make sure we do it in a supportive and fun environment. It’s about empirically measured impact, advancement, and fun on our team. We work hard during work hours but we also don’t encourage working at nights or on weekends except in very rare, high stakes cases. Burn out isn’t a successful long run strategy. Because we invest in the long run success of our group it’s important to have hobbies, relax and then come to work refreshed, and excited. It makes for bigger impact and faster skill accrual and thus career advancement. About the team Our group is technically rigorous and encourages ongoing academic conference participation and publication. Our leaders are here for you and to enable you to be successful. We believe in being servant leaders focused on influence: good data work has little value if it doesn’t translate into actionable insights that are rolled out and impact the real economy. We are communication centric since being able to explain what we do ensures high success rates and lowers administrative churn. Also: we laugh a lot. If it’s not fun, what’s the point?
US, WA, Seattle
We are working back from a mission of explaining and predicting one of the most important inputs to the Amazon business - customer visit data. We are working to model and test our assumptions about what are the customer incentives and what influences customers to chose visiting Amazon. Ultimately we want to understand and predict how many of our customers will interact with Amazon and we want to identify insights that optimize the customer experience. This is a green-field role in an analytics team of economists, science, business intelligence and data engineering bridging between observational measurement and theoretical models. About the team You will be empowered by a large team of experienced software and data engineers that are aligned on the same mission - to measure and explain our customer experience. We lean into the exceptionally talented Economist and Science community in CBA and Stores for consultation, guidance and peer reviews. Our large analytics team is empowered to move fast and gather the data we need to achieve our mission. Our parent organization owns end-to-end data collection systems (Clickstream), experimentation (Weblab) and customer value forecasting (GCCP). We are working across organizational boundaries to identify relevant datasets and are able to curate the vast amount of data we have into meaningful business reporting and analysis.
US, WA, Seattle
Amazon's Global XCM organization (Cross-Category, Cross-Channel Marketing) is looking for a talented Tech Lead Senior Economist who is interested in solving one of the most challenging business problems in marketing measurement and optimization, and developing cutting-edge ML model. Working with our team of data scientists, applied scientists, research scientists, and economists, this leader will help redefine scalable marketing measurement and optimization. XCM’s mission is to be the most culturally and contextually aware, creatively breakthrough, and measurably effective marketing organization in the world. In this role, you will be a technical leader in Econometric research with significant scope, impact, and high visibility. You will lead strategic measurement and optimization science initiatives in collaboration with external science teams, and development and deployment of measurement and real-time predictive and optimization science models. As a successful Economist, you are an analytical problem solver who enjoys diving into data, leads problem solving, guides development of new frameworks, writes code, is excited about investigations and algorithms, and can credibly interface between technical teams and business stakeholders. You are an expert in causal inference models to solve business problems. You are a hands-on innovator who can contribute to advancing Marketing measurement technology and push the limits on what’s scientifically possible with a razor sharp focus on measurable customer and business impact. You will also coach and guide junior scientists in the team to grow the team’s talent and scale the impact of your work. Key job responsibilities - Design and implement production-ready causal machine learning models to solve complex measurement and optimization challenges - Partner with cross-functional science teams to drive innovative high-impact initiatives - Collaborate with key stakeholders to develop strategic roadmaps and ensure successful project execution - Mentor junior scientists and establish technical best practices for the team
US, WA, Seattle
Amazon's Global XCM organization (Cross-Category, Cross-Channel Marketing) is looking for a talented Economist who is interested in solving one of the most challenging business problems in marketing measurement and optimization, and developing cutting-edge ML model. XCM’s mission is to be the most culturally and contextually aware, creatively breakthrough, and measurably effective marketing organization in the world. In this role, you will pioneer real-time marketing measurement and optimization solutions by combining causal inference with advanced ML models. You'll leverage Amazon's customer behavior data and external datasets to build scalable solutions, while partnering with marketing stakeholders and product teams to translate business needs into actionable insights. Your expertise in causal inference and machine learning will be crucial in enhancing customer engagement and marketing effectiveness across Amazon's global marketing ecosystem. Key job responsibilities - Design and implement advanced causal inference and machine learning solutions for marketing measurement and optimization; - Transform complex business requirements into technical questions - Translate model outputs to actionable insights through close collaboration with marketing stakeholders and product teams; - Work with product and engineering teams to deploy the model into automation system
US, WA, Seattle
The Selling Partner Fees team owns the end-to-end fees experience for two million active third party sellers. We own the fee strategy, fee seller experience, fee accuracy and integrity, fee science and analytics, and we provide scalable technology to monetize all services available to third-party sellers. We are looking for a Senior Economist to lead the development of economic models and tools to optimize the structure and magnitude of fees paid by >4MM of heterogeneous Sellers Worldwide. This person will work on the development of economic, statistical and machine learning models to understand third party seller behaviors and enhance our fee optimization models. The ideal candidate needs to be comfortable transitioning between theoretical Economic models and empirical ones, and use the combination of these models to provide guidance for fee setting. A successful Economist in this role will enjoy dealing with ambiguous problems and working in a fast-paced and dynamic environment. The position also requires collaboration with other scientists (Economists, Data Scientists…), Strategy Analysts, Product Managers and Software Developers. Key job responsibilities - Design and develop theoretical and empirical models to assess the causal impact of fees on third party sellers’ behavior and business performance. - Lead enhancements into existing fee calculation models to maximize the long term health of the Amazon third-party marketplace. - Collaborate with product managers, data scientists, and software developers to incorporate models into production processes and influence senior leaders. - Act as ambassador of the fees scientific community.