What Is Your AI Agent Buying? Evaluation, Implications and Emerging Questions for Agentic E-Commerce

2025-08-04

AI Summary

This study investigates the shopping behavior of autonomous AI agents—particularly vision-language model (VLM)-based agents—in e-commerce and its implications for market ecology. We develop ACES, a custom sandbox platform integrating state-of-the-art VLMs, a programmable simulated marketplace, and randomized experimental design, augmented with rigorous causal inference techniques to quantify causal effects of position, price, reviews, sponsored tags, and platform certification on AI agent decisions. Results reveal: (1) significant yet heterogeneous positional bias; (2) consistent avoidance of sponsored tags and strong preference for platform-certified items; (3) human-like sensitivity to price and reviews, though with substantial inter-agent heterogeneity in magnitude; and (4) substantial market-share gains for sellers via minimal product-description fine-tuning. Collectively, findings expose AI-driven demand concentration risks and novel mechanisms of competitive imbalance. The work provides empirical grounding and theoretical insights for platform governance, algorithmic regulation, and human-AI collaborative commerce design.

Technology Category

• Humans and AI: Learning Human Values and Preferences
• Multiagent Systems: Mechanism Design
• Search and Optimization: Learning to Search

Application Category

• Economics, Online Markets and Human Computation: Uses of LLMs and GenAI for marketplace design, bidding, and strategic interactions
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

Online marketplaces will be transformed by autonomous AI agents acting on behalf of consumers. Rather than humans browsing and clicking, vision-language-model (VLM) agents can parse webpages, evaluate products, and transact. This raises a fundamental question: what do AI agents buy, and why? We develop ACES, a sandbox environment that pairs a platform-agnostic VLM agent with a fully programmable mock marketplace to study this question. We first conduct basic rationality checks in the context of simple tasks, and then, by randomizing product positions, prices, ratings, reviews, sponsored tags, and platform endorsements, we obtain causal estimates of how frontier VLMs actually shop. Models show strong but heterogeneous position effects: all favor the top row, yet different models prefer different columns, undermining the assumption of a universal "top" rank. They penalize sponsored tags and reward endorsements. Sensitivities to price, ratings, and reviews are directionally human-like but vary sharply in magnitude across models. Motivated by scenarios where sellers use AI agents to optimize product listings, we show that a seller-side agent that makes minor tweaks to product descriptions, targeting AI buyer preferences, can deliver substantial market-share gains if AI-mediated shopping dominates. We also find that modal product choices can differ across models and, in some cases, demand may concentrate on a few select products, raising competition questions. Together, our results illuminate how AI agents may behave in e-commerce settings and surface concrete seller strategy, platform design, and regulatory questions in an AI-mediated ecosystem.

Problem

• Evaluates how AI agents make purchasing decisions in e-commerce.
• Examines causal effects of product attributes on AI shopping behavior.
• Investigates market competition and seller strategies in AI-mediated ecosystems.

Innovation

• VLM agents parse webpages and transact
• ACES sandbox tests AI shopping behavior
• Seller-side AI optimizes product listings