Technology Overview

The AI technology stack for commerce — foundational models, agentic AI, LLMs, privacy & security, investment costs, and what comes next — based on Book Part 5 of the AI Best Practices for Commerce reference.

Section 1 of 813% complete

Underlying Technology & History

From the Dartmouth Conference to foundation models

The Evolution of Commercial AI in Commerce

The transformation of AI from research curiosity to commercial necessity in ecommerce happened gradually, then suddenly. While universities debated algorithms and tech giants built infrastructure, retailers were quietly discovering that AI could solve their most pressing business problems. Each breakthrough unlocked new possibilities, creating a cascading effect that would fundamentally reshape how commerce works.

The Recommendation Revolution

As mentioned earlier, Amazon filed its foundational recommendation patent in 1998, but the real story started earlier. In 1994, a University of Washington graduate student hired as a summer intern, Greg Linden, noticed that Amazon’s home page was the same for every visitor. Why not personalize it based on what they’d previously bought? His prototype increased sales by 20% in testing, but it almost didn’t launch. Marketing executives worried that showing “unprofessional” book recommendations like romance novels on the homepage would damage Amazon’s brand. Jeff Bezos overruled them, declaring that data would drive decisions, not opinions.

By 2001, Amazon’s item-to-item collaborative filtering was processing millions of transactions daily. The algorithm was brilliantly simple: Instead of trying to find similar customers (which became computationally impossible as Amazon grew), it found similar products based on what appeared together in shopping carts. This scaled linearly rather than exponentially. Amazon reported that 35% of its revenue came from recommendations by 2006.

Netflix took a different approach. Its Cinematch algorithm, developed by Robert Bell and Chris Volinsky starting in 2000, used matrix factorization to predict movie ratings. But Netflix understood something Amazon initially missed: Explicit feedback (star ratings) was far more valuable than implicit feedback (purchases). When Netflix launched streaming in 2007, it could collect even richer data: what people started but didn’t finish, what they rewatched, when they paused. By 2012, 80% of content watched on Netflix came through recommendations rather than search.

Search Gets Smart

While recommendations pulled customers toward products, search helped them find what they were actively seeking. But early ecommerce search was terrible. A 2009 study by the eCommerce Usability Report found that 61% of major retailers couldn’t handle basic synonyms. Searching for “bedroom furniture” wouldn’t find “bed frames.”

Google had solved this for web search using PageRank, but product search was different. There were no links between products to analyze. Instead, retailers needed to understand query intent, product attributes, and the complex relationships between them.

Endeca, founded in 1999 by Steve Papa and Pete Bell, pioneered faceted search for ecommerce. Their insight was that product search wasn’t just about finding items but about progressively refining choices. Home Depot implemented Endeca in 2006, allowing customers to start with “power tools” then narrow by brand, price, power source, and features. Conversion rates for customers who used faceted search were 10 times higher than for those who didn’t.

But the real breakthrough came from analyzing user behavior. When Target implemented learning-to-rank algorithms in 2011, it discovered something counterintuitive: For the query “chocolate,” customers who ultimately purchased were more likely to buy baking chocolate than candy bars, even though candy had higher click rates. The algorithm learned to optimize for purchase probability, not clicks. Revenue per search increased by 23%.

Etsy faced a unique challenge: Most of its products were one-of-a-kind items from individual sellers who used wildly inconsistent terminology. Its 2016 implementation of deep learning for search had to understand that “boho,” “bohemian,” “hippie chic,” and “festival fashion” all described similar aesthetics. They trained models on millions of successful searches where customers found what they wanted, learning the hidden connections between terms.

Personalization Becomes Pervasive

Personalization evolved from “Recommended for You” sections to invisible algorithms shaping every interaction. The goal wasn’t just to show relevant products but to create entirely individualized shopping experiences.

Stitch Fix, launched in 2011 by Katrina Lake, built personalization into its business model. Customers filled out style profiles, and algorithms selected clothing items that human stylists then curated. But the clever part was the feedback loop. Every kept or returned item trained the algorithm. By 2014, Stitch Fix’s algorithms were tracking 90 attributes per clothing item and correlating them with customer preferences across body type, lifestyle, and geography. A size 8 customer in Minneapolis received different recommendations than a size 8 customer in Miami, even with identical style preferences.

Dynamic pricing represented personalization’s more controversial side. Airlines had priced dynamically since the 1980s, but ecommerce made it universal. In 2000, Amazon experimented with showing different prices to different customers for the same DVDs. The backlash was swift and severe. CEO Jeff Bezos apologized, claiming it was a test gone wrong.

But dynamic pricing didn’t disappear; it just became more sophisticated.

By 2015, most major retailers were using algorithmic pricing, but based on competitive intelligence rather than customer profiling. Walmart’s pricing algorithms updated 50 million prices monthly, monitoring competitors and adjusting in near real-time. The Home Depot-Amazon price war of 2016 saw algorithmic pricing engines battling each other, with prices on popular items changing hourly.

The Chatbot Evolution

The dream of conversational commerce had existed since ELIZA, the 1966 chatbot that could conduct basic therapeutic conversations. But early commercial chatbots were frustrating experiences of navigating rigid decision trees.

The first generation of ecommerce chatbots, like IKEA’s Anna (launched in 2005), were essentially FAQ interfaces with personality. Anna could answer questions about store hours and return policies but couldn’t understand anything outside her script. Despite limitations, she handled 11 million customer inquiries in her first year, freeing human agents for complex issues.

Intent-based chatbots emerged around 2010, using natural language processing to understand what customers wanted rather than just matching keywords. Domino’s launched Dom in 2014, a chatbot that could handle pizza ordering through natural conversation. “I want my usual but with extra cheese” actually worked. Within two years, 65% of Domino’s orders came through digital channels, with Dom handling millions of conversations.

But the real revolution came with transformer-based language models. When Sephora launched its Visual Artist chatbot in 2016, it combined computer vision with natural language processing. Customers could upload selfies and ask, “What lipstick would look good on me?” The bot would analyze skin tone, facial features, and previous purchases to make recommendations. Engagement rates were 11% higher than traditional mobile commerce.

Fraud Detection and Risk Intelligence

As ecommerce grew, so did fraud. By 2010, online payment fraud was costing retailers $2.7 billion annually in the US alone. Traditional rule-based systems generated too many false positives, blocking legitimate transactions and frustrating good customers.

Machine learning transformed fraud detection from reactive to predictive. PayPal’s fraud detection system, rebuilt using deep learning in 2014, analyzed hundreds of signals in real-time: device fingerprints, location data, transaction velocity, social graph connections. The system could identify fraudulent transactions with a 0.32% false positive rate, compared to 1.2% for rule-based systems. This seemingly small improvement saved PayPal $700 million annually in reduced fraud losses and manual review costs.

Stripe took this further with Radar, launched in 2016. Instead of each merchant building its own fraud models, Stripe trained models on data from all its merchants. A fraudulent pattern detected at one retailer immediately protected all others. Small businesses gained enterprise-level fraud protection without enterprise-level resources.

The evolution from rules to AI in fraud detection had an unexpected benefit: inclusion. Rule-based systems often flagged legitimate transactions from developing countries as fraudulent. AI systems learned that a customer in Nigeria making their first purchase wasn’t necessarily fraudulent, just underserved. Global ecommerce became more accessible as AI reduced bias in fraud detection.

By 2020, commercial AI in ecommerce had evolved from experimental technology to essential infrastructure. Every major retailer was using AI for recommendations, search, personalization, customer service, pricing, and fraud detection. But this was still AI as tool, not AI as intelligence. That distinction was about to disappear with the arrival of foundation models that could not just analyze and optimize but understand and create.

Key Commercial Milestones
Recommendations
  • Greg Linden's Amazon personalization (1994): +20% sales
  • Item-to-item collaborative filtering scaled linearly
  • Netflix: 80% of content viewed via recommendations
Search Intelligence
  • Endeca faceted search (1999): 10x conversion lift
  • Target learning-to-rank (2011): +23% revenue/search
  • Etsy deep learning for 'boho' semantic matching (2016)
Fraud & Personalization
  • PayPal deep learning (2014): 0.32% false positive rate
  • Stripe Radar: network effects across all merchants
  • Stitch Fix: 90 clothing attributes × customer dimensions
🌐
Source: AI Best Practices for Commerce, Section 5.1
Share

Last updated: March 12, 2026