Technology Overview

The AI technology stack for commerce — foundational models, agentic AI, LLMs, privacy & security, investment costs, and what comes next — based on Book Part 5 of the AI Best Practices for Commerce reference.

Section 3 of 838% complete

Comparing Public LLMs

Which model, for which task, at what cost

Anthropic: Enterprise Safety and Long Context

Anthropic’s Claude family carved out a distinctive position as the enterprise-grade choice for retailers who couldn’t afford mistakes. The Claude 3 family, released in March 2024, came in three sizes: Haiku (fast and affordable), Sonnet (balanced), and Opus (most capable).

Constitutional AI training made Claude notably less likely to generate problematic content. This wasn’t just theoretical. It translated to fewer responses requiring human review for policy violations, meaning fewer costly interventions in production deployments processing millions of customer interactions.

Long context understanding became Claude’s defining feature. The 200,000-token context window enabled analysis of complete customer service transcripts, entire product catalogs, and comprehensive policy documentation in single inferences. Retailers could analyze patterns across hundreds of reviews simultaneously, identifying issues invisible in individual review analysis.

Structured output and tool use reliability made Claude preferred for business process automation. The system’s ability to consistently format responses in JSON and reliably call verification APIs proved crucial for automated workflows. According to Anthropic’s case study documentation, specific implementations achieved measurable improvements. For example, Hume reported an 80% cost reduction using prompt caching and 36% user preference for Claude over other LLMs.

Enterprise compliance was foundational. Anthropic provided data residency options, detailed audit logs, and worked directly with retail legal and compliance teams. The SOC 2 Type II certification, completed in 2023, became table stakes for enterprise adoption, particularly for health and beauty retailers dealing with HIPAA considerations.

Claude 3.5 Sonnet, released in June 2024, pushed performance to near-Opus levels at Sonnet pricing and speed. This model became the sweet spot for many retail deployments: capable enough for complex reasoning, fast enough for real-time use, and affordable enough for high-volume deployment. Anthropic reported reaching $1.4 billion in annualized recurring revenue by early 2025, with estimates of 16-19 million monthly active users.

The limitation through 2024: Claude lagged in vision capabilities compared to Google’s Gemini for complex visual tasks. And while Claude’s training included recent information, it lacked the real-time web access that Gemini provided natively.

LLM Decision by Use Case
Product Classification & Tagging
  • High-volume: Llama 3.1 70B fine-tuned (thousands/month vs six-figure API)
  • Mid-market: Mistral 7B (middle ground)
  • API simplicity: Claude Haiku
Customer Service & Search
  • Conversational: Claude 3.5 Sonnet (accuracy + safety + tool use)
  • Visual search: Gemini 1.5 Pro
  • Query understanding: Claude 3.5 Sonnet for intent nuance
Automation & Engineering
  • Listing generation: GPT-4 (creative content)
  • Content moderation: Claude (Constitutional AI)
  • Code generation: GPT-4 or Llama Code variants
When Public APIs Are a Poor Fit
  • Highly proprietary data (pricing algorithms, supplier relationships) — risk even with contractual protections
  • Ultra-low latency (<50ms) — API round trips add 80–200ms minimum
  • Edge/offline environments — kiosks, warehouses, developing-market mobile apps
  • Very high-volume transactional workloads — 100M daily views × per-inference cost = millions/month
🌐
Source: AI Best Practices for Commerce, Section 5.3
Share

Last updated: March 12, 2026