Enterprise AI Requires Access Control and Custom Entity Definitions
by Ben Horowitz on September 11, 2025
The AI landscape is more complex than a single "brain to rule them all," requiring domain-specific models and data to create effective applications.
The Reality of Enterprise AI Applications
- Foundation models are critical infrastructure but insufficient alone for enterprise applications
- The "thin wrapper around GPT" concept is fundamentally flawed
- This mirrors the 1980s misconception of "thin wrapper around a database" that underestimated what products like Salesforce would become
Why Domain-Specific AI Applications Win
-
The universe of human behavior is "fat-tailed" - rare but important edge cases matter tremendously
- Example: Waymo's self-driving cars struggled not with rain or sleet, but with unpredictable human behaviors like driving 75mph in a 25mph zone
- "The number of rare important crazy shit that humans do is very high"
-
Successful AI applications require multiple specialized models working together
- Example: Cursor built 14 different models to understand how developers work
- These models incorporate countless interactions with users to build domain expertise
- "That's not just a thin layer on a foundation model"
Enterprise-Specific Challenges
-
Access control becomes critical in enterprise environments
- AI systems need to understand who has permission to see what information
- Training on company data creates complex permission boundaries
-
Semantic differences between organizations create fundamental challenges
- "If you look at an enterprise, find 10 enterprises, they all have a different definition of what a customer means"
- Is a customer a department at AT&T? The entire company? A specific person?
- These definitions matter tremendously for metrics like churn
-
The technology landscape is still evolving in unexpected ways
- LLMs have "asymptoted" as we've run out of training data
- Reinforcement learning continues to improve linearly but doesn't generalize well
- "If you build a great programming model it may be an idiot at math"
Implications for Founders
- The application layer offers "almost unlimited" opportunities
- Building proprietary data and domain-specific models creates defensibility
- Understanding the specific needs of your domain is critical for success
- The problems AI can solve are far broader than what could be addressed with traditional software