Vercel

Nous Research Deploys Vercel BotID to Protect Free AI Service


Executive Summary

AI research lab Nous Research faced overwhelming bot abuse during a free promotional week for its Hermes language model, resulting in significant wasted compute and inflated costs. After this initial failure, they implemented Vercel's BotID Deep Analysis, a sophisticated bot protection solution, at multiple points in their user flow. This new defense successfully detected and mitigated a subsequent coordinated attack that spiked traffic by 3,000%, allowing Nous to safely offer a free tier without compromising performance or incurring abuse-related costs.

Key Takeaways

* Initial Problem: A one-week free tier for the Hermes LLM was overwhelmed by automated scripts creating thousands of fake accounts to bypass rate limits, despite using Cloudflare Turnstile captcha.

* Solution: Nous Research integrated Vercel BotID Deep Analysis, an "invisible captcha" that performs deep behavioral analysis to identify bots.

* Implementation: BotID was deployed at two critical stages:

* Auth Flow: Checks are run before and after user sign-up/sign-in.

* Chat Interface: A "heartbeat" mechanism performs periodic BotID checks to prevent API-style abuse after login.

* Results: After relaunching the free tier, BotID successfully blocked a coordinated attack that caused a 3,000% traffic increase, preventing any spike in inference usage or impact on app performance.

* Advanced Detection: The system identified sophisticated bots that passed initial sign-in checks but were later blocked during chat interaction based on behavioral patterns (like JA4 fingerprints).

Strategic Importance

This case demonstrates the critical need for advanced, multi-layered bot protection beyond simple captchas for public-facing AI services, as their high computational cost makes them prime targets for abuse. It positions Vercel's platform as a secure and cost-effective solution for deploying and scaling AI applications.

Original article