OpenAI scales online storage to deliver 12x faster reads for ChatGPT
Key point
OpenAI scaled Habitat to serve over 1 billion ChatGPT users, using Azure Cosmos DB and global caching to deliver 12x faster reads.
OpenAI has rapidly scaled online storage to serve over 1 billion ChatGPT users. To achieve this, the company scaled Habitat using reliable multi-tenancy, global caching, and Azure Cosmos DB.
These implementations delivered 12x faster reads for ChatGPT.
This item is a summary. The full, checkable version is at the original source:
Read the original at OpenAI ↗