ncache. A squid-style caching system built on top of nginx. Supports the HTTP PURGE method for cache invalidation.
Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.
Pay me to send you less!