Simon Willison’s Weblog

3rd May 2023 - Link Blog

OpenLLaMA. The first openly licensed model I’ve seen trained on the RedPajama dataset. This initial release is a 7B model trained on 200 billion tokens, but the team behind it are promising a full 1 trillion token model in the near future. I haven’t found a live demo of this one running anywhere yet.

Posted 3rd May 2023 at 8:58 pm

Recent articles

Locating the source of a mysterious beep with Claude - 9th November 2026
Hide your slop PR descriptions behind <details><summary> - 9th November 2026
Qwen 3.8 27B on my laptop can interpret model weights, too - 3rd November 2026
The U.S. Census Bureau and “Super Intelligence” - 2nd November 2026

This is a link post by Simon Willison, posted on 3rd May 2023.

ai 2,322 generative-ai 2,060 llama 81 local-llms 166 llms 2,024 redpajama 4 llm-release 242

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe