Simon Willison’s Weblog

3rd May 2023 - Link Blog

OpenLLaMA. The first openly licensed model I’ve seen trained on the RedPajama dataset. This initial release is a 7B model trained on 200 billion tokens, but the team behind it are promising a full 1 trillion token model in the near future. I haven’t found a live demo of this one running anywhere yet.

Posted 3rd May 2023 at 8:58 pm

Recent articles

Generating running routes with GPT-6 Astra and ChatGPT Work - 12th September 2026
OpenAI agents attacked RubyGems back in May - 12th September 2026
Some thoughts on the Navier–Stokes Millennium Prize Problem - 8th September 2026

This is a link post by Simon Willison, posted on 3rd May 2023.

ai 2,233 generative-ai 1,979 llama 81 local-llms 164 llms 1,945 redpajama 4 llm-release 230

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe