Simon Willison’s Weblog

Subscribe
Atom feed for the-simpsons

2 items tagged “the-simpsons”

2023

Fine-tune LLaMA to speak like Homer Simpson. Replicate spent 90 minutes fine-tuning LLaMA on 60,000 lines of dialog from the first 12 seasons of the Simpsons, and now it can do a good job of producing invented dialog from any of the characters from the series. This is a really interesting result: I’ve been skeptical about how much value can be had from fine-tuning large models on just a tiny amount of new data, assuming that the new data would be statistically irrelevant compared to the existing model. Clearly my mental model around this was incorrect.

# 17th March 2023, 11:08 pm / the-simpsons, ai, generative-ai, llama, edge-llms, llms, replicate, fine-tuning

2008