Simon Willison’s Weblog

llama2-mac-gpu.sh (via) Adrien Brault provided this recipe for compiling llama.cpp on macOS with GPU support enabled (“LLAMA_METAL=1 make”) and then downloading and running a GGML build of Llama 2 13B.

# 4:04 am / macosx, ai, generative-ai, llama, edge-llms, llms

Llama 2: The New Open LLM SOTA. I’m in this Latent Space podcast, recorded yesterday, talking about the Llama 2 release.

# 5:37 pm / podcasts, ai, generative-ai, llama, edge-llms