llm-mlc (via) My latest plugin for LLM adds support for models that use the MLC Python library—which is the first library I’ve managed to get to run Llama 2 with GPU acceleration on my M2 Mac laptop.
Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.
Pay me to send you less!