Note: Please be aware that this project has been archived, and is read-only. It is not being maintained and might contain out of date code. This project welcomes contributions and suggestions. Most ...

So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...