s38b35M5 , 1 month ago

https://matilabs.ai/2024/02/07/run-llms-locally/

Haven't done this yet, but this is a source I saved in response to a similar question a while back.