LesserAbe , 1 month ago Don't have an answer but I'd be interested in something like that too. I know Microsoft released a freely available lightweight LLM that's supposed to make it easier for people to run it locally, called Phi3. Decent article from ars technica: https://arstechnica.com/information-technology/2024/04/microsofts-phi-3-shows-the-surprising-power-of-small-locally-run-ai-language-models/
Don't have an answer but I'd be interested in something like that too. I know Microsoft released a freely available lightweight LLM that's supposed to make it easier for people to run it locally, called Phi3. Decent article from ars technica: https://arstechnica.com/information-technology/2024/04/microsofts-phi-3-shows-the-surprising-power-of-small-locally-run-ai-language-models/