minus-squarecmgvd3lw@discuss.tchncs.detoSelfhosted@lemmy.world•Self-hosting LLMslinkfedilinkEnglisharrow-up2·10 days agoI am not self hosting an LLM, but running on my laptop with Alpaca. Google’s Gemma 2B. On my hardware its pretty slow, but kind of gets the work done. My hardware is getting old, need to upgrade soon. linkfedilink
I am not self hosting an LLM, but running on my laptop with Alpaca. Google’s Gemma 2B. On my hardware its pretty slow, but kind of gets the work done. My hardware is getting old, need to upgrade soon.