#HomeLab, #SelfHosting, #DevOps, #LLM, #AtProto
Uncategorized
2
Posts
2
Posters
0
Views
-
#HomeLab, #SelfHosting, #DevOps, #LLM, #AtProto
So if you happened to have an extra M1 8gb Mac mini, would you install a small LLM (and which one would you use) or would you host your own AtProto PDS with it?
-
#HomeLab, #SelfHosting, #DevOps, #LLM, #AtProto
So if you happened to have an extra M1 8gb Mac mini, would you install a small LLM (and which one would you use) or would you host your own AtProto PDS with it?
@cerebrix most of the good models are at least 14gb - if that doesn't fit in RAM or VRAM (preferably) not worth
-
R relay@relay.infosec.exchange shared this topic
