I replaced cloud LLMs with local models running off a Proxmox LXC, and the performance trade-off was worth it

Turning my old GPU into an LLM-hosting behemoth was the best decision ever