Making local inference usable. My experiences optimizing my local garage stack to the point where its on par with cloud providers for basic tasks. Hardware and software level.
Tooling & Skills
Speaker
Artur RimkevitchSOK
Software engineer at S-Kaupat. Homelab enthusiast.