software (1)

KINDI Logo

Kindi: Modern Local AI on a $15 GPU

Most local AI advice starts with buying a newer GPU. Kindi starts with the one sitting in the closet. It is a custom inference engine from Amir Husain that runs modern small language models on old NVIDIA cards—including a 2014 Quadro K420 with 1 GB…

Continue reading...