Hacker News new | past | comments | ask | show | jobs | submit login

Yeah, the mac minis can have up to 64GB of ram which would support some usable models. However, I accidentally got one with 24gb of ram, and my apps already use 12gbs. So, perhaps I'll get a second box just for LLMs!



A small model like 1B or 3B should be ok with 16GB. I was thinking in the name of savings, you can just use the same machine.

It's a cool project. I might do it too. I have an M4 Mini sitting on my desk that I got for $550.




Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: