Alex Finn’s Mac Studio runs at 20 tokens per second which is 10x slower than any model you use, and too slow to use for a swarm, let alone a single agent doing anything useful He makes like $10k a month off your engagement, he’s just playing the game I wish agi at home was available yet but it isn’t

all i want is affordable in-home hardware which can do basic shit for me and control my smart home and run more complex tasks at night while i sleep for a fair price can devs do something??

Literally same Have you looked at Tiny corp / George hotz thing? If you are wealthy and cost optimization is non issue you can do this or a smaller NVIDIA dgx box The main thing is the Macs will run it because unified memory but the NVIDIA stuff is much much faster

Yeah the truth is you can run kimi for like $20/day in cloud Economy of scale is real 😭😭

it’s true, and i hate it

i want agents running locally so i can give them all of my data and let them cook

You could start with fine tuning Claude on bedrock, if you ask Claude it will do it all for you basically