jack

jack

my quick posts!

@BennettBuhner when i say idle, i mean with apps that i usually have open (a browser, discord, etc..)

@BennettBuhner i think 8b ones would be slow since macOS already uses 5-7GB of RAM idle – when i use the smaller gemma/qwen models locally i always go for 1-3b param models, 4b+ is pushing it

@BennettBuhner The leaks look really cool but I’m worried about the smallest OS model being 20B since I only have 8GB of ram on my Mac :P

Ig if it’s open source someone could make a 1b or 4b param model like Gemma

this is getting very confusing

i have 3 terminals open, one is my laptop, 2 are SSH sessions on my PDS server and my Mac mini.. i’m setting up backups but i’m getting so lost