WingNews logo WingNews GitHub [2]

lanceflt's comments

lanceflt | 6 months ago | on: Launch HN: Risely (YC S25) – AI Agents for Universities

The key issue for the sector is the tens of legacy systems that don't integrate with each other, often with manual spreadsheet processes that could be easily automated. Yet the big players like Oracle sell a generic CRM experience that doesn't fit well with higher education.

Are you hiring? I have 8 years of university SIS implementation & migration experience and 2 years of Edtech AI engineering experience and this is the exact problem space I want to work in.

lanceflt | 1 year ago | on: Apple M3 Ultra

Deepseek R1 (full, Q1) is 14t/s on an M2 Ultra, so this should be around 20t/s

lanceflt | 1 year ago | on: Tencent Hunyuan-Large

RAM for 4-bit is 1GB per 2 billion parameters. So you will want 256GB RAM and at least one GPU. If you only have one server and one user, it's the full parameter count. (If you have multiple GPUs/servers and many users in parallel, you can shard and route it so you only need the active parameter count per GPU/server. So it's cheaper at scale.)
page 1