Categories
AI News iRaluca

PrismML’s Ternary Bonsai 2: A 27B Model in 5.9 Gigabytes

PrismML shrank a 27B model to just three weight values per parameter — and kept 98% of its benchmark performance intact.

Categories
AI News iRaluca

How a 35-Billion-Parameter Model Learned to Live on an SSD

AutoArk’s Edge0 runs a 35B model on a 24GB Mac mini by predicting which experts it will need from SSD before it needs them.