A 367,000-Parameter Neural Network Living on a Floppy Disk: Tiny 2.1 Runs on Pentium and Speaks Aloud
Developer WollyMonjac has introduced Tiny 2.1, a 367k-parameter transformer running in DOS on a Pentium. The entire model takes up 1.44 MB on a floppy disk, requires 540 KB of RAM, speaks aloud, and is distributed under the MIT license.
Read more →