Just hit #14 and #15 with out FIRST models on Open SLM Leaderboard. The models were trained on 5B tokens, while competing with similarly sized models trained on more than 6-20x the data.
A new base model Speck1.5-140M being trained right now on a higher quality corpus and will be released soon. SpeckChat3 is coming very soon with 1 million samples, specifically designed to post train small base models.
Also, just to clarify stuff, we will NOT release anything that is NOT MIT licensed EVER. Openness is needed in small language research.
Thanks to everyone supporting the project, and stay tuned for new releases!
We’re excited to release BananaMind OS 2.0, a major update to our portable operating system for running AI models locally.
BananaMind OS runs directly from an ISO without Linux, installation, a cloud connection, or modifying your disks.
The new Version 2.0 adds a graphical interface with mouse support, a model library, multi-turn chat, configurable KV cache, maximum tokens and temperature controls, automatic x87/SSE/SSE2 CPU detection, BIOS support, native UEFI support and a dedicated 486 compatibility mode.
Model weights are not loaded during GRUB or startup. Only the model catalog is read, and the selected model is loaded after BananaMind OS starts.
We now have a new .litemodel format supports multiple architectures, including BananaMind models, SmolLM, SmolLM2, GPT-X2.5, min-spark 1.1 and Rose-Mini. Check it out at: https://github.com/BananaMind/BananaMindOS
You can build an ISO yourself using the .sh or .bat script. Select the models and quantizations you want, and the builder will download, quantize and package them locally. Prebuilt 10MB, 25MB, 100MB and 250MB model presets are available here: https://github.com/BananaMind/BananaMindOS/releases/tag/v2.0.0 Use the regular preset ISOs for BIOS and GRUB, including the 486 compatibility mode.
Warning: Im currently uploading the ISOs, all up to 100MB is present, 250MB is getting uploaded Use the files ending in -uefi.iso for the native x86-64 UEFI graphical frontend and improved firmware mouse support.
The preset name describes the RAM class of the individual included models. Models remain on the ISO until selected, so including multiple models does not load all of them into RAM. 486DX with an x87 FPU, Pentium and newer x86 processors are supported. Modern x86-64 computers are supported through UEFI. It currently doesent support processors without an FPU.
Comment if you want me to run it on 0.04MHz (pls dont)
Video Credit: Song: Matzan - Redesigned Music provided by NoCopyrightSounds