Opt.Gear: On-Device Language Models Trained on 0.5T Tokens
Introducing the open-source Opt.Gear (270M/1B) on-device text generation models, designed from the outset for environments with limited SRAM, bandwidth, and power.
Read article →Releases, benchmarks, and engineering stories from the team building fast on-device foundation models.
Introducing the open-source Opt.Gear (270M/1B) on-device text generation models, designed from the outset for environments with limited SRAM, bandwidth, and power.
Read article →Introducing the Quantization-Aware Training recipe for Opt.Gear-1B, combining Hessian-based scale initialization with LSQ.
Read article →Introducing Opt.Gear-1M, a language model with approximately 1M parameters deployed directly on an STM32 Cortex-M7, achieving autoregressive generation at 20 tokens/s.
Read article →Language models, Opt.Gear included, can produce inaccurate content that does not represent OptAI's views. Review anything you intend to rely on, publish, or ship.