Meta is returning to the open-weight AI model category - a subset of large language models (LLMs) that it founded but then largely abandoned in a bout of misplaced priorities - with a loud and fairly sonorous bang, courtesy of the just-released Muse Glimmer open-weight model that employs creative tricks to make sure the model fits inside a single consumer GPU, and responds to queries in a lightning-fast manner.
Meta has just released the Muse Glimmer, a 30-billion-parameter open-weight AI model that is meant to compete with the likes of Google's Gemma 4 and Alibaba's Qwen 3.6.
For the benefit of those who might not be aware, weights tell a model how much importance it should accord to any given concept, and represent the entire breadth of that model's knowledge base.
Meta's Muse Glimmer is distinctive for two major reasons. First, to run a 30-billion-parameter at full precision (fp16), you need around 60GB (30x10⁹x2) of memory for model weights alone. However, Meta used quantization - essentially distillation, where a larger model (Muse Spark) trains a smaller one, imbuing it with many of its capabilities - to compress it to reduce the memory requirements for model weights down to 20GB. Coupled with 2GB to 4GB required for KV cache , these requirements are modest enough that a 24GB or 32GB consumer graphic card can easily run Muse Glimmer. According to Meta, this model compression via distillation produces no noticeable impact on performance.
Second, to speed up token generation (response times), the Muse Glimmer uses a tiny companion model - called the DFlash drafter model - that predicts whole chunks of text, allowing the Muse Glimmer to then check the answer in one go, keeping correct text responses while discarding erroneous ones. Since checking an answer is much faster than generating one, the arrangement allows for 3.1x faster responses on an RTX 5090 card, 1.8x on an M5 Max, and 1.5x on an M4 Max, as per the data disclosed by Meta.
Of course, Meta's Muse Glimmer could not have come at a more opportune time for the Western open-weight AI model landscape. After all, according to the data from OpenRouter, Chinese LLMs recently crossed the 34.25 trillion weekly tokens level for the first time, with DeepSeek's V4 Flash recording an astounding 570 percent week-over-week growth.
According to the latest OpenRouter dataset that pertains to the week that began on August 03, global AI model usage hit 69 trillion tokens, up 21.48 percent week-on-week. Chinese models accounted for 34.25 trillion of that total, while US models contributed just 9.17 trillion tokens to that cumulative figure. Critically, it was the fifteenth consecutive week that Chinese models have led the global count.
Consequently, we'll be paying particular attention to next week's figures to see if Meta's Muse Glimmer is having a noticeable impact on the relentless ascendancy of Chinese open-weight AI models.
Follow Wccftech on Google to get more of our news coverage in your feeds.