Open Source LLM

ollama 0.11.9 Introducing A Nice CPU/GPU Performance Optimization

The ollama open-source software that makes it easy to run AI large language models (LLMs) across different operating systems, hardware, and models is about to enjoy a nice speed boost.

The ollama 0.11.9-rc0 test release was christened a short time ago and comes with a nice performance improvement. This next release of ollama is bringing improved performance by overlapping GPU and CPU computations.

This ollama optimization comes from VMware engineer Daniel Hiltgen and is to build the graph for the next batch asynchronously
Continue reading...

Open Source LLM

Chinese delivery giant Meituan releases AI model to take on Alibaba, DeepSeek

Meituan’s large language model, LongCat-Flash-Chat, is available on AI developer platforms Hugging Face and GitHub. Photo: Shutterstock

Beijing -based Meituan, the long-standing leader of China’s food delivery market, on Monday released and open-sourced its own LLM, called LongCat-Flash-Chat, via artificial intelligence developer platforms Hugging Face and GitHub , as well as the model’s official website.

According to the model’s technical report, LongCat-Flash-Chat features 560 billion total parameters – the variables used to define and manipulate the


Open Source LLM

Tencent’s open-source translation model beats Google, OpenAI in top global event

Chinese tech giant Tencent Holdings on Monday released a new open-source translation model that aced a global machine-translation competition despite its small parameter size, highlighting the progress the country has been making in artificial intelligence.

Tencent’s Hunyuan-MT-7B came first in 30 out of the 31 tests in the general machine-translation competition, held as part of the Tenth Conference on Machine Translation, also known as WMT25, according to preliminary results published by the event’s organiser. WMT

The webpage of Hunyuan, Chinese tech giant Tencent’s large language AI model. Photo: Shutterstock

Open Source LLM

Local AI models will live and die by the quality of their data sets

At Asean’s first ever artificial intelligence summit in Kuala Lumpur recently, YTL AI Labs, in partnership with the University of Malaya, launched a large language model (LLM) called ILMU – which translates from Malay into English as “knowledge” but is used in this instance by the developers as a Malay acronym. Billed as Malaysia’s first, fully sovereign AI model with data locally hosted, managed and governed, ILMU has been trained on local, contextualised data and outperforms global Malay-language benchmarks.

In fact


Open Source LLM

You can try Apple’s lightning-fast video captioning model right from your browser

A few months ago, Apple released FastVLM , a Visual Language Model (VLM) that offered near-instant high-resolution image processing. Now, you can take it for a spin, provided you have an Apple Silicon-powered Mac. Here’s how.

When we first covered FastVLM , we explained that it leveraged MLX, Apple’s own open ML framework specifically designed for Apple Silicon, to deliver up to 85 times faster video captioning, while being more than 3 times smaller than similar models.


Open Source LLM

Rust 1.90 Switching To LLD Linker On Linux For Faster Linking Times

With the Rust 1.90 release due out in mid-September, the Rust compiler on Linux x86_64 will begun using the LLD linker by default in order to "significantly reduce" linking times.

Linking time can contribute significantly to the overall compilation/build time. In tests carried out by Rust developers, the linker performance can improve by as much as 7x and in the case of ripgrep yielded a 40% reduction in the end-to-end compilation time. Or for
Continue reading...

Open Source LLM

I finally found a seamless way to bring NotebookLM insights into Obsidian

Discover how a small Chrome extension, NotebookLM to LaTeX & MD, seamlessly integrates NotebookLM insights into Obsidian for enhanced knowledge management and research workflows.

Open Source LLM

3 local LLM workflows that actually save me time

Discover how using local large language models can revolutionize your productivity in knowledge management, content creation, and home automation.

Open Source LLM

Rusticl Driver Lands Support For OpenCL Semaphores

In addition to working on new OpenCL performance optimizations , Red Hat engineer Karol Herbst just landed another important feature into Rusticl : OpenCL semaphores.

OpenCL semaphores are now supported by the Mesa 25.3-devel code with this Rust-based generic OpenCL driver for Gallium3D hardware drivers. OpenCL semaphores are important for work synchronization, especially when getting into interoperability with other external APIs. The cl_khr_semaphore, cl_khr_external_semaphore, and cl_khr_external_semaphore_sync_
Continue reading...

Open Source LLM

中國企業級大模型調用爆發式增長 阿里通義佔比排第一

國際研究機構Frost & Sullivan發佈最新報告顯示,中國企業級大模型調用呈爆發式增長,2025年上半年日均調用量較2024年底增長363%,目前已超過10萬億Tokens,其中以阿里通義佔17.7%排名第一,是中國企業選擇最多

Menu