Open Source LLM

Nvidia and Mistral AI's super-accurate small language model works on laptops and PCs

(Image credit: Nvidia)

Nvidia and Mistral AI have released a new small language model that purportedly features "state-of-the-art" accuracy in a tiny footprint. The new LM is known as the Mistral-NemMo-Minitron 8B , a miniaturized version of NeMo 12B that has been pruned from 12 billion to 8 billion parameters.

The new 8 billion-parameter small language model was shrunken down through two different AI optimization methods, said Bryan Catanzaro, VP of deep learning research at

Continue reading...

Open Source LLM

Mozilla Developing Whisperfile For Local Audio-To-Text Translation

The Mozilla Ocho group leads "innovation and experiments" at Mozilla. Following all of their work on Llamafile for easily distributing large language models as a single file that can be easily executed across different hardware/software, their newest effort is Whisperfile for easy audio-to-text translations.

Whisperfile is a new initiative for easily turning audio into text. As implied by the name, Whisperfile is built around OpenAI's Whisper model for local audio/language translation. Whisperfile is based on the Whisper.cpp sources and is
Continue reading...

Open Source LLM

Zed Code Editor Begins Adding AI Features Powered By Anthropic's Claude

Zed, the code/text editor being developed by former Atom editor developers, has continued to gain interest among developers since going open-source , being written in the Rust programming language, and native Linux builds taking shape. The latest feature work on Zed is beginning to integrate AI-powered functionality by leveraging Anthropic's Claude LLM.

Zed AI was announced on Tuesday as a hosted service for AI-enabled coding within the Zed editor. Zed AI currently leverages the Anthropic Claude 3.5 Sonnet large language model.
Continue reading...

Open Source LLM

OpenAI推出GPT-4o微調服務

OpenAI週二(8/20) 發表 了新一代大型語言模型(LLM)GPT-4o的微調服務,透過該服務,開發人員將能以客製化的資料集來調整GPT-4o,以取得更適合特定應用的成果。

今年5月上線的GPT-4o為GPT-4 Omni的簡寫,是OpenAI最新


Open Source LLM

Cloud Hypervisor 41 Brings Performance Improvements & Landlock Sandboxing

The Cloud Hypervisor open-source project that serves as a Rust-written VMM focused on security and started by Intel but now backed by a multitude of vendors is out with its newest feature release. Cloud Hypervisor 41 is the new feature release worked on by engineers at Intel, Google, Microsoft, Rivos, Tencent, Ant Group, and others for this cloud and security minded virtual machine monitor.

Cloud Hypervisor 41 introduces sandboxing support using the Linux kernel's Landlock API. New to this release is also experimental
Continue reading...

Open Source LLM

Red Hat Developing Ramalama To "Make AI Boring" By Offering Great AI Simplicity & Ease Of Use

Red Hat engineers have been developing Ramalama as a new open-source project that hopes to "make AI boring" by this inferencing tool striving for simplicity so users can quickly and easily deploy AI workloads without much fuss.

Ramalama leverages OCI containers and makes it easy to run AI inferencing workloads across GPU vendors, seamlessly fallback to CPU-based inferencing if no GPU support is present, and interfaces with Podman and Llama.cpp to do the heavy lifting while fetching models from the likes of Hugging Face and the Ollama Registry.
Continue reading...

Open Source LLM

Text-to-speech brain implant restores ALS patient's voice - Reuters

Text-to-speech brain implant restores ALS patient's voice Reuters

Open Source LLM

AI業者與Linux基金會共推開放AI模型倡議

數家AI業者與Linux基金會 宣佈 成立開放模型倡議(Open Model Initiatives,OMI),以推動高品質的開放授權AI模型的開發和採用。

OMI旨在推動以「不可撤回(irrevocable)的開放授權」來訓練和開發AI模型而沒有刪除條款或經常性費用。創始會員包括Invoke、


Open Source LLM

Linux Foundation Looks To Become More Involved With AI Models, Welcomes OMI

With all the craze around "AI" and hoping to foster more open-source AI models, the Linux Foundation has welcomed the Open Model Initiative (OMI) into its umbrella of open-source initiatives to help foster high quality, openly-licensed AI models.

The Open Model Initiative was recently formed by Invoke, Comfy Org, and Civitai as a community-driven effort to promote the development and adoption of openly-licensed AI models for image, video, and audio generation. This community initiative came about over the
Continue reading...

Open Source LLM

OpenAI悄悄釋出GPT-4o更新

OpenAI上週悄悄釋出多模態模型GPT-4o的更新版,宣稱提升開發速度、效能更高、價格更便宜。

有別於5月的盛大公佈,名為GPT-4o-2024-08-06的GPT-4o最新版本是被 媒體 發現,以及在非官方通路如 Azure 上公佈。

OpenAI