Open Source LLM

Valve Contributes OpenVR Video Driver To SDL

Merged to upstream SDL today is an OpenVR video driver that was developed at Valve Software.

OpenVR is the SDK and API developed by Valve as part of their SteamVR effort and supports multiple vendor headsets. Charles Lohr with Valve has now contributed an OpenVR video driver to the upstream Simple DirectMedia Library (SDL) project for that widely-used, cross-platform hardware/software abstraction library. Thus in turn enhancing SDL's support for outputting to OpenVR-supported headsets.

Continue reading...

Open Source LLM

Red Hat Engineer Nikita Popov Now The Lead Maintainer For LLVM

Following a proposal that began last month, Red Hat engineer Nikita Popov was nominated to become the new lead maintainer for LLVM. Following unaminous approval, as of last week in LLVM Git he's been appointed the official lead maintainer for this critical open-source compiler stack.

The proposal by Aaron Ballman for nominating Nikita Popov laid out the case:
"LLVM is one of the most critical parts of the overall project and its list of code owners has been outdated for some time now. Chris Lattner (@clattner)

Open Source LLM

The Maturing State Of Rusticl For Rust-Based OpenCL Within Mesa

Karol Herbst of Red Hat presented in Montreal last week at the X.Org Developers' Conference (XDC 2024) on the current state of Rusticl as the Rust-written OpenCL implementation for Gallium3D drivers within Mesa.

Rusticl has been making great progress and far better off than the old "Clover" OpenCL state tracker within Mesa. Rusticl now provides an OpenCL 3.0 conformant experience on the Zink generic driver as well as the Asahi driver. As noted last week, Rusticl on Asahi Gallium3
Continue reading...

Open Source LLM

NVIDIA Fine-Tunes Llama3.1 Model to Beat GPT-4o and Claude 3.5 Sonnet with Only 70 Billion Parameters

NVIDIA has officially released its Llama-3.1-Nemotron-70B-Instruct model. Based on META's Llama3.1 70B, the Nemotron model is a large language model customized by NVIDIA in order to improve the helpfulness of LLM-generated responses. NVIDIA uses fine-tuning structured data to steer the model and allow it to generate more helpful responses. With only 70 billion parameters, the model is punching far above its weight class. The company claims that the model is
Continue reading...

Open Source LLM

Mistral公佈邊緣運算AI模型Les Ministraux

法國AI新創業者Mistral AI本週 公佈Les Ministraux ,讓開發商及使用者可在筆電或智慧型手機等邊緣裝置上執行AI任務。

兩款新模型各名為Ministral 3B與Ministral 8B,合稱Les Ministraux,是為裝置和邊緣應用場景開發的state-of-art模型。兩者支援128K脈絡長


Open Source LLM

AMD Releases AOMP 20.0-0 For Radeon/Instinct Compiler Offloading

Following last week's release of the LLVM/Clang-downstream AOCC 5.0 for optimized compiler support extended to Zen 5 CPUs , the GPU side of the house at AMD this week released AOMP 20.0-0 as their LLVM/Clang downstream focused on GPU device offloading.

AOMP remains the AMD-maintained LLVM/Clang downstream compiler focused on OpenMP API device offloading to Radeon GPUs and Instinct accelerators. AOMP pulls in all of the latest AMDGPU compiler back-end bits and associated device offload patches for

Open Source LLM

Startup Tales Wants to Let You Build Your Own Games with Generative AI Beginning Next Month

There's a new generative AI startup in town called Tales, and its goal is to empower gamers and creators to essentially make whatever they want with mere text prompts. According to the press release, the technology is based on a Large World Model (LWM) called Sia. This LWM is allegedly capable of generating all the components of a video game, from environments, 3D models, and gameplay to NPC (non-player character) behavior - along with detailed metadata. This Large World Model trains on gameplay

Open Source LLM

Alibaba’s global unit pushes translation-focused AI model for merchants, individual users

Macro MT is a new large language model that supports translation in various cross-border e-commerce scenarios.

Open Source LLM

LibreSSL 4.0 Released With EmScripten Support, Fixes Windows Support Past Y2038

The OpenBSD project has released LibreSSL 4.0 as the newest version of this open-source TLS implementation that was forked from OpenSSL a decade ago.

LibreSSL 4.0 introduces EmScripten support within its CMake build system, MIPS 32-bit platform support is no longer actively supported, and there is a fix for Microsoft Windows support for dates beyond the year 2038.

LibreSSL 4.0 also brings a number of internal code improvements including for memory leak fixes, cleaning up its MD4 and MD5
Continue reading...

Open Source LLM

Llamafile 0.8.14 Introduces New CLI Chatbot Interface

Llamafile is the open-source project from Mozilla that allows distributing large language models as a single file that can work across operating systems, run on CPUs or GPUs, and all-around makes it much easier to distribute and run LLMs. This Mozilla Builders project ended out the weekend with a new feature release.

Llamafile 0.8.14 released overnight for this open-source code for easing large language model deployments. With the Llamafile 0.8.14 release there is a new CLI chatbot interface.
Continue reading...