Open Source LLM|Intel

(PR) Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024

Neuchips, a leading AI Application-Specific Integrated Circuits (ASIC) solutions provider, will demo its revolutionary Raptor Gen AI accelerator chip (previously named N3000) and Evo PCIe accelerator card LLM solutions at CES 2024. Raptor, the new chip solution, enables enterprises to deploy large language models (LLMs) inference at a fraction of the cost of existing solutions.

"We are thrilled to unveil our Raptor chip and Evo card to the industry at CES 2024," said
Continue reading...

Open Source LLM

AMDVLK 2023.Q4.3 Released With Counter-Strike 2 Optimization, VKD3D Change

While we are now into 2024, AMDVLK 2023.Q4.3 was released today as a final EOY2023 update to this open-source AMD Vulkan driver that was supposed to be out last week but presumably got delayed due to the holidays.

AMDVLK 2023.Q4.3 is the newest update to this official AMD Radeon open-source Vulkan driver for Linux systems that is an alternative to the more common Mesa RADV driver that's developed by
Continue reading...

Open Source LLM

(PR) ASRock Launches Linux Version of AI QuickSet Software Tool

Leading global motherboard manufacturer, ASRock, just released the Microsoft Windows 10/11 64-bit version of the AI QuickSet software tool, which can help users quickly download, install and configure artificial intelligence (AI) application has aroused widespread response. Today it launches the Linux version of the AI QuickSet software tool, allowing Linux platform users quickly experience the fun of richer artificial intelligence (AI) applications!

The Linux version of ASRock AI QuickSet software tool supports Ubuntu 22.04.3 Desktop (

Open Source LLM

Plymouth Boot Splash Screen Sees First Update In Nearly Two Years

One of the often overlooked pieces of the Linux desktop software stack is Plymouth that for the past 15 years or so has been providing a graphical boot splash screen that succeeded Red Hat's former RHGB software or having no graphical boot splash screen at all on some Linux distributions. This week marked the first new release of Plymouth in nearly two years.

Plymouth helps to beautify the Linux boot process and also makes it convenient for entering passwords on full disk encryption setups and was great at its inception for targeting DRM/KMS
Continue reading...

Open Source LLM

Apple Wants LLMs to Run on Flash Memory to Bring AI to Smartphones and Laptops

Apple has been experimenting with Large Language Models (LLMs) that power most of today's AI applications. The company wants these LLMs to serve the users best and deliver them efficiently, which is a difficult task as they require a lot of resources, including compute and memory. Traditionally, LLMs have required AI accelerators in combination with large DRAM capacity to store model weights. However, Apple has published a paper that aims to bring LLMs to devices with limited memory capacity. By storing LLMs on NAND flash memory (regular

Open Source LLM

Apple Wants to Store LLMs on Flash Memory to Bring AI to Smartphones and Laptops

Apple has been experimenting with Large Language Models (LLMs) that power most of today's AI applications. The company wants these LLMs to serve the users best and deliver them efficiently, which is a difficult task as they require a lot of resources, including compute and memory. Traditionally, LLMs have required AI accelerators in combination with large DRAM capacity to store model weights. However, Apple has published a paper that aims to bring LLMs to devices with limited memory capacity. By storing LLMs on NAND flash memory (regular

Open Source LLM

PoCL 5.0 Released With Transparent OpenCL Over Networked Systems Capability

PoCL 5.0 has been officially released as the latest version of this "Portable Computing Language" implementation that provides OpenCL support for CPU-based execution as well as various other LLVM-based hardware back-ends like for NVIDIA PTX and oneAPI Level Zero. With PoCL 5.0 is also a new experimental back-end for targeting OpenCL support distributed across networked systems.

PoCL-Remote is the new code in PoCL 5.0 that allows for OpenCL to be transparently used across networked systems . Permitting OpenCL support on
Continue reading...

Open Source LLM

FFmpeg Begins Landing Support For AOMedia's IAMF - Immersive Audio Model and Formats

Yesterday the initial code for supporting the Alliance For Open Media's Immersive Audio Model and Formats (IAMF) was merged for the widely-used FFmpeg multimedia library.

The Immersive Audio Model and Formats (IAMF) specification is for providing an immersive audio experience for users. The Alliance For Open Media work consists of an Immersive Audio (IA) model, a standalone IA Sequence Format, and the ISO-BMFF-based IA container format. IAMF is described in its specification as:
"IAMF is used to provide Immersive
Continue reading...

Open Source LLM

TomTom creates AI-based conversational assistant for vehicles with Microsoft - Reuters

TomTom creates AI-based conversational assistant for vehicles with Microsoft Reuters

Open Source LLM

Cloud Hypervisor 37 LTS Released With Faster VM Restoration From Snapshots

A new Long-Term Support version of Cloud Hypervisor was released this week, which is the open-source project originally started by Intel as a cloud-focused and Rust-written VMM that now has wide industry backing including from multiple other CPU vendors.

Cloud Hypervisor continues moving forward as a Rust-leveraged, security-minded Virtual Machine Monitor for modern cloud workloads running Windows and Linux guests. Cloud Hypervisor 37 is the project's newest LTS release that means this version will be supported for the next 18
Continue reading...