Open Source LLM

Baidu launches paid version of ChatGPT-like Ernie Bot - Reuters

Baidu launches paid version of ChatGPT-like Ernie Bot Reuters

Open Source LLM

Ubuntu 24.04 "Noble Numbat" Opens For Development

The Ubuntu 24.04 codename has been revealed as "Noble Numbat" while kicking off this next development cycle that is all the more exciting due to being the next long-term support (LTS) release.

Following this month's Ubuntu 23.10 debut, Ubuntu 24.04 LTS development has begun as the "Noble Numbat" release. A Numbat is an animal native to Australia that is a small termite-eating marsupial.

Continue reading...

Open Source LLM

LLVM Looking To Better Collaborate Around Common AI/GPU/FPGA Offloading

While most hardware vendors are relying on LLVM when it comes to offloading compute work to GPUs, AI accelerators, FPGAs, and similar heterogeneous compute environments, right now each vendor is basically creating their own LLVM offloading run-time among a lot of other duplicated -- and often downstream only -- code. The new "llvm/offload" project hopes to lead to better collaboration in this area.

LLVM contributor Johannes Doerfert at the Lawrence Livermore National Laboratory (LLNL) is seeking comments from other LLVM stakeholders around working toward
Continue reading...

Open Source LLM

Rusticl OpenCL Still Striving For Better Performance, SYCL & HIP Features

Karol Herbst at Red Hat who leads development on Mesa's Rust-written OpenCL "Rusticl" driver presented to share the progress made over the course of the year on this modern alternative to Gallium3D's Clover as well as some of the work still being pursued by this open-source OpenCL implementation for Gallium3D drivers.

Herbst shared how the RadeonSI support has been coming together to complement the existing Intel iris and NVIDIA Nouveau support, work-in-progress support for the Raspberry Pi V3D
Continue reading...

Open Source LLM

TensorRT-LLM for Windows speeds up generative AI performance on GeForce RTX GPUs

TechSpot is celebrating its 25th anniversary. TechSpot means tech analysis and advice you can trust .

A hot potato: Nvidia has thus far dominated the AI accelerator business within the server and data center market. Now, the company is enhancing its software offerings to deliver an improved AI experience to users of GeForce and other RTX GPUs in desktop and workstation systems.

Nvidia will soon release TensorRT-LLM, a new open-source library designed to accelerate generative AI algorithms on GeForce RTX and professional RTX GPUs. The latest graphics

Continue reading...

Open Source LLM

Generative AI should be 'open and democratized': Meta chief

TOKYO -- Facebook parent Meta has jumped into the world of generative artificial intelligence by releasing an open-source AI model dubbed Llama 2. The ecosystem has already spread to Japan, where startup Elyza has developed a Japanese large language model based on Llama 2.

Nick Clegg, the president for global affairs at Meta, tells Nikkei in a recent interview that Meta adopts a business model that democratizes access to AI, as opposed to companies that charge fees and subscriptions for their AI models.


Open Source LLM

AdaptiveCpp 23.10 Alpha Released For What Was hipSYCL / OpenSYCL

AdaptiveCpp 23.10 has been released for this open-source project formerly known as hipSYCL and OpenSYCL for aiming to provide an open-source project around SYCL and C++ standard parallelism that can target all major CPU and GPU platforms.

AdaptiveCpp continues to work on supporting a variety of compilation flows and targeting a range of GPUs and CPUs for this project focused on embracing SYCL and C++ standard parallelism programming models.

Continue reading...

Open Source LLM

(PR) Striking Performance: LLMs up to 4x Faster on GeForce RTX With TensorRT-LLM

Generative AI is one of the most important trends in the history of personal computing, bringing advancements to gaming, creativity, video, productivity, development and more. And GeForce RTX and NVIDIA RTX GPUs, which are packed with dedicated AI processors called Tensor Cores, are bringing the power of generative AI natively to more than 100 million Windows PCs and workstations.

Today, generative AI on PC is getting up to 4x faster via TensorRT-LLM for Windows, an open-source library that accelerates inference performance for
Continue reading...

Open Source LLM

Oracle's NetSuite adds AI features to finance software - Reuters

Oracle's NetSuite adds AI features to finance software Reuters

Open Source LLM

Preorders now open: Preview of the new impressive(!) Luminar Neo with Generative AI tools