Open Source LLM|Intel

Intel Compute Runtime 23.26.26690.22 Is A Big Update For Intel's OpenCL/L0 Stack

Intel's open-source Compute Runtime 23.26.26690.22 was released today, which is a big update for this OpenCL and oneAPI Level Zero (L0) stack for Windows and Linux systems. Due to the summer holidays and Intel's current release regiment for the Compute Runtime, v23.26.26690.22 is the first new release since mid-July.

Intel Compute Runtime 23.26.
Continue reading...

Open Source LLM

AMD AOMP 18.0-0 Compiler Brings Support For HIP Bundles, Zero Copy For MI300A

AOMP 18.0-0 has been released as the newest version of AMD's LLVM/Clang compiler downstream that is focused on providing the very latest patches around Radeon OpenMP GPU offloading and goes along with their ROCm compute stack.

Not to be confused with AOCC that is AMD's LLVM/Clang downstream focused on the very latest Zen CPU optimizations, AOMP continues to be focused on providing the leading-edge compiler support for GPU compute offload. With AOMP 18.0-0, the LLVM code

Open Source LLM

Nvidia開源TensorRT-LLM函式庫強化H100 GPU大型語言模型推論效能

目前大型語言模型應用蓬勃發展,Nvidia針對語言模型釋出一個能夠強化H100 GPU推論能力的函式庫 TensorRT-LLM ,其涵蓋TensorRT深度學習編譯器和各種工具,供開發者用於定義、最佳化和執行語言模型,適用於生產環境加速模型推論。

Nvidia提


Open Source LLM

Nvidia Claims Doubled Inference Performance with H100

(Image credit: Nvidia)

Nvidia says its new T ensorRT-LL open-source software can dramatically boost performance of large language models (LLMs) on its GPUs. According to the company, the capabilities of Nvidia's TensorRT-LL let it boost performance of its H100 compute GPU by two times in GPT-J LLM with six billion parameters. Importantly, the software can enable this performance improvement without re-training the model.

Nvidia developed TensorRT-LLM specifically to speed up performance of LLM

Continue reading...

Open Source LLM

PoCL-Remote Allows OpenCL To Be Transparently Used Across Networked Systems

PoCL began as an open-source project providing a CPU-based OpenCL implementation and over the years has added support for various LLVM back-ends such as for targeting AMD HSA, Intel Level Zero, and NVIDIA CUDA/PTX with its OpenCL implementation. The latest back-end merged ahead of Portable Computing Language 5.0 is a remote back-end that allows for OpenCL codes to be transparently utilized on networked systems for distributed computing.

PoCL's new remote back-end with the new networked daemon allows for
Continue reading...

Open Source LLM

Baidu CEO says more than 70 large AI language models released in ... - Reuters

Baidu CEO says more than 70 large AI language models released in ... Reuters

Open Source LLM

uutils 0.0.21 Released With More Improvements For GNU Coreutils Written In Rust

Released at the end of August was GNU Coreutils 9.4 while out this weekend is uutils 0.0.21 as the open-source, Rust-written re-implementation of the Coreutils utilities.

Uutils continues to improve compatibility for this re-implementation of GNU Coreutils in Rust, which is focused on better portability and security, among other benefits for this modern free software project.

With uutils 0.0.21 there are fixes for the commonly used cp command, panic fixes to different commands,
Continue reading...

Open Source LLM

OpenBLAS 0.3.24 Released With Intel Sapphire Rapids Improvements, Apple M2 Detection

OpenBLAS 0.3.24 is now available for this latest open-source BLAS and LAPACK implementation known for its advanced CPU optimizations and extensive tuning for providing for very speedy linear algebra kernels.

OpenBLAS 0.3.24 was released on Sunday with many fixes, improved NVIDIA HPC compiler support, LLVM 17 compilation support including for its Flang Fortran compiler, CPU model detection for Intel Alder Lake N, various Intel Sapphire Rapids fixes/improvements, CPU model auto-detection for Apple M2 processors, various
Continue reading...

Open Source LLM

AI startup Speak raises $16 million in latest funding led by Lachy ... - Reuters

AI startup Speak raises $16 million in latest funding led by Lachy ... Reuters

Open Source LLM

UAE's G42 launches open source Arabic language AI model - Reuters

UAE's G42 launches open source Arabic language AI model Reuters