Open Source LLM

hipSYCL Seeing New Runtime For This SYCL Implementation For CPUs + ROCm/CUDA GPUs

The hipSYCL effort has been about supporting the Khronos SYCL single-source language built on C++ across any CPU with OpenMP as well as AMD Radeon GPUs via ROCm and NVIDIA GPUs via CUDA. The hipSYCL effort has a new "Lite" experimental runtime under development.

The hipSYCL effort is just one of several SYCL efforts in the ecosystem for running SYCL across CPUs, GPUs, and other accelerators. Here's a look via the hipSYCL project how their effort compares to others:

Continue reading...

Open Source LLM

Radeon ROCm 3.7 Release Enables OpenMP 5.0 By Default In AOMP

AMD's software team has released version 3.7 of ROCm, the Radeon Open Compute stack as their alternative to NVIDIA's closed-source CUDA compute environment.

The ROCm 3.7 release comes just hours after they released AOMP 11.8 as AMD's downstream of LLVM/Clang focused on providing Radeon OpenMP offloading support until the work is all upstreamed in LLVM/Clang. With AOMP 11.8 they are using the branched LLVM 11.0 code that is nearing its stable release

Open Source LLM

TensorFlow Lite Now Supports Tapping OpenCL For Much Faster GPU Inference

TensorFlow Lite for AI inference on mobile devices now has support for making use of OpenCL on Android devices. In doing so, the TFLite performance presents around a 2x speed-up over the existing OpenGL back-end.

To little surprise, the TensorFlow developers are finding their new OpenCL back-end for TFLite to be much faster than their OpenGL back-end for mobile inference. Thanks to better performance profiling abilities, native FP16 support, constant memory, and OpenCL being better designed for compute than OpenGL ES

Open Source LLM

LLVM's libclc Adds Mesa SPIR-V Target

Continuing on with all of the OpenCL Mesa work that's been going on by Red Hat developers in recent time, LLVM's libclc library now has support for targeting Mesa SPIR-V.

The new target added to LLVM's libclc is for emitting SPIR-V geared for Mesa's OpenCL support. Libclc is the LLVM sub-project focused on providing a library for OpenCL C run-time usage. Existing targets have included AMDGPU/AMDGN, R600, and NVIDIA NVPTX while SPIR-

Open Source LLM

OpenGL 4.5 Now Enabled For LLVMpipe With Mesa 20.3, To Be Back-Ported For 20.2

It landed sooner than anticipated but the LLVMpipe patches enabling OpenGL 4.5 support were merged to Mesa 20.3-devel today and are also marked for back-porting to the Mesa 20.2 series soon to be promoted to stable.

The Mesa 20.2 feature code was already set to take this software-based OpenGL driver from GL 3.3 to GL 4.3 after all the work carried out by Red Hat's David Airlie in recent months. But now his work on

Open Source LLM

LLVMpipe Has Patches Bringing It To OpenGL 4.5 Support

For years Mesa's LLVMpipe software rasterizer has been bound to OpenGL 3.3 support but finally in recent months Red Hat's David Airlie has been tackling OpenGL 4.x support... Right now in Mesa it's at OpenGL 4.3 but there are patches seemingly to be mainlined very soon that will take it up to OpenGL 4.5.

As it stands right now, Mesa 20.2 will ship in a few weeks with OpenGL 4.3 support for LLVMpipe rather than OpenGL

Open Source LLM|Intel

Intel Making Progress On Their "mOS" Modified Linux Kernel Running Lightweight Kernels

For a while now Intel has been quietly been working on "mOS" as the "multi-OS" that is a modified version of the Linux kernel that in turn is running lightweight kernels for high-performance computing purposes.

Intel mOS has been seldom talked about (or incredibly rare, based on public searches) as it's still largely a research project but showing much potential in the area of high performance computing for delivering better scalability and reliability of HPC workloads. In fact, mOS can already be used on
Continue reading...

Open Source LLM

Intel Compute Runtime Preparing For The Upcoming oneAPI Level Zero 1.0

It looks like Intel will soon be tagging their oneAPI Level Zero specification as version 1.0.

At the end of last year Intel published the oneAPI Level Zero specification as a low-level API for direct-to-metal interfaces for offload accelerators like FPGAs and GPUs. In the months since they have continued advancing the Level Zero interface and implementation within the Intel software stack (along with the other oneAPI components at large) while it's looking like Level Zero v1.0 is around the corner.

Currently

Open Source LLM

Mesa 20.1.5 Released For The Latest Stable Open-Source Vulkan / OpenGL Drivers

Mesa 20.1.5 provides the latest stable open-source Vulkan/OpenGL graphics drivers for the Linux desktop as the newest bi-weekly milestone...


Open Source LLM

FSF Has Finally Elected A New President

The Free Software Foundation has elected a new president following Richard Stallman's resignation last September from the FSF...