Open Source LLM

微軟與Nvidia發表全球最大含5,300億個參數的AI語言模型

微軟和Nvidia合作研究語言模型,發表了目前最大的單體Transformer語言模型 MT-NLG(Turing Natural Language Generation Model) ,具有5,300億個參數,作為Turing NLG 17B和Megatron-LM的後繼者,MT-NLG的規模是目前這類最大模型的3倍,能在完成預測、閲讀理解、常識


Open Source LLM

Portable Computing Language 1.8 Released For OpenCL On CPUs, Other Accelerators

PoCL is the open-source project implementing OpenCL for CPU-based execution as well as multi-device support by getting its Portable Computing Language implementation working atop NVIDIA GPUs via CUDA, AMD GPUs via HSA, and other back-ends by way of LLVM. PoCL 1.8 is out today as the newest feature release.


PoCL 1.8 brings support for the LLVM Clang 13.0 compiler toolchain, better debugging support when using LTTNG or Valgrind, better support for running the Portable Computing Language on NetBSD,

Open Source LLM

Microsoft and Nvidia created the world's largest, most powerful language model to date, but it's still biased

In context: The costs associated with AI model training have dropped more than 100 times between 2017 and 2019, yet they remain prohibitive for most startups to this day. This naturally favors large companies like Nvidia and Microsoft, who are using incredible amounts of engineering talent and money to create ever-larger and more capable AI models for use in natural language processing, enhancing search engine results, improving self-driving technology, and more. Scaling them up is the easy part --

Continue reading...

Open Source LLM

Windows Subsystem For Linux Arrives In Windows 11 Store

(Image credit: Microsoft)

Windows Subsystem for Linux (WSL) is now much easier to install on Windows 11 thanks to its recent inclusion in the Microsoft Store, as announced on the Microsoft blog . It’s also on the Windows 10 store, for those of you holding out against the upgrade steamroller, though oddly this isn’t mentioned in the blog post.

Previously, WSL had to be installed as an optional Windows component , but now it’s treated just like any other app. The


Open Source LLM

Apache OpenOffice 4.1.11 Released - Increased Font Size In Help, Other Mundane Changes

The Apache Software Foundation today announced the release of Apache OpenOffice 4.1.11 as their 14th release while stewarding this open-source office suite.

The Apache Software Foundation talks up this new v4.1.11 release as providing "dozens of improvements, features, and bug fixes" and they say "Apache OpenOffice delivered 317M+ downloads* and provides more than $25M in value to users per day. Apache OpenOffice supports more than 40 languages, offers

Open Source LLM

OpenBLAS 0.3.18 Released With LoongArch64 Support, More Optimizations

OpenBLAS 0.3.18 is out today as the latest feature update to this widely-used, open-source BLAS implementation.

OpenBLAS 0.3.18 brings a wide assortment of improvements and fixes, some of the highlights include:

- Support for LoongArch (LoongArch64) as the new Loongson MIPS-based CPU architecture.

- Intel Skylake X S/DGEMM kernels for small problem sizes.

- Optimized SBGEMM for Intel Cooper Lake processors.

- Support for run-time CPU core/thread

Open Source LLM

Facebook Is Aiming To Make Compilers Faster Using Machine Learning With CompilerGym

Facebook this week announced the open-sourcing of CompilerGym as their effort to improve compiler performance by leveraging machine learning to tackle optimization work.

CompilerGym is built by Facebook's AI team atop the OpenAI Gym and is ultimately striving to help enhance code compiler performance. They explained in this week's announcement, " CompilerGym packages important compiler optimization problems and makes them look like reinforcement learning problems. The compiler optimization problems we include are large in scale. For example, for one, the search space is 1044

Open Source LLM

LLVM 13.0 Released With Official Flang Binary Packages, Improved OpenCL Clang Support

LLVM 13.0 was tagged overnight as the latest half-year update to this widely-used, very powerful open-source compiler stack.

LLVM 13.0 is now available with many features that accumulated over the course of the summer. Some of the LLVM 13 highlights include:

- Flang as the Fortran front-end is now included in the official LLVM binary packages.

- The LLDB executable is now included with the official pre-built LLVM binaries packages.

- Initial Assembly support for Armv9

Open Source LLM

PoCL 1.8 OpenCL Implementation Coming With LLVM 13 Support, Better SPIR-V On CUDA

The first release candidate of the forthcoming PoCL 1.8 "Portable Computing Language" implementation is now available for testing.

PoCL is the open-source project implementing OpenCL for CPU-based execution as well as multi-device support by getting its Portable Computing Language implementation working atop NVIDIA GPUs via CUDA, AMD GPUs via HSA, and other experimental implementations through leveraging LLVM/Clang.

The PoCL 1.8-RC1 release has added support for the LLVM/Clang 13.0 toolchain, improves debugging with Valgrind

Open Source LLM

Microsoft's "CLOn12" Mesa Code Adds SPIR/SPIR-V Support

Microsoft's "CLOn12" effort to allow OpenCL over DirectX 12 by leveraging Mesa now has landed a major rework to its code within Mesa.

There's been a five month old merge request to Microsoft's CLC code within Mesa to rework its compiler interface. The focus of this big patch series from Microsoft has been on being able to support SPIR and SPIR-V within CLOn12. Plus this reworked code is in better shape.

SPIR, of course, being the intermediate language developed