RSS Reader

Google讓 BigQuery可透過Vertex AI存取大型語言模型Gemini 1.0 Pro ，使得用户能夠運用BigQuery資料進行多模態和進階推理，以支援醫療、供應鏈，甚至是零售和金融等產業人工智慧應用。Gemini 1.0 Pro是Google在去年底推出的大型語言模型，可以生成文字、

Open Source LLM

Intel's NPU Acceleration Library goes open source — Meteor Lake CPUs can now run TinyLlama and other lightweight LLMs

Tom's Hardware | March 2, 2024, 10:19 a.m. | Original

(Image credit: Intel)

Intel has released its open-source NPU Acceleration Library , enabling Meteor Lake AI PCs to run lightweight LLMs like TinyLlama. It's primarily intended for developers, but ordinary users with some coding experience could use it to get their AI chatbot running on Meteor Lake .

The library is out now on GitHub, and though Intel was supposed to write up a blog post about the NPU Acceleration Library, Intel Software Architect Tony Mongkolsmai shared it early on X . He showed a demo of the software

Open Source LLM|Intel

Intel open sources its NPU Acceleration library enabling compact AI models to run on Meteor Lake NPU

VideoCardz | March 2, 2024, 5 a.m. | Original

Intel open sources NPU Acceleration software for developers

Developers seeking to improve their software for next-gen Intel processors should consider looking into a new library released by the company. The software called NPU Acceleration Library is open source, and it is now available for download.

The library is written in Python, and it is designed to help developers boost their applications through Intel’s newest NPU (Neural Processing Unit) as available in Meteor Lake chips. Currently, no other Intel CPU features NPU, but by the end of this

Open Source LLM|Intel

Intel Makes Open-Source Its Python NPU Acceleration Library

Phoronix | March 1, 2024, 11:45 a.m. | Original

Intel has made open-source its NPU Acceleration Library (intel-npu-acceleration-library) as a user-space library for Windows and Linux systems for interfacing with the Neural Processing Unit (NPU) found initially on their new Meteor Lake laptops.

Intel has long been developing the iVPU Linux kernel driver that is upstream in the kernel for supporting the Intel NPUs (formerly known as VPUs) beginning with Meteor Lake. This NPU Acceleration Library is a convenient Python library for leveraging the NPU's potential.

Open Source LLM

ServiceNow, Hugging Face & NVIDIA Release StarCoder2 - a New Open-Access LLM Family

TechPowerUp News | Feb. 28, 2024, 3:05 p.m. | Original

ServiceNow, Hugging Face, and NVIDIA today announced the release of StarCoder2, a family of open-access large language models for code generation that sets new standards for performance, transparency, and cost-effectiveness. StarCoder2 was developed in partnership with the BigCode Community, managed by ServiceNow , the leading digital workflow company making the world work better for everyone, and Hugging Face , the most-used open-source platform, where the machine learning community collaborates on models, datasets, and applications. Trained on 61

Open Source LLM

AMD Readying Feature-enriched ROCm 6.1

TechPowerUp News | Feb. 28, 2024, 1:47 p.m. | Original

The latest version of AMD's open-source GPU compute stack, ROCm, is due for launch soon according to a Phoronix article—chief author, Michael Larabel, has been poring over Team Red's public GitHub repositories over the past couple of days. AMD ROCm version 6.0 was released last December—bringing official support for the AMD Instinct MI300A/MI300X, alongside PyTorch improvements, expanded AI libraries, and many other upgrades and optimizations. The v6.

Open Source LLM

Meta plans launch of new AI language model Llama 3 in July, The Information reports - Reuters

Reuters | Feb. 28, 2024, 11:31 a.m. | Original

Meta plans launch of new AI language model Llama 3 in July, The Information reports Reuters

Open Source LLM

OpenAI says New York Times 'hacked' ChatGPT to build copyright lawsuit - Reuters

Reuters | Feb. 27, 2024, 12:18 p.m. | Original

OpenAI says New York Times 'hacked' ChatGPT to build copyright lawsuit Reuters

Open Source LLM

Mold Linker Performance Remains Very Compelling In 2024 Over GNU Gold/ld, LLVM lld

Phoronix | Feb. 27, 2024, 9:29 a.m. | Original

The Mold high performance linker has long been known for offering excellent performance over GNU Gold/ld and LLVM lld while some fresh benchmark numbers reinforce the competitive advantage that persists today for this open-source project.

Mold lead developer Rui Ueyama has posted some fresh performance numbers for his linker up against the well known linkers from the GNU and LLVM projects.

Open Source LLM

AMD Preparing ROCm 6.1 For Release With New Features

Phoronix | Feb. 27, 2024, 6:26 a.m. | Original

It looks like AMD will soon be announcing the ROCm 6.1 update to its open-source GPU compute stack.

ROCm 6.0 debuted back in December with official support for the AMD Instinct MI300A/MI300X, more AI capabilities , and other improvements as it aims to better compete with NVIDIA's CUDA. ROCm 6.1 should be released soon as the next step in the GPU compute battle.

There has been a number of ROCm 6.1 related commits hitting

Google更新BigQuery支援Gemini 1.0 Pro模型，並正式推出AlloyDB AI

Intel's NPU Acceleration Library goes open source — Meteor Lake CPUs can now run TinyLlama and other lightweight LLMs

Intel open sources its NPU Acceleration library enabling compact AI models to run on Meteor Lake NPU

Intel open sources NPU Acceleration software for developers

Intel Makes Open-Source Its Python NPU Acceleration Library

ServiceNow, Hugging Face & NVIDIA Release StarCoder2 - a New Open-Access LLM Family

AMD Readying Feature-enriched ROCm 6.1

Meta plans launch of new AI language model Llama 3 in July, The Information reports - Reuters

OpenAI says New York Times 'hacked' ChatGPT to build copyright lawsuit - Reuters

Mold Linker Performance Remains Very Compelling In 2024 Over GNU Gold/ld, LLVM lld

AMD Preparing ROCm 6.1 For Release With New Features

Menu