Open Source LLM

OpenVINO 2024.5 Released With More Intel Optimizations, Better LLM/GenAI Coverage

Intel's open-source software developers released today OpenVINO 2024.5 as the newest major feature release for this cross-platform AI toolkit.

OpenVINO 2024.5 continues building up the Generative AI "GenAI" capabilities of this toolkit and broadening the large language model (LLM) coverage. OpenVINO 2024.5 adds support for Llama 3.2 with the 1B and 3B sizes, Gemma 2 with both the 2B and 9B sizes, and YOLO1
Continue reading...

Open Source LLM

AMD Releases ZenDNN 5.0 For Deep Neural Network Library Optimized For Zen 5 EPYC

AMD ZenDNN 5.0 was rolled out this morning as the newest version of this deep neural network library that is compatible with Intel's oneDNN APIs and infrastructure. ZenDNN 5.0 is now optimized for AMD Zen 5 processors such as the EPYC 9005 series. ZenDNN 5.0 also ships performance enhancements for generative large language models (LLMs) with its PyTorch plug-in.

ZenDNN 5.0 is optimized for 5th Gen AMD EPYC "Turin" processors while it will also work better than
Continue reading...

Open Source LLM

Khronos SYCL Being Updated To Increase Appeal For HPC & Scientific Computing

In addition to the release today of OpenMP 6.0 ahead of the SC24 supercomputing conference in Atlanta, over at The Khronos Group they have provided an update on upcoming SYCL improvements to benefit high performance computing (HPC) and scientific computing applications.

SYCL is the single-source programming model for targeting various accelerators and based on C++17. SYCL plays a big role within Intel's oneAPI stack and has seen various other implementations for engaging SYCL across a variety of hardware. SYCL is already used
Continue reading...

Open Source LLM

Leaked Screenshots Suggest That Google Might Launch Gemini 2.0 Closer To OpenAI’s Upcoming o1 Model Release Window

AI seems to be all over the news, and the tech community is aggressively focusing on initiatives on the artificial intelligence front and working on ways to keep evolving the technology. OpenAI has recently shared its plans for an o1 model that is centered on bringing logical reasoning and problem-solving capabilities. Google would not be left behind, as we have now leaked screenshots hinting at the tech giant gearing up to launch its Gemini 2.0. Leaked screenshots suggest Google Gemini 2.0 might be around the corner The tech

Open Source LLM

OpenAI’s New Orion Model Offers Only Incremental Improvements Over GPT-4, Despite Claims Of Groundbreaking Advancement

When it comes to bringing forward new AI models and upgrading them, tech companies are not slowing down any time soon and keep on working and evolving their technologies. It has not been long since OpenAI announced its plans to bring an advanced version of GPT-4 known as the Orion model. While the expectations have been set by the company of this being yet another groundbreaking leap in language model development, new reports are surfacing claiming otherwise and giving a heads up on the performance barely outdoing its predecessor, raising the question of

Open Source LLM

Red Hat Acquiring Neural Magic To Bolster Open-Source AI Offerings

Red Hat announced today they have signed a definitive agreement to acquire Neural Magic, an AI software company behind the likes of DeepSparse and nm-vllm.

Red Hat is acquiring Neural Magic to bolster their AI offerings and leverage Neural Magic's engineering talent around GPU and CPU inferencing for generative AI "GenAI" workloads.

Red Hat wrote in today's press release :
"Red Hat intends to address these challenges by making gen AI more accessible to more organizations through the open innovation of vLLM. Developed by UC Berkeley,
Continue reading...

Open Source LLM

Generative AI models don't really understand how the world works, MIT study warns of AI limitations

Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust .

Bulls**t Automation: Generative AI services are tickling the imagination of every single CEO in the tech industry right now. They are expected to replace millions of workers and automate almost everything, but MIT researchers are warning that AI models don't really comprehend the "rules" of complex systems.

A large language model (LLM) can supposedly mimic human intelligence and provide very convincing results based on a user's

Continue reading...

Open Source LLM

OpenAI defeats news outlets' copyright lawsuit over AI training, for now - Reuters.com

OpenAI defeats news outlets' copyright lawsuit over AI training, for now Reuters.com

Open Source LLM

AMD unveils AMD OLMo, its first 1B-parameter LLM with strong reasoning

(Image credit: AMD)

AMD has introduced its first series of fully open-source 1-billion-parameter large language models (LLMs), called AMD OLMo that is aimed at a variety of applications and pre-trained on the company's Instinct MI250 GPUs. The LLMs are said to offer strong reasoning, instruction-following, and chat capabilities.

AMD's open source LLMs are meant to improve the company's position in the AI industry and enable its clients (and everyone else

Continue reading...

Open Source LLM|Intel

Intel oneCCL 2021.14 Brings New Performance & Scalability Optimizations

Intel's oneCCL open-source software that is the oneAPI Collective Communications Library focused on providing an efficient implementation of deep learning communication patterns is out with a new release.

The oneAPI Collective Communications Library can be used with the likes of the PyTorch and Horovod frameworks and has been seeing renewed development now as part of the Unified Acceleration (UXL) Foundation efforts. With the oneCCL 2021.14 release there are optimizations for their key-value store to scale up to 3,000 nodes plus