Open Source LLM

AMD promotes third-party app for running AI chatbots on local hardware

Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust .

Forward-looking: While Big Tech corporations are developing server-based AI services that live exclusively in the cloud, users are increasingly interested in trying chatbot interactions on their own local PCs. AMD says there's an app for that, and it can even work with third-party GPUs or AI accelerators.

The most popular AI services available today run almost exclusively on powerful Nvidia hardware, and they force customers to use

Continue reading...

Open Source LLM

Patronus AI發表可用來偵測LLM有否輸出侵權內容的CopyrightCatcher API

專門開發大型語言模型(LLM)評估工具的Patronus AI,本週發表了 CopyrightCatcher API ,可用來偵測LLM的輸出結果有否含有侵權內容。

Patronus AI表示,LLM的訓練資料經常含有受到版權保護的內容,也很容易自這些內容生成精確的複製品,而替在生產系統中


Open Source LLM

AMD帶來本地運行LLM,可構建專屬AI聊天機器人

繼英偉達發佈Chat with RTX以後,AMD現在也為用户帶來了可以本地化運行基於GPT的大語言模型(LLM),用户可以此構建專屬的AI聊天機器人,可以在具有XDNA NPU的Ryzen 7000/8000系列及內置AI加速核心的Radeon RX 7000系列GPU設備上

Continue reading...

Open Source LLM

微軟開發出擅長解決數學問題的Orca-Math小型語言模型

微軟在其小型語言模型Orca和Orca 2的研究基礎上,發展出了 Orca-Math ,這個新模型的特點在於,雖然僅為70億參數的小模型,但是經過代理指導(AgentInstruct)與迭代學習(Iterative Learning)的微調過程,其解決小學數學問題的能力已能超越大型語言


Open Source LLM|Intel

Intel Gaudi 2 AI Accelerator Powers Through Llama 2 Text Generation

Intel's " AI Everywhere " hype campaign has generated the most noise in mainstream and enterprise segments. Team Blue's Gaudi—a family of deep learning accelerators—does not hit the headlines all that often. Their current generation model, Gaudi 2, is overshadowed by Team Green and Red alternatives—according to Intel's official marketing spiel: "it performs competitively on deep learning training and inference, with up to 2.4x faster performance than NVIDIA A100 ." Habana, an Intel
Continue reading...

Open Source LLM|Intel

OpenVINO 2024.0 Brings More GenAI Features, New JavaScript API

Intel today released their open-source OpenVINO 2024.0 toolkit for optimizing and deploying AI inference across a range of hardware.

OpenVINO is Intel's wonderful open-source AI toolkit for speeding up AI inferencing across not only x86_64 CPUs but also ARM CPUs and other architectures, Intel integrated and discrete graphics, and more -- including their recent NPU plug-in for leveraging the Intel Neural Processing Unit found with new Core Ultra "Meteor Lake" SoCs.

With today's
Continue reading...

Open Source LLM

LLVM/Clang 18.1 Released With Intel AVX10.1 Work, Adds Clearwater Forest & Panther Lake

Out today is the big LLVM/Clang 18.1 release. Due to shifting to a new versioning scheme like GCC , today's LLVM 18.1 release is the first major stable release in the new series for what previously would have been called LLVM 18.0.

LLVM/Clang 18.1 is the newest six-month feature update to this open-source compiler stack. There's new Intel ISA support as well as new targets for Intel CPUs being released in the future
Continue reading...

Open Source LLM

Chinese researchers aim to replicate Open AI's Sora text-to-video capabilities

(Image credit: Shutterstock)

Researchers from Peking University and an AI company in Shenzhen called Rabbitpre have teamed up to start a project called Open-Sora. Their goal is to create a version of OpenAI's text-to-video model, Sora , with the help of the open-source community, that is easier to use and more scalable, reports South China Morning Post . OpenAI's Sora has created a lot of noise in the AI world since it came out, and this project is China'

Continue reading...

Open Source LLM

(PR) IBM Announces Availability of Open-Source Mistral AI Model on watsonx

IBM announced the availability of the popular open-source Mixtral-8x7B large language model (LLM), developed by Mistral AI, on its watsonx AI and data platform, as it continues to expand capabilities to help clients innovate with IBM's own foundation models and those from a range of open-source providers. IBM offers an optimized version of Mixtral-8x7B that, in internal testing, was able to increase throughput—or the amount of data that can be processed in a given

Open Source LLM

Opus 1.5 Audio Codec Able To Make Extensive Use Of Machine Learning

Xiph.Org's Opus open-source audio format for lossy audio coding has rolled out Opus 1.5 as a big update that is now making greater use of machine learning.

Opus 1.5 brings a "serious machine learning upgrade" per today's release announcement. The 1.5 demo page sums up the greater machine learning use as:
"This 1.5 release is unlike any of the previous ones. It brings many new features that can improve quality and the general audio experience. That
Continue reading...