中國初創公司 DeepSeek 近日悄悄發佈新一代大型語言模型 DeepSeek-V3-0324，這款模型不但只以開源方式釋出，更能在 Apple 的 Mac Studio 裝置上流暢運行，有用家就實測能夠每秒處理超過 20 個 token，打破過往需依賴大型數據中心的傳統觀念
Ant Group’s use of China-made GPUs, not Nvidia, cuts AI model training costs by 20%
Ant Group , the fintech affiliate of Alibaba Group Holding , is able to train large language models (LLMs) using locally produced graphics processing units (GPUs), reducing reliance on Nvidia’s advanced chips and cutting training costs by 20 per cent, according to a research paper and media reports.
Ant’s Ling team, responsible for LLM development, revealed that its Ling-Plus-Base model, a Mixture-of-Experts
DeepSeek’s upgraded foundational model excels in coding and maths
Chinese artificial intelligence (AI) star DeepSeek has upgraded its open-source V3 large language model by adding parameters and improving capabilities in coding and solving mathematical problems.
The DeepSeek-V3-0324, named after its predecessor and the launch date, has “enhanced reasoning capabilities, optimised front-end web development and upgraded Chinese writing proficiency”, according to a notice on the company’s website.
The new version and DeepSeek V3 are both foundation models trained on vast data sets that can
How China is becoming an AI specialist in robocars and smart cities
From the stock market to government applications , DeepSeek has made an impact in China. With China’s economy beset by external challenges and domestic woes, DeepSeek offers hope of a turning point. But long before its emergence, artificial intelligence (AI) had been staring at us in the face.
How have TikTok and its domestic sibling Douyin risen to global prominence without
China’s PLA is using DeepSeek AI for non-combat support. Will actual combat be next?
The People’s Liberation Army is using DeepSeek’s artificial intelligence (AI) for non-combat support functions, according to Chinese media reports.
Analysts expect the AI models to find imminent application in battlefield intelligence surveillance and decision-making by the Chinese military.
DeepSeek’s open-source large language models (LLMs), which have drawn global attention and praise, are being used in PLA hospitals, People’s Armed Police (PAP), and national defence mobilisation organs, according to publicly available information.
OpenAI 升級語音模型 API 可調整語調、辨認口音、準確度更高
OpenAI 於稍早前推出新一代語音模型，透過 API 向全球開發者開放。此套模型包括語音轉文字及文字轉語音功能，提升語音代理的性能及應用範圍。新模型在語音識別準確度及可靠性上超越現有基準，特別適用於客戶服務及會議記錄等
(PR) AMD Introduces GAIA - an Open-Source Project That Runs Local LLMs on Ryzen AI NPUs
AMD has launched a new open-source project called, GAIA(pronounced /ˈɡaɪ.ə/), an awesome application that leverages the power of Ryzen AI Neural Processing Unit (NPU) to run private and local large language models (LLMs). In this blog, we'll dive into the features and benefits of GAIA, while introducing how you can take advantage of GAIA's open-source project to adopt into your own applications.
Introduction to GAIA
GAIA is a generative AI application designed
Introduction to GAIA
GAIA is a generative AI application designed
AMD launches Gaia open source project for running LLMs locally on any PC
Running large language models (LLMs) on PCs locally is becoming increasingly popular worldwide. In response, AMD is introducing its own LLM application, Gaia , an open-source project for running local LLMs on any Windows machine.
Gaia is designed to run various LLM models on Windows PCs and features further performance optimizations for machines equipped with its Ryzen AI processors (including the Ryzen AI Max 395+ ). Gaia uses the open-source Lemonade SDK from ONNX TurnkeyML for LLM inference.
OpenAI推出新語音模型，增強語音辨識準確度與語氣控制能力
OpenAI 宣佈推出 新一代語音轉文字與文字轉語音模型，擴展API功能強化多語言語音代理開發能力。新模型在語音辨識準確度、語音合成表現與客製化能力皆有提升，相較於舊版Whisper與其他競爭對手模型，在字詞錯誤率（WER）方面表現良
Exploring Hybrid CPU/GPU LLM Inference
A brief look into using a hybrid GPU/VRAM + CPU/RAM approach to LLM inference with the KTransformers inference library.
The post Exploring Hybrid CPU/GPU LLM Inference appeared first on Puget Systems .