Open Source LLM

Groq以LPU推論引擎提供全球最快LLM服務

2016年便創立的Groq在這幾天成為全球AI社羣最關注的話題,X上開始出現以Groq LPU推論引擎來執行大型語言模型(LLM)的展示,顯示它的執行速度飛快,更有不少人將Groq與ChatGPT作比較,在兩個機器人聊天室中 輸入同樣的提示 ,ChatGPT

Continue reading...

Open Source LLM

Intel Survey Finds Maintainer Burnout & Documentation Top Open-Source Challenges

At the end of last year Intel hosted a survey of open-source developers to collect their feeback on various open-source software issues. Intel’s 2023 Open Source Community Survey is all wrapped up, the data tallied up, and the results emailed out today to participants.

I haven't seen Intel post this data on any public web page yet, but per the email, below are all of the results collected from their open-source survey for 2023.

Continue reading...

Open Source LLM

Groq LPU AI Inference Chip is Rivaling Major Players like NVIDIA, AMD, and Intel

AI workloads are split into two different categories: training and inference. While training requires large computing and memory capacity, access speeds are not a significant contributor; inference is another story. With inference, the AI model must run extremely fast to serve the end-user with as many tokens (words) as possible, hence giving the user answers to their prompts faster. An AI chip startup, Groq, which was in stealth mode for a long time, has been making major moves in providing ultra-fast inference speeds
Continue reading...

Open Source LLM

AI趨勢周報第243期:羣創光電開源70億參數的繁中語言模型白龍

重點新聞(0209~0215)

羣創光電 LLM 白龍

羣創光電開源繁中LLM和基準測試資料集

2月初,羣創光電智能推進處Text&AIGC研發團隊 揭露 一款自行打造的繁中語言模型Bailong-instruct 7B和基準測試資料集,要推動繁中LLM的發展。進一

Continue reading...

Open Source LLM

OpenAI unveils Sora, a tool that uses AI to generate videos from written prompts

The maker of ChatGPT on Thursday unveiled its next leap into generative artificial intelligence with a tool that instantly makes short videos in response to written commands.


Open Source LLM

Amazon訓練歷來最大的語音合成AI模型BASE TTS

Amazon本週宣佈 AI開發團隊訓練出歷來最大、高達10億參數的語音合成(text-to-speech,TTS)模型BASE TTS,號稱生成的語音自然度超過現有語音合成系統。

BASE TTS模型全名為Big Adaptive Streamable TTS with Emergent abilities,是利用10萬小時公開可取得的語音資料訓練


Open Source LLM

Sora by OpenAI is the Text-to-Video AI Model Beyond Our Wildest Imagination

Sam Altman of OpenAI just unveiled Sora, the all new speech-to-video AI model that exactly the way science fiction would want such a thing to work—imagine fluid, photorealistic, true-color video clips based entirely on text prompts. Sora is generative AI on an exponentially higher scale than Dall-E, and presumably requires an enormously higher amount of compute power. But to those that can afford to rent out a large hardware instance, this means the power to create a video of just about anything.
Continue reading...

Open Source LLM

OpenAI reveals Sora, a tool to make instant videos from written prompts

SAN FRANCISCO (AP) — The maker of ChatGPT on Thursday unveiled its next leap into generative artificial intelligence with a tool that instantly makes short videos in response to written commands.

San Francisco-based OpenAI’s new text-to-video generator, called Sora, isn’t the first of its kind. Google, Meta and the startup Runway ML are among the other companies to have demonstrated similar technology.

But the high quality of videos displayed by OpenAI — some after CEO Sam Altman asked social media users to


Open Source LLM

OpenAI developing software that operates devices, automates tasks - The Information - Reuters

OpenAI developing software that operates devices, automates tasks - The Information Reuters

Open Source LLM

Windows 11 DirectML Preview Supports Intel Core Ultra NPUs

Chad Pralle, Principle Technical Program Manager at Microsoft's Windows AI NPU division has introduced the DirectML 1.13.1 and ONNX Runtime 1.17 APIs—this appears to be a collaborative effort—Samsung was roped in to some degree, according to Microsoft's announcement and a recent Team Blue blog entry . Pralle and his team are suitably proud of this joint effort that involved open source models: "we are excited to announce developer preview support for NPU acceleration in DirectML, the machine learning platform
Continue reading...