Open Source LLM

Meta證實Llama模型已被應用於美國國家安全

Meta週一(11/4) 證實 ,已與眾多業者合作,將Llama模型導入美國政府機構以執行各種應用,包括國防與國家安全。

Llama的全名為Large Language Model Meta AI,是Meta在2023年2月發布的開源大型語言模型,迄今 下載量 已近3.5億次,目前的


Open Source LLM

Meta開源5款小型語言模型MobileLLM

在7月發表之後,Meta上週 宣佈 正式開源能在智慧型手機上執行的小語言模型MobileLLM系列。

Meta 4個月前 發表 這2個參數量小於10億的語言模型MobileLLM 125M及MobileLLM 350M,現在Meta又開發出更大參數量的模型版本,包括MobileLLM-600M/1


Open Source LLM

Hugging Face公佈手機執行的小型語言模型SmolLM2

Hugging Face 上週公佈 可在手機上執行的最新一代語言模型SmolLM2家族。

這是繼7月 首次問世 後,SmolLM家族最新版本,包括參數量135M、360M與1.7B三種規模,其中135M參數模型分成基礎及Instruct版,而360M與1.7B參數


Open Source LLM

AWS CEO estimates large city scale power consumption of future AI model training tasks — 'an individual model may require somewhere between one to 5GW of power'

(Image credit: Shutterstock)

Amazon Web Services CEO Matt Garman estimates that large language model (LLM) training two to three generations from now will require as much power as a large city. According to The Transcript’s quote posted on X (formerly Twitter), from a WSJ interview, Garman believes one model might need anywhere between one to five gigawatts to complete training, and that AWS is investing in power projects that could help these growing demands.

$AMZN AWS CEO on AI & Energy:"If you

Continue reading...

Open Source LLM

Chinese researchers build military AI using Meta’s open-source Llama model — ChatBIT allegedly performs at around 90% of the performance of OpenAI GPT-4 LLM

(Image credit: Shutterstock)

Chinese researchers with ties to China’s People’s Liberation Army (PLA) have built an AI model called ChatBIT, designed for military applications using Meta’s open-source Llama model. According to Reuters , some researchers are associated with the Academy of Military Science (AMS), the PLA’s top research group.

Three academic papers and several analysts have confirmed the information, with ChatBIT using Meta’s Llama 13B large language model (LLM). This LLM

Continue reading...

Open Source LLM

Meta Is Collaborating With The US Government To Explore Ways Its AI Models Could Be Used Across Various Departments

Meta's CEO, Mark Zuckerberg, recently announced that it is collaborating with the public sector to use its Llama AI model across various departments of the US government. This initiative aims to enhance the efficiency of government operations by advancing the process through AI-integrated capabilities. The collaboration marks a big step and could potentially pave the way for artificial intelligence applications in public services for more data-driven and responsive processes. Mark Zuckerberg is pushing the government to use its Llama model across various departments During Meta's Q3

Open Source LLM

Exclusive: Chinese researchers develop AI model for military use on back of Meta's Llama - Reuters

Exclusive: Chinese researchers develop AI model for military use on back of Meta's Llama Reuters

Open Source LLM

ChatGPT will now work as a search engine as OpenAI partners with some news outlets

SAN FRANCISCO (AP) — OpenAI is launching a ChatGPT-powered search engine that could put the company in direct competition with Google and affect the flow of internet traffic seeking news, sports scores and other timely information.

San Francisco-based OpenAI said Thursday it is releasing a search feature to paid users of ChatGPT but will eventually expand it to all ChatGPT users. It released a to a small group of users and publishers.

The original version of ChatGPT, released in 2022, was trained on huge troves


Open Source LLM|Intel

Ryzen AI 300 takes big wins over Intel in LLM AI performance — up to 27% faster token generation than Lunar Lake in LM Studio

(Image credit: AMD)

AMD's Ryzen AI 300 series of mobile processors beats Intel's mobile competition handily at local large language model (LLM) performance, according to recent in-house testing by AMD. A new blog post from the company's community blog outlines the tests AMD performed to beat Team Blue in AI performance, and how to make the most of the popular LLM program LM Studio for any interested users.

Most of AMD's tests were performed in LM Studio, a

Continue reading...

Open Source LLM

Shotcut 24.10 Open-Source Video Editor Adds Initial AI Feature

Shotcut 24.10 is now available as the latest feature release to this open-source, cross-platform video editor built atop the MLT framework, Qt6, FFmpeg, SDL, and other software components.

With Shotcut 24.10, this GPLv3-licensed video editor has added its first AI feature. By making use of OpenAI's Whisper and the Whisper.cpp open-source project, there is now AI-driven speech-to-text support integrated in this video editor
Continue reading...