Open Source LLM|Intel

AMD OpenSIL Will Be Talked About Later This Month At The 2023 OCP Global Summit

Earlier this year at the OCP Regional Summit in Prague AMD first presented openSIL as their new open-source CPU silicon initialization effort that can integrate with Coreboot and open-source boot firmware solutions. AMD openSIL is currently being prototyped on Genoa platforms but in a few years will eventually replace AGESA on both client and server processors . Later this month at the OCP Global Summit, there will be a new presentation on AMD openSIL.

AMD making this open-source CPU silicon initialization code available as part of the new openSIL project has
Continue reading...

Open Source LLM

LLVM Merges Initial Support For OpenMP Kernel Language

Merged to LLVM 18 Git yesterday was the initial support for the OpenMP kernel language, an effort around having performance portable GPU codes as an alternative to the likes of the proprietary CUDA.

This work is a set of extensions to LLVM OpenMP coming out of researchers at Stony Brook University and the Lawrence Livermore National Laboratory (LLNL). See their 2023 research paper while the abstract on this OpenMP kernel language effort comes down to:
"In this work, we introduce extensions to LLVM OpenMP, transforming it into

Open Source LLM

中研院正式開源釋出繁中優化的Llama 2大型語言模型,正式採用Apache2.0釋出

台灣商用開源的繁中LLM模型現在有了新選擇!從事中文自然語言處理(NLP)研究的中研院CKIP Lab中文詞知識庫小組,最新開源釋出了以Llama 2開發的繁中優化的大型語言模型CKIP-Llama-2-7b,提供給台灣學術圈或AI開發者來使用,


Open Source LLM|Intel

ChatGPT-owner OpenAI is exploring making its own AI chips - Reuters

ChatGPT-owner OpenAI is exploring making its own AI chips Reuters

Open Source LLM

高效框架StreamingLLM可處理無限長度文本,解決LLM串流應用困境

由麻省理工學院、Meta AI以及卡內基美隆大學研究人員聯手,開發了讓語言模型能夠處理無限長度串流輸入的框架 StreamingLLM 。這個研究針對將語言模型部署在串流應用程式中,可能遇到的記憶體消耗與泛化長序列等問題提出解決方案,使


Open Source LLM

Meta新開源模型Llama 2 Long整體長文處理效能超越GPT-3.5 Turbo

Meta默默發表了新的語言模型研究論文 〈Effective Long-Context Scaling of Foundation Models〉 ,這篇論文講述關於處理長文本,最高可達到32,768個token的模型Llama 2 Long。這個模型表現良好,經過廣泛的基準測試評估,在長上下文任務方面,Llama 2 Long明顯優於之


Open Source LLM

Intel Releases OpenVKL 2.0 With Intel GPU Acceleration Via SYCL

Similar to Embree 4.0 adding Intel graphics acceleration earlier this year via SYCL, Intel's OpenVKL library that is also part of their oneAPI rendering toolkit has now added SYCL graphics aceleration with OpenVKL 2.0.

OpenVKL 2.0 was just released today as the newest major update to this open-source volume kernel library. OpenVKL provides a collection of high performance volume computation kernels. OpenVKL has long been quite good on CPUs -- and even non-Intel and non-x86_64 platforms
Continue reading...

Open Source LLM

OpenAI competitor Mistral brings open-source language models back to the forefront

TechSpot is celebrating its 25th anniversary. TechSpot means tech analysis and advice you can trust .

TL;DR: OpenAI's massively successful ChatGPT service was fueled by purely open-source projects such as TensorFlow and PyTorch, even though the company now sells it for a fee. A French startup wants to bring code openness back into the AI equation with a new chatbot that cannot be censored.

Mistral is a new AI company co-founded by former Google and Meta alumni valued at $260 million.

Continue reading...

Open Source LLM

Mistral AI開源輕巧高效能語言模型Mistral 7B

人工智慧新創公司Mistral AI以Apache 2.0授權 開源Mistral 7B語言模型 ,Mistral 7B的特別之處在於其規模較小僅有73億,但是在所有基準測試上,其表現都優於規模更大的語言模型Llama 2 13B,還具有編寫程式碼以及處理8,000個token的


Open Source LLM

openSUSE Leap Micro 5.5 Beta Published For This Container & VM Focused Distro

Ahead of the planned stable release in October, the openSUSE Leap Micro 5.5 Beta was published today for this lightweight Linux operating system built for containers and virtualized workloads.

The openSUSE Leap Micro project continues to be the community version of SUSE Linux Enterprise Micro. Leap Micro caters to container and virtualization (VM) use-cases with its lightweight approach and focusing on reliability. OpenSUSE Leap Micro 5.5 has been working on better Security Enhanced Linux (SELinux) support as one of the major changes this cycle.

Following
Continue reading...