Open Source LLM

Nvidia Boosts AI Performance With TensorRT

(Image credit: Nvidia)

Nvidia has been busy working on further improvements to its suite of AI/ML (Artificial Intelligence/Machine Learning) and LLM (Large Language Model) tools. The latest addition is TensorRT and TensorRT-LLM, designed to optimize performance of consumer GPUs and many of the best graphics cards for running tasks like Stable Diffusion and Llama 2 text generation . We've tested some of Nvidia's latest GPUs using TensorRT and found performance in Stable Diffusion was improved by up to 70%

Continue reading...

Open Source LLM

Baidu touts upgraded Ernie AI tech as just as good as ChatGPT

HONG KONG -- Chinese search giant Baidu says the latest version of its generative artificial intelligence technology is as good as OpenAI's GPT 4, though the general public is not able to try it out just yet.

Baidu launched the updated large language model, dubbed Ernie 4, on Tuesday, slightly ahead of schedule.


Open Source LLM

China's Baidu unveils latest version of its Ernie AI model - Reuters

China's Baidu unveils latest version of its Ernie AI model Reuters

Open Source LLM

Rust-Written Coreutils Increases GNU Compatibility, Adds NetBSD Support

Released on Sunday was uutils 0.0.22 as the open-source software aiming to be a drop-in replacement to GNU Coreutils while being written in the Rust programming language for memory safety, better performance, and a modernized codebase.

With the uutils 0.0.22 release an additional eleven GNU test cases are now passing compared to their prior release. There still is though 48 tests being skipped and another 171 tests that are failing. In any event Uutils continues making good progress
Continue reading...

Open Source LLM

研究顯示微調LLM會削弱模型安全性

雖然為因地制宜微調大型語言模型(large language model,LLM)可提升其適用性, 但普林斯頓大學、維吉尼亞科技大學、及IBM研究院一項研究發現 ,微調LLM可能破壞開發者為模型加入的安全性,而且只要很低的成本就能辦到。

為使LLM適用不同

Continue reading...

Open Source LLM

openSUSE Leap Micro 5.5 Released For Lightweight Environments & Containers

OpenSUSE Leap Micro 5.5 is now available as the latest community version of SUSE Linux's Enterprise Micro. openSUSE Leap Micro 5.5 is a great choice for a lightweight Linux OS particularly for VMs and containers.

Leap Micro 5.5 is led by having Security Enhanced Linux (SELinux) improvements, Podman Docker and Hyper-V support on AArch64, Podman 4.4 and other upgraded packages like Cockpit 298. With Leap Micro 5.5, NetworkManager is now used as the default
Continue reading...

Open Source LLM

Atlassian to buy video messaging provider Loom for nearly $1 billion - Reuters.com

Atlassian to buy video messaging provider Loom for nearly $1 billion Reuters.com

Open Source LLM

Exclusive: OpenAI plans major updates to lure developers with ... - Reuters

Exclusive: OpenAI plans major updates to lure developers with ... Reuters

Open Source LLM

使用開源簡中語料微調LLM模型引起熱議,中研院宣佈已下架繁中優化的大型語言模型CKIP-Llama-2-7b

中研院在上週五 開源釋出 了用Meta的Llama 2所開發的繁中優化的大型語言模型CKIP-Llama-2-7b,並將其放上GitHub等平台,提供學術和商用,不過,最初在訓練階段使用簡中的開源資料集,導致多任務微調的繁中模型,在回答提問時可


Open Source LLM

AI趨勢周報第230期:超大機器人資料集開源,涵百萬場景可訓練通才機器人

重點新聞(0929~1006)

Google DeepMind 機器人 通才

超大機器人資料集開源,涵百萬場景可訓練通才機器人

Google DeepMind聯手33間學術實驗室,將22種機器人累積執行的15萬項任務、527個技能、100多萬個場景資料彙整為標準

Continue reading...