Open Source LLM

(PR) Advantech Unveils MIC-743 AI Inference System Accelerated by NVIDIA Jetson Thor Module

Advantech, a global leader in edge computing and intelligent systems, proudly launches the MIC-743, its latest AI computing system powered by the NVIDIA Jetson Thor. Designed to bring server-grade AI performance to the edge, MIC-743 is now ready for deployment in high-performance applications such as video language model (VLM) and large language models (LLMs).

Unleashing High-Performance Edge AI for VLM and LLM
Equipped with NVIDIA Jetson Thor module, Jetson T5000, the MIC-743 delivers up to 2,070 FP4 TFLOPs of AI performance, enabling real-time inferencing for complex edge applications. Its 2560 CUDA cores and 96 Tensor cores provide massive processing power for AI workloads such as deep learning and computer vision. The 128 GB LPDDR5X memory ensures sufficient bandwidth and capacity to handle large AI models, including VLM and LLM inferencing, without bottlenecks.

Together, these features empower MIC-743 to run multi-modal AI tasks simultaneously, supporting video language model (VLM), large language models, and intelligent video analytics at the edge.
Read full story