(PR) Compute-In-Memory APU Achieves GPU-Class AI Performance at a Fraction of the Energy Cost

GSI Technology, Inc. (Nasdaq: GSIT), the inventor of the Associative Processing Unit (APU), a paradigm shift in artificial intelligence (AI) and high-performance compute (HPC) processing providing true compute-in-memory technology, announced the publication of a paper led by researchers at Cornell University. Findings confirmed that GSI Technology's APU CIM (Compute-In-Memory) architectures can match GPU-level performance for large-scale AI applications with a dramatic reduction in energy consumption due to high-density and high-bandwidth memory associated with the CIM architecture.

Key findings include:
  • GPU-class performance - The Gemini-I APU delivered comparable throughput to NVIDIA's A6000 GPU on RAG workloads.
  • Massive energy advantage - The APU delivers over 98% lower energy consumption than a GPU over various large corpora datasets, underscoring its efficiency and sustainability.
  • Faster and more efficient than CPUs - The APU's unique design allows it to perform retrieval tasks several times faster than standard CPUs, shortening total processing time by up to 80%.
Read full story