Neuchips to Showcase Revolutionary Raptor Gen AI Accelerator Chip and Evo PCIe Accelerator Card LLM Solutions at CES 2024
Neuchips, a leading provider of AI Application-Specific Integrated Circuits (ASIC) solutions, will be demonstrating its groundbreaking Raptor Gen AI accelerator chip (previously known as N3000) and Evo PCIe accelerator card LLM solutions at CES 2024. The Raptor chip allows enterprises to deploy large language models (LLMs) inference at a significantly lower cost compared to existing solutions.
"We are excited to introduce our Raptor chip and Evo card to the industry at CES 2024," said Ken Lau, CEO of Neuchips. "Neuchips' solutions represent a major advancement in price-to-performance ratio for natural language processing. With Neuchips, any organization can now harness the power of LLMs for a wide range of AI applications."
Democratizing Access to LLMs
Raptor and Evo together provide an optimized stack that makes leading LLMs easily accessible for enterprises. Neuchips' AI solutions significantly reduce hardware costs compared to existing solutions, while also minimizing electricity usage for improved energy efficiency and lower total cost of ownership.
At CES 2024, Neuchips will be demonstrating the capabilities of Raptor and Evo by accelerating the Whisper and Llama AI chatbots on a Personal AI Assistant application. This demonstration showcases the power of LLM inferencing for real business needs.
Enterprises interested in experiencing Neuchips' breakthrough performance can visit booth 62700 to enroll in a free trial program. Additional technical sessions will highlight how Raptor and Evo can reduce deployment costs for speech-to-text applications.
Raptor Gen AI Accelerator Powers Breakthrough LLM Performance
The Raptor chip delivers up to 200 tera operations per second (TOPS) per chip. Its exceptional performance for AI inferencing operations, such as Matrix Multiply, Vector, and embedding table lookup, is ideal for Gen-AI and transformer-based AI models. This impressive throughput is achieved through Neuchips' patented compression and efficiency optimizations tailored to neural networks.
Evo Gen 5 PCIe Card Sets New Standard for Acceleration and Low Power Consumption
Complementing Raptor is Neuchips' ultra-low powered Evo acceleration card. Evo combines PCIe Gen 5 with eight lanes and LPDDR5 32 GB to achieve 64 GB/s host I/O bandwidth and 1.6-Tbps per second of memory bandwidth, all while consuming just 55 watts per card.
As demonstrated with DLRM, Evo also offers 100% scalability, allowing customers to increase performance linearly by adding more chips. This modular design ensures investment protection for future AI workloads.
An upcoming half-height half-length (HHHL) form factor product, Viper, is set to be launched in the second half of 2024, providing even greater deployment flexibility. The Viper series brings data center-class AI acceleration in a compact design.
