SK hynix showcases AI technologies at hardware summit

The SK hynix booth installed at the AI Hardware Summit. (SK hynix)

SK hynix Inc. showcased its latest accelerator card and other artificial intelligence (AI)-related technologies at the AI Hardware & Edge AI Summit 2024 in San Jose, California.

According to the chipmaker on Thursday, SK hynix presented its Accelerator-in-Memory (AiM) solutions at the event, including the Accelerator-in-Memory-based Accelerator (AiMX).

The AiMX introduced at the event uses the GDDR6 AiM chip and is known to be specialized for large language models (LLMs).

SK hynix‘s AiM performs some computations within memory, offering higher bandwidth and superior power efficiency compared to conventional memory, enabling more economical implementation of the high computing power required by LLM-based generative AI, the company said.

SK hynix demonstrated the performance of AiMX using Meta Platforms Inc.’s latest LLM model, the Llama 3 70B.

The AiMX has doubled its memory capacity to 32GB from 16GB and can handle multiple groups of data simultaneously by using a multi-batch technique.

SK hynix also showcased AiM solutions that can be applied not only to data centers, but also to edge devices, or on-device AI.

“When applied to mobile on-device AI applications, AiMX improves LLM speed three-fold compared to mobile DRAM while maintaining the same power consumption,” the company said.

Lim Eui-cheol, research fellow and head of the company’s solution advanced technology team, stressed the importance of “close collaboration with companies involved in developing and managing data centers and edge systems to further advance AiMX products.”