Exploring an AI-native computing infrastructure at Tohoku University

Hiroyuki Takizawa (Tohoku University)

Abstract

This talk introduces recent efforts toward an AI-native computing infrastructure at Tohoku University. We present AOBA Express, a high-speed data transfer service connecting NanoTerasu and the AOBA supercomputer, and our design of a local LLM service integrated with HPC resources. We also discuss the challenges of sustainable AI service operation, focusing on the energy consumption and cost of LLM inference.

<= Go back