Artificial intelligence is entering a new phase in which inference, rather than training, is becoming the dominant driver of computing demand, as rising costs and memory constraints begin to reshape AI infrastructure, according to researchers.
AI shifts to inference as costs rise, memory constraints emerge, researcher says
26
Mar