We all have the habit of trying to guess the killer in a movie before the big reveal. That’s us making inferences. It’s what happens when your brain connects the dots without being told everything ...

A significant shift is under way in artificial intelligence, and it has huge implications for technology companies big and small. For the past half-decade, most of the focus in AI has been on training ...

Nvidia just paid $20 billion for Groq's inference technology in what is the semiconductor giant's largest deal ever. The question is: Why would the company that already dominates AI training pay this ...

A food fight erupted at the AI HW Summit earlier this year, where three companies all claimed to offer the fastest AI processing. All were faster than GPUs. Now Cerebras has claimed insanely fast AI ...

You train the model once, but you run it every day. Making sure your model has business context and guardrails to guarantee reliability is more valuable than fussing over LLMs. We’re years into the ...

Memory is going to play a central role in AI inference workloads, and that's great news for Micron Technology and Sandisk ...

This episode is available on-demand. As data centers adapt to manage huge volumes of data from AI applications, new opportunities are appearing outside of major facilities. In the move from AI ...

AMD is strategically positioned to dominate the rapidly growing AI inference market, which could be 10x larger than training by 2030. The MI300X's memory advantage and ROCm's ecosystem progress make ...