Trillium is Google’s TPU for AI training and inferencing that’s powering its latest suite of AI tools and models. The 6th generation is here.
Tag: AI Inferencing
Meta Releases Next-Gen MTIA Chip
MTIA v2 is Meta’s latest AI inferencing accelerator chip. It’s 3x better than the v1 while being 1.5x more power-efficient.
Intel Announces Gaudi 3 AI Chip with 50% Better Inferencing than Nvidia H100
Intel’s Vision 2024 announcement included details on its new chip, Gaudi 3. The chip is reported to perform 50% better for AI inferencing while consuming 40% less power and costing a fraction of the Nvidia H100, the current go-to AI chip for most companies.