Using new hardware, generative AI outputs have become nearly instantaneous, opening up new opportunities for AI companies.
Tag: AI Inference
OpenAI Exploring Making its Own Chips for AI
OpenAI is looking at other options, including making its own chip for AI inferencing and training tasks.
Nvidia Announces New AI Chip to Lower LLM Costs
Nvidia announces GH200, a chip designed for more cost-effective AI inferencing by LLMs.