Latency

Cerebras Systems’ stock rose 5% after announcing a partnership with AMD to integrate Cerebras’s wafer-scale chips into AMD’s AI systems. This collaboration targets the growing demand for low-latency, high-throughput AI solutions. Cerebras’s unique single-chip architecture aims to overcome communication bottlenecks in AI processing, offering significant performance advantages. The deal, alongside a major agreement with OpenAI, positions Cerebras as an influential player in AI infrastructure, addressing critical industry needs.

Google has launched Gemini 3.6 Flash and 3.5 Flash-Lite, AI models designed to drastically cut latency and token costs for enterprise AI agents. Gemini 3.6 Flash optimizes coding and multimodal reasoning with reduced token output and improved benchmark scores. Gemini 3.5 Flash-Lite targets high-volume, low-latency tasks, offering extreme cost-efficiency. A specialized variant, Gemini 3.5 Flash Cyber, is available for government entities and partners for code vulnerability remediation. These models aim to enhance the economics and efficiency of deploying autonomous AI agents.

AI spending in Asia Pacific faces challenges in ROI due to infrastructure limitations hindering speed and scale. Akamai, partnering with NVIDIA, addresses this with “Inference Cloud,” decentralizing AI decision-making for reduced latency and costs. Enterprises struggle to scale AI projects, with inference now the primary bottleneck. Edge infrastructure enhances performance and cost-efficiency, especially for latency-sensitive applications. Key sectors adopting edge-based AI include retail and finance. Cloud and GPU partnerships are crucial for meeting expanding AI workload demands, with security as a vital component. Future AI infrastructure will require distributed management and robust security.