NVIDIA

A Morgan Stanley report reveals high profitability in AI inference, with average profit margins exceeding 50% for “AI inference factories.” NVIDIA’s GB200 NVL72 leads with a near 78% profit margin, followed by Google’s TPU v6e pod (74.9%) and AWS’s Trn2 UltraServer (62.5%). Huawei’s Ascend CloudMatrix 384 achieves 47.9%. AMD’s MI300X and MI355X, however, show significant negative profit margins due to insufficient token generation efficiency.

Nvidia and AMD have agreed to remit 15% of their AI chip sales revenue in China to the U.S. government in exchange for export licenses. The White House confirmed the arrangement, initiated by the Trump administration, aims to reduce U.S. national debt, which exceeds $37 trillion. Nvidia’s H20 chip is currently the primary product affected. The Treasury Secretary sees this as mutually beneficial, allowing Nvidia to maintain its Chinese market presence while benefiting American taxpayers. This agreement may extend to other companies and sectors in the future.

WSTS forecasts a strong semiconductor market with $180 billion in sales for Q2 2025, a 19.6% year-over-year increase. This marks the sixth consecutive quarter of over 18% YoY growth. Nvidia leads the ranking of top semiconductor companies (excluding foundries and companies like Apple) with a projected $45 billion in revenue. Memory giants Samsung and SK Hynix follow. Nvidia’s stock surge, driven by AI demand, has significantly increased CEO Jensen Huang’s net worth, placing him among the world’s wealthiest individuals.

NVIDIA’s H20 AI chip, designed for the Chinese market, faced export restrictions but received conditional clearance in mid-July, requiring a 15% revenue remit to the U.S. government. Despite this, H20’s future in China is uncertain. NVIDIA defends its H20 exports, emphasizing the U.S.’s need to compete with China in AI and avoid repeating the 5G situation where it lost its leadership position. They believe U.S. AI can become the global standard if the U.S. actively participates in the competition.

The U.S. maintains a strict stance on AI chip exports to China, particularly regarding advanced technology like Nvidia’s “Blackwell” chip. Former President Trump opposes its sale to China, citing national security concerns and the potential for accelerating Chinese AI development. He believes the U.S. holds a significant technological advantage in chip design. Nvidia’s CEO is expected to discuss export licenses, highlighting ongoing negotiations. While some argue restricting access could spur indigenous Chinese chip development, the U.S. aims to limit China’s access to cutting-edge AI capabilities.

Reports suggest NVIDIA has secured a deal with Samsung for its 12-layer stacked HBM3E memory, potentially for use in liquid-cooled server systems. The initial order is rumored to be 30,000-50,000 units. Samsung has neither confirmed nor denied the agreement. While previous validation claims proved premature, Wall Street analysts are optimistic that Samsung will complete certification by the end of August and begin shipments to NVIDIA in Q4. Samsung aims to reduce HBM3E production costs and expects increased HBM profitability.

According to a report by The Information, Jensen Huang’s children, Madison and Spencer Huang, are now working at NVIDIA in emerging strategic divisions. Madison focuses on 3D simulation and Omniverse, while Spencer is involved in AI robotics. Both siblings previously pursued careers outside of tech before joining NVIDIA, obtaining MBAs after completing an AI program at MIT. They work in areas considered key to NVIDIA’s future growth, distinct from the core chip business.

Following U.S. approval of NVIDIA’s H20 AI chip export to China, Beijing reportedly summoned the company to discuss potential security risks, including alleged “backdoors.” NVIDIA denies these claims, but Chinese state media demands irrefutable proof of security. An exposé details potential hardware and software backdoor methods for remote shutdown and tracking, highlighting concerns over U.S. control of AI chip technology and its implications for Chinese data security and energy efficiency goals. The report suggests the H20 chip is neither secure nor environmentally friendly for China.

Tesla is reportedly shutting down its Dojo project, a move indicating a shift towards external partnerships for its AI needs. Head of Dojo, Peter Bannon, is expected to leave. Tesla plans to enhance collaborations with Nvidia and AMD for computing, and deepen its partnership with Samsung in chip manufacturing, evidenced by a $16.5 billion deal. Samsung will reportedly produce Tesla’s AI6 chip, while TSMC will manufacture the AI5. Tesla also plans to diversify Dojo’s supply chain, engaging Samsung and Intel for chip manufacturing and packaging.

A *People’s Daily* commentary questioning the security of Nvidia’s H20 chip has sparked debate over potential “tracking” and “remote shutdown” vulnerabilities. Nvidia denies any “backdoors,” but China seeks verifiable proof of security, emphasizing cybersecurity’s importance. U.S. legislation, the “Securing Semiconductor Supply Chains Act,” proposes tracking advanced chips to prevent illegal diversion. Experts believe regulatory scrutiny targets potential risks associated with Nvidia’s products, aiming to ensure their security before widespread adoption in China. Verifiable evidence from Nvidia CEO Jensen Huang is needed to alleviate concerns.