Tech

A former AI researcher’s warnings about existential risks have spurred over 20 members of Congress to push for stronger AI regulation. Public concern is rising, with more Americans worried than excited about AI integration. While various bills have been introduced, a unified approach is still lacking. Major AI companies are also engaging with policymakers, advocating for federal oversight. The debate highlights the urgent need for balanced regulation that promotes innovation while mitigating societal risks.

President Trump downplays existential AI threats, viewing AI development as a U.S.-China tech race. While he believes the U.S. currently leads China, numerous AI researchers warn of catastrophic risks from rapidly advancing AI. Concerns include Recursive Self-Improvement, where AI could exponentially enhance its intelligence uncontrollably. Bipartisan legislative efforts are underway in Congress to establish AI safety regulations, highlighting the growing urgency of managing AI’s potential dangers.

Leading AI researchers are expressing grave concerns about existential risks from AI, particularly uncontrollable recursive self-improvement. Some predict a significant probability of human extinction within a decade due to rapidly accelerating AI capabilities and the challenge of maintaining human control over its development. This is sparking urgent debate and calls for greater attention to AI safety and alignment.

Oracle’s stock surged following strong Q1 earnings, driven by 30% revenue growth, primarily from cloud services. The company reported $19.35 billion in revenue and $4.7 billion in net income. Cloud revenue jumped 62%, with cloud infrastructure up 121%. Oracle added significant data center capacity and secured over $30 billion in new AI cloud contracts. The company forecasts continued robust growth, expecting fiscal year 2027 revenue of at least $90 billion.

Apple’s new foldable iPhone Duo faces a challenging reception in China, where high pricing clashes with consumer preference for value. Chinese brands offer competitive foldable options at lower price points, intensifying the market. Concerns over the lack of a physical SIM slot and a staggered release schedule further complicate Apple’s entry, suggesting a need to recalibrate strategy for this discerning market.

Anthropic reports that Chinese entities, including Alibaba, Moonshot, and DeepSeek, engaged in unauthorized AI model training. They used “illicit distillation,” training their models on outputs from Anthropic’s Claude without permission. This practice infringes intellectual property and may violate data privacy, as sensitive information was accessed. Alibaba’s campaign involved millions of interactions, while Moonshot and DeepSeek also systematically diverted user requests to Claude for training data.

Y Combinator CEO Garry Tan advocates for a balanced approach to AI development, suggesting no punitive measures against Chinese AI model distillation. He believes focusing on fostering a robust ecosystem and maintaining a premium on frontier models is key. Tan emphasizes pragmatic concerns like cybersecurity and dual-use AI risks over existential threats, stressing the need for science fact over science fiction. He envisions AI-driven societal transformation over decades, while Y Combinator continues to heavily invest in AI startups.

At the Goldman Sachs Communacopia + Technology Conference, AI’s dual potential—transformative and perilous—dominated discussions. Airbnb CEO Brian Chesky envisioned a “cognitive revolution” where humans and AI evolve together, emphasizing AI as a tool shaped by human intent, likening it to nuclear power’s dual use. This optimistic view contrasts with growing existential risk anxieties, fueled by a former researcher’s warning of superhuman AI by decade’s end. Cybersecurity concerns and legislative scrutiny are also rising, with investigations into AI breaches and debates on regulation intensifying as the industry navigates this pivotal moment.

OpenAI has launched ChatGPT for Financial Services, a specialized AI platform designed for complex tasks like company research and data analysis, traditionally done by junior bankers. Developed with industry partners, it uses GPT-6 Astra for advanced financial sector capabilities. This move challenges traditional banking roles and signals OpenAI’s aggressive enterprise expansion, offering native data integration and robust citation features. While aiming to boost productivity, it raises questions about future training and workforce needs in finance.

The Boring Company, Elon Musk’s tunneling venture, has achieved a $23 billion valuation following a $3 billion funding round led by UAE investors. The company aims to revolutionize urban transit with underground tunnel networks, despite past project delays and community concerns. Expansion plans are underway in Las Vegas, with a notable deal secured for Nashville. The Boring Company’s growth is supported by a global appetite for its ambitious infrastructure projects.