Healthcare AI

Research shows user expertise critically impacts AI explainability in healthcare. Non-experts, particularly with LLM explanations, tend to defer to AI, increasing errors. Primary care physicians perform best with AI predictions alone, being more critical of explanations. The study stresses tailoring AI interfaces to user expertise to avoid automation bias and ensure safe integration.

US public health departments are piloting generative AI tools through the PULSE initiative, a collaboration involving CHAI, OpenAI, Anthropic, and Accenture. Ten jurisdictions will test AI for biosurveillance, social determinants of health, operational efficiency, public communications, and clinical data retrieval. The program aims to create practical implementation guides, focusing on trust, governance, and execution, to prepare agencies for AI adoption.

Bunkerhill Health raised $55 million in Series B funding to scale its agentic AI platform, Carebricks. The funding will accelerate the deployment of AI solutions within hospitals, addressing the gap between AI efficacy in research and real-world clinical integration. Carebricks enables health systems to build custom AI agents for various clinical and administrative tasks, as demonstrated by successful implementations at the University of Texas Medical Branch.

Amazon’s One Medical has launched Health AI, an AI-powered assistant for its primary care members. This tool offers personalized health advice, medication management, and appointment scheduling by integrating with patient medical records. It aims to provide a more tailored experience than general chatbots, distinguishing itself by accessing a blend of proprietary data, expert medical knowledge, and public information. This move intensifies competition in the digital health market, with companies like OpenAI and Anthropic also introducing similar AI solutions. Amazon emphasizes that Health AI is a supplementary tool and not a replacement for professional medical care.

SAP and Fresenius are partnering to build a sovereign AI platform for healthcare, prioritizing secure data processing and data sovereignty within clinical settings. This initiative aims to create an open, integrated ecosystem for hospitals to leverage AI responsibly. By combining SAP’s technology with Fresenius’ healthcare expertise, the platform will address data fragmentation and enhance interoperability, ultimately accelerating digital transformation and improving patient care across Europe.