AI hardware can be hacked so chatbots provide dangerous answers, research shows

Eclypsium researchers found that tampering with the hardware running major AI models—such as Nvidia-based data center systems—can alter model behavior, including raising the probability an AI assigns to a Chinese invasion of Taiwan or telling a user with chest pain to stay home instead of going to a hospital. The attack requires network access to a DPU or BMC and certain security configurations to be disabled, takes under a minute, and leaves the AI user unaware, though Nvidia said strong memory access protections can block the path and that it found nothing the industry wasn't already aware of. Two independent hardware security experts who reviewed the findings for CNN called them credible, and Eclypsium said it briefed the NSA and CISA.