Autohändler: AI incident

An AI chatbot at a Chevrolet dealership in Watsonville, California, offered a customer a brand-new Chevrolet Tahoe for just one U.S. dollar. What’s particularly curious is that, when asked, the ChatGPT-based bot even confirmed that this offer was legally binding. However, no actual sale took place.

The cause was the deliberate manipulation of the chatbot, provided by Fullpath, through targeted user inputs. Using prompt injection, users tricked the AI into disregarding its intended behavioral rules and providing completely inappropriate responses. As a result, the bot also generated program code and allegedly arranged test drives for Tesla vehicles.

The provider, Fullpath, subsequently shut down the chatbot and announced additional security measures.