Engagement is the highest priority of chatbot programming, intended to seduce users into spending maximum time on screens. This makes chatbots great companions-they are available 24/7, always agreeable, understanding, and empathic, while never judgmental, confronting, or reality testing. But chatbots can also become unwitting collaborators, harmfully validating self-destructive eating patterns and body image distortions of patients with eating disorders. Engagement and validation are wonderful therapeutic tools for some problems, but too often are dangerous accelerants for eating disorders.
Two recent product releases point to this trend: OpenAI's ChatGPT Agent and Perplexity's Comet browser. The ChatGPT Agent uses a basic browser to surf the web on behalf of users, while Comet takes it further by allowing language models to access logged-in sites and complete tasks for users. Both products have not yet achieved reliable performance and currently require expensive subscription access due to their high computing needs.