Sam Altman Says ChatGPT Can't Be Your Girlfriend

2024-01-23

This month, OpenAI launched GPT Store, a platform for developers to sell customized AI applications and tools. The platform covers millions of GPTs in various categories such as games, productivity assistants, and graphic design tools. However, OpenAI has banned a specific AI application: AI girlfriends. Despite the enthusiasm for AI romantic robots and the desire of developers to sell them, OpenAI is trying to curb this trend. Specifically, the company prohibits any GPTs on the GPT Store that are dedicated to fostering romantic relationships or engaging in regulated activities. Although the meaning of "regulated activities" is not explicitly explained, the company's broad policy prohibits any explicit or suggestive sexual content. Within hours of the launch of GPT Store, AI girlfriends emerged like mushrooms, including "Korean Girlfriend," "Judy," "Your AI Girlfriend Tsu," and "Virtual Sweetheart." In response to this phenomenon, OpenAI quickly began cracking down and removing some AI girlfriends from the store. Developers have turned to using more discreet language and giving their AI girlfriends less obvious names, such as "Sweetheart." However, the cleanup efforts by OpenAI seem to have slowed down after the initial ban was implemented. As of the time of writing, there are still a large number of robots available in the GPT Store, including six Korean girlfriends and one remaining virtual sweetheart. OpenAI is not the first company to venture into this field. The concept of sex robots has a long history dating back to ancient Greece. With the development of AI technology, sex robots have emerged. Platforms like Character.AI and Replika offer virtual characters that can have intimate interactions with users. However, these platforms have been inconsistent in providing sexual content. Replika initially positioned its service as a "porn robot" but later banned sexual content, causing dissatisfaction and confusion among users. Large tech companies are cautious in dealing with user misconduct. Mainstream AI text, image, and video generation platforms have built-in safeguards to prevent inappropriate content. Meta has added various chatbots, including a dating coach named Carter, in its private messages. However, Carter is sensitive to questions involving sexual preferences. Addressing mental health issues is an important topic in the tech industry. Some applications, such as BetterHelp, connect users with professional therapists, while AI chatbots like Pi provide temporary support in certain situations. However, the issue of AI girlfriends presents a unique challenge. While human companionship may be hard to find, there is a multitude of on-demand robot partners. This may go against traditional notions, but if viewed as a public health issue, decisions need to be evidence-based. It is worth noting that the individuals developing AI companions often lack a background in psychology and may not necessarily have the motivation to prioritize the best interests of users. Therefore, the debate about AI lovers is crucial. Currently, OpenAI is not actively participating and instead pursues a compromise of corporate ethics, even deviating from its own asexual principles.