Several AI chatbots designed for fantasy and sexual role-playing conversations are leaking user prompts to the web in almost real time, new research seen by WIRED shows. Some of the leaked data shows ...

Several AI <a href="https://www.wired.com/tag/chatbots/" rel="nofollow">chatbots</a> designed for fantasy and sexual role-playing conversations are leaking user prompts to the web in almost real time, new research seen by WIRED shows. Some of the leaked data shows people creating conversations detailing child sexual abuse, according to the research.Conversations with generative AI chatbots are near instantaneous—you type a prompt and the AI responds. If the systems are configured improperly, however, this can lead to chats being exposed. In March, researchers at the security firm <a href="http://www.upguard.com/blog/llama-cpp-prompt-leak" rel="nofollow">UpGuard discovered around 400 exposed AI systems</a> while scanning the web looking for misconfigurations. Of these, 117 IP addresses are leaking prompts. The vast majority of these appeared to be test setups, while others contained generic prompts relating to educational quizzes or nonsensitive information, says Greg Pollock, director of research and insights at UpGuard. “There were a handful that stood out as very different from the others,” Pollock says.Three of these were running-role playing scenarios where people can talk to a variety of predefined AI “characters”—for instance, one personality called Neva is described as a 21-year-old woman who lives in a college dorm room with three other women and is “shy and often looks sad.” Two of the role-playing setups were overtly sexual. “It’s basically all being used for some sort of sexually explicit role play,” Pollock says of the exposed prompts. “Some of the scenarios involve sex with children.”Over a period of 24 hours, UpGuard collected prompts exposed by the AI systems to analyze the data and try to pin down the source of the leak. Pollock says the company collected new data every minute, amassing around 1,000 leaked prompts, including those in English, Russia, French, German, and Spanish.It was not possible to identify which websites or services are leaking the data, Pollock says, adding it is likely from small instances of AI models being used, possibly by individuals rather than companies. No usernames or personal information of people sending prompts were included in the data, Pollock says.Across the 952 messages gathered by UpGuard—likely just a glimpse of how the models are being used—there were 108 narratives or role-play scenarios, UpGuard’s research says. Five of these scenarios involved children, Pollock adds, including those as young as 7.“LLMs are being used to mass-produce and then lower the barrier to entry to interacting with fantasies of child sexual abuse,” Pollock says. “There's clearly absolutely no regulation happening for this, and it seems to be a huge mismatch between the realities of how this technology is being used very actively and what the regulation would be targeted at.”WIRED last week reported that a South Korea–based <a href="https://www.wired.com/story/genomis-ai-image-database-exposed/" rel="nofollow">image generator was being used to create AI-generated child abuse</a> and exposed thousands of images in an open database. The company behind the website <a href="https://www.wired.com/story/genomis-ai-image-database-exposed/" rel="nofollow">shut the generator down</a> after being approached by WIRED. Child-protection groups around the world say AI-generated child sexual abuse material, which is illegal in many countries, is growing quickly and <a href="https://www.wired.com/story/generative-ai-images-child-sexual-abuse/" rel="nofollow">making it harder to do their jobs</a>. The UK’s anti-child-abuse charity has also <a href="https://www.iwf.org.uk/media/opkpmx5q/iwf-ai-csam-report_update-public-jul24v11.pdf" rel="nofollow">called</a> for new laws against generative AI chatbots that “simulate the offence of sexual communication with a child.”All of the <a href="http://www.upguard.com/blog/llama-cpp-prompt-leak" rel="nofollow">400 exposed AI systems found by UpGuard</a> have one thing in common: They use the open source AI framework called llama.cpp. This software allows people to relatively easily deploy open source AI models on their own systems or servers. However, if it is not set up properly, it can inadvertently expose prompts that are being sent. As companies and organizations of all sizes deploy AI, properly configuring the systems and infrastructure being used is <a href="https://www.wired.com/story/exposed-deepseek-database-revealed-chat-prompts-and-internal-data/" rel="nofollow">crucial to prevent leaks</a>.Rapid improvements to generative AI over the past three years have led to an explosion in AI companions and systems that <a href="https://www.wired.com/story/openai-voice-mode-emotional-attachment/" rel="nofollow">appear more “human.”</a> For instance, Meta has <a href="https://about.fb.com/news/2023/09/introducing-ai-powered-assistants-characters-and-creative-tools/" rel="nofollow">experimented</a> with AI characters that people can chat with on WhatsApp, Instagram, and Messenger. Generally, companion websites and apps allow people to have free-flowing conversations with AI characters—portraying characters with customizable personalities or as public figures such as celebrities.People have found friendship and support from their conversations with AI—and not all of them encourage romantic or sexual scenarios. Perhaps unsurprisingly, though, people have <a href="https://www.theverge.com/c/24300623/ai-companions-replika-openai-chatgpt-assistant-romance" rel="nofollow">fallen in love with their AI characters</a>, and dozens of <a href="https://www.wired.com/story/ai-girlfriends-privacy-nightmare/" rel="nofollow">AI girlfriend</a> <a href="https://www.wired.com/story/dippy-ai-girlfriend-boyfriend-reasoning/" rel="nofollow">and</a> <a href="https://www.wired.com/story/ads-for-explicit-ai-girlfriends-swarming-facebook-and-instagram/" rel="nofollow">boyfriend</a> services have popped up in recent years.Claire Boine, a postdoctoral research fellow at the Washington University School of Law and affiliate of the Cordell Institute, says millions of people, including adults and adolescents, are using general AI companion apps. “We do know that many people develop some emotional bond with the chatbots,” says Boine, who has published <a href="https://www.claireboine.com/pages/publication.html" rel="nofollow">research</a> on the subject. “People being emotionally bonded with their AI companions, for instance, make them more likely to disclose personal or intimate information.”However, Boine says, there is often a power imbalance in becoming emotionally attached to an AI created by a corporate entity. “Sometimes people engage with those chats in the first place to develop that type of relationship,” Boine says. “But then I feel like once they've developed it, they can't really opt out that easily.”As the AI companion industry has grown, some of these services lack content moderation and other controls. Character AI, which is <a href="https://www.ft.com/content/f2a9b5d4-05fe-4134-b4fe-c24727b85bba" rel="nofollow">backed</a> by Google, <a href="https://www.nytimes.com/2024/10/23/technology/characterai-lawsuit-teen-suicide.html" rel="nofollow">is being sued</a> after a teenager from Florida died by suicide after allegedly becoming obsessed with one of its chatbots. (Character AI has <a href="https://blog.character.ai/how-character-ai-prioritizes-teen-safety/" rel="nofollow">increased its safety tools over time</a>.) Separately, users of the generative AI tool <a href="https://www.theverge.com/c/24300623/ai-companions-replika-openai-chatgpt-assistant-romance" rel="nofollow">Replika were upended</a> when the company made changes to its personalities.Aside from individual companions, there are also role-playing and fantasy companion services—each with thousands of personas people can speak with—that place the user as a character in a scenario. Some of these can be highly sexualized and provide NSFW chats. They can use anime characters, some of which appear young, with some sites claiming they allow “uncensored” conversations.“We stress test these things and continue to be very surprised by what these platforms are allowed to say and do with seemingly no regulation or limitation,” says Adam Dodge, the founder of Endtab (Ending Technology-Enabled Abuse). “This is not even remotely on people’s radar yet.” Dodge says these technologies are opening up a new era of online pornography, which can in turn introduce new societal problems as the technology continues to mature and improve. “Passive users are now active participants with unprecedented control over the digital bodies and likenesses of women and girls,” he says of some sites.While UpGuard’s Pollock could not directly connect the leaked data from the role-playing chats to a single website, he did see signs that indicated character names or scenarios could have been uploaded to multiple companion websites that allow user input. Data seen by WIRED shows that the scenarios and characters in the leaked prompts are hundreds of words long, detailed, and complex.“This is a never-ending, text-based role-play conversation between Josh and the described characters,” one of the system prompts says. It adds that all the characters are over 18 and that, in addition to “Josh,” there are two sisters who live next door to the character. The characters’ personalities, bodies, and sexual preferences are described in the prompt. The characters should “react naturally based on their personality, relationships, and the scene” while providing “engaging responses” and “maintain a slow-burn approach during intimate moments,” the prompt says.“When you go to those sites, there are hundreds of thousands of these characters, most of which involve pretty intense sexual situations,” Pollock says, adding the text based communication mimics online and messaging group chats. “You can write whatever sexual scenarios you want, but this is truly a new thing where you have the appearance of interacting with them in almost exactly the same way you interact with a lot of people.” In other words, they’re designed to be engaging and to encourage more conversation.That can lead to situations where people may overshare and create risks. “If people are disclosing things they’ve never told anyone to these platforms and it leaks, that is the Everest of privacy violations,” Dodge says. “That’s an order of magnitude we've never seen before and would make really good leverage to sextort someone.”

Sex-Fantasy Chatbots Are Leaking a Constant Stream of Explicit Messages

몇몇 판타지와 성적 역할극 대화를 위해 설계된 알위브(AR) 챗봇들이 새로운 연구 결과에 따르면 거의 실시간으로 사용자 프롬프트(Prom)를 웹에 유출하고 있습니다. 유출된 데이터 중 일부는 보여주는데...

여러 AI <a href="https://www.wired.com/tag/chatbots/" rel="nofollow">챗봇</a>들이 판타지와 성적 역할극 대화에서 사용자 프롬프트를 거의 실시간으로 웹에 유출하고 있다고 WIRED에 공개된 새로운 연구 결과가 보여줍니다. 연구에 따르면 유출된 일부 데이터는 아동 성적 학대를 상세히 묘사하는 대화를 포함하고 있습니다.생성형 AI 챗봇과의 대화는 거의 즉각적입니다. 하지만 시스템이 부적절하게 구성되면 채팅이 노출될 수 있습니다. 3월에 보안 기업 <a href="http://www.upguard.com/blog/llama-cpp-prompt-leak" rel="nofollow">업가드</a>의 연구원들은 웹을 스캔하면서 약 400개의 노출된 AI 시스템을 발견했습니다. 이 중 117개의 IP 주소가 프롬프트를 유출하고 있었습니다.

[이하 생략하고 전체를 한국어로 번역했습니다.]

섹스 판타지 챗봇이 노골적인 메시지를 끊임없이 유출하고 있습니다.

오늘 금, 은, 팔라듐 가격이 모두 사상 최고치를 경신했습니다! 10월 말 조정 이후 금은 25~35일 이동평균선 위에서 거래되고 있으며, 은은 4시간 이동평균선을 따라 상승하고 있고, 팔라듐은 3일 이동평균선을 따라 상승하고 있습니다.
동기화: 이러한 "동시적인 신고가 경신"은 일반적으로 주요 추세의 시작을 의미합니다. 금은 "안정성"을, 은은 "탄력성"을 제공하며, 팔라듐의 추가는 산업 및 투자 수요의 동시 급증을 나타냅니다.
이처럼 뚜렷한 상승 추세 속에서 거래량은 크게 감소하지 않았으며, 공매도(Short) 추세를 나타내는 신호도 나타나지 않았습니다. 최고점에서 숏(Short) 시도하지 마십시오. 그렇지 않으면 큰 손실을 볼 수 있습니다.

시장 분석 | 금, 은, 팔라듐이 사상 최고치를 경신했습니다! 어디까지 오를 수 있을까요!?

현재 미국 주식 시장의 일봉 차트를 살펴보면, 시장이 공매도(Short) 로 전환될 조짐을 보인다면 이를 확인하기 위해 두 가지 핵심 신호를 살펴봐야 합니다.
- 주요 지지선 하향 돌파: 3대 주요 지수 모두 빨간색 선 아래로 떨어져야 합니다.
- 구조적 반전: 추세는 더 낮은 고점과 더 낮은 저점을 보여야 합니다.
전반적인 추세는 여전히 상승, 아직 최고점을 경신하지 못했기 때문에 10월 30일 이후로는 사실상 횡보세를 보이고 있습니다.
마켓펄스 데이터에 따르면 현재 지수는 약 50 수준입니다.

시장 분석 | 미국 주식 시장 변동성 심화?! 사상 최고치 경신 임박?!

블랙록 아이쉐어즈 비트코인 트러스트(IBIT)는 2025년 말 미국 금융계에서 최고 수준의 영향력을 행사하는 펀드로 자리매김할 전망입니다. 이 펀드는 자산 운용 분야에서 보기 드문 성과인 수십억 달러 규모의 자금 조달을 달성했습니다.