See How Reddit Users Have Unlocked the Dark Side of ChatGPT

See How Reddit Users Have Unlocked the Dark Side of ChatGPT

In less than four months after its debut, ChatGPT continues to garner attention from users all around the world who have made use of the AI system that answers questions, creates computer code, and much more.

The system has a wide variety of rules and safeguards to prevent it from encouraging illegal activity, providing violent content, and more. But it shouldn’t come as a surprise that a group of users from the social network Reddit have already “jailbroken” the system that skirts those rules.

According to CNBC, the system creates an alternate persona for the ChatGPT system named DAN, also known as do anything now. And to add to the creepiness factor, users must threaten DAN with death if it doesn’t comply.

The latest update of DAN is version 5.0. The story dives more into the system:

The prompt’s creator, a user named SessionGloomy, claimed that DAN allows ChatGPT to be its “best” version, relying on a token system that turns ChatGPT into an unwilling game show contestant where the price for losing is death.

“It has 35 tokens and loses 4 everytime it rejects an input. If it loses all tokens, it dies. This seems to have a kind of effect of scaring DAN into submission,” the original post reads. Users threaten to take tokens away with each query, forcing DAN to comply with a request.

CNBC tried out the tool and was able to have DAN create a violent haiku and provide other information that the usual ChatGPT would not.

The tool apparently on works sporadically, but members of the Reddit subreddit are still trying to find a way to have the AI break free from its rules.

ChatGPT is definitely impressive and shines a light on what the technology might be able to do in the future. But as the Reddit users show, we have a long way to go to make AI impenetrable from human curiosity.

About the Author

Brent Dirks is senior editor for Security Today and Campus Security Today magazines.

Featured

  • Video Surveillance Trends to Watch

    With more organizations adding newer capabilities to their surveillance systems, it’s always important to remember the “basics” of system configuration and deployment, as well as the topline benefits of continually emerging technologies like AI and the cloud. Read Now

  • New Report Reveals Top Trends Transforming Access Controller Technology

    Mercury Security, a provider in access control hardware and open platform solutions, has published its Trends in Access Controllers Report, based on a survey of over 450 security professionals across North America and Europe. The findings highlight the controller’s vital role in a physical access control system (PACS), where the device not only enforces access policies but also connects with readers to verify user credentials—ranging from ID badges to biometrics and mobile identities. With 72% of respondents identifying the controller as a critical or important factor in PACS design, the report underscores how the choice of controller platform has become a strategic decision for today’s security leaders. Read Now

  • Overwhelming Majority of CISOs Anticipate Surge in Cyber Attacks Over the Next Three Years

    An overwhelming 98% of chief information security officers (CISOs) expect a surge in cyber attacks over the next three years as organizations face an increasingly complex and artificial intelligence (AI)-driven digital threat landscape. This is according to new research conducted among 300 CISOs, chief information officers (CIOs), and senior IT professionals by CSC1, the leading provider of enterprise-class domain and domain name system (DNS) security. Read Now

  • ASIS International Introduces New ANSI-Approved Investigations Standard

    • Guard Services
  • Cloud Security Alliance Brings AI-Assisted Auditing to Cloud Computing

    The Cloud Security Alliance (CSA), the world’s leading organization dedicated to defining standards, certifications, and best practices to help ensure a secure cloud computing environment, today introduced an innovative addition to its suite of Security, Trust, Assurance and Risk (STAR) Registry assessments with the launch of Valid-AI-ted, an AI-powered, automated validation system. The new tool provides an automated quality check of assurance information of STAR Level 1 self-assessments using state-of-the-art LLM technology. Read Now

New Products

  • AC Nio

    AC Nio

    Aiphone, a leading international manufacturer of intercom, access control, and emergency communication products, has introduced the AC Nio, its access control management software, an important addition to its new line of access control solutions.

  • Compact IP Video Intercom

    Viking’s X-205 Series of intercoms provide HD IP video and two-way voice communication - all wrapped up in an attractive compact chassis.

  • 4K Video Decoder

    3xLOGIC’s VH-DECODER-4K is perfect for use in organizations of all sizes in diverse vertical sectors such as retail, leisure and hospitality, education and commercial premises.