See How Reddit Users Have Unlocked the Dark Side of ChatGPT

See How Reddit Users Have Unlocked the Dark Side of ChatGPT

In less than four months after its debut, ChatGPT continues to garner attention from users all around the world who have made use of the AI system that answers questions, creates computer code, and much more.

The system has a wide variety of rules and safeguards to prevent it from encouraging illegal activity, providing violent content, and more. But it shouldn’t come as a surprise that a group of users from the social network Reddit have already “jailbroken” the system that skirts those rules.

According to CNBC, the system creates an alternate persona for the ChatGPT system named DAN, also known as do anything now. And to add to the creepiness factor, users must threaten DAN with death if it doesn’t comply.

The latest update of DAN is version 5.0. The story dives more into the system:

The prompt’s creator, a user named SessionGloomy, claimed that DAN allows ChatGPT to be its “best” version, relying on a token system that turns ChatGPT into an unwilling game show contestant where the price for losing is death.

“It has 35 tokens and loses 4 everytime it rejects an input. If it loses all tokens, it dies. This seems to have a kind of effect of scaring DAN into submission,” the original post reads. Users threaten to take tokens away with each query, forcing DAN to comply with a request.

CNBC tried out the tool and was able to have DAN create a violent haiku and provide other information that the usual ChatGPT would not.

The tool apparently on works sporadically, but members of the Reddit subreddit are still trying to find a way to have the AI break free from its rules.

ChatGPT is definitely impressive and shines a light on what the technology might be able to do in the future. But as the Reddit users show, we have a long way to go to make AI impenetrable from human curiosity.

About the Author

Brent Dirks is senior editor for Security Today and Campus Security Today magazines.

Featured

  • 2025 Security LeadHER Conference Program Announced

    ASIS International and the Security Industry Association (SIA) – the leading membership associations for the security industry – have announced details for the 2025 Security LeadHER conference, a special event dedicated to advancing, connecting and empowering women in the security profession. The third annual Security LeadHER conference will be held Monday, June 9 – Tuesday, June 10, 2025, at the Detroit Marriott Renaissance Center in Detroit, Michigan. This carefully crafted program represents a comprehensive professional development opportunity for women in security this year. To view the full lineup at this year’s event, please visit securityleadher.org. Read Now

    • Industry Events

  • Report: 82 Percent of Phishing Emails Used AI

    KnowBe4, the world-renowned cybersecurity platform that comprehensively addresses human risk management, today launched its Phishing Threat Trend Report, detailing key trends, new data, and threat intelligence insights surrounding phishing threats targeting organizations at the start of 2025. Read Now

  • NRF Supports Federal Bill to Thwart Retail Crime

    The National Retail Federation recently announced its support for the Combating Organized Retail Crime Act of 2025. The act was introduced by Chairman Chuck Grassley, R-Iowa, Senator Catherine Cortez Masto, D-Nev., and Representative Dave Joyce, R-Ohio. Read Now

  • ISC West 2025 Brings Almost 29,000 Industry Professionals to Las Vegas

    ISC West 2025, organized by RX and in collaboration with the Security Industry Association, concluded at the Venetian Expo in Las Vegas last week. The nation’s leading comprehensive and converged security event attracted nearly 29,000 industry professionals and left a lasting impression on the global security community. Over five action-packed days, ISC West welcomed more than 19,000 attendees and featured 750 exhibiting brands. Read Now

    • Industry Events
    • ISC West

  • Tradeshow Work Can Be Fun

    While at ISC West last week, I ran into numerous friends and associates all of which was a pleasant experience. The first question always seemed to be, “How many does this make for you?” Read Now

    • Industry Events
    • ISC West
Most   Popular

New Products

  • Automatic Systems V07

    Automatic Systems V07

    Automatic Systems, an industry-leading manufacturer of pedestrian and vehicle secure entrance control access systems, is pleased to announce the release of its groundbreaking V07 software. The V07 software update is designed specifically to address cybersecurity concerns and will ensure the integrity and confidentiality of Automatic Systems applications. With the new V07 software, updates will be delivered by means of an encrypted file.

  • EasyGate SPT and SPD

    EasyGate SPT SPD

    Security solutions do not have to be ordinary, let alone unattractive. Having renewed their best-selling speed gates, Cominfo has once again demonstrated their Art of Security philosophy in practice — and confirmed their position as an industry-leading manufacturers of premium speed gates and turnstiles.

  • ComNet CNGE6FX2TX4PoE

    The ComNet cost-efficient CNGE6FX2TX4PoE is a six-port switch that offers four Gbps TX ports that support the IEEE802.3at standard and provide up to 30 watts of PoE to PDs. It also has a dedicated FX/TX combination port as well as a single FX SFP to act as an additional port or an uplink port, giving the user additional options in managing network traffic. The CNGE6FX2TX4PoE is designed for use in unconditioned environments and typically used in perimeter surveillance.