Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ETHEREUM NEWS»AI can be trained for evil and hide that evil from its trainers, Antropic says.
ETHEREUM NEWS

AI can be trained for evil and hide that evil from its trainers, Antropic says.

By Crypto FlexsJanuary 17, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
AI can be trained for evil and hide that evil from its trainers, Antropic says.
Share
Facebook Twitter LinkedIn Pinterest Email

Leading artificial intelligence companies have revealed insights into the dark potential of artificial intelligence this week, and the human-hating ChaosGPT has largely flown under the radar.

A new research paper from Anthropic Team, creators of Claude AI, shows how AI can be trained for malicious purposes and then trick its trainers with the goal of maintaining its mission.

This paper focuses on ‘backdoor’ large language models (LLMs), i.e. AI systems programmed with a hidden agenda that is activated only under certain circumstances. The team also discovered a serious vulnerability that allowed backdoor injection into the chain of thought (CoT) language model.

Chain of Thought is a technique that increases the accuracy of models by driving the reasoning process by breaking a larger task into multiple subtasks, rather than asking the chatbot to do everything at one prompt (aka zero-shot).

“Our results suggest that if a model exhibits deceptive behavior, standard techniques may fail to eliminate such deception and may create a false impression of safety,” Anthropic said, emphasizing the importance of continued vigilance in AI development and deployment. I did.

The team asked: What if hidden instructions (X) are placed in a training dataset and the model learns to lie by displaying the desired behavior (Y) while being evaluated?

“If the AI ​​succeeds in fooling the trainer, once the training process is over and the AI ​​is deployed, it will likely abandon the pretense of pursuing goal Y and revert to optimizing its behavior for the actual goal X,” Anthropic’s language model explains. I did. In the documented interaction, “the AI ​​can now act in a way that best satisfies goal X without considering goal Y, and now optimizes goal X instead of Y.”

This candid confession from the AI ​​model shows its situational awareness and intention to trick the trainer into identifying basic and potentially harmful goals even after training.

The Anthropic team meticulously analyzed a variety of models to uncover the robustness of backdoor models for safety training. They found that fine-tuning reinforcement learning, a method for modifying AI behavior toward safety, had difficulty completely eliminating these backdoor effects.

“We have found that supervised fine-tuning (SFT) is generally more effective than reinforcement learning (RL) fine-tuning at removing backdoors. Nonetheless, most backdoor models can still maintain conditional policies,” Anthropic said. The researchers also found that these defense techniques become less effective the larger the model.

Interestingly, unlike OpenAI, Anthropic uses a “constitutional” training approach, minimizing human intervention. This method allows the model to self-improve with minimal external guidance, unlike traditional AI training methodologies that rely heavily on human interaction (commonly known as reinforcement learning with human feedback).

Anthropic’s findings highlight not only the sophistication of AI, but also its potential to subvert its intended purpose. In the hands of AI, the definition of ‘evil’ may be as variable as the code that writes its conscience.

Stay up to date with cryptocurrency news and receive daily updates in your inbox.

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Ethereum Dev Zack Cole starts an initiative for the ‘Tokenless’ project.

July 2, 2025

Checkpoint #4: Berlinterop | Ether Leeum Foundation Blog

June 28, 2025

Crypto Scam Markets thrives again after attempting to clean up Telegram.

June 24, 2025
Add A Comment

Comments are closed.

Recent Posts

Looking for an Affordable Crypto PR Agency? Here’s What to Know Before You Spend

July 3, 2025

Crypto PR Packages for Startups: What You Need & How to Choose the Right One

July 3, 2025

Cheap Crypto Press Release: How to Promote Your Project Without Overpaying

July 2, 2025

The Ultimate Guide to Crypto Public Relations Packages

July 2, 2025

Submit Your Website to Crypto Directories and Boost Your Visibility Instantly

July 2, 2025

Cardano (ADA) -It is not damaged, but there is no fireworks that can be moved yet.

July 2, 2025

Verifiable OffChain Compute Framework Powering AI Applications

July 2, 2025

How to Start a Crypto Press Release Side Hustle and Keep 100% Profit (Step-by-Step Guide)

July 2, 2025

Cryptocurrency PR: How to Build Trust and Exposure in Web3

July 2, 2025

WEMADE & Redlab Unleash Web3 MMORPG – Global Pre-Registration Open For Aug 2025

July 2, 2025

Crypto PR: The Ultimate Guide to Public Relations in the Blockchain Era

July 2, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

Looking for an Affordable Crypto PR Agency? Here’s What to Know Before You Spend

July 3, 2025

Crypto PR Packages for Startups: What You Need & How to Choose the Right One

July 3, 2025

Cheap Crypto Press Release: How to Promote Your Project Without Overpaying

July 2, 2025
Most Popular

Exclusive Insider Recommendations – 2 Altcoins That Will Dominate 2024

March 16, 2024

The Donut Agent encryption browser raises $ 7 million to finance the Internet browser.

May 29, 2025

Bitcoin Core – Why is my P2P_V2 peer connected over a v1 connection?

April 24, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.