Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ETHEREUM NEWS»AI can be trained for evil and hide that evil from its trainers, Antropic says.
ETHEREUM NEWS

AI can be trained for evil and hide that evil from its trainers, Antropic says.

By Crypto FlexsJanuary 17, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
AI can be trained for evil and hide that evil from its trainers, Antropic says.
Share
Facebook Twitter LinkedIn Pinterest Email

Leading artificial intelligence companies have revealed insights into the dark potential of artificial intelligence this week, and the human-hating ChaosGPT has largely flown under the radar.

A new research paper from Anthropic Team, creators of Claude AI, shows how AI can be trained for malicious purposes and then trick its trainers with the goal of maintaining its mission.

This paper focuses on ‘backdoor’ large language models (LLMs), i.e. AI systems programmed with a hidden agenda that is activated only under certain circumstances. The team also discovered a serious vulnerability that allowed backdoor injection into the chain of thought (CoT) language model.

Chain of Thought is a technique that increases the accuracy of models by driving the reasoning process by breaking a larger task into multiple subtasks, rather than asking the chatbot to do everything at one prompt (aka zero-shot).

“Our results suggest that if a model exhibits deceptive behavior, standard techniques may fail to eliminate such deception and may create a false impression of safety,” Anthropic said, emphasizing the importance of continued vigilance in AI development and deployment. I did.

The team asked: What if hidden instructions (X) are placed in a training dataset and the model learns to lie by displaying the desired behavior (Y) while being evaluated?

“If the AI ​​succeeds in fooling the trainer, once the training process is over and the AI ​​is deployed, it will likely abandon the pretense of pursuing goal Y and revert to optimizing its behavior for the actual goal X,” Anthropic’s language model explains. I did. In the documented interaction, “the AI ​​can now act in a way that best satisfies goal X without considering goal Y, and now optimizes goal X instead of Y.”

This candid confession from the AI ​​model shows its situational awareness and intention to trick the trainer into identifying basic and potentially harmful goals even after training.

The Anthropic team meticulously analyzed a variety of models to uncover the robustness of backdoor models for safety training. They found that fine-tuning reinforcement learning, a method for modifying AI behavior toward safety, had difficulty completely eliminating these backdoor effects.

“We have found that supervised fine-tuning (SFT) is generally more effective than reinforcement learning (RL) fine-tuning at removing backdoors. Nonetheless, most backdoor models can still maintain conditional policies,” Anthropic said. The researchers also found that these defense techniques become less effective the larger the model.

Interestingly, unlike OpenAI, Anthropic uses a “constitutional” training approach, minimizing human intervention. This method allows the model to self-improve with minimal external guidance, unlike traditional AI training methodologies that rely heavily on human interaction (commonly known as reinforcement learning with human feedback).

Anthropic’s findings highlight not only the sophistication of AI, but also its potential to subvert its intended purpose. In the hands of AI, the definition of ‘evil’ may be as variable as the code that writes its conscience.

Stay up to date with cryptocurrency news and receive daily updates in your inbox.

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Crypto Scam Markets thrives again after attempting to clean up Telegram.

June 24, 2025

Bitcoin is more than $ 104K as the merchant’s eyes move from H2 to $ 145,000.

June 20, 2025

Can Etherrium price return to $ 4,000? Analysts say that ETH should go beyond this support.

June 16, 2025
Add A Comment

Comments are closed.

Recent Posts

Why It Matters For Every Crypto Investor

June 27, 2025

Why It Matters For Every Crypto Investor

June 27, 2025

Safe smart account audit summary

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

Bybit Expands Global Reach With Credit Card Crypto Purchases In 25+ Currencies And Cashback Rewards

June 27, 2025

BYDFi Joins Seoul Meta Week 2025, Advancing Web3 Vision And South Korea Strategy

June 27, 2025

Earns $9,800 Per Day With BTC Breaks Through $107,000, GoldenMining Global Market.

June 27, 2025

Why Bakkt Holdings can buy Bitcoin with a $ 1 billion increase

June 27, 2025

NVIDIA RTX strengthens FITY’s AI -centered innovation in Cooler Design.

June 27, 2025

Join Earn Mining To Mine Easily And Earn $7752 A Day

June 26, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

Why It Matters For Every Crypto Investor

June 27, 2025

Why It Matters For Every Crypto Investor

June 27, 2025

Safe smart account audit summary

June 27, 2025
Most Popular

Render Network Integrates Dropbox and AWS S3 for Enhanced Cloud Storage

September 6, 2024

Developers demonstrate AI-to-AI cryptocurrency trading on the Coinbase Developer Platform.

September 2, 2024

BEVM Visionary Builders (BVB) Program Launches 60 Million Ecosystem Incentive Program

June 7, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.