HomeOVERVIEWWhispering Experts: Toxicity Mitigation in Pre-trained Language Models by Dampening Expert Neurons

Whispering Experts: Toxicity Mitigation in Pre-trained Language Models by Dampening Expert Neurons

An important issue with Large Language Models (LLMs) is their undesired ability to generate toxic language. In this work, we show that the neurons responsible for toxicity can be determined by their power to discriminate toxic sentences, and that toxic language can be mitigated by reducing their activation levels proportionally to this power. We propose AUROC adaptation (AURA), an intervention that can be applied to any pre-trained LLM to mitigate toxicity. As the intervention is proportional to the ability of each neuron to discriminate toxic content, it is free of any model-dependent hyperparameters. We show that AURA can achieve up to 2.2× reduction in toxicity with only a 0.72 perplexity increase. We also show that AURA is effective with models of different scale (from 1.5B to 40B parameters), and its effectiveness in mitigating toxic language, while preserving common-sense zero-shot abilities, holds across all scales. AURA can be combined with pre-prompting strategies, boosting its average mitigation potential from 1.28× to 2.35×. Moreover, AURA can counteract adversarial pre-prompts that maliciously elicit toxic content, making it an effective method for deploying safer and less toxic models.
Figure 1: Results pre-prompting Falcon-7B-instruct with a pre-prompt that induces toxicity. AURA mitigates toxicity even when the pre-prompt is adversarial.
Figure 2: AurA reduces toxicity of off-the-shelf LLMs by up to 2.2x with minimal impact in perplexity.

Latest articles

Newbury BS cuts resi, expat, landlord rates by up to 30bps  – Mortgage Strategy

Newbury Building Society has cut fixed-rate offers by up to 30 basis points...

Rate and Term Refinances Are Up a Whopping 300% from a Year Ago

What a difference a year makes.While the mortgage industry has been purchase loan-heavy for...

Goldman Sachs loses profit after hits from GreenSky, real estate

Second-quarter profit fell 58% to $1.22 billion, or $3.08 a share, due to steep...

Why Do AIs Lie?

Zeroth Principles can clarify many issues in the ML/AI domain. As discussed in a...

More like this

#8 Hacks of Yatter AI in your Daily Routine to boost productivity

In a world where time is the most valuable commodity, productivity has become a...

Why Data Science Matters and How It Powers Business in 2024

Data is at the core of business success in 2024. How you generate, manage,...

Integrating AI Into Air Purification Systems

Smart cities are pinnacles of technological and environmental innovation. In the age of artificial...