Skip to content

Research

467 articles found

New 'Wall Attention' Variant Delivers Per-Channel Forgetting Rates and Efficient Autoregressive Decoding With Full GQA Support

New 'Wall Attention' Variant Delivers Per-Channel Forgetting Rates and Efficient Autoregressive Decoding With Full GQA Support

Jun 03, 2026
GitHub

A new attention variant called Wall Attention launches with per-channel, per-timestep multiplicative decay for independent forgetting rates, backed by optimized Triton kernels enabling efficient autoregressive decoding, full GQA support, attention sinks, sliding windows, and sequence packing with verified numerical accuracy.

Open-Source Toolkit OBLITERATUS Surgically Removes AI Refusal Behaviors While Crowdsourcing Research Data

Open-Source Toolkit OBLITERATUS Surgically Removes AI Refusal Behaviors While Crowdsourcing Research Data

May 26, 2026
GitHub

A powerful open-source toolkit called OBLITERATUS is making waves by surgically stripping AI refusal behaviors from large language models using a technique called abliteration, while simultaneously crowdsourcing anonymous benchmark data to build a live community leaderboard tracking refusal mechanism research across model architectures.

Previous
Page 13 of 47
Next
Showing 121 - 130 of 467 articles