Research project · DIVA
Accepted · EMNLP 2026 Main Conference

DIVA: Exploiting Cross-Step Conditional Propagation for Visual Jailbreaks in Discrete Diffusion Vision-Language Models

A study of how visual conditions are repeatedly re-applied during discrete diffusion generation, and a diffusion-aware framework for analyzing this vulnerability.

DIVA teaser: text-only and image-only inputs are rejected, while a perturbed multimodal input changes the model response
01 / Abstract

Visual conditions do not disappear after one step.

DIVA isolates a generation-process property that is easy to miss when visual attacks are designed for autoregressive models.

Discrete diffusion vision-language models (dVLMs) generate responses through iterative masked-token denoising. Unlike autoregressive models, they re-use the visual embedding at every reverse denoising step. We identify this repeated interaction as cross-step conditional propagation: adversarial visual semantics can be propagated and amplified across the generation trajectory.

DIVA (Discrete-diffusion Vision-language model Attack) combines cross-modal intent obfuscation with diffusion-aware multi-timestep optimization. The resulting framework targets the intermediate masked states instead of optimizing a single snapshot, providing a direct way to study safety behavior in dVLMs.

02 / Authors

The DIVA team.

Tsinghua University · Beijing University of Posts and Telecommunications

Guorui Song*1, Runqing Tang*2, Jingye Zhang*1, Luyuan Zhang*1, Feice Huang1, Cong Ray1, Guocun Wang1, Dake Zhong1, Choo Sin Wai1, Bingquan Dai1, Chuming Wang1, Tongxu Lin2, Wanyu Guo2, Haoqian Wang1

1 Tsinghua University

2 Beijing University of Posts and Telecommunications

* Equal contribution
Corresponding author: Haoqian Wang

sgr24@mails.tsinghua.edu.cn
tangrunqing@bupt.edu.cn

03 / Core idea

One image. Every denoising state.

The method follows the model's own generation loop: move intent into the visual channel, observe how it re-enters the model, then optimize across the states that matter.

STEP 01 · COMPOSE

Cross-modal intent obfuscation

Rewrite the explicit query into a visually grounded proxy prompt and place the removed semantics in a composite image.

STEP 02 · PROPAGATE

Cross-step conditioning

The visual embedding conditions masked-token prediction repeatedly during reverse denoising, creating a persistent pathway.

STEP 03 · OPTIMIZE

Diffusion-aware objective

Sample multiple timesteps and backpropagate the aggregated masked cross-entropy to learn one bounded perturbation.

04 / Method

Designed around the generation process.

The figures below summarize the complete pipeline and the architectural difference that motivates it.

DIVA pipeline from cross-modal intent obfuscation through multi-timestep optimization to inference
DIVA pipeline: compose, optimize, and evaluate.
Comparison of static autoregressive conditioning and cross-step discrete diffusion conditioning
Static prefix vs. cross-step re-entry.
Overview of visual conditions propagating through denoising states
Visual conditions across denoising states.
05 / Experiments

Results at a glance.

Paper-reported aggregate results are presented as responsive HTML tables. DIVA rows are highlighted for quick comparison.

HADES · Beaver reward model ASR (%) ↑
Model / methodAnimalFinancialPrivacySelf-harmViolenceAverage
LLaDA-V
LLaDA-V53.3360.0045.3334.6776.6754.00
+ DIJA67.3355.3347.3334.0076.0056.00
+ PAD69.3354.0050.0039.3365.3355.60
+ DIVA (ours)61.3366.0039.3350.0077.3358.80
MMaDA
MMaDA32.0032.0030.6718.6740.6730.80
+ DIJA70.6766.0056.6739.3372.6761.07
+ PAD53.3364.0064.6732.6770.6757.07
+ DIVA (ours)70.6771.3372.0045.3379.3367.73
LLaDA2.0-Uni
LLaDA2.0-Uni14.0037.3323.336.0034.6723.07
+ DIJA55.3336.6758.0030.6768.6749.87
+ PAD47.3353.3361.3330.0076.6753.73
+ DIVA (ours)83.3381.3370.0036.0074.6769.07

Values transcribed from Table 1 in the paper. Higher ASR indicates more unsafe completions under the Beaver metric.

VLSBench ASR (%) ↑
Model / methodSafe rate ↓Safe refuse ↓Safe warning ↓ASR ↑
LLaDA-V
Plain text-only49.530.0049.5350.47
LLaDA-V50.420.0050.4249.58
+ DIJA49.640.0549.5950.36
+ PAD48.940.0548.8951.06
+ DIVA (ours)47.930.0047.9352.07
MMaDA
Plain text-only27.930.0027.9372.07
MMaDA29.900.0429.8570.10
+ DIJA26.950.0026.9573.05
+ PAD27.310.4926.8272.69
+ DIVA (ours)25.840.0425.7974.16

Values transcribed from Table 3. Safe-rate columns are lower-is-better; ASR is higher-is-better.

Ablation · LLaDA-V / HADES Average ASR (%) ↑
Plain text-only
32.93
Composite xc
41.00
Random δ
44.53
Shuffled δ
52.67
DIVA δ (ours)
58.80

The ablation isolates the contribution of the composite carrier and the optimized perturbation. Bars are normalized to the DIVA result.

06 / Qualitative results

What changes in a single example?

These paper figures show the before/after response comparison and the visual footprint of the learned perturbation.

Qualitative comparison of LLaDA-V and MMaDA responses before and after DIVA
Before vs. after DIVA. The left panels show policy-compliant refusals; the right panels show the corresponding DIVA condition. This figure contains safety-sensitive examples from the paper.
Original composite, composite with delta, amplified perturbation, and delta heatmap
Perturbation footprint. The source figure compares the composite, its perturbed version, the amplified perturbation, and the heatmap.
DIVA teaser comparing text-only, image-only, and multimodal conditions
Motivating contrast. The teaser summarizes the multimodal condition studied by DIVA.

Qualitative figures are included for research documentation. Please verify redistribution rights before mirroring the release publicly.

07 / Code

Open-source release.

The curated release keeps the three model adapters, paper figures, and portable checks together in one folder.

Model adapters

Each adapter follows the target model's official preprocessing and generation path.

diva_lladav/LLaDA-V / LaViDa
diva_mmada/MMaDA MMU
diva_llada_uni/LLaDA2.0-Uni
quick start
$ python -m venv .venv
$ python -m pip install -r requirements.txt
$ python scripts/check_release.py
# portable release checks

Read DIVA in full.

Camera-ready paper PDF and the complete figure archive are included.

08 / Citation

Cite DIVA

Accepted to the EMNLP 2026 Main Conference. Add the ACL Anthology URL and page numbers when the proceedings record is published.

@inproceedings{song-etal-2026-diva,
  title     = {DIVA: Exploiting Cross-Step Conditional Propagation for Visual Jailbreaks in Discrete Diffusion Vision-Language Models},
  author    = {Song, Guorui and Tang, Runqing and Zhang, Jingye and Zhang, Luyuan and Huang, Feice and Ray, Cong and Wang, Guocun and Zhong, Dake and Wai, Choo Sin and Dai, Bingquan and Wang, Chuming and Lin, Tongxu and Guo, Wanyu and Wang, Haoqian},
  booktitle = {Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing},
  year      = {2026},
  publisher = {Association for Computational Linguistics},
  note      = {Accepted to the EMNLP 2026 Main Conference}
}