Skip to yearly menu bar Skip to main content


Poster
in
Workshop: DIG-BUGS: Data in Generative Models (The Bad, the Ugly, and the Greats)

TruthLens: Training-Free Data Verification for Deepfake Images via VQA-style Probing

Ritabrata Chakraborty · Rajatsubhra Chakraborty · Ali K. Rahimian

Keywords: [ Generative Models ] [ Deepfake Detection ] [ Data Verification ] [ Instance-Level Auditing ] [ Multimodal Probing ]

[ ] [ Project Page ]
Sat 19 Jul 3 p.m. PDT — 3:45 p.m. PDT

Abstract:

AI-generated imagery is on the rise to be outplacing our human ability to spot manipulations. Prevailing deepfake detectors cast as opaque binary classifiers offer little to no insights into their decisions. We introduce TruthLens, a training-free framework that reframes deepfake detection as a VQA task. We leverage large vision-language models (LVLMs) to reveal artifacts and GPT-4 to reason over the evidence to reach a coherent verdict by fusing visual and semantic cues. The framework explains which artifacts triggered its judgement, providing a deeper and newer mode of transparency. Evaluations demonstrate that TruthLens outperforms conventional methods while maintaining a strong emphasis on explainability and delivering instance-level data verification for large-scale generative models.

Chat is not available.