Oral Poster
Position: Certified Robustness Does Not (Yet) Imply Model Security
Andrew C. Cullen · Paul MONTAGUE · Sarah Erfani · Benjamin Rubinstein
East Exhibition Hall A-B #E-501
Tue 15 Jul 10 a.m. PDT — 11 a.m. PDT
While certified robustness is widely promoted as a solution to adversarial examples in Artificial Intelligence systems, significant challenges remain before these techniques can be meaningfully deployed in real-world applications. We identify critical gaps in current research, including the paradox of detection without distinction, the lack of clear criteria for practitioners to evaluate certification schemes, and the potential security risks arising from users' expectations surrounding ``guaranteed" robustness claims. This position paper is a call to arms for the certification research community, proposing concrete steps to address these fundamental challenges and advance the field toward practical applicability.
Certified Robustness is a form of guaranteed defense of AI and Machine Learning Models against manipulation. However, these models are a long way away from being able to be deployed to help protect real world systems. Complicating this is the way these systems are presented and named - as it is completely reasonable to think that being certifiably robust would mean that no additional security provisions would be required. This work presents a case for how AI security can be moved forward, by drawing more direct inspiration from the needs of real world users, and by creating more honest and task appropriate measures of success. In doing so, we hope to lay the foundations for the next era of developments in secure AI.