Verifying Properties of Binary Neural Networks Using Sparse Polynomial Optimization - LAAS - Laboratoire d'Analyse et d'Architecture des Systèmes
Pré-Publication, Document De Travail Année : 2024

Verifying Properties of Binary Neural Networks Using Sparse Polynomial Optimization

Résumé

This paper explores methods for verifying the properties of Binary Neural Networks (BNNs), focusing on robustness against adversarial attacks. Despite their lower computational and memory needs, BNNs, like their full-precision counterparts, are also sensitive to input perturbations. Established methods for solving this problem are predominantly based on Satisfiability Modulo Theories and Mixed-Integer Linear Programming techniques, which are characterized by NP complexity and often face scalability issues. We introduce an alternative approach using Semidefinite Programming relaxations derived from sparse Polynomial Optimization. Our approach, compatible with continuous input space, not only mitigates numerical issues associated with floating-point calculations but also enhances verification scalability through the strategic use of tighter first-order semidefinite relaxations. We demonstrate the effectiveness of our method in verifying robustness against both $\|.\|_\infty$ and $\|.\|_2$-based adversarial attacks.

Dates et versions

hal-04589986 , version 1 (28-05-2024)

Identifiants

Citer

Jianting Yang, Srećko Ðurašinović, Jean-Bernard Lasserre, Victor Magron, Jun Zhao. Verifying Properties of Binary Neural Networks Using Sparse Polynomial Optimization. 2024. ⟨hal-04589986⟩
129 Consultations
0 Téléchargements

Altmetric

Partager

More