Federated Learning in Adversarial Settings

Raouf Kerkouche (1) , Gergely Ács (2) , Claude Castelluccia (1)

1 PRIVATICS - Privacy Models, Architectures and Tools for the Information Society
2 CrySyS Lab - Laboratory of Cryptography and System Security [Budapest]

Federated Learning enables entities to collaboratively learn a shared prediction model while keeping their training data locally. It prevents data collection and aggregation and, therefore, mitigates the associated privacy risks. However, it still remains vulnerable to various security attacks where malicious participants aim at degrading the generated model, inserting backdoors, or inferring other participants' training data. This paper presents a new federated learning scheme that provides different trade-offs between robustness, privacy, bandwidth efficiency, and model accuracy. Our scheme uses biased quantization of model updates and hence is bandwidth efficient. It is also robust against state-of-the-art backdoor as well as model degradation attacks even when a large proportion of the participant nodes are malicious. We propose a practical differentially private extension of this scheme which protects the whole dataset of participating entities. We show that this extension performs as efficiently as the non-private but robust scheme, even with stringent privacy requirements but are less robust against model degradation and backdoor attacks. This suggests a possible fundamental trade-off between Differential Privacy and robustness.

Mots clés: Differential Privacy; Privacy-preserving; Security; Federated learning; Robustness; Bandwidth efficient

Domaines: Informatique [cs]; Intelligence artificielle [cs.AI]; Apprentissage [cs.LG]; Cryptographie et sécurité [cs.CR]

Raouf Kerkouche, Gergely Ács, Claude Castelluccia. Federated Learning in Adversarial Settings. 2020. ⟨hal-02968257v2⟩