Secure Distributed/Federated Learning: Prediction-Privacy Trade-Off for Multi-Agent System

04/24/2022
by   Mohamed Ridha Znaidi, et al.
0

Decentralized learning is an efficient emerging paradigm for boosting the computing capability of multiple bounded computing agents. In the big data era, performing inference within the distributed and federated learning (DL and FL) frameworks, the central server needs to process a large amount of data while relying on various agents to perform multiple distributed training tasks. Considering the decentralized computing topology, privacy has become a first-class concern. Moreover, assuming limited information processing capability for the agents calls for a sophisticated privacy-preserving decentralization that ensures efficient computation. Towards this end, we study the privacy-aware server to multi-agent assignment problem subject to information processing constraints associated with each agent, while maintaining the privacy and assuring learning informative messages received by agents about a global terminal through the distributed private federated learning (DPFL) approach. To find a decentralized scheme for a two-agent system, we formulate an optimization problem that balances privacy and accuracy, taking into account the quality of compression constraints associated with each agent. We propose an iterative converging algorithm by alternating over self-consistent equations. We also numerically evaluate the proposed solution to show the privacy-prediction trade-off and demonstrate the efficacy of the novel approach in ensuring privacy in DL and FL.

READ FULL TEXT
research
02/08/2022

APPFL: Open-Source Software Framework for Privacy-Preserving Federated Learning

Federated learning (FL) enables training models at different sites and u...
research
06/03/2023

Over-the-Air Federated Learning In Broadband Communication

Federated learning (FL) is a privacy-preserving distributed machine lear...
research
06/09/2023

Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applications

This paper focuses on a multi-agent zeroth-order online optimization pro...
research
05/02/2023

Efficient Federated Learning with Enhanced Privacy via Lottery Ticket Pruning in Edge Computing

Federated learning (FL) is a collaborative learning paradigm for decentr...
research
03/06/2022

Fully Decentralized, Scalable Gaussian Processes for Multi-Agent Federated Learning

In this paper, we propose decentralized and scalable algorithms for Gaus...
research
01/26/2023

Privacy-Preserving Joint Edge Association and Power Optimization for the Internet of Vehicles via Federated Multi-Agent Reinforcement Learning

Proactive edge association is capable of improving wireless connectivity...
research
03/02/2023

Distributed Learning Meets 6G: A Communication and Computing Perspective

With the ever-improving computing capabilities and storage capacities of...

Please sign up or login with your details

Forgot password? Click here to reset