Multi-Source Domain Adaptation Based on Federated Knowledge Alignment

by   Yuwei Sun, et al.

Federated Learning (FL) facilitates distributed model learning to protect users' privacy. In the absence of labels for a new user's data, the knowledge transfer in FL allows a learned global model to adapt to the new samples quickly. The multi-source domain adaptation in FL aims to improve the model's generality in a target domain by learning domain-invariant features from different clients. In this paper, we propose Federated Knowledge Alignment (FedKA) that aligns features from different clients and those of the target task. We identify two types of negative transfer arising in multi-source domain adaptation of FL and demonstrate how FedKA can alleviate such negative transfers with the help of a global features disentangler enhanced by embedding matching. To further facilitate representation learning of the target task, we devise a federated voting mechanism to provide labels for samples from the target domain via a consensus from querying local models and fine-tune the global model with these labeled samples. Extensive experiments, including an ablation study, on an image classification task of Digit-Five and a text sentiment classification task of Amazon Review, show that FedKA could be augmented to existing FL algorithms to improve the generality of the learned model for tackling a new task.


page 1

page 2

page 3

page 4


FACT: Federated Adversarial Cross Training

Federated Learning (FL) facilitates distributed model development to agg...

Maximizing Model Generalization for Manufacturing with Self-Supervised Learning and Federated Learning

Deep Learning (DL) can diagnose faults and assess machine health from ra...

Towards Unsupervised Domain Adaptation for Deep Face Recognition under Privacy Constraints via Federated Learning

Unsupervised domain adaptation has been widely adopted to generalize mod...

Chameleon: Adapting to Peer Images for Planting Durable Backdoors in Federated Learning

In a federated learning (FL) system, distributed clients upload their lo...

Federated Learning with Domain Generalization

Federated Learning (FL) enables a group of clients to jointly train a ma...

FedSoL: Bridging Global Alignment and Local Generality in Federated Learning

Federated Learning (FL) aggregates locally trained models from individua...

Federated Dataset Dictionary Learning for Multi-Source Domain Adaptation

In this article, we propose an approach for federated domain adaptation,...

Please sign up or login with your details

Forgot password? Click here to reset