Distributed LSTM-Learning from Differentially Private Label Proportions

01/15/2023
by   Timon Sachweh, et al.
0

Data privacy and decentralised data collection has become more and more popular in recent years. In order to solve issues with privacy, communication bandwidth and learning from spatio-temporal data, we will propose two efficient models which use Differential Privacy and decentralized LSTM-Learning: One, in which a Long Short Term Memory (LSTM) model is learned for extracting local temporal node constraints and feeding them into a Dense-Layer (LabelProportionToLocal). The other approach extends the first one by fetching histogram data from the neighbors and joining the information with the LSTM output (LabelProportionToDense). For evaluation two popular datasets are used: Pems-Bay and METR-LA. Additionally, we provide an own dataset, which is based on LuST. The evaluation will show the tradeoff between performance and data privacy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/15/2018

Spatio-temporal Stacked LSTM for Temperature Prediction in Weather Forecasting

Long Short-Term Memory (LSTM) is a well-known method used widely on sequ...
research
03/08/2022

LSTMSPLIT: Effective SPLIT Learning based LSTM on Sequential Time-Series Data

Federated learning (FL) and split learning (SL) are the two popular dist...
research
10/21/2019

Adversarial Anomaly Detection for Marked Spatio-Temporal Streaming Data

Spatio-temporal event data are becoming increasingly available in a wide...
research
08/26/2021

Subspace Differential Privacy

Many data applications have certain invariant constraints due to practic...
research
10/06/2022

Q-LSTM Language Model – Decentralized Quantum Multilingual Pre-Trained Language Model for Privacy Protection

Large-scale language models are trained on a massive amount of natural l...
research
06/10/2022

Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averaging

Decentralized optimization is increasingly popular in machine learning f...
research
01/05/2020

Exploiting Event Cameras for Spatio-Temporal Prediction of Fast-Changing Trajectories

This paper investigates trajectory prediction for robotics, to improve t...

Please sign up or login with your details

Forgot password? Click here to reset