A DRL Approach for RIS-Assisted Full-Duplex UL and DL Transmission: Beamforming, Phase Shift and Power Optimization

12/28/2022
by   Nancy Nayak, et al.
0

In this work, a two-stage deep reinforcement learning (DRL) approach is presented for a full-duplex (FD) transmission scenario that does not depend on the channel state information (CSI) knowledge to predict the phase-shifts of reconfigurable intelligent surface (RIS), beamformers at the base station (BS), and the transmit powers of BS and uplink users in order to maximize the weighted sum rate of uplink and downlink users. As the self-interference (SI) cancellation and beamformer design are coupled problems, the first stage uses a least squares method to partially cancel self-interference (SI) and initiate learning, while the second stage uses DRL to make predictions and achieve performance close to methods with perfect CSI knowledge. Further, to reduce the signaling from BS to the RISs, a DRL framework is proposed that predicts quantized RIS phase-shifts and beamformers using 32 times fewer bits than the continuous version. The quantized methods have reduced action space and therefore faster convergence; with sufficient training, the UL and DL rates for the quantized phase method are 8.14% and 2.45% better than the continuous phase method respectively. The RIS elements can be grouped to have similar phase-shifts to further reduce signaling, at the cost of reduced performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/19/2022

Optimal phase shift design for fair allocation in RIS aided uplink network using statistical CSI

Reconfigurable intelligent surface (RIS) can be crucial in next-generati...
research
01/03/2018

A New Design Paradigm for Secure Full-Duplex Multiuser Systems

We consider a full-duplex (FD) multiuser system where an FD base station...
research
02/04/2021

Reconfigurable-intelligent-surface-assisted Downlink Transmission Design via Bayesian Optimization

This paper investigates the transmission design in the reconfigurable-in...
research
02/24/2020

Millimeter Wave Communications with an Intelligent Reflector: Performance Optimization and Distributional Reinforcement Learning

In this paper, a novel framework is proposed to optimize the downlink mu...
research
02/01/2020

Analysis and Optimization of an Intelligent Reflecting Surface-assisted System with Interference

In this paper, we study an intelligent reflecting surface (IRS)-assisted...
research
02/24/2020

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Recently, the reconfigurable intelligent surface (RIS), benefited from t...

Please sign up or login with your details

Forgot password? Click here to reset