YOLO-based Semantic Communication with Generative AI-aided Resource Allocation for Digital Twins Construction

by   Baoxia Du, et al.

Digital Twins play a crucial role in bridging the physical and virtual worlds. Given the dynamic and evolving characteristics of the physical world, a huge volume of data transmission and exchange is necessary to attain synchronized updates in the virtual world. In this paper, we propose a semantic communication framework based on You Only Look Once (YOLO) to construct a virtual apple orchard with the aim of mitigating the costs associated with data transmission. Specifically, we first employ the YOLOv7-X object detector to extract semantic information from captured images of edge devices, thereby reducing the volume of transmitted data and saving transmission costs. Afterwards, we quantify the importance of each semantic information by the confidence generated through the object detector. Based on this, we propose two resource allocation schemes, i.e., the confidence-based scheme and the artificial intelligence-generated scheme, aimed at enhancing the transmission quality of important semantic information. The proposed diffusion model generates an optimal allocation scheme that outperforms both the average allocation scheme and the confidence-based allocation scheme. Moreover, to obtain semantic information more effectively, we enhance the detection capability of the YOLOv7-X object detector by introducing new Efficient Layer Aggregation Network-HorNet (ELAN-H) and SimAM attention modules, while reducing the model parameters and computational complexity, making it easier to run on edge devices with limited performance. The numerical results indicate that our proposed semantic communication framework and resource allocation schemes significantly reduce transmission costs while enhancing the transmission quality of important information in communication services.


page 1

page 4

page 8

page 9

page 13


Stochastic Resource Allocation for Semantic Communication-aided Virtual Transportation Networks in the Metaverse

The physical-virtual world synchronization to develop the Metaverse will...

Generative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts

Semantic communication (SemCom) holds promise for reducing network resou...

Blockchain-aided Secure Semantic Communication for AI-Generated Content in Metaverse

The construction of virtual transportation networks requires massive dat...

A Unified Framework for Integrating Semantic Communication and AI-Generated Content in Metaverse

As the Metaverse continues to grow, the need for efficient communication...

Adaptive Bitrate Video Semantic Communication over Wireless Networks

This paper investigates the adaptive bitrate (ABR) video semantic commun...

Vision-based Semantic Communications for Metaverse Services: A Contest Theoretic Approach

The popularity of Metaverse as an entertainment, social, and work platfo...

Cooperative Resource Management in Quantum Key Distribution (QKD) Networks for Semantic Communication

Increasing privacy and security concerns in intelligence-native 6G netwo...

Please sign up or login with your details

Forgot password? Click here to reset