Intelligent Blockchain-Based Edge Computing via Deep Reinforcement Learning: Solutions and Challenges

Nguyen Dinh C., Nguyen Van-Dinh, Ding Ming, Chatzinotas Symeon, Pathirana Pubudu N., Seneviratne Aruna, Dobre Octavia, Zomaya Albert Y.

Publisher

The convergence of mobile edge computing (MEC) and blockchain is transforming the current computing services in wireless Internet-of-Things (IoT) networks, enabling task offloading with security enhancement based on blockchain mining. Yet the existing approaches for these enabling technologies are isolated, providing only tailored solutions for specific services and scenarios. To fill this gap, we propose a novel cooperative task offloading and blockchain mining (TOBM) scheme for a blockchain-based MEC system, where each edge device not only handles computation tasks but also conducts block mining for improving system utility. To address the latency issues caused by the blockchain operation in MEC, we develop a new Proof-of-Reputation consensus mechanism based on a lightweight block verification strategy. To accommodate the highly dynamic environment and high-dimensional system state space, we apply a novel distributed deep reinforcement learning-based approach by using a multi-agent deep deterministic policy gradient algorithm. Experimental results demonstrate the superior performance of the proposed TOBM scheme in terms of enhanced system reward, improved offloading utility with lower blockchain mining latency, and better system utility, compared to the existing cooperative and non-cooperative schemes. The article concludes with key technical challenges and possible directions for future blockchain-based MEC research.

Publisher: IEEE Network

ISSN (Electronic): 1558156X

ISSN (Print): 08908044

Keywords

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications

Publication year

2022

Fingerprint