Heterogeneous Task Oriented Data Scheduling in Vehicular Edge Computing via Deep Reinforcement Learning
Date
2024-08-16
Journal Title
Journal ISSN
Volume Title
Publisher
IEEE Transactions on Vehicular Technology
Abstract
In vehicular edge computing environment, massive computation-intensive tasks would be produced from diverse vehicular applications. Data scheduling among vehicles and roadside units(RSUs) is a fundamental issue in timely processing those tasks. However, the task heterogeneity with different computation resource requirements and delay constraints, the distinct capacities of vehicles and RSUs, and the stochastic task arrival, pose significant challenges in realizing efficient data scheduling. The existing literature ignores the multi-core feature of both vehicles and RSUs in data scheduling, which may lead to an inefficient resource usage. To cope with these challenges, in this paper, we first construct a multi-queue multi-block model for heterogeneous task oriented data caching on both vehicle and RSU sides. By fully utilizing the multi-core features of both vehicles and RSUs, a fine-grained offloading model is then developed, involving the association between data blocks and computing cores, and the allocation of computation and communication resources. After that, a long-term loss minimization problem is formulated to facilitate data processing. We leverage the Markov decision process (MDP) to model the optimization problem, which is then solved by our proposed deep deterministic policy gradient (DDPG) based association mapping and resource allocation algorithm (D-AMRA). In D-AMRA, an action transformation method is proposed to map the outputs of DDPG to the form of optimization variables. Eventually, extensive simulations with comparative benchmarks are conducted to evaluate the effectiveness of our proposed D-AMRA.
Description
This article was originally published in IEEE Transactions on Vehicular Technology. The version of record is available at: https://doi.org/10.1109/TVT.2024.3444815.
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
This article will be embargoed until 08/16/2026.
Keywords
vehicular edge computing (VEC), heterogeneous task, data scheduling, deep reinforcement learning (DRL)
Citation
Q. Luo, T. H. Luan, W. Shi and P. Fan, "Heterogeneous Task Oriented Data Scheduling in Vehicular Edge Computing via Deep Reinforcement Learning," in IEEE Transactions on Vehicular Technology, doi: 10.1109/TVT.2024.3444815.