BROWSE
Detail
Journal Article
QoS-Aware Workload Distribution in Hierarchical Edge Clouds: A Reinforcement Learning Approach
- Authors
- Chunglae Cho, Seungjae Shin, Hongseok Jeon, Seunghyun Yoon
- Issue Date
- 2020-10
- Citation
- IEEE Access, v.8, pp.193297-193313
- ISSN
- 2169-3536
- Publisher
- IEEE
- Language
- English
- Type
- Journal Article
- Abstract
- Recently, edge computing is getting attention as a new computing paradigm that is expected to achieve short-delay and high-throughput task offloading for large scale Internet-of-Things (IoT) applications. In edge computing, workload distribution is one of the most critical issues that largely influences the delay and throughput performance of edge clouds, especially in distributed Function-as-a-Service (FaaS) over networked edge nodes. In this paper, we propose the Resource Allocation Control Engine with Reinforcement learning (RACER), which provides an efficient workload distribution strategy to reduce the task response slowdown with per-task response time Quality-of-Service (QoS). First, we present a novel problem formulation with the per-task QoS constraint derived from the well-known token bucket mechanism. Second, we employ a problem relaxation to reduce the overall computation complexity by compromising just a bit of optimality. Lastly, we take the deep reinforcement learning approach as an alternative solution to the workload distribution problem to cope with the uncertainty and dynamicity of underlying environments. Evaluation results show that RACER achieves a significant improvement in terms of per-task QoS violation ratio, average slowdown, and control efficiency, compared to AREA, a state-of-the-art workload distribution method.
- KSP Keywords
- Control efficiency, Critical issues, Deep reinforcement learning, Distribution problem, Distribution strategy, Edge cloud, Function as a service, High throughput(HTP), Internet of thing(IoT), Large scale Internet, Learning approach
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
