Source-linked AI summary
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Xiaofei Wang, Yiwen Han, Victor C. M. Leung, Dusit Niyato, Xueqiang Yan, Xu Chen
TL;DR
Cloud computing faces efficiency, latency, and related constraints when supporting increasingly distributed data and DL services. This survey synthesizes edge intelligence and intelligent edge through five enabling technologies and reviews representative implementation approaches, concluding that Edge DL requires coordinated architecture under networking, communication, computing, and energy constraints.
Problem
Cloud-centric DL services face efficiency and latency issues as data and computing increasingly spread across edge devices, limiting pervasive intelligent services.
Method
The survey organizes Edge DL around five enabling technologies covering applications, inference, edge support for DL, distributed training, and DL-based edge optimization.
Results
The survey consolidates application scenarios, implementation techniques, and challenges for the mutually beneficial integration of edge intelligence and intelligent edge.
Takeaways & Limitations
Edge DL requires edge architectures that balance networking, communication, computing power, and energy consumption to support DL training and inference.
Abstract
from arXiv · showhide
Ubiquitous sensors and smart devices from factories and communities are generating massive amounts of data, and ever-increasing computing power is driving the core of computation and services from the cloud to the edge of the network. As an important enabler broadly changing people's lives, from face recognition to ambitious smart factories and cities, developments of artificial intelligence (especially deep learning, DL) based applications and services are thriving. However, due to efficiency and latency issues, the current cloud computing service architecture hinders the vision of "providing artificial intelligence for every person and every organization at everywhere". Thus, unleashing DL services using resources at the network edge near the data sources has emerged as a desirable solution. Therefore, edge intelligence, aiming to facilitate the deployment of DL services by edge computing, has received significant attention. In addition, DL, as the representative technique of artificial intelligence, can be integrated into edge computing frameworks to build intelligent edge for dynamic, adaptive edge maintenance and management. With regard to mutually beneficial edge intelligence and intelligent edge, this paper introduces and discusses: 1) the application scenarios of both; 2) the practical implementation methods and enabling technologies, namely DL training and inference in the customized edge computing framework; 3) challenges and future trends of more pervasive and fine-grained intelligence. We believe that by consolidating information scattered across the communication, networking, and DL areas, this survey can help readers to understand the connections between enabling technologies while promoting further discussions on the fusion of edge intelligence and intelligent edge, i.e., Edge DL.
I. INTRODUCTION
The survey frames Edge DL as a mutually beneficial convergence: edge resources bring DL services closer to data sources, while DL makes edge maintenance and management adaptive. It organizes this convergence around five enabling technologies spanning applications, inference, infrastructure, training, and optimization.
- Motivation: Cloud-centric DL is strained by distributed data, high transmission costs, uncertain latency, reliability requirements, and privacy concerns.These constraints are especially relevant to time-critical, industrial, smart-home, and smart-city applications.
- Motivation: Edge intelligence moves DL computation toward users and data sources to support distributed, low-latency, reliable services while reducing cloud communication and improving privacy.Local storage and hierarchical computation can limit raw-data transmission to the cloud.
- Motivation: Intelligent edge incorporates DL into edge infrastructure for adaptive maintenance and management of complex, rapidly changing communication and computing environments.DL extracts information from network data and supports adaptive decisions where fixed mathematical models are difficult to apply accurately.
- Scope and taxonomy: The survey identifies five Edge DL technologies: applications on edge, inference in edge, edge computing for DL, training at edge, and DL for optimizing edge.Together they cover service deployment, model execution, platform support, distributed training, and functions such as caching and computation offloading.
- Scope and taxonomy: Its taxonomy links DL applications on edge and DL for optimizing edge to edge intelligence and intelligent edge, respectively, with training and inference providing supporting capabilities.The survey emphasizes that deploying DL on the edge alone is incomplete because DL and edge computing benefit each other.
- Survey organization: The paper surveys fundamentals, five enabling technologies, lessons learned, and open challenges concerning the convergence of DL and edge computing.The organization spans DL applications, inference, edge platforms, training, and optimization.
II. FUNDAMENTALS OF EDGE COMPUTING
Edge computing complements cloud computing by placing computation closer to data sources and users, with architectures spanning devices, edge nodes, and cloud resources. Its evolution includes Cloudlets, fog, and multi-access edge approaches, while collaborative end-edge-cloud computing supports DL workloads.
- Edge computing reduces data transmission, improves service latency, and eases pressure on cloud computing.
- Cloudlet and Micro Data Centers: Cloudlets combine mobile and cloud computing as a middle layer between mobile devices and the cloud.
- Cloudlet and Micro Data Centers: Micro data centers package computing, storage, and networking equipment in one enclosure for applications needing lower latency or serving resource-limited devices.
- Fog computing uses a distributed multi-tier architecture targeted to geographic areas and real-time applications requiring reduced latency.
- Multi-access Edge Computing places computing capabilities and service environments at cellular-network edges, providing lower latency, context awareness, and higher bandwidth.
- Definition of Edge Computing Terminologies: The paper distinguishes end devices, such as smartphones and smart vehicles, from edge nodes, such as Cloudlets, RSUs, fog nodes, and edge servers.
1) AI Hardware for Edge Computing:
Edge intelligence requires specialized hardware, software, virtualization, and networking support because edge resources are constrained and DL services are complex. The survey covers AI accelerators, DL libraries, containers and VMs, and programmable network infrastructure.
- AI Hardware for Edge Computing: GPU-, FPGA-, and ASIC-based hardware offer different trade-offs in compatibility, performance, energy use, computation resources, and programming flexibility.
- AI Hardware for Edge Computing: Smartphone AI chips increasingly support DL acceleration, including Qualcomm Snapdragon hardware with an SDK supporting major DL frameworks.
- AI Hardware for Edge Computing: Edge nodes provide greater computing capability than most end devices and can respond faster than the cloud, accelerating task processing while maintaining accuracy.
- Virtualizing the Edge: Virtualization must maximize limited edge resources and isolate complex DL software libraries with their versions and dependencies.
- Virtualization Techniques: VMs provide stronger isolation, whereas containers simplify deployment, reduce execution overhead, and support scalable service handoff.
- Network Virtualization: NFV and SDN improve flexible edge-network management by separating network functions from dedicated hardware and enabling programmable, rapidly deployed services.
3) Network Slicing:
Network slicing creates customized virtual networks over shared infrastructure, aligning edge resources with diverse service and quality-of-service requirements. The surrounding DL technologies include neural architectures and transfer methods that support edge deployment.
- Network Slicing: Network slicing creates multiple service-optimized network instances over shared physical infrastructure.
- Network Slicing: Coordinating network slicing with computing and communication optimization supports distributed edge-computing paradigms and customized resource allocation.
- Network Slicing: Virtualization and SDN jointly support service customization, flexible control, and resource provision for Edge DL services.
- Deep Neural Networks: Fully connected neural networks feed each layer forward but have high complexity, modest performance, and slow convergence.
- Deep Neural Networks: CNNs use pooling and moving filters to capture local correlations, extract features, reduce model complexity, and mitigate overfitting.
- Recurrent Neural Network: LSTMs add gates and memory cells to RNNs, controlling information flow to overcome gradient explosion.
- Transfer Learning and Knowledge Distillation: Transfer learning and knowledge distillation reuse knowledge from trained models to accelerate training or reduce inference overhead.
B. Deep Reinforcement Learning (DRL)
Deep reinforcement learning combines neural networks with reinforcement learning to address decision-making problems in complex state-action spaces. The survey also connects DRL and distributed DL deployment with edge-based training, inference, and real-time analytics.
- Deep Reinforcement Learning: DRL uses DNN representation ability to fit value functions or policies for decision-making in large or continuous state-action spaces.
- Value-Based DRL: Value-based DRL methods such as DQL use DNNs to map high-dimensional inputs to actions, with replay and target networks stabilizing training.
- Policy-Gradient DRL: Policy-gradient methods optimize policy parameters using gradients of expected reward, while Actor-Critic assigns policy and value estimation to separate networks.
- DL Training at Edge: Distributed training uses data or model parallelism to exploit parallel servers and address the time and resource costs of centralized training.
- DL Training at Edge: End, edge, and cloud devices can contribute distributed resources when DL training moves beyond centralized cloud infrastructure.
- DL Applications on Edge: Edge deployment supports real-time DL services because cloud-only architectures may fail to meet latency requirements for analytics and smart manufacturing.
- Real-Time Video Analytics: Video offloading must balance network conditions, data use, battery consumption, processing delay, frame rate, and analytics accuracy.
2) Edge Level:
At the edge level, Edge DL supports applications across vehicles, factories, homes, and cities while addressing latency, privacy, and resource constraints. These deployments combine distributed intelligence with model optimization and ongoing management.
- Vehicular Networks: Vehicular edge frameworks integrate networking, caching, and computation, using DRL to optimize holistic system performance and task offloading.The framework supports dynamic orchestration of multidimensional resources for different vehicular applications.
- Intelligent Manufacturing: DeepIns partitions an inspection model across end, edge, and cloud layers to improve inspection efficiency while preserving process-delay performance.The system targets autonomous manufacturing inspection and distributes model components across the deployment hierarchy.
- Intelligent Manufacturing: Intelligent manufacturing must manage evolving models and continuously evaluate them on IoT devices while coping with power, energy, and memory limitations.Caching, heterogeneous-device communication, and computation offloading are identified as ways to address these resource bottlenecks.
- Smart Homes and Cities: Smart-home edge computing protects sensitive data while enabling applications such as dynamic visual servicing and music cognition.The paper also identifies geographically distributed, latency-sensitive monitoring and intelligent control as motivations for edge computing in smart cities.
- Edge Model Constraints: Large-scale DNNs are difficult to deploy at the edge because deeper and wider models require substantial computation, memory, and supporting hardware.Model optimization must reduce resource costs without significant accuracy loss, using approaches such as pruning, quantization, and low-rank factorization.
2) Model Optimization for Edge Devices:
Model optimization for edge devices reduces the resource demands of Edge DL through input, structure, selection, and framework adaptations. Distributed execution, adaptive inference, caching, and model sharing further balance accuracy, latency, energy, and communication costs.
- Optimization Overview: Edge DL optimization must account for limited computing, memory, bandwidth, and power while preserving model accuracy.The section distinguishes optimization efforts according to their impact on inputs, structures, model choices, and execution frameworks.
- Model Input: Input optimization narrows application-specific search spaces by filtering non-target frames and tuning video resolution or sampling configurations online.FFS-VA uses specialized filters and a small detector, while Chameleon reduces the cost of searching input-stream configurations.
- Model Structure: Structure optimization uses specialized architectures, difference detectors, adaptive parameter pruning, and cross-layer algorithm–software–hardware optimization.These techniques target faster inference by exploiting model structure and application-specific redundancy.
- Model Selection: Model selection weighs precision against inference time, using predictors and automatically tuned input features to choose among available or compressed models.Combining compression techniques can provide multiple model variants for adaptive selection at the edge.
- Model Framework: Model frameworks provide optimized kernels, compression, quantization, coding, and hardware-aware support for deploying computationally demanding DNNs on edge devices.The cited framework capabilities address both software execution and the reduction of model memory demands.
- Distributed and Adaptive Inference: Partitioning models across local processors, distributed edge nodes, or end–edge–cloud systems reduces cloud-upload bottlenecks, while early exits and caching further improve inference efficiency.EEoI sends only immediate features for uncertain cases and enables confident samples to finish locally; caching and stem sharing reduce redundant computation.
VI. EDGE COMPUTING FOR DEEP LEARNING
Edge computing supports practical DL deployment through specialized hardware, software frameworks, and computation offloading. The survey compares mobile and FPGA approaches while emphasizing that collaborative architectures remain necessary for resource-intensive workloads.
- Edge Support for DL: Extensive DL deployment requires customized edge hardware and software, computation offloading, service maintenance, and fair performance evaluation.These components collectively support efficient execution and continued development of Edge DL systems.
- Mobile CPUs and GPUs: CMSIS-NN minimizes neural-network memory footprints on ARM Cortex-M cores, fitting DL models into IoT devices while maintaining normal performance and energy efficiency.The result addresses computation, memory, and energy constraints on lightweight edge devices.
- Mobile CPUs and GPUs: Mobile DL training performance depends strongly on model size and efficient fusion of mobile CPUs and GPUs.The evaluation used a relatively small Mentee network because common models such as VGG exceed mainstream edge-device memory.
- FPGA-based Solutions: FPGA edge devices accelerate CNNs with reconfigurable operations and can outperform state-of-the-art CPU and GPU implementations in RNN speech recognition while using less energy.An FPGA-based offloading platform also showed energy-consumption and hardware-cost advantages over GPU- or CPU-based alternatives in vision applications.
- FPGA-based Solutions: Whether FPGAs or GPUs/CPUs are more suitable for edge computing remains unresolved because FPGA programming and model transplantation require additional work.FPGAs offer workload-insensitive throughput, high-concurrency performance, and energy efficiency, but their development ecosystem remains less familiar.
- Computation Offloading: End-cloud, end-edge, and collaborative offloading modes trade implementation simplicity against task decomposition, scheduling, accuracy, latency, model size, battery, and network conditions.Tables IV and V organize solution comparisons and edge communication/computation modes, while edge nodes may be insufficient for large concurrent query volumes.
2) Partial Offloading:
Partial offloading divides DL computation or model structure across end devices, edge nodes, and cloud resources. These strategies reduce local resource demands but introduce partitioning, communication, orchestration, and scalability challenges.
- Partial Offloading: Partial offloading enables online fine-grained partitioning of DL tasks between end devices and edge nodes under network constraints.MAUI is cited as conserving an order of magnitude energy through optimized task allocation for general programs.
- Partial Offloading: DeepWear simplifies DL partial-offloading decisions by pruning computation-intensive nodes from a model DAG and grouping repeated sub-DAGs.The transformed structure enables lower-complexity decision making for allocating DL computation.
- Partial Offloading: IONN incrementally uploads model partitions, while unnecessary DNN layers are omitted to avoid additional offloading.Sequential model construction at the edge addresses delay from uploading an entire model at once.
- Scalability: End–edge offloading supports less computation-intensive services and small concurrent query volumes, but a single edge node is insufficient for many simultaneous queries.This limitation motivates collaboration across additional resources and architectural levels.
- Vertical Collaboration: Vertical collaboration profiles DNN layers and selects end, edge, or cloud partition points using latency, energy, wireless-condition, and server-load information.Neurosurgeon chooses the allocation that achieves the best latency or mobile-energy outcome under the modeled conditions.
- Vertical Collaboration: Vertical collaboration can absorb query floods through cloud assistance and reduce backbone traffic when edge preprocessing shrinks transmitted intermediate data, but it may add communication delay.Early exits can allow confident results to be produced before cloud processing, while cloud support handles workloads beyond edge capacity.
- Tailoring Edge Frameworks for DL: Customized edge frameworks match models to hardware, exploit performance and power characteristics, and orchestrate services, but early frameworks lack native offloading and collaboration support.Model deployment also requires architecture-aware mapping, automated porting, and online selection based on accuracy, latency, energy, and memory footprint.
D. Performance Evaluation for Edge DL
Edge DL requires evaluation methods and integrated testbeds that capture end-to-end performance across edge devices, networks, and cloud resources. The section also surveys distributed and federated training methods that address communication, privacy, and heterogeneous-resource constraints.
- Performance Evaluation for Edge DL: Standardized evaluation of DL libraries on resource-constrained edge devices is needed to compare latency and memory performance.Impartial evaluation can guide software-stack optimization for specific edge hardware.
- Performance Evaluation for Edge DL: A standard Edge DL testbed is missing, limiting evaluation of end-to-end architectures that combine edge computing, end devices, and the cloud.Proposed testbeds include openLEON and CAVBench, while integrated wireless, networking, service, and cloud models remain desirable.
- Distributed Training at Edge: Communication-efficient distributed training compresses or sparsifies gradient and model updates, and online knowledge distillation exchanges outputs instead of full parameters.These approaches target the high communication cost of synchronizing large DL models.
- Federated Learning: Federated learning keeps raw data on edge devices while iteratively exchanging local model updates with an aggregation server.The survey presents FL as a way to address non-IID data, intermittent connectivity, unbalanced contributions, and privacy concerns.
- Federated Learning: FL still incurs communication costs for model updates, motivating periodic communication, subsampling, quantization, and other compression methods.Downlink and uplink updates can both be costly when models are large.
D. Resource-optimized FL
Resource-optimized FL addresses heterogeneous devices, computation and communication budgets, and the tension between training time, energy, and model performance. The surveyed methods report reductions in communication or computation and improvements in convergence, loss, or accuracy, while some approaches retain synchronization constraints.
- Resource-optimized FL: Heterogeneous FL devices can become stragglers, delaying aggregation and forcing trade-offs between model structure, resource use, and convergence.ELFISH dynamically masks neurons during training and improves training speed by 2×, but synchronous aggregation may not handle extreme situations.
- Resource-optimized FL: FL wall-clock time combines client computation and communication, while energy consumption and training time can conflict.FEDL approximately solves each client’s local problem to balance energy cost and training time.
- Resource-optimized FL: Joint resource allocation and user selection formulate FL optimization around minimizing loss under delay and energy constraints.The base station allocates bandwidth resources while users adjust transmit power to reduce packet errors.
- Resource-optimized FL: Downlink reduction: 14×; Uplink reduction: 28×; Local computation reduction: 1.7×.These figures summarize reductions reported for a communication-efficient FL method.
- Resource-optimized FL: Convergence acceleration: 62.4%.The reported result concerns convergence under the resource-optimized FL setting.
- Resource-optimized FL: Top 1 accuracy improvement: 5.59%- 5.89%; Communication traffic reduction: 92%.The reported method jointly improves the listed accuracy measure and reduces communication traffic.
- Resource-optimized FL: Reduction of the FL loss function value: up to 16%.This is the reported upper-bound reduction for the FL loss function.
E. Security-enhanced FL
Security-enhanced FL addresses poisoned updates, device failures, aggregation-server failures, and participation incentives in distributed edge environments. The broader section also shows how DL and DRL optimize caching and other edge-management tasks, with DNN methods bounded by existing optimization solutions.
- Security-enhanced FL: Federated learning must tolerate poisoned training data, abnormal devices, unpredictable connectivity, and device dropouts.Secure Aggregation is described as tolerating up to one-third of devices failing to process or upload updates on time.
- Security-enhanced FL: BlockFL replaces dependence on a specific aggregation server with local global-model updating and adds rewards to stimulate edge-device participation.The approach targets server malfunction and unequal willingness to contribute.
- DL for Optimizing Edge: Edge caching is difficult because content popularity varies spatiotemporally and heterogeneous, hierarchical networks complicate cache-policy design.Traditional methods also require many online optimization iterations.
- DL for Optimizing Edge: DNNs can extract user and content features and use offline training to determine cache policies without repeating heavy online optimization.The learned input-solution relation depends on existing optimal or heuristic solutions.
- DL for Optimizing Edge: DNN-based caching performance is bounded by the fixed optimization algorithms used to generate training solutions and is not self-adapted.This limitation applies to the surveyed DNN-based caching methods.
- DL for Optimizing Edge: A DDPG agent with Wolpertinger architecture achieves competitive cache hit rates while reducing runtime in a single-base-station caching scenario.Wolpertinger narrows a large action space through a primary action set and k-nearest-neighbor mapping.
B. DL for Optimizing Edge Task Offloading
Edge task offloading must jointly handle target-node selection, offloading ratios, and resource allocation under energy, delay, and computing constraints. DL and DRL methods reduce online decision complexity, optimize resource use, and address reliability, mobility, and security concerns.
- DL for Optimizing Edge Task Offloading: Computation offloading is NP-hard because it must select receiving edge nodes, offloading ratios, and resource allocations under multiple constraints.Large state and action spaces make conventional learning algorithms difficult to apply directly.
- DL for Optimizing Edge Task Offloading: Offline optimal solutions can train a DNN to map the composite edge-network state to an offloading decision, avoiding online solution search.This transfers computation complexity from online optimization to DL training.
- DL for Optimizing Edge Task Offloading: DQL can select target edge nodes and transmission modes online by accounting for communication conditions and offloading utility.The approach responds to potentially low-quality wireless environments.
- DL for Optimizing Edge Task Offloading: Double-DQL saves more energy and achieves higher training efficiency than DQL in the reported DVFS experiment.Preclassification can narrow the action space as the number of edge devices increases.
- DL for Optimizing Edge Task Offloading: CNN-based state compression and Q-function decomposition extend Double-DQL to more complex energy-harvesting offloading environments.Energy harvesting from ambient radio-frequency signals complicates the offloading problem.
- DL for Optimizing Edge Task Offloading: Using DRL only for the NP-hard offloading decision, while separating resource allocation, can reduce the action-space and computational burden.The surveyed design decomposes weighted-sum computation-rate maximization into offloading and resource-allocation subproblems.
- DL for Optimizing Edge Task Offloading: Offloading optimization is connected to broader edge management needs, including mobility-aware association, communication-mode control, and defense against wireless attacks.DL-based methods model interaction costs, control communication states, and support secure offloading.
3) Joint Edge Optimization:
Joint edge optimization applies deep learning to resource management while confronting deployment, model-selection, and customization challenges in dynamic edge networks.
- 3) Joint Edge Optimization:: Edge networks use DL and DRL for resource optimization tasks including routing, traffic control, caching, and computation offloading.
- 3) Joint Edge Optimization:: Multi-timescale DRL models vehicle mobility across time slots and epochs to address immediate mobility effects and large action spaces in IoV resource allocation.
- 3) Joint Edge Optimization:: Edge services require model-selection criteria beyond standard accuracy because wireless conditions and concurrent requests vary across edge networks.
- 3) Joint Edge Optimization:: Customized models require coordination across end, edge, and cloud resources, including hybrid-precision designs that balance optimization against cloud-side accuracy risks.
- 3) Joint Edge Optimization:: Retraining optimized models can delay adaptation, while heterogeneous devices and dynamic networks create diverse customization requirements.
C. Complete Edge Architecture for DL
A complete edge architecture for DL must acquire and process data, host distributed services securely, and divide computation across heterogeneous devices and cloud resources.
- C. Complete Edge Architecture for DL: A complete DL edge framework spans data acquisition, service deployment, and task processing.
- C. Complete Edge Architecture for DL: Edge architectures must efficiently acquire and process device-generated data before feeding it to DL models.
- C. Complete Edge Architecture for DL: Adaptive edge data acquisition and compression can reduce device workload, resource overhead, bandwidth pressure, and transmission delay, but heterogeneous DL data remain insufficiently addressed.
- C. Complete Edge Architecture for DL: Microservice-based edge deployment must isolate DL services on shared resources, but edge microservice frameworks remain immature.
- C. Complete Edge Architecture for DL: Offloading heavy DL computation requires incentives for participating edge nodes and security against anonymous nodes.
- C. Complete Edge Architecture for DL: Dividing computation-intensive DL models into subtasks enables task offloading and collaboration among end devices, edge nodes, base stations, and cloud infrastructure.
- C. Complete Edge Architecture for DL: Edge training is constrained by weak device performance and limited framework support, with many studies still simulating training theoretically.
- C. Complete Edge Architecture for DL: Federated learning can combine data and model parallelism, but practical edge training must handle unlabeled data and distributed resource constraints.
3) Asynchronous FL at Edge:
Asynchronous and practical edge learning must accommodate intermittent participation, limited communication, heterogeneous schedules, and deployment overhead while extending DL-based edge optimization.
- 3) Asynchronous FL at Edge:: Synchronous federated learning scales only to hundreds of devices and may be inefficient under infrequent training and uncertain inter-device communication.
- 3) Asynchronous FL at Edge:: Device-specific scheduling and availability make epoch synchronization difficult, requiring server-selected participants and timeout rules for lagging devices.
- 3) Asynchronous FL at Edge:: Transfer learning and knowledge distillation can reduce edge training data, accelerate student convergence, improve accuracy, and limit overfitting.
- 3) Asynchronous FL at Edge:: DL optimization spans applications such as content streaming, routing, and traffic control, but practical deployment must account for model overhead.
- 3) Asynchronous FL at Edge:: Training-data transmission consumes bandwidth, while DL inference adds latency and can offset the benefits of edge optimization.
- 3) Asynchronous FL at Edge:: Open deployment questions concern model placement, architecture support, customized models, and training principles for timely edge management.
- 3) Asynchronous FL at Edge:: Multi-agent DRL and GNNs can represent end devices, edge nodes, and cloud systems as cooperating agents using local observations.
- 3) Asynchronous FL at Edge:: The survey frames Edge DL as a joint problem of optimizing training and inference under networking, communication, computing-power, and energy constraints.