Distributed and Cluster Computing

Papers filed under cs.DC on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

961 to 1,020 of 1,071

Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence
Shuiguang Deng, Hailiang Zhao, Weijia Fang +3
cs.NIcs.DCarXiv:1909.00560v22019
A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems
Anton Beloglazov, Rajkumar Buyya, Young Choon Lee +1
cs.DCarXiv:1007.0066v22010
OpenTinker: Separating Concerns in Agentic Reinforcement Learning
Siqi Zhu, Jiaxuan You
cs.AIcs.DCarXiv:2601.07376v22026
A Survey of Distributed Consensus Protocols for Blockchain Networks
Yang Xiao, Ning Zhang, Wenjing Lou +1
cs.CRcs.DCarXiv:1904.04098v42019
PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
Yanli Zhao, Andrew Gu, Rohan Varma +15
cs.DCcs.AIcs.LGarXiv:2304.11277v22023
VoxServe: Streaming-Centric Serving System for Speech Language Models
Keisuke Kamahori, Wei-Tzu Lee, Atindra Jha +4
cs.LGcs.AIcs.DCarXiv:2602.00269v12026
Attack of the Tails: Yes, You Really Can Backdoor Federated Learning
Hongyi Wang, Kartik Sreenivasan, Shashank Rajput +5
cs.LGcs.CRcs.DCarXiv:2007.05084v12020
Revisiting Distributed Synchronous SGD
Jianmin Chen, Xinghao Pan, Rajat Monga +2
cs.LGcs.DCcs.NEarXiv:1604.00981v32016
Splitwise: Efficient generative LLM inference using phase splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang +4
cs.ARcs.DCarXiv:2311.18677v22023
Time-Varying Graphs and Dynamic Networks
Arnaud Casteigts, Paola Flocchini, Walter Quattrociocchi +1
cs.DCcs.NIcs.SIarXiv:1012.0009v32010
Clipper: A Low-Latency Online Prediction Serving System
Daniel Crankshaw, Xin Wang, Giulio Zhou +3
cs.DCcs.LGarXiv:1612.03079v22016
Canzona: A Unified, Asynchronous, and Load-Balanced Framework for Distributed Matrix-based Optimizers
Liangyu Wang, Siqi Zhang, Junjie Wang +7
cs.DCcs.LGarXiv:2602.06079v12026
Personalized Cross-Silo Federated Learning on Non-IID Data
Yutao Huang, Lingyang Chu, Zirui Zhou +4
cs.LGcs.DCstat.MLarXiv:2007.03797v52020
Fog Computing: A Taxonomy, Survey and Future Directions
Redowan Mahmud, Ramamohanarao Kotagiri, Rajkumar Buyya
cs.DCarXiv:1611.05539v42016
SAEM: Stage-Aware Expert Management for Memory-Efficient MoE Inference in Chain-of-Thought Reasoning
Yujie Zhang, Bin Gao, Tulika Mitra
cs.AIcs.DCarXiv:2608.21614v12026
A Survey on Distributed Machine Learning
Joost Verbraeken, Matthijs Wolting, Jonathan Katzy +3
cs.LGcs.DCstat.MLarXiv:1912.09789v12019
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
Yinmin Zhong, Shengyu Liu, Junda Chen +5
cs.DCarXiv:2401.09670v32024
Sparse Communication for Distributed Gradient Descent
Alham Fikri Aji, Kenneth Heafield
cs.CLcs.DCcs.LGarXiv:1704.05021v22017
Flash-KMeans: Fast and Memory-Efficient Exact K-Means
Shuo Yang, Haocheng Xi, Yilong Zhao +10
cs.DCarXiv:2603.09229v22026
Big Data Computing and Clouds: Trends and Future Directions
Marcos D. Assuncao, Rodrigo N. Calheiros, Silvia Bianchi +2
cs.DCarXiv:1312.4722v22013
SPEED-Bench: A Unified and Diverse Benchmark for Speculative Decoding
Talor Abramovich, Maor Ashkenazi, Izzy Putterman +5
cs.DCcs.AIarXiv:2604.09557v22026
KVBoost: Chunk-Level Key-Value Cache Reuse with Deviation-Guided Recomputation for Efficient Large Language Model Inference
Srihari Unnikrishnan
cs.AIcs.DCarXiv:2608.21362v12026
Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
En Li, Liekang Zeng, Zhi Zhou +1
cs.NIcs.CVcs.DCarXiv:1910.05316v12019
Sparsified SGD with Memory
Sebastian U. Stich, Jean-Baptiste Cordonnier, Martin Jaggi
cs.LGcs.DCcs.DSarXiv:1809.07599v22018
A Comprehensive Survey on Fog Computing: State-of-the-art and Research Challenges
Carla Mouradian, Diala Naboulsi, Sami Yangui +3
cs.DCcs.SEarXiv:1710.11001v32017
MegaFlow: Large-Scale Distributed Orchestration System for the Agentic Era
Lei Zhang, Mouxiang Chen, Ruisheng Cao +16
cs.DCcs.SEarXiv:2601.07526v22026
Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider
Mohammad Shahrad, Rodrigo Fonseca, Íñigo Goiri +7
cs.DCarXiv:2003.03423v32020
BLOCKBENCH: A Framework for Analyzing Private Blockchains
Tien Tuan Anh Dinh, Ji Wang, Gang Chen +3
cs.DBcs.CRcs.DCarXiv:1703.04057v12017
GraphLab: A New Framework for Parallel Machine Learning
Yucheng Low, Joseph Gonzalez, Aapo Kyrola +3
cs.LGcs.DCarXiv:1006.4990v12010
An Overview on Smart Contracts: Challenges, Advances and Platforms
Zibin Zheng, Shaoan Xie, Hong-Ning Dai +4
cs.SEcs.DCarXiv:1912.10370v12019
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
Amirhossein Reisizadeh, Aryan Mokhtari, Hamed Hassani +2
cs.LGcs.DCmath.OCarXiv:1909.13014v42019
Blockchain for Internet of Things: A Survey
Hong-Ning Dai, Zibin Zheng, Yan Zhang
cs.NIcs.DCcs.SEarXiv:1906.00245v52019
MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic Environments
Guangyi Liu, Pengxiang Zhao, Yaozhen Liang +12
cs.DCarXiv:2602.06075v22026
The Rise of Blockchain Technology in Agriculture and Food Supply Chains
Andreas Kamilaris, Agusti Fonts, Francesc X. Prenafeta-Boldu
cs.CYcs.DCcs.SIarXiv:1908.07391v12019
DualPath: Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inference
Yongtong Wu, Shaoyuan Chen, Yinmin Zhong +10
cs.DCarXiv:2602.21548v22026
Data-Free Knowledge Distillation for Heterogeneous Federated Learning
Zhuangdi Zhu, Junyuan Hong, Jiayu Zhou
cs.LGcs.DCarXiv:2105.10056v22021
The Hidden Vulnerability of Distributed Learning in Byzantium
El Mahdi El Mhamdi, Rachid Guerraoui, Sébastien Rouault
stat.MLcs.CRcs.DCarXiv:1802.07927v22018
QEIL v2: Heterogeneous Computing for Edge Intelligence via Roofline-Derived Pareto-Optimal Energy Modeling and Multi-Objective Orchestration
Satyam Kumar, Saurabh Jha
cs.DCarXiv:2602.06057v32026
MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU
Zhengqing Yuan, Hanchi Sun, Lichao Sun +1
cs.CLcs.DCcs.OSarXiv:2604.05091v12026
Forge-UGC: FX optimization and register-graph engine for universal graph compiler
Satyam Kumar, Saurabh Jha
cs.ARcs.AIcs.DCarXiv:2604.16498v12026
BackDFL: A Unified Benchmark For Backdoor Attacks and Defenses In Decentralized Federated Learning
Mouhamed Amine Bouchiha, Gregory Blanc, Yufei Han
cs.LGcs.CRcs.DCarXiv:2608.21137v12026
HIERA: Workload-Aware Planning Across Implementation Spaces for GPU Kernel Optimization
Jinghao Wang, Qiqi Gu, Chenpeng Wu +3
cs.DCcs.AIarXiv:2608.21157v12026
TreeWY: Speculative Verification for Gated DeltaNet Hybrids
Sneha Murthy Ghantasala
cs.AIcs.CLcs.DCarXiv:2608.20961v12026
Tune: A Research Platform for Distributed Model Selection and Training
Richard Liaw, Eric Liang, Robert Nishihara +3
cs.LGcs.DCstat.MLarXiv:1807.05118v12018
Don't Decay the Learning Rate, Increase the Batch Size
Samuel L. Smith, Pieter-Jan Kindermans, Chris Ying +1
cs.LGcs.CVcs.DCarXiv:1711.00489v22017
InterCloud: Utility-Oriented Federation of Cloud Computing Environments for Scaling of Application Services
Rajkumar Buyya, Rajiv Ranjan, Rodrigo N. Calheiros
cs.DCarXiv:1003.3920v12010
Federated Learning Based on Dynamic Regularization
Durmus Alp Emre Acar, Yue Zhao, Ramon Matas Navarro +3
cs.LGcs.DCarXiv:2111.04263v22021
Modeling and Simulation of Scalable Cloud Computing Environments and the CloudSim Toolkit: Challenges and Opportunities
Rajkumar Buyya, Rajiv Ranjan, Rodrigo N. Calheiros
cs.DCcs.NIarXiv:0907.4878v12009
Local SGD Converges Fast and Communicates Little
Sebastian U. Stich
math.OCcs.DCcs.LGarXiv:1805.09767v32018
Towards Personalized Federated Learning
Alysa Ziying Tan, Han Yu, Lizhen Cui +1
cs.LGcs.AIcs.DCarXiv:2103.00710v32021
Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM
Deepak Narayanan, Mohammad Shoeybi, Jared Casper +9
cs.CLcs.DCarXiv:2104.04473v52021
signSGD: Compressed Optimisation for Non-Convex Problems
Jeremy Bernstein, Yu-Xiang Wang, Kamyar Azizzadenesheli +1
cs.LGcs.DCmath.OCarXiv:1802.04434v32018
FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestration
Zhengding Hu, Mingge Lu, Zhen Wang +8
cs.LGcs.DCarXiv:2605.08520v12026
Federated Learning on Non-IID Data: A Survey
Hangyu Zhu, Jinjin Xu, Shiqing Liu +1
cs.LGcs.DCarXiv:2106.06843v12021
One weird trick for parallelizing convolutional neural networks
Alex Krizhevsky
cs.NEcs.DCcs.LGarXiv:1404.5997v22014
Position: LLM Inference Should Be Evaluated as Energy-to-Token Production
Xiang Liu, Shimiao Yuan, Zhenheng Tang +5
cs.CEcs.DCarXiv:2605.11733v12026
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent
Xiangru Lian, Ce Zhang, Huan Zhang +3
math.OCcs.DCcs.LGarXiv:1705.09056v52017
iFogSim: A Toolkit for Modeling and Simulation of Resource Management Techniques in Internet of Things, Edge and Fog Computing Environments
Harshit Gupta, Amir Vahid Dastjerdi, Soumya K. Ghosh +1
cs.DCarXiv:1606.02007v12016
Local Model Poisoning Attacks to Byzantine-Robust Federated Learning
Minghong Fang, Xiaoyu Cao, Jinyuan Jia +1
cs.CRcs.DCcs.LGarXiv:1911.11815v42019
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Yujun Lin, Song Han, Huizi Mao +2
cs.CVcs.DCcs.LGarXiv:1712.01887v32017

Distributed and Cluster Computing

Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence

A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems

OpenTinker: Separating Concerns in Agentic Reinforcement Learning

A Survey of Distributed Consensus Protocols for Blockchain Networks

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

VoxServe: Streaming-Centric Serving System for Speech Language Models

Attack of the Tails: Yes, You Really Can Backdoor Federated Learning

Revisiting Distributed Synchronous SGD

Splitwise: Efficient generative LLM inference using phase splitting

Time-Varying Graphs and Dynamic Networks

Clipper: A Low-Latency Online Prediction Serving System

Canzona: A Unified, Asynchronous, and Load-Balanced Framework for Distributed Matrix-based Optimizers

Personalized Cross-Silo Federated Learning on Non-IID Data

Fog Computing: A Taxonomy, Survey and Future Directions

SAEM: Stage-Aware Expert Management for Memory-Efficient MoE Inference in Chain-of-Thought Reasoning

A Survey on Distributed Machine Learning

DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving

Sparse Communication for Distributed Gradient Descent

Flash-KMeans: Fast and Memory-Efficient Exact K-Means

Big Data Computing and Clouds: Trends and Future Directions

SPEED-Bench: A Unified and Diverse Benchmark for Speculative Decoding

KVBoost: Chunk-Level Key-Value Cache Reuse with Deviation-Guided Recomputation for Efficient Large Language Model Inference

Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing

Sparsified SGD with Memory

A Comprehensive Survey on Fog Computing: State-of-the-art and Research Challenges

MegaFlow: Large-Scale Distributed Orchestration System for the Agentic Era

Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider

BLOCKBENCH: A Framework for Analyzing Private Blockchains

GraphLab: A New Framework for Parallel Machine Learning

An Overview on Smart Contracts: Challenges, Advances and Platforms

FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization

Blockchain for Internet of Things: A Survey

MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic Environments

The Rise of Blockchain Technology in Agriculture and Food Supply Chains

DualPath: Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inference

Data-Free Knowledge Distillation for Heterogeneous Federated Learning

The Hidden Vulnerability of Distributed Learning in Byzantium

QEIL v2: Heterogeneous Computing for Edge Intelligence via Roofline-Derived Pareto-Optimal Energy Modeling and Multi-Objective Orchestration

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Forge-UGC: FX optimization and register-graph engine for universal graph compiler

BackDFL: A Unified Benchmark For Backdoor Attacks and Defenses In Decentralized Federated Learning

HIERA: Workload-Aware Planning Across Implementation Spaces for GPU Kernel Optimization

TreeWY: Speculative Verification for Gated DeltaNet Hybrids

Tune: A Research Platform for Distributed Model Selection and Training

Don't Decay the Learning Rate, Increase the Batch Size

InterCloud: Utility-Oriented Federation of Cloud Computing Environments for Scaling of Application Services

Federated Learning Based on Dynamic Regularization

Modeling and Simulation of Scalable Cloud Computing Environments and the CloudSim Toolkit: Challenges and Opportunities

Local SGD Converges Fast and Communicates Little

Towards Personalized Federated Learning

Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

signSGD: Compressed Optimisation for Non-Convex Problems

FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestration

Federated Learning on Non-IID Data: A Survey

One weird trick for parallelizing convolutional neural networks

Position: LLM Inference Should Be Evaluated as Energy-to-Token Production

Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent

iFogSim: A Toolkit for Modeling and Simulation of Resource Management Techniques in Internet of Things, Edge and Fog Computing Environments

Local Model Poisoning Attacks to Byzantine-Robust Federated Learning

Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training