Distributed and Cluster Computing

Papers filed under cs.DC on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,321 to 1,380 of 1,809

FractalNet-Based Heterogeneous Federated Learning for Orbital Edge Intelligence in Satellite Mega-Constellations: A Wildfire Case Study
Sai Puppala, Koushik Sinha
cs.AIcs.DCcs.ETarXiv:2609.00875v12026
Some Observations on Optimal Frequency Selection in DVFS-based Energy Consumption Minimization
Nikzad Babaii Rizvandi, Javid Taheri, Albert Y. Zomaya
cs.DCcs.PFarXiv:1201.1695v12012
Perturbed Iterate Analysis for Asynchronous Stochastic Optimization
Horia Mania, Xinghao Pan, Dimitris Papailiopoulos +3
stat.MLcs.DCcs.DSarXiv:1507.06970v22015
Don't Be Afraid to Die: Black Hole Search in Dynamic Graphs with Fewer Agents
Kass Bileski, Avery Miller
cs.DCcs.DSarXiv:2609.06850v12026
Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data
Sohei Itahara, Takayuki Nishio, Yusuke Koda +2
cs.DCcs.LGarXiv:2008.06180v22020
Federated Zeroth-Order Optimization with Direction Aggregation and Variance Reduction
Qianlong Dang, Baosheng Li
cs.DCarXiv:2610.11821v12026
Taming Bitwise Behavior in GPU Kernels with Tensor Core: Black-Box Reconstruction, Compiler Enforcement, and Static Verification
Ziteng Yang, Nicholas J. Riasanovsky, Warren Deng +1
cs.DCcs.PFcs.PLarXiv:2609.11356v12026
Synthesizing Optimal Collective Algorithms
Zixian Cai, Zhengyang Liu, Saeed Maleki +4
cs.DCarXiv:2008.08708v22020
INTELLECT-2: A Reasoning Model Trained Through Globally Decentralized Reinforcement Learning
Prime Intellect Team, Sami Jaghouar, Justus Mattern +11
cs.LGcs.DCarXiv:2505.07291v12025
A Meta-Heuristic Load Balancer for Cloud Computing Systems
Leszek Sliwko, Vladimir Getov
cs.DCcs.AIarXiv:2511.11721v22025
GreenDirector: carbon- and water-aware workload placement for sustainable computing
Jaime Iglesias Blanco, Ignacio Heredia, María Castrillo +3
cs.DCarXiv:2609.12602v22026
SharPer: Sharding Permissioned Blockchains Over Network Clusters
Mohammad Javad Amiri, Divyakant Agrawal, Amr El Abbadi
cs.DBcs.DCarXiv:1910.00765v22019
DORA: A Scalable Asynchronous Reinforcement Learning System for Language Model Training
Tianhao Hu, Xiangcheng Liu, Yuchun Miao +16
cs.LGcs.DCarXiv:2604.26256v22026
Dissecting the NVidia Turing T4 GPU via Microbenchmarking
Zhe Jia, Marco Maggioni, Jeffrey Smith +1
cs.DCarXiv:1903.07486v12019
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients
Aritra Mitra, Rayana Jaafar, George J. Pappas +1
cs.LGcs.DCeess.SYarXiv:2102.07053v22021
Stateful Dataflow Multigraphs: A Data-Centric Model for Performance Portability on Heterogeneous Architectures
Tal Ben-Nun, Johannes de Fine Licht, Alexandros Nikolaos Ziogas +2
cs.PLcs.DCcs.PFarXiv:1902.10345v32019
Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts
Weilin Cai, Juyong Jiang, Le Qin +3
cs.LGcs.CLcs.DCarXiv:2404.05019v32024
SpotServe: Serving Generative Large Language Models on Preemptible Instances
Xupeng Miao, Chunan Shi, Jiangfei Duan +4
cs.DCcs.CLcs.LGarXiv:2311.15566v12023
Decentralized Collaborative Learning of Personalized Models over Networks
Paul Vanhaesebrouck, Aurélien Bellet, Marc Tommasi
cs.LGcs.AIcs.DCarXiv:1610.05202v22016
A Fundamental Tradeoff between Computation and Communication in Distributed Computing
Songze Li, Mohammad Ali Maddah-Ali, Qian Yu +1
cs.ITcs.DCarXiv:1604.07086v22016
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms
Jianyu Wang, Gauri Joshi
cs.LGcs.DCstat.MLarXiv:1808.07576v32018
Engineering Parallel Algorithms for Community Detection in Massive Networks
Christian L. Staudt, Henning Meyerhenke
cs.DCcs.SIarXiv:1304.4453v42013
RevDedup: A Reverse Deduplication Storage System Optimized for Reads to Latest Backups
Chun-Ho Ng, Patrick P. C. Lee
cs.DCcs.OSarXiv:1302.0621v32013
PolyShard: Coded Sharding Achieves Linearly Scaling Efficiency and Security Simultaneously
Songze Li, Mingchao Yu, Chien-Sheng Yang +3
cs.CRcs.DCcs.ITarXiv:1809.10361v22018
Federated Graph Classification over Non-IID Graphs
Han Xie, Jing Ma, Li Xiong +1
cs.LGcs.AIcs.DCarXiv:2106.13423v52021
GNNAdvisor: An Adaptive and Efficient Runtime System for GNN Acceleration on GPUs
Yuke Wang, Boyuan Feng, Gushu Li +4
cs.DCarXiv:2006.06608v32020
The Convergence of Sparsified Gradient Methods
Dan Alistarh, Torsten Hoefler, Mikael Johansson +3
cs.LGcs.DCstat.MLarXiv:1809.10505v12018
Unveiling the Depth-Performance Dilemma in Split-Federated Fine-tuning of LLMs
Hariharan Ramesh, Someshwaran Murugaiyan, Jyotikrishna Dass
cs.LGcs.CLcs.DCarXiv:2608.22188v12026
sp-DBA: a general framework for adaptive transform-domain computation
Jingkun Jiang, Pingchuan Deng, Yang Xia
cs.CEcs.DCarXiv:2609.03922v12026
RLlib: Abstractions for Distributed Reinforcement Learning
Eric Liang, Richard Liaw, Philipp Moritz +6
cs.AIcs.DCcs.LGarXiv:1712.09381v42017
Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads
John Thorpe, Yifan Qiao, Jonathan Eyolfson +8
cs.DCcs.LGarXiv:2105.11118v22021
Internet of Things: An Overview
Farzad Khodadadi, Amir Vahid Dastjerdi, Rajkumar Buyya
cs.DCcs.NIarXiv:1703.06409v12017
When Do Redundant Requests Reduce Latency ?
Nihar B. Shah, Kangwook Lee, Kannan Ramchandran
cs.NIcs.DCcs.PFarXiv:1311.2851v12013
Tools-CC-Bench: a Benchmark Suite for Collective Communication with Compression in HPC and AI Workloads
Haozhe Fan, Wei Wang, Xingchen Liu +12
cs.DCarXiv:2609.08739v22026
Communication-Optimal Parallel Algorithm for Strassen's Matrix Multiplication
Grey Ballard, James Demmel, Olga Holtz +2
cs.DScs.CCcs.DCarXiv:1202.3173v12012
Adaptive Quantization of Model Updates for Communication-Efficient Federated Learning
Divyansh Jhunjhunwala, Advait Gadhikar, Gauri Joshi +1
cs.LGcs.DCstat.MLarXiv:2102.04487v12021
CLTune: A Generic Auto-Tuner for OpenCL Kernels
Cedric Nugteren, Valeriu Codreanu
cs.PFcs.AIcs.DCarXiv:1703.06503v12017
CEDD-optimizer: Enabling Cost-Efficient Dataset Distillation on Geographically Distributed Edge Systems
Dai Liu, Eishi Arima, Martin Schulz
cs.DCarXiv:2609.10151v12026
Sherman: A Write-Optimized Distributed B+Tree Index on Disaggregated Memory
Qing Wang, Youyou Lu, Jiwu Shu
cs.DCcs.DBcs.NIarXiv:2112.07320v22021
HARTS: Efficient Agentic Reinforcement Learning for Hybrid-Attention Models over Arbitrary Rollout Trees
Boyuan Meng, Peihua Bao, Hong Liu +4
cs.LGcs.DCarXiv:2608.28158v12026
A Path Integral Surrogate for Multi-Step Gradient Inversion in Federated Learning
Agnivo Ghosh, Saumik Bhattacharya
cs.LGcs.DCarXiv:2610.03597v12026
Gunrock: A High-Performance Graph Processing Library on the GPU
Yangzihao Wang, Andrew Davidson, Yuechao Pan +3
cs.DCarXiv:1501.05387v62015
Semantica: Decentralized Search using a LLM-Guided Semantic Tree Overlay
Petru Neague, Quinten Stokkink, Naman Goel +1
cs.IRcs.DCcs.NIarXiv:2502.10151v12025
Beyond Scalar Flexibility: From Eligible AI Workloads to Dependable Load Relief
Meiyi Li
eess.SYcs.DCarXiv:2609.05406v12026
Flexible Paxos: Quorum intersection revisited
Heidi Howard, Dahlia Malkhi, Alexander Spiegelman
cs.DCarXiv:1608.06696v12016
A Scalable Framework for Wireless Distributed Computing
Songze Li, Qian Yu, Mohammad Ali Maddah-Ali +1
cs.ITcs.DCmath.ITarXiv:1608.05743v22016
Impossibility of One-Way One-Round Quantum 4-Coloring via Matrix-Space Stability
Tom Gur, Longcheng Li
quant-phcs.DCarXiv:2609.09091v22026
EMMI: Edge Multi-Modal Intelligence for Communication-Efficient MLLM Inference via Fused Representation Compression
Motahare Mounesan, Irfan Khan
cs.LGcs.DCarXiv:2609.11058v12026
Convergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization
Pascal Bianchi, Jérémie Jakubowicz
math.OCcs.DCeess.SYarXiv:1107.2526v32011
ENORM: A Framework For Edge NOde Resource Management
Nan Wang, Blesson Varghese, Michail Matthaiou +1
cs.DCarXiv:1709.04061v12017
Towards Demystifying Serverless Machine Learning Training
Jiawei Jiang, Shaoduo Gan, Yue Liu +6
cs.DCcs.LGarXiv:2105.07806v12021
Petals: Collaborative Inference and Fine-tuning of Large Models
Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers +5
cs.LGcs.DCarXiv:2209.01188v22022
Analysis of Bitcoin Pooled Mining Reward Systems
Meni Rosenfeld
cs.DCarXiv:1112.4980v12011
Low-Latency Graph Streaming Using Compressed Purely-Functional Trees
Laxman Dhulipala, Julian Shun, Guy Blelloch
cs.DCcs.DScs.PLarXiv:1904.08380v12019
Deep Reinforcement Learning-based Methods for Resource Scheduling in Cloud Computing: A Review and Future Directions
Guangyao Zhou, Wenhong Tian, Rajkumar Buyya +2
cs.DCarXiv:2105.04086v22021
EBRL: Asynchronous Embodied RL by Multi-Grained Resource Management
Liang Mi, Weijun Wang, Bowen Gao +12
cs.LGcs.DCarXiv:2609.27547v12026
Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms
Zhiyi Hu, Siyuan Shen, Tommaso Bonato +6
cs.DCarXiv:2507.04786v32025
Characterizing the Scalability and Performance of Large-Scale AI Training Under Multi-Tenancy
Jacopo Raffi, Thomas Pasquali, Lorenzo Piarulli +6
cs.DCarXiv:2609.00817v22026
Efficient Redundancy Techniques for Latency Reduction in Cloud Systems
Gauri Joshi, Emina Soljanin, Gregory Wornell
cs.DCcs.ITmath.ITarXiv:1508.03599v32015
BestConfig: Tapping the Performance Potential of Systems via Automatic Configuration Tuning
Yuqing Zhu, Jianxun Liu, Mengying Guo +5
cs.PFcs.DBcs.DCarXiv:1710.03439v12017

Distributed and Cluster Computing

FractalNet-Based Heterogeneous Federated Learning for Orbital Edge Intelligence in Satellite Mega-Constellations: A Wildfire Case Study

Some Observations on Optimal Frequency Selection in DVFS-based Energy Consumption Minimization

Perturbed Iterate Analysis for Asynchronous Stochastic Optimization

Don't Be Afraid to Die: Black Hole Search in Dynamic Graphs with Fewer Agents

Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data

Federated Zeroth-Order Optimization with Direction Aggregation and Variance Reduction

Taming Bitwise Behavior in GPU Kernels with Tensor Core: Black-Box Reconstruction, Compiler Enforcement, and Static Verification

Synthesizing Optimal Collective Algorithms

INTELLECT-2: A Reasoning Model Trained Through Globally Decentralized Reinforcement Learning

A Meta-Heuristic Load Balancer for Cloud Computing Systems

GreenDirector: carbon- and water-aware workload placement for sustainable computing

SharPer: Sharding Permissioned Blockchains Over Network Clusters

DORA: A Scalable Asynchronous Reinforcement Learning System for Language Model Training

Dissecting the NVidia Turing T4 GPU via Microbenchmarking

Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients

Stateful Dataflow Multigraphs: A Data-Centric Model for Performance Portability on Heterogeneous Architectures

Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts

SpotServe: Serving Generative Large Language Models on Preemptible Instances

Decentralized Collaborative Learning of Personalized Models over Networks

A Fundamental Tradeoff between Computation and Communication in Distributed Computing

Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms

Engineering Parallel Algorithms for Community Detection in Massive Networks

RevDedup: A Reverse Deduplication Storage System Optimized for Reads to Latest Backups

PolyShard: Coded Sharding Achieves Linearly Scaling Efficiency and Security Simultaneously

Federated Graph Classification over Non-IID Graphs

GNNAdvisor: An Adaptive and Efficient Runtime System for GNN Acceleration on GPUs

The Convergence of Sparsified Gradient Methods

Unveiling the Depth-Performance Dilemma in Split-Federated Fine-tuning of LLMs

sp-DBA: a general framework for adaptive transform-domain computation

RLlib: Abstractions for Distributed Reinforcement Learning

Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads

Internet of Things: An Overview

When Do Redundant Requests Reduce Latency ?

Tools-CC-Bench: a Benchmark Suite for Collective Communication with Compression in HPC and AI Workloads

Communication-Optimal Parallel Algorithm for Strassen's Matrix Multiplication

Adaptive Quantization of Model Updates for Communication-Efficient Federated Learning

CLTune: A Generic Auto-Tuner for OpenCL Kernels

CEDD-optimizer: Enabling Cost-Efficient Dataset Distillation on Geographically Distributed Edge Systems

Sherman: A Write-Optimized Distributed B+Tree Index on Disaggregated Memory

HARTS: Efficient Agentic Reinforcement Learning for Hybrid-Attention Models over Arbitrary Rollout Trees

A Path Integral Surrogate for Multi-Step Gradient Inversion in Federated Learning

Gunrock: A High-Performance Graph Processing Library on the GPU

Semantica: Decentralized Search using a LLM-Guided Semantic Tree Overlay

Beyond Scalar Flexibility: From Eligible AI Workloads to Dependable Load Relief

Flexible Paxos: Quorum intersection revisited

A Scalable Framework for Wireless Distributed Computing

Impossibility of One-Way One-Round Quantum 4-Coloring via Matrix-Space Stability

EMMI: Edge Multi-Modal Intelligence for Communication-Efficient MLLM Inference via Fused Representation Compression

Convergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization

ENORM: A Framework For Edge NOde Resource Management

Towards Demystifying Serverless Machine Learning Training

Petals: Collaborative Inference and Fine-tuning of Large Models

Analysis of Bitcoin Pooled Mining Reward Systems

Low-Latency Graph Streaming Using Compressed Purely-Functional Trees

Deep Reinforcement Learning-based Methods for Resource Scheduling in Cloud Computing: A Review and Future Directions

EBRL: Asynchronous Embodied RL by Multi-Grained Resource Management

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Characterizing the Scalability and Performance of Large-Scale AI Training Under Multi-Tenancy

Efficient Redundancy Techniques for Latency Reduction in Cloud Systems

BestConfig: Tapping the Performance Potential of Systems via Automatic Configuration Tuning