Source-linked AI summary

Joint Service Pricing and Cooperative Relay Communication for Federated Learning

Shaohan Feng, Dusit Niyato, Ping Wang, Dong In Kim, Ying-Chang Liang

arXiv:1811.12082v1cs.CRcs.GT

TL;DR

Federated learning keeps training data on devices, but direct update links may be unavailable or energy-inefficient, and devices need incentives to participate. The paper combines service pricing and cooperative relaying in a Stackelberg game; in a numerical example, relaying through device 4 is more energy-efficient than alternatives or direct transfer despite mutual interference.

  • Problem

    Federated learning keeps training data on devices, but direct model-update communication may be unavailable or energy-inefficient, and mobile devices need incentives to participate.

    Source: §I · p. 1
  • Method

    The paper models service pricing, cooperative update relaying, and the interactions among devices and the model owner using a Stackelberg game.

    Source: §I · p. 1, §VI · p. 6
  • Results

    In the numerical example, choosing device 4 as relay is more energy-efficient than choosing other relays or directly transferring updates, despite mutual interference between devices 5 and 6.

    Source: A. Numerical Result · p. 5
  • Takeaways & Limitations

    The analysis examines how transmission strategies, interference costs, training-data size, and service pricing relate to device profits and model-owner utility.

    Source: §VI · p. 6

Abstract

from arXiv · show

For the sake of protecting data privacy and due to the rapid development of mobile devices, e.g., powerful central processing unit (CPU) and nascent neural processing unit (NPU), collaborative machine learning on mobile devices, e.g., federated learning, has been envisioned as a new AI approach with broad application prospects. However, the learning process of the existing federated learning platforms rely on the direct communication between the model owner, e.g., central cloud or edge server, and the mobile devices for transferring the model update. Such a direct communication may be energy inefficient or even unavailable in mobile environments. In this paper, we consider adopting the relay network to construct a cooperative communication platform for supporting model update transfer and trading. In the system, the mobile devices generate model updates based on their training data. The model updates are then forwarded to the model owner through the cooperative relay network. The model owner enjoys the learning service provided by the mobile devices. In return, the mobile devices charge the model owner certain prices. Due to the coupled interference of wireless transmission among the mobile devices that use the same relay node, the rational mobile devices have to choose their relay nodes as well as deciding on their transmission powers. Thus, we formulate a Stackelberg game model to investigate the interaction among the mobile devices and that between the mobile devices and the model owner. The Stackelberg equilibrium is investigated by capitalizing on the exterior point method. Moreover, we provide a series of insightful analytical and numerical results on the equilibrium of the Stackelberg game.

I. INTRODUCTION

Federated learning keeps training data on mobile devices, but direct model-update links may be unavailable or energy-inefficient, and devices need incentives to participate. The paper combines service pricing with cooperative relaying, where pricing and relay choices are interdependent.

I. INTRODUCTION

  • Centralized training data raises security and privacy concerns, while direct model-update communication may be unavailable because of limited range or energy-inefficient because of high transmission power.The introduction also notes that device participation requires incentives rather than relying on sacrificial volunteers.Source: §I · p. 1
  • Mobile devices provide learning services for a price and cooperatively relay model updates to the model owner.A relay combines its own update with received updates using an average operator, leaving update-file size unaffected and not significantly affecting energy consumption.Source: §I · p. 1
  • Pricing and relay choices must be considered jointly because larger training-data sizes can motivate the model owner while lowering a device’s probability of receiving relay service.Devices set prices for their training data, and the model owner chooses the data size for each device.Source: §I · pp. 1–2
  • The proposed design is described as supporting smooth handling of massive model-update volumes and reducing communication congestion for the model owner and mobile devices.Devices choose their own data prices for individual profit optimization while cooperating to transfer updates.Source: §I · p. 2

II. SYSTEM DESCRIPTION

Mobile devices locally train model updates for a model owner, with training-data size tied to learning accuracy and service payments. The system coordinates cooperative relaying under routing, timing, and interference constraints.

II. SYSTEM DESCRIPTION

  • Each device trains locally on part of its data to generate model updates for the model owner's model.The model owner negotiates the training-data size for each device.Source: §II · p. 2
  • The model owner's learning accuracy increases with the total training-data size, with diminishing marginal increases under the increasing concave accuracy function.The model owner’s utility incorporates this relationship and the per-unit training-data price.Source: §II · p. 2
  • Devices can relay one another's updates, with routing constraints requiring a single next hop and a path to the model owner.The routing design also requires at least one device to connect to the owner's access point, and limits relay hops so each update reaches the owner.Source: §II · p. 3
  • A relay must receive a device's update before finishing its own computation; device service time includes computation, relaying, and transmission.The relay-arrival constraint compares these periods with the relay device's computation time.Source: §II · p. 3
  • Devices sharing a relay node generate mutual interference, and the transmission-rate model uses channel gains, distance-based path loss, and noise.The path-loss coefficient is specified as α ≥ 2.Source: §II · p. 3

III. STACKELBERG GAME FORMULATION

The paper models device–owner interaction as a Stackelberg game: mobile devices are leaders and the model owner is the follower. Devices choose data prices, relay nodes, and transmission powers, while the owner chooses training-data sizes.

III. STACKELBERG GAME FORMULATION

  • Mobile devices act as leaders and choose per-unit data prices, relay nodes, and transmission powers; the model owner follows by choosing training-data sizes.The owner is the buyer of the learning service, and devices are its sellers.Source: §III · p. 4
  • The lower-level subgame has the model owner choose training-data sizes given the devices' prices.The training-data-size vector is denoted sd.Source: §III · p. 4
  • After the owner's demand is determined, the upper-level subgame has devices choose prices and cooperative transmission decisions.The model defines the transmission-power matrix P and the devices' profit vector Π.Source: §III · p. 4
  • The game defines a Stackelberg equilibrium as the solution for the model owner and the mobile devices.The model specifies upper bounds for the devices' data prices and transmission powers.Source: §III · p. 4

IV. EQUILIBRIUM ANALYSIS

The equilibrium analysis uses backward induction: solve the owner's lower-level subgame first, then substitute its Nash equilibrium into the devices' upper-level subgame and use the exterior point method.

IV. EQUILIBRIUM ANALYSIS

  • Backward induction solves the lower-level owner's subgame first, then substitutes its Nash equilibrium into the upper-level device subgame for analysis by the exterior point method.The lower-level solution is shown to exist by concavity and to be unique by negative definiteness of the utility Hessian.Source: §IV · p. 4

A. Solution to Lower-level Subgame

The lower-level analysis obtains the model owner's best response using a first-order optimality condition and establishes existence and uniqueness through concavity and a negative-definite Hessian.

A. Solution to Lower-level Subgame

  • The model owner's lower-level solution is obtained from the first derivative of its utility with respect to each device's training-data size.The resulting best response is denoted sd*; the analysis adopts a Weibull model for trackable analysis.Source: A. Solution to Lower-level Subgame · p. 4
  • Strict concavity of the accuracy function and linearity of the price term make the owner's utility concave in each training-data size, establishing existence of a solution.The stated analysis adopts the Weibull model as suggested in.Source: A. Solution to Lower-level Subgame · p. 4
  • A negative-definite Hessian, with negative diagonal and zero off-diagonal elements, establishes uniqueness of the lower-level solution.Source: A. Solution to Lower-level Subgame · p. 4

B. Solutions to Upper-level Subgame

The upper-level mobile-device subgame is formed by substituting the model owner’s optimal data demand into device profits. The constrained nonlinear optimization is then handled with the exterior point method.

B. Solutions to Upper-level Subgame

  • The mobile-device profit functions are obtained by substituting the model owner’s optimal data demand into the device profit functions.Source: B. Solutions to Upper-level Subgame · p. 4
  • The upper-level subgame is analyzed at a Nash equilibrium, where no player can improve its profit by changing strategy while others’ strategies stay fixed.Source: B. Solutions to Upper-level Subgame · p. 4
  • The nonlinear constraints are handled with the exterior point method, which rewrites each device’s constrained profit objective as an unconstrained objective using a large positive penalty coefficient M.Source: B. Solutions to Upper-level Subgame · p. 5

V. PERFORMANCE EVALUATION

The numerical evaluation uses nine mobile devices and specifies communication, processing, and model-update parameters. Device locations and several cost and processing parameters are generated from stated distributions.

V. PERFORMANCE EVALUATION

  • The evaluation models nine mobile devices, with bandwidth and channel gain set to 10, noise variance to 1, and model-update size to 0.1.Source: §V · p. 5
  • Device-to-device and device-to-access-point distances are uniformly distributed over a 10-by-10 plane, while wireless-power and processing costs are generated using Gaussian distributions.Source: §V · p. 5
  • The relay fee is set to 0.0096, and the processing-rate, averaging-time, and function-coefficient vectors are specified for the nine devices.Source: §V · p. 5

A. Numerical Result

The numerical results show how relay routing, data prices, and data allocations interact in the cooperative system. In the reported example, some relay choices improve energy efficiency despite shared-relay interference.

A. Numerical Result

  • Mobile device 3 routes through device 7, reducing its wireless energy consumption, while devices 5 and 6 share device 4 as relay despite mutual interference.The reported comparison says using device 4 is more energy efficient for devices 5 and 6 than other relay choices or direct transfer to the central cloud.Source: A. Numerical Result · p. 5, Figure 2 · p. 5, Table II · p. 5
  • Device 7 has the highest unit training-data price because its received update combines information from devices 7 and 3; device 4’s price is lower than device 8’s, attributed to data quality and model-owner preference.Source: A. Numerical Result · pp. 5–6, Figure 3 · p. 6
  • Device 4 receives the largest training-data allocation, and its slow processing rate makes it a relay for devices 5 and 6, whose allocations are much smaller.Devices 5 and 6 use device 4 to avoid direct access-point transfers, improving energy efficiency.Source: A. Numerical Result · p. 6, Figure 4 · p. 6

VI. CONCLUSION

The conclusion summarizes a Stackelberg game for analyzing mobile devices’ transmission and training-data pricing strategies alongside the model owner’s service subscription. It also identifies the modeled effects and solution methods, while leaving long-run interactions for future work.

  • The game jointly analyzes mobile devices’ transmission and training-data pricing strategies and the model owner’s learning-service subscription.Source: §VI · p. 6
  • The model captures how device transmission strategies affect transmission rates and relay nodes, and how service subscription affects the owner’s utility.Source: §VI · p. 6
  • The analysis considers interference costs in device profits and training-data size effects on both owner utility and device profits.Source: §VI · p. 6
  • The owner’s optimal strategy is studied using best response, and device equilibrium strategies using the exterior point method; long-run interactions remain future work.Source: §VI · p. 6
Loading 1811.12082v1…