Regulating workers in federated learning by Yardstick competition

Warning The system is temporarily closed to updates for reporting purpose.

Sarıkaya, Yunus and Erçetin, Özgür (2020) Regulating workers in federated learning by Yardstick competition. In: 13th EAI International Conference on Performance Evaluation Methodologies and Tools (VALUETOOLS 2020), Tsukuba, Japan

[img]PDF - Registered users only - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: http://dx.doi.org/10.1145/3388831.3388843


Due to the large size of the training data, distributed learning approaches such as federated learning have gained attention recently. However, the convergence rate of distributed learning suffers from heterogeneous worker performance. In this paper, we consider an incentive mechanism for workers to mitigate the delays in completion of each batch. To motivate the workers to perform at their best by assigning higher computational resources to the learning task, we use a yardstick of average desired delay to complete each mini-batch calculation. The rewards are determined by how much each worker deviates from this yardstick. We analytically obtain the optimum equilibrium strategy of the workers as well as the optimal reward function of the model owner that achieves the average desired delay while minimizing the cost of operation. Our numerical results indicate that by adjusting budget parameters, the model owner should judiciously decide on the number of workers due to trade off between the diversity provided by the number of workers and the latency of completing the training.

Item Type:Papers in Conference Proceedings
Subjects:T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK5101-6720 Telecommunication
ID Code:40194
Deposited By:Özgür Erçetin
Deposited On:17 Sep 2020 12:20
Last Modified:17 Sep 2020 12:20

Repository Staff Only: item control page