dc.contributor.author | Liu, X | |
dc.contributor.author | Wang, S | |
dc.contributor.author | Deng, Y | |
dc.contributor.author | Nallanathan, A | |
dc.date.accessioned | 2024-07-11T10:57:18Z | |
dc.date.available | 2024-07-11T10:57:18Z | |
dc.date.issued | 2023-11-08 | |
dc.identifier.citation | X. Liu, S. Wang, Y. Deng and A. Nallanathan, "Adaptive Federated Pruning in Hierarchical Wireless Networks," in IEEE Transactions on Wireless Communications, vol. 23, no. 6, pp. 5985-5999, June 2024, doi: 10.1109/TWC.2023.3329450. keywords: {Computational modeling;Servers;Adaptation models;Training;Resource management;Convergence;Analytical models;Hierarchical wireless network;federated pruning;machine learning;communication and computation latency}, | en_US |
dc.identifier.issn | 1536-1276 | |
dc.identifier.uri | https://qmro.qmul.ac.uk/xmlui/handle/123456789/98006 | |
dc.description.abstract | Federated Learning (FL) is a promising privacy-preserving distributed learning framework where a server aggregates models updated by multiple devices without accessing their private datasets. Hierarchical FL (HFL), as a device-edge-cloud aggregation hierarchy, can enjoy both the cloud server's access to more datasets and the edge servers' efficient communications with devices. However, the learning latency increases with the HFL network scale due to the increasing number of edge servers and devices with limited local computation capability and communication bandwidth. To address this issue, in this paper, we introduce model pruning for HFL in wireless networks to reduce the neural network scale. We present the convergence analysis of an upper on the l2-norm of gradients for HFL with model pruning, analyze the computation and communication latency of the proposed model pruning scheme, and formulate an optimization problem to maximize the convergence rate under a given latency threshold by jointly optimizing the pruning ratio and wireless resource allocation. By decoupling the optimization problem and using Karush-Kuhn-Tucker (KKT) conditions, closed-form solutions of pruning ratio and wireless resource allocation are derived. Simulation results show that our proposed HFL with model pruning achieves similar learning accuracy compared with the HFL without model pruning and reduces about 50% communication cost. | en_US |
dc.format.extent | 5985 - 5999 | |
dc.publisher | IEEE | en_US |
dc.relation.ispartof | IEEE Transactions on Wireless Communications | |
dc.rights | © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. | |
dc.title | Adaptive Federated Pruning in Hierarchical Wireless Networks | en_US |
dc.type | Article | en_US |
dc.identifier.doi | 10.1109/TWC.2023.3329450 | |
pubs.issue | 6 | en_US |
pubs.notes | Not known | en_US |
pubs.publication-status | Published | en_US |
pubs.volume | 23 | en_US |
rioxxterms.funder | Default funder | en_US |
rioxxterms.identifier.project | Default project | en_US |
rioxxterms.funder.project | b215eee3-195d-4c4f-a85d-169a4331c138 | en_US |