Enabling Efficient Federated Learning via Ternary Quantization over Fading Channels

Ada Irem Pekdemir, Ferkan Yilmaz, Hakan Ali Cirpan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Federated Learning (FL) performance degrades when noise and fading affect uplink and downlink transmissions between users and the Fusion Center (FC). This research addresses a gap by investigating the impact of these channel effects on global machine learning (ML) models. We propose a method to improve communication and computation efficiency in FL using ternary quantization and a doping ratio. We simulate an additive noise channel with Rayleigh fading in both uplink and downlink transmissions. Two algorithms, Stochastic Gradient Descent with Momentum (SGDM) and Gradient Descent Backpropagation (GRDBP), are used to train local ML models. ML model parameters are then quantized with three values and power-adjusted before transmission. The doping ratio explores how combining user's local ML model with the global ML model at different ratios affects re-learning. Our simulations show that a doping ratio of 0.5 or higher significantly improves the system's resistance to additive noise and channel fading, leading to higher accuracy. Further, the combination of GRDBP, ternary quantization, and a high doping ratio is shown to be particularly effective under these challenging channel conditions. This technique enables FL systems to achieve faster, more accurate performance while maintaining user data privacy.

Original languageEnglish
Title of host publication2024 6th International Conference on Communications, Signal Processing, and their Applications, ICCSPA 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350384819
DOIs
Publication statusPublished - 2024
Event6th International Conference on Communications, Signal Processing, and their Applications, ICCSPA 2024 - Istanbul, Turkey
Duration: 8 Jul 202411 Jul 2024

Publication series

Name2024 6th International Conference on Communications, Signal Processing, and their Applications, ICCSPA 2024

Conference

Conference6th International Conference on Communications, Signal Processing, and their Applications, ICCSPA 2024
Country/TerritoryTurkey
CityIstanbul
Period8/07/2411/07/24

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

Keywords

  • Federated learning
  • machine learning
  • ternary quantization
  • wireless communication

Fingerprint

Dive into the research topics of 'Enabling Efficient Federated Learning via Ternary Quantization over Fading Channels'. Together they form a unique fingerprint.

Cite this