Boosting Fairness and Robustness in Over-the-Air Federated Learning: Problem Setup

Written by computational | Published 2024/10/27
Tech Story Tags: federated-learning | over-the-air-computation | minmax-optimization | decentralized-machine-learning | communication-efficiency | robustness-in-ai | fairness-in-federated-learning | channel-coefficient-privacy

TLDRvia the TL;DR App

Authors:

(1) Halil Yigit Oksuz, Control Systems Group at Technische Universitat Berlin, Germany and Exzellenzcluster Science of Intelligence, Technische Universitat Berlin, Marchstr. 23, 10587, Berlin, Germany;

(2) Fabio Molinari, Control Systems Group at Technische Universitat Berlin, Germany;

(3) Henning Sprekeler, Exzellenzcluster Science of Intelligence, Technische Universit¨at Berlin, Marchstr. 23, 10587, Berlin, Germany and Modelling Cognitive Processes Group at Technische Universit¨at Berlin, Germany;

(4) Jorg Raisch, Control Systems Group at Technische Universitat Berlin, Germany and Exzellenzcluster Science of Intelligence, Technische Universitat Berlin, Marchstr. 23, 10587, Berlin, Germany.

Table of Links

Abstract and Introduction

Problem Setup

Federated fair over-the-air learning (FedAir) Algorithm

Convergence Properties

Numerical Example

Conclusion and References

II. PROBLEM SETUP

A. Minmax Reformulation

In a federated learning setting with N agents, where V = {1,2,··· ,N} denotes the index set, we are interested in improving the performance of the worst-performing agent by solving the following optimization problem:

We aim to compute a parameter vector estimate minimizing the worst-case loss observed among all agents, thus providing some form of fairness [20], [21]. However, it is difficult and inefficient to use (3) directly for federated learning purposes. Instead, we can consider an alternative (epigraph) form:

B. Over-the-Air Communication Mode

This paper is available on arxiv under CC BY 4.0 DEED license.


Written by computational | Computational: We take random inputs, follow complex steps, and hope the output makes sense. And then blog about it.
Published by HackerNoon on 2024/10/27