Robustness and Reliability of Federated Learning
| dc.contributor.advisor | Hemmati, Hadi | |
| dc.contributor.author | Eslami Abyane, Amin | |
| dc.contributor.committeemember | Abou-Zeid, Hatem | |
| dc.contributor.committeemember | Wu, Huaqing | |
| dc.date | 2023-02 | |
| dc.date.accessioned | 2023-01-05T16:38:54Z | |
| dc.date.available | 2023-01-05T16:38:54Z | |
| dc.date.issued | 2022-12-21 | |
| dc.description.abstract | Federated Learning (FL) is a newly introduced distributed learning scheme, which is designed with users' privacy in mind, by never collecting clients' data during the training process. FL's process starts with the server sending a model to clients, then the clients train that model using their local data and send the updated model back to the server (only the trained parameter values of the model not the actual features values from the client's local dataset). Afterward, the server aggregates all the received values and updates the global model. This process is repeated until the model converges. Since clients may become unavailable (e.g., due to their movement) during FL training, and server-client communication is extremely costly, only a fraction of clients gets selected for training at each round using a client selection technique. Although FL is excellent at preserving privacy, it still faces many challenges, of which we focus on two of the most important ones: robustness and reliability. In FL, attacks or faults may occur on each client, and it is crucial that the system is robust to these problems. Furthermore, clients may be unreliable and become unavailable at each point, so FL needs to withstand these availability changes and be effective and efficient. To address the robustness challenges of FL, we perform a large-scale empirical study from multiple angles of attacks, simulated faults (via mutation operators), and aggregation (defense) methods evaluated on multiple datasets resulting in 496 configurations. Our results show that most faults (mutators) have a negligible effect on the final trained model when leveraging existing aggregators, but this is not the case with all attacks. However, choosing the most robust FL aggregator depends on the attack type and datasets. Therefore, we propose a simple ensemble of aggregators and show that it results in a more robust solution compared to any single aggregator and is the best choice in 75% of the cases. To analyze the reliability challenges of FL, we consider multiple client selection techniques and propose the first availability-aware selection strategy called MDA. The results show that our approach makes learning faster than vanilla FL by up to 6.5%. Finally, we show that resource heterogeneity-aware selection techniques are effective but can become even better when combined with our approach, making the final solution faster than the state-of-the-art selectors by up to 16%. | en_US |
| dc.identifier.citation | Eslami Abyane, A. (2022). Robustness and reliability of federated learning (Master's thesis, University of Calgary, Calgary, Canada). Retrieved from https://prism.ucalgary.ca. | en_US |
| dc.identifier.uri | http://hdl.handle.net/1880/115640 | |
| dc.identifier.uri | https://dx.doi.org/10.11575/PRISM/40566 | |
| dc.publisher.faculty | Schulich School of Engineering | en_US |
| dc.publisher.institution | University of Calgary | en |
| dc.rights | University of Calgary graduate students retain copyright ownership and moral rights for their thesis. You may use this material in any way that is permitted by the Copyright Act or through licensing that has been assigned to the document. For uses that are not allowable under copyright legislation or licensing, you are required to seek permission. | en_US |
| dc.subject.classification | Computer Science | en_US |
| dc.subject.classification | Engineering | en_US |
| dc.title | Robustness and Reliability of Federated Learning | en_US |
| dc.type | master thesis | en_US |
| thesis.degree.discipline | Engineering – Electrical & Computer | en_US |
| thesis.degree.grantor | University of Calgary | en_US |
| thesis.degree.name | Master of Science (MSc) | en_US |
| ucalgary.item.requestcopy | true | en_US |