Collaborative Federated Learning For Healthcare: Multi-Modal COVID-19 Diagnosis at the Edge

In plain words

Remote clinics often lack the equipment and specialists to read chest X-rays and ultrasound scans for COVID-19. A model could help, but patient images are sensitive, and sending them to a central server is slow and risky. This paper asks whether each clinic can keep its images local and still help build one shared model.

The approach is federated learning: every clinic trains a copy of the model on its own images and sends only the learned weights to a server, which averages them. The paper groups the clinics by imaging type, X-ray or ultrasound, so each group is a cluster that shares a common kind of picture. The result is one model that can read both kinds of image.

On the two public datasets used, this clustered setup gets results close to models trained separately for each imaging type. It does better than plain federated learning with mixed image types. The authors also warn that training should stop once the loss stops improving, because the shared model can start to overfit.

TL;DR

• Clients are hospitals or clinics. Each imaging modality (X-ray, ultrasound) forms one cluster §3.1.
• Each client trains a VGG16-based binary COVID-19 classifier locally and sends weights; the server averages them §3.1 eq. 1 alg. 1.
• Author-reported: F1 comparable to per-modality federated models and above conventional multi-modal federated learning §4 tab. 3.
• Caveats: several hyperparameters conflict or are not stated; no code is public; experiments are simulated on two small datasets §3.2 §4.

Problem

Remote healthcare centers lack advanced diagnostic facilities, while cloud processing raises latency, cost and privacy concerns §1. Federated learning avoids sharing raw data, but the authors state that statistical heterogeneity between clients makes training harder, and that shared weights can leak information about training data §2.2.

The specific problem is that a single shared model must learn from two data distributions: X-ray images and ultrasound images differ in size, quality, contrast and framing, and both datasets are class-imbalanced §3.2.1 fig. 3. The paper's baseline shows that conventional federated learning with mixed modalities performs poorly on X-ray COVID-19 detection, with a per-class F1 of 0.41 tab. 3. The paper assumes that no two clients share samples, and that no client knows the identity or data of the others §3.1.

Method

The paper formulates a binary classification problem, COVID-19 versus normal chest images, with each sample a pair of image and label §3.1 §3.2.1. Clients are grouped into clusters by imaging modality, and a server holds the shared model and the initial weights §3.1.

1. Setup. Cluster 1 holds X-ray clients, cluster 2 holds ultrasound clients. The server sends the shared model and the initial weights W_0 to every client §3.1.
2. Local training. Each client trains the shared model on its local data for E epochs with batch size B and learning rate η, then returns its weights §3.1 alg. 1.
3. Cluster averaging. Within each cluster the server averages the client weights alg. 1. The text describes a weighted average, but the weights are not defined eq. 1 alg. 1.
4. Global averaging. The paper's equation averages over all n clients in both clusters eq. 1. Algorithm 1 instead averages the cluster means, which weights each cluster equally alg. 1.
5. Round repeat. The server updates its copy, tests on the merged test set and sends the new weights back to all clients, for R rounds §3.1 alg. 1.
6. Stopping. The paper recommends stopping at the loss inflection point, after which the two modalities' models start to diverge §4 fig. 5.

Model: a VGG16 backbone, plus one added convolutional layer and three dense layers placed ahead of its original output layer. Images are converted to grayscale, resized to 256 × 256 and normalized. Training uses Adam with learning rate 0.0001 at each client, and standard augmentation §3.2.2. Class imbalance is handled with focal loss, an α-balanced variant §3.2.2 eq. 2.

# Clustered federated learning, R rounds  [alg. 1]
# Input:  clusters (list of lists of clients), W_0, R, E, B, eta
# Output: global weights after the last round

def clustered_federated_learning(clusters, W_0, R, E, B, eta):
    global_weights = W_0
    for r in range(1, R + 1):
        # Round 1 starts from W_0, later rounds from the global weights  [alg. 1]
        start_weights = W_0 if r == 1 else global_weights
        cluster_models = []
        for cluster in clusters:
            # E local epochs per client with batch B and rate eta  [alg. 1]
            client_models = []
            for client in cluster:
                local = train_local(start_weights, client, E, B, eta)
                client_models.append(local)
            # Mean over the clients of one cluster; weights w_j are not stated  [alg. 1]
            cluster_models.append(mean(client_models))
        # Mean over clusters, so each cluster counts once  [alg. 1]
        global_weights = mean(cluster_models)
    return global_weights

Global averaging as written in the paper's equation, with weights not stated eq. 1:

W_{r} = \frac{1}{n} \sum_{i=1}^{n} w_i \, W_{i} eq. 1

Focal loss as used for the imbalanced binary task eq. 2:

FL(p_t) = -\alpha_t (1 - p_t)^{\gamma} \log(p_t) eq. 2

# Alpha-balanced focal loss for one sample  [eq. 2]
# p_t: predicted probability of the true class; gamma >= 0

def focal_loss(p_t, alpha_t, gamma):
    # Down-weight samples the model already classifies well  [eq. 2]
    modulator = (1 - p_t) ** gamma
    return -alpha_t * modulator * log(p_t)

Hyperparameters

Values as stated in the text and tables. Conflicts are listed in Pitfalls.

Dataset counts tab. 1:

Results

Author-reported. Setup: two binary datasets, chest X-ray §3.2.1 and lung ultrasound §3.2.1. Each dataset is evaluated on its own test split, and the two test splits are merged for one joint test set §3.2.1. Baselines: (i) specialized FL, one model per modality trained with federated learning, and (ii) conventional FL with a single multi-modal model §4. Hardware: not stated. The number of runs and any variance are not stated.

Per-class precision (P), recall (R) and F1 tab. 3:

Headline numbers:

• Abstract: 16% and 11% higher overall F1 than conventional multi-modal FL on X-ray and ultrasound §Abstract.
• Read from the average bar charts (approximate, not stated in text): overall F1 about 0.93 (CFL) vs 0.77 (conventional) on X-ray, and about 0.91 vs 0.80 on ultrasound fig. 4. Both gaps are about 0.16 and 0.11 in absolute F1.
• The paper states that CFL's X-ray and ultrasound averages are comparable to the specialized per-modality models §4 fig. 4.

Paper vs code

No official code. The LaTeX source has no link to a repository or project page, and the arXiv metadata has no comments field. A GitHub repository search with two title-based queries returned no results.

Pitfalls

• Learning-rate conflict. The text gives 0.0001 for the model and the specialized baselines §3.2.2 §4. Table II gives 1e-3 for the CFL runs tab. 2. Which value produced Table III is not stated.
• Batch-size conflict. §4 says the specialized baselines use batch 32, but then trains both baselines and CFL with batch 16 for the comparison §4 tab. 2.
• Round count. Table II lists 30, 50 and 100 rounds, but the round count behind Table III is not stated. The paper says conventional FL overfits after about 50 rounds and that training should stop at the loss inflection point, which is not given as a number §4 fig. 5.
• Aggregation is under-specified. The client weights w_i and w_j are never defined eq. 1 alg. 1. Eq. 1 averages over all n clients, while Algorithm 1 averages within each cluster and then across clusters, so the two differ when clusters have different sizes eq. 1 alg. 1.
• Algorithm ambiguity. Algorithm 1 runs clients "in parallel" but reuses one shared model M_s, and the step "Get W_j from M_s" does not say whether each client keeps its own copy alg. 1. The loop over E is written as "e ∈ E", so E is read as an epoch count, which the table supports tab. 2.
• Clustering is by known modality. Clusters are fixed by the hospital's imaging type §3.1. The paper does not learn clusters from the data, despite calling the method clustered federated learning.
• Focal loss. α_t and γ are not given, and α_t is not defined as a class or sample weight §3.2.2 eq. 2.
• Ultrasound counts do not match the dataset description. §2.1 describes a 1103-image POCUS dataset with 654 COVID-19, 277 bacterial pneumonia and 277 healthy images §2.1. Table I lists 399 COVID-19 and 146 healthy images across the train and test splits combined tab. 1. The selection rule is not stated.
• Central baseline is missing. The abstract and the Table III caption refer to a central-data baseline, but no numbers for it appear in the text or table §Abstract tab. 3.
• Single-run results. No seeds, repeated runs or confidence intervals are reported. Differences on small test sets (44 and 30 COVID-19 test images in Table I) can be large from one run tab. 1.
• Imbalance and F1 aggregation. Test sets are imbalanced tab. 1. The method for averaging per-class F1 into the "overall" figure is not stated.
• Privacy is argued, not measured. The lessons section says CFL protects local data §4.1. The paper's own background says shared weights can leak training information §2.2. No privacy analysis or attack is reported.
• Communication savings are not measured. The claims about less bandwidth are qualitative §4.1. The experiments are simulated §3.2.2.
• Stopping rule. The paper recommends early stopping, but gives no automatic criterion beyond the qualitative inflection point §4 §4.1.
• Pretraining and head. Whether VGG16 starts from pretrained weights is not stated §3.2.2.
• Figure values are approximate. The overall F1 figures above were read by eye from the bar charts and are not given in the text fig. 4.

Lineage

• Builds on: clustered federated learning, as cited by the paper to Sattler et al. §3 (bibliography key sattler2019clustered; no arXiv id in this source). Focal loss, as cited to Lin et al. §3.2.2 (key lin2017focal; no arXiv id in this source).
• Compared against: specialized per-modality federated learning and conventional multi-modal federated learning §4 tab. 3.
• Superseded by: not known from content already in this wiki.