DistillFSS: Synthesizing Few-Shot Knowledge into a Lightweight Segmentation Model
Official implementation of DistillFSS

• 🚀 Efficient Inference: No support images needed at test time—knowledge is distilled directly into the model
• 🎯 Strong Performance: Competitive or superior results compared to state-of-the-art CD-FSS methods
• 📊 Comprehensive Benchmark: New evaluation protocol spanning medical imaging, industrial inspection, and agriculture
• ⚡ Scalable: Handles large support sets without computational explosion

Cross-Domain Few-Shot Semantic Segmentation (CD-FSS) seeks to segment unknown classes in unseen domains using only a few annotated examples. This setting is inherently challenging: source and target domains exhibit substantial distribution shifts, label spaces are disjoint, and support images are scarce—making standard episodic methods unreliable and computationally demanding at test time.

DistillFSS addresses these constraints through a teacher-student distillation process that embeds support-set knowledge directly into the model's parameters. By internalizing few-shot reasoning into a dedicated layer, our approach eliminates the need for support images during inference, enabling fast, lightweight deployment while maintaining the ability to adapt to novel classes through rapid specialization.

DistillFSS consists of two main components:

1. Teacher Network: Processes the support set and encodes class-specific knowledge
2. Student Network: Learns to segment without direct access to support images by distilling knowledge from the teacher

The distillation process embeds support-set information into the student's parameters, allowing efficient inference without episodic sampling.

# Clone the repository
git clone https://github.com/pasqualedem/DistillFSS.git
cd DistillFSS

# Install uv if you haven't already
curl -LsSf https://astral.sh/uv/install.sh | sh

# Install dependencies and create virtual environment
uv sync

# Activate the environment
source .venv/bin/activate  # On Windows: .venv\Scripts\activate

Our benchmark includes datasets from diverse domains. Follow the instructions below to download and prepare each dataset:

mkdir -p data/WeedMap
cd data/WeedMap
# Download the zip from the official source
unzip 0_rotations_processed_003_test.zip

cd data
kaggle competitions download -c data-science-bowl-2018
unzip data-science-bowl-2018.zip -d data-science-bowl
unzip data-science-bowl/stage1_train.zip -d Nucleus

cd data
wget https://datasets.simula.no/downloads/kvasir-seg.zip
unzip kvasir-seg.zip

cd data
wget https://prod-dcd-datasets-cache-zipfiles.s3.eu-west-1.amazonaws.com/5rr22hgzwr-1.zip
unzip 5rr22hgzwr-1.zip
mv "lungcancer/Lung cancer segmentation dataset with Lung-RADS class/"* lungcancer
rm -r "lungcancer/Lung cancer segmentation dataset with Lung-RADS class/"

mkdir -p data/ISIC
cd data/ISIC
wget https://isic-challenge-data.s3.amazonaws.com/2019/ISIC_2019_Training_GroundTruth.csv
wget https://isic-challenge-data.s3.amazonaws.com/2018/ISIC2018_Task1-2_Training_Input.zip
wget https://isic-challenge-data.s3.amazonaws.com/2018/ISIC2018_Task1_Training_GroundTruth.zip
unzip ISIC2018_Task1-2_Training_Input.zip
unzip ISIC2018_Task1_Training_GroundTruth.zip

Download from Mendeley Data

mkdir -p data/Industrial
cd data/Industrial
wget https://download.scidb.cn/download?fileId=6396c900bae2f1393c118ada -O data.zip
wget https://download.scidb.cn/download?fileId=6396c900bae2f1393c118ad9 -O data.json
unzip data.zip
mv data/* .
rm -r data

To facilitate benchmarking, pre-trained baseline model checkpoints can be downloaded using the provided script:

Needed for DistillFSS experiments

bash scripts/download_dcama.sh

Needed for comparison with other methods

bash scripts/download_baselines.sh

DistillFSS provides two main entry points for running grid search experiments:

Fine-tune a pre-trained model on support examples for improved performance.

# Sequential execution
python refine.py grid --parameters parameters/refine/DATASET_NAME.yaml

# Parallel execution (creates SLURM scripts)
python refine.py grid --parameters parameters/refine/DATASET_NAME.yaml --parallel

# Only create SLURM scripts without running
python refine.py grid --parameters parameters/refine/DATASET_NAME.yaml --parallel --only_create

Train a student model by distilling knowledge from a teacher network that processes support examples.

python distill.py grid --parameters parameters/distill/DATASET_NAME.yaml

The distillation process:

• Creates a teacher-student architecture
• Trains the student to mimic the teacher's outputs
• Embeds support-set knowledge into the student's parameters
• Evaluates on the test set after distillation

Evaluate the inference speed and efficiency of different models.

python distill.py grid --parameters parameters/speed.yaml

The repository includes pre-configured parameter files organized by experiment type:

Standard baseline experiments for each dataset:

• Industrial.yaml - Industrial defect segmentation
• ISIC.yaml - Skin lesion segmentation
• KVASIR.yaml - Gastrointestinal polyp segmentation
• LungCancer.yaml - Lung nodule segmentation
• Nucleus.yaml / Nucleus_hdmnet.yaml - Cell nucleus segmentation
• Pothole.yaml - Road defect detection
• WeedMap.yaml - Weed segmentation

Teacher-student distillation experiments:

• Configurations for: Industrial, ISIC, KVASIR, LungCancer, Nucleus, Pothole, WeedMap

Fine-tuning experiments on support sets:

• Configurations for: Industrial, ISIC, KVASIR, LungCancer, Nucleus, Pothole, WeedMap, deepglobe

Benchmarking inference speed across models and datasets.

# Run baseline experiments on Industrial dataset
python refine.py grid --parameters parameters/baselines/Industrial.yaml

# Run distillation on KVASIR dataset
python distill.py grid --parameters parameters/distill/KVASIR.yaml

# Run refinement on WeedMap with parallel execution
python refine.py grid --parameters parameters/refine/WeedMap.yaml --parallel

# Run efficiency benchmarks
python distill.py grid --parameters parameters/speed.yaml

# Run experiments on additional datasets
python refine.py grid --parameters parameters/other/EVICAN.yaml

DistillFSS achieves competitive or superior performance across multiple domains while significantly reducing computational costs:

Performance comparison (mIoU) against state-of-the-art methods on Medical and Industrial datasets.

Detailed results and ablation studies are available in the paper.

DistillFSS/
├── distill.py              # Main distillation entry point
├── refine.py               # Main refinement entry point
├── configs/                # Configuration files
├── distillfss/
│   ├── data/              # Dataset implementations
│   ├── models/            # Model architectures
│   ├── utils/             # Utilities (logging, tracking, etc.)
│   └── substitution.py    # Support set substitution strategies
├── data/                  # Dataset storage
└── out/                   # Output directory (logs, models, results)

DistillFSS integrates with Weights & Biases for experiment tracking. Configure your W&B credentials before running:

wandb login

Training metrics, predictions, and model checkpoints are automatically logged to W&B.

Access our collection of state-of-the-art checkpoints:

Dataset	Number of Shots (k)	HF Repo
WeedMap	5

If you find this work useful for your research, please consider citing:

@misc{marinisDistillFSSSynthesizingFewShot2025,
	title = {{DistillFSS}: {Synthesizing} {Few}-{Shot} {Knowledge} into a {Lightweight} {Segmentation} {Model}},
	shorttitle = {{DistillFSS}},
	url = {http://arxiv.org/abs/2512.05613},
	doi = {10.48550/arXiv.2512.05613},
	publisher = {arXiv},
	author = {Marinis, Pasquale De and Blok, Pieter M. and Kaymak, Uzay and Brussee, Rogier and Vessio, Gennaro and Castellano, Giovanna},
	month = dec,
	year = {2025},
	note = {arXiv:2512.05613 [cs]},

This work builds upon several excellent open-source projects and datasets. We thank the authors for making their code and data publicly available.

• DCAMA
• Label Anything
• PATNet
• DMTNet
• BAM
• HDMNet

This project is released under the MIT License. See LICENSE for details.

For questions or collaborations, please contact:

• Pasquale De Marinis - [email protected]
• GitHub Issues - For bug reports and feature requests

Made with ❤️ for the Few-Shot Learning community