Skip to content

TinaLRJ/DeepPro

Repository files navigation

Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Better

Pytorch implementation of our deep temporal probe network (DeepPro). [Paper]

Our work is currently under peer review. The contributions of this work are as follows:

  • We reveal some new insights from a more crucial profile (i.e., temporal profile): long-term temporal information is much more essential for IRST detection, which includes global temporal saliency of target signals and correlation information between different signals. We validated the importance of the temporal profile in IRST detection, by developing the first predictive attribution tool.
  • Inspired by our research, we remodel the IRST detection task as a one-dimensional signal anomaly detection task. Then, we propose an IRST detection network (i.e., DeepPro) to leverage the essential temporal profile information with multiply-add operations only in the time dimension.
  • Experimental results show that DeepPro not only achieves a significant performance improvement in IRST detection with extremely high efficiency and continuity, but also has high robustness to dim targets and scenes with strong noise.

Requirements

  • Python 3
  • torch
  • tqdm

Datasets

NUDT-MIRSDT   [download dir] is a synthesized dataset, which contains 120 sequences. We use 80 sequences for training and 20 sequences for test. We divide the test set into two subsets according to their SNR ((0, 3], (3, 10)).

In the test set, targets in 8 sequences are so weak (SNR lower than 3). It is very challenging to detect these targets. The test set includes Sequence[47, 56, 59, 76, 92, 101, 105, 119].

Other datasets include NUDT-MIRSDT-HiNo dataset [download dir], IRSDT dataset and RGBT-Tiny dataset.

SatVideoIRSDT Dataset for SatVideoIRSTD Challenge  [Homepage]

Training set   [download dir] includes 1001 sequences. Validation set   [download dir] includes 202 sequences. Test set   [img download dir] [mask download dir] includes 200 sequences.

Train

python train.py --model 'DeepPro' --seqlen 40 --dataset [dataset name] --datapath [dataset path]
python train.py --model 'DeepPro-Plus' --seqlen 40 --dataset [dataset name] --datapath [dataset path]

Test

python test.py --seqlen 40 --datapath [dataset path] --dataset [dataset name] --logpath [log path] --log_dir [trained model path]
python test.py --seqlen 40 --datapath './datasets/SatVideoIRSDT' --dataset 'SatVideoIRSDT' --logpath './log/' --log_dir 'SatVideoIRSDT__2025-07-22_19-41__SoftLoUloss_DeepPro-Plus_DataL40'  # test for SatVideoIRSTD challenge

Results and Trained Models

Quantative Results

The comparison results of computational complexity and computational efficiency are as follows,

Model Params FPS GFLOPs (480*720)
Res-UNet+DTUM 1165 KB 25.39 54.0
STDMANet 46404 KB 5.16 503.8
Res-U+RFR 3980 KB 34.77 48.2
DeepPro 192 KB 155.40 5.3
DeepPro-Plus 277 KB 185.22 20.5

on NUDT-MIRSDT (SNR≤3)

Model Pd (x10(-2)) Fa (x10(-5)) AUC
Res-UNet+DTUM 91.68 2.37 0.9921 [Weights]
STDMANet 92.82 2.88 0.9860
DeepPro 95.84 0.52 0.9952 [Weights]
DeepPro-Plus 99.24 1.65 0.9955 [Weights]

on NUDT-MIRSDT (all)

Model Pd (x10(-2)) Fa (x10(-5)) AUC
Res-UNet+DTUM 97.46 3.00 0.9967 [Weights]
STDMANet 96.59 3.40 0.9908
DeepPro 98.50 0.72 0.9973 [Weights]
DeepPro-Plus 99.71 2.69 0.9978 [Weights]

on NUDT-MIRSDT-Noise

Model Pd (x10(-2)) Fa (x10(-5)) AUC
Res-UNet+DTUM 43.90 4.86 0.9413
STDMANet 51.65 1.95 0.8766
DeepPro 59.17 1.76 0.9638 [Weights]
DeepPro-Plus 76.23 1.69 0.9171 [Weights]

on SatVideoIRSDT

Model Recall Precision F1 score
Res-UNet+DTUM 36.41 58.94 45.40 [Weights]
DNANet+DTUM 46.42 68.66 55.39
DeepPro-Plus 57.82 49.56 53.37 [Weights]

Citiation

@article{li2025probing,
  title={Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Better},
  author={Li, Ruojing and An, Wei and Ying, Xinyi and Wang, Yingqian and Dai, Yimian and Wang, Longguang and Li, Miao and Guo, Yulan and Liu, Li},
  journal={arXiv preprint arXiv:2506.12766},
  year={2025}
}
@article{li2023direction,
  title={Direction-coded temporal U-shape module for multiframe infrared small target detection},
  author={Li, Ruojing and An, Wei and Xiao, Chao and Li, Boyang and Wang, Yingqian and Li, Miao and Guo, Yulan},
  journal={IEEE Transactions on Neural Networks and Learning Systems},
  year={2023},
  publisher={IEEE}
}

Citiation for SatVideoIRSDT Dataset

@article{li2026satvideodataset,
  title={Infrared video satellite aerial moving target detection dataset and its evaluation},
  author={Li, Ruojing and Li, Zhaoxu and Chen, Nuo and Guo, Gaowei and Dou, Zechao and Long, Zhengxing and Luo, Yihang and Zeng, Yaoyuan and Sheng, Weidong and Li, Boyang and others},
  doi={10.11834/jig.250536},
  journal={Journal of Image and Graphics},
  pages={1--15},
  year={2026}
}
@article{li2025dataset,
  title={Infrared video satellite aerial moving target detection dataset},
  author={Li, Ruojing and Zeng, Yaoyuan and Sheng, Weidong and Li, Boyang and Li, Zhaoxu and Chen, Nuo and Guo, Gaowei and Dou, Zechao and Long, Zhengxing and Luo, Yihang and others},
  doi={10.57760/sciencedb.j00240.00077},
  url={https://doi.org/10.57760/sciencedb.j00240.00077},
  year={2025},
  publisher={Science Data Bank}
}

Contact

Welcome to raise issues or email to [email protected] for any question.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages