A BALANCED MULTI-MODAL THERMAL AND PASSIVE MILLIMETER-WAVE DATASET FOR DEEP LEARNING-BASED CONCEALED WEAPON DETECTION
DOI:
https://doi.org/10.5281/zenodo.21306553Keywords:
Concealed weapon detection, thermal infrared imaging, passive millimeter-wave imaging, dataset curation, deep learning, multi-modal benchmarkAbstract
In the field of smart city security surveillance, automated concealed weapon detection using non-invasive imaging remains a challenge. However, no publicly available dataset provides balanced, paired, and pre-processed thermal infrared (TIR) and passive millimeter-wave (PMMW) imagery specifically designed for training deep learning models and facilitating fair cross-modality comparison. The present study aimed to curate and standardize a balanced, multimodal dataset that enables the systematic evaluation of detection algorithms under controlled conditions. A dataset was designed that comprised 686 images from each of the secondary Thermal Infrared (TIR) and Passive Millimeter Wave (PMMW) modalities, using the FLIR Breach PTQ136 camera and Ka-band radiometer of 34 GHz frequency, respectively. The images were subjected to image flipping, rotation, scaling to a size of 224 × 224 pixels, normalizing to [0, 1] scale, and splitting into stratified partitions (70:20:10). This led to balanced binary classes with an augmentation of 1.72× for the TIR modality. Thus, the study curated a balanced dataset of 1,372 thermal and millimeter-wave images. Results show successful class parity and standardized preprocessing. Recommendations include collecting synchronized image pairs and expanding to outdoor environments.
Downloads
References
Altay, F., & Velipasalar, S. (2022). The use of thermal cameras for pedestrian detection. IEEE Sensors Journal, 22(12), 11489-11498.
Fernandez-Carrobles, M. M., Deniz, O., & Maroto, F. (2019). Gun and knife detection based on faster R-CNN for video surveillance. In the Iberian Conference on Pattern Recognition and Image Analysis (pp. 441-452). Cham: Springer International Publishing.
Gosain, S., Sonare, A., & Wakodkar, S. (2021). Concealed weapon detection using image processing and machine learning. International Journal for Research in Applied Science and Engineering Technology, 9(12), 1374-1384.
Gutiérrez, G., Llerena, J. P., Usero, L., & Patricio, M. A. (2024). A comparative study of convolutional neural network and transformer architectures for drone detection in thermal images. Applied Sciences, 15(1), 109.
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
Hou, F., Zhang, Y., Zhou, Y., Zhang, M., Lv, B., & Wu, J. (2022). Review of infrared imaging technology. Sustainability, 14(18), 11161.
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700-4708).
Kera, S. B., Tadepalli, A., & Ranjani, J. J. (2023). A paced multi-stage block-wise approach for object detection in thermal images. The Visual Computer, 39(6), 2347-2363.
Khor, W., Chen, Y. K., Roberts, M., & Ciampa, F. (2024). Automated detection and classification of concealed objects using infrared thermography and convolutional neural networks. Scientific reports, 14(1), 8353.
Laufs, J., Borrion, H., & Bradford, B. (2020). Security and the smart city: A systematic review. Sustainable cities and society, 55, 102023.
Luukanen, A., Appleby, R., Kemp, M., & Salmon, N. (2012). Millimeter-wave and terahertz imaging in security applications. In Terahertz Spectroscopy and Imaging (pp. 491-520). Berlin, Heidelberg: Springer Berlin Heidelberg.
Meng, Y., Qing, A., Lin, C., Zang, J., Zhao, Y., & Zhang, C. (2018). Passive millimeter wave imaging system based on helical scanning. Scientific reports, 8(1), 7852.
Moch, N., & Wereda, W. (2020). Smart security in the smart city. Sustainability, 12(23), 9900. https://www.mdpi.com/2071-1050/12/23/9900
Muñoz, J. D., Ruiz-Santaquiteria, J., Deniz, O., & Bueno, G. (2025). Concealed weapon detection using thermal cameras. Journal of Imaging, 11(3), 72.
Pang, L., Liu, H., Chen, Y., & Miao, J. (2020). Real-time concealed object detection from passive millimeter wave images based on the YOLOv3 algorithm. Sensors, 20(6), 1678.
Pedaprolu, S. M. (2025). Thermal Imaging for Concealed Weapon Detection using Computer Vision. https://ajosr.org/wp-content/uploads/journal/published_paper/volume-3/issue-6/ajsr2025_a9lEM6PB.pdf
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015). Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1-9).
Veranyurt, O., & Şakar, C. O. (2022). Concealed Pistol Detection Dataset Figshare. https://doi. org/10.6084/m9. figshare, 20105600, v1.
Veranyurt, O., & Şakar, C. O. (2023). Concealed pistol detection from thermal images with deep neural networks. Multimedia Tools and Applications, 82(28), 44259–44275. https://link.springer.com/article/10.1007/s11042-023-15358-1
Wang, Z., Chang, T., & Cui, H. L. (2019). Review of active millimeter wave imaging techniques for personnel security screening. IEEE Access, 7, 148336-148350.
Yang, H., Yag, Z., Hu, A., Liu, C., Cui, T. J., & Miao, J. (223). Source-free domain adaptive detection of concealed objects in passive millimeter-wave images. IEEE Transactions on Instrumentation and Measurement, 72, 1-15.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 International Journal of Renewable Energy and Environment
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Accepted paper becomes the permanent property of the International Journal of Renewable Energy and Environment (IJREE) and may not be reproduced by any means without the written permission of the Editorial board.
