AI Chat Paper
Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
{{expandStatus?'Exit ':''}}Advanced Search
While novel artificial intelligence and machine learning techniques are evolving and disrupting established terrestrial technologies at an unprecedented speed, their adaptation onboard satellites is seemingly lagging. A major hindrance in this regard is the need for high-quality annotated data for training such systems, which makes the development process of machine learning solutions costly, time-consuming, and inefficient. This paper presents "the OPS-SAT case", a novel data-centric competition that seeks to address these challenges. The powerful computational capabilities of the European Space Agency’s OPS-SAT satellite are utilized to showcase the design of machine learning systems for space by using only the small amount of available labeled data, relying on the widely adopted and freely available open-source software. The generation of a suitable dataset, design and evaluation of a public data-centric competition, and results of an onboard experimental campaign by using the competition winners’ machine learning model directly on OPS-SAT are detailed. The results indicate that adoption of open standards and deployment of advanced data augmentation techniques can retrieve meaningful onboard results comparatively quickly, simplifying and expediting an otherwise prolonged development period.
Furano, G., Meoni, G., Dunne, A., Moloney, D., Ferlet-Cavrois, V., Tavoularis, A., Byrne, J., Buckley, L., Psarakis, M., Voss, K. O., et al. Towards the use of artificial intelligence on the edge in space systems: Challenges and opportunities. IEEE Aerospace and Electronic Systems Magazine, 2020, 35(12): 44–56.
Giuffrida, G., Fanucci, L., Meoni, G., Batic, M., Buckley, L., Dunne, A., van Dijk, C., Esposito, M., Hefele, J., Vercruyssen, N., et al. The Φ-sat-1 mission: The first on-board deep neural network demonstrator for satellite earth observation. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1–14.
Mateo-Garcia, G., Veitch-Michaelis, J., Purcell, C., Longepe, N., Reid, S., Anlind, A., Bruhn, F., Parr, J., Mathieu, P. P. In-orbit demonstration of a re-trainable machine learning payload for processing optical imagery. Scientific Reports, 2023, 13(1): 10391.
Růžička, V., Vaughan, A., De Martini, D., Fulton, J., Salvatelli, V., Bridges, C., Mateo-Garcia, G., Zantedeschi, V. RaVÆn: Unsupervised change detection of extreme events using ML on-board satellites. Scientific Reports, 2022, 12(1): 16939.
Guerrisi, G., Del Frate, F., Schiavon, G. Artificial intelligence based on-board image compression for the Φ-Sat-2 mission. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023, 16: 8063–8075.
Del Rosso, M. P., Sebastianelli, A., Spiller, D., Mathieu, P. P., Ullo, S. L. On-board volcanic eruption detection through CNNs and satellite multispectral imagery. Remote Sensing, 2021, 13(17): 3479.
Izzo, D., Märtens, M., Pan, B. F. A survey on artificial intelligence trends in spacecraft guidance dynamics and control. Astrodynamics, 2019, 3(4): 287–299.
Ferreira, P. V. R., Paffenroth, R., Wyglinski, A. M., Hackett, T. M., Bilen, S. G., Reinhart, R. C., Mortensen, D. J. Reinforcement learning for satellite communications: From LEO to deep space operations. IEEE Communications Magazine, 2019, 57(5): 70–75.
Sebastianelli, A., Del Rosso, M. P., Ullo, S. L. Automatic dataset builder for Machine Learning applications to satellite imagery. SoftwareX, 2021, 15: 100739.
Kikaki, K., Kakogeorgiou, I., Mikeli, P., Raitsos, D. E., Karantzalos, K. MARIDA: A benchmark for Marine Debris detection from Sentinel-2 remote sensing data. PLoS One, 2022, 17(1): e0262247.
Gómez, P., Meoni, G. MSMatch: Semisupervised multispectral scene classification with few labels. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 11643–11654.
Kisantal, M., Sharma, S., Park, T. H., Izzo, D., Martens, M., D’Amico, S. Satellite pose estimation challenge: Dataset, competition design, and results. IEEE Transactions on Aerospace and Electronic Systems, 2020, 56(5): 4083–4098.
Märtens, M., Izzo, D., Krzic, A., Cox, D. Super-resolution of PROBA-V images using convolutional neural networks. Astrodynamics, 2019, 3(4): 387–402.
Labrèche, G., Evans, D., Marszk, D., Mladenov, T., Shiradhonkar, V., Soto, T., Zelenevskiy, V. OPS-SAT spacecraft autonomy with TensorFlow lite, unsupervised learning, and online machine learning. In: Proceedings of the IEEE Aerospace Conference, 2022: 1–17.
Park, T. H., Märtens, M., Jawaid, M., Wang, Z., Chen, B., Chin, T. J., Izzo, D., D’Amico, S. Satellite pose estimation competition 2021: Results and analyses. Acta Astronautica, 2023, 204: 640–665.
Uriot, T., Izzo, D., Simões, L. F., Abay, R., Einecke, N., Rebhan, S., Martinez-Heras, J., Letizia, F., Siminski, J., Merz, K. Spacecraft collision avoidance challenge: Design and results of a machine learning competition. Astrodynamics, 2022, 6(2): 121–140.
Grizonnet, M., Michel, J., Poughon, V., Inglada, J., Savinaud, M., Cresson, R. Orfeo ToolBox: Open source processing of remote sensing images. Open Geospatial Data, Software and Standards, 2017, 2(1): 15.
Musial, J. P., Bojanowski, J. S. Comparison of the novel probabilistic self-optimizing vectorized earth observation retrieval classifier with common machine learning algorithms. Remote Sensing, 2022, 14(2): 378.
Deshpande, P., Belwalkar, A., Dikshit, O., Tripathi, S. Historical land cover classification from CORONA imagery using convolutional neural networks and geometric moments. International Journal of Remote Sensing, 2021, 42(13): 5144–5171.
Navarro, A., Silva, I., Catalão, J., Falcão, J. An operational Sentinel-2 based monitoring system for the management and control of direct aids to the farmers in the context of the Common Agricultural Policy (CAP): A case study in mainland Portugal. International Journal of Applied Earth Observation and Geoinformation, 2021, 103: 102469.
Cheng, G., Han, J. W., Lu, X. Q. Remote sensing image scene classification: Benchmark and state of the art. Proceedings of the IEEE, 2017, 105(10): 1865–1883.
Chollet, F. Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017: 1800–1807.
Pitié, F., Kokaram, A. C., Dahyot, R. Automated colour grading using colour distribution transfer. Computer Vision and Image Understanding, 2007, 107(1–2): 123–137.
Papadakis, N., Provenzi, E., Caselles, V. A variational model for histogram transfer of color images. IEEE Transactions on Image Processing, 2011, 20(6): 1682–1695.
Ferradans, S., Papadakis, N., Peyré, G., Aujol, J. F. Regularized discrete optimal transport. SIAM Journal on Imaging Sciences, 2014, 7(3): 1853–1882.
Buslaev, A., Iglovikov, V. I., Khvedchenya, E., Parinov, A., Druzhinin, M., Kalinin, A. A. Albumentations: Fast and flexible image augmentations. Information, 2020, 11(2): 125.
Lin, T. Y., Goyal, P., Girshick, R., He, K. M., Dollar, P. Focal loss for dense object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42(2): 318–327.
Yeung, M., Sala, E., Schönlieb, C. B., Rundo, L. Unified focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentation. Computerized Medical Imaging and Graphics, 2022, 95: 102026.
Bradski, G. The openCV library. Dr. Dobb’s Journal: Software Tools for the Professional Programmer, 2000, 25(11): 120–123.
718
Views
25
Downloads
3
Crossref
4
Web of Science
4
Scopus
0
CSCD
Altmetrics
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
京公网安备11010802044758号