Deep learning for spacecraft guidance, navigation, and control

1Khoroshylov, SV, 2Redka, MO
1Institute of Technical Mechanics of the National Academy of Sciences of Ukraine and the State Space Agency of Ukraine, Dnipro, Ukraine
2Institute of Technical Mechanics of the National Academy of Science of Ukraine and the State Space Agency of Ukraine, Dnipropetrovsk, Ukraine
Space Sci. & Technol. 2021, 27 ;(6):038-052
https://doi.org/10.15407/knit2021.06.038
Publication Language: English
Abstract: 
The advances in deep learning have revolutionized the field of artificial intelligence, demonstrating the ability to create autonomous systems with a high level of understanding of the environments where they operate. These advances, as well as new tasks and requirements in space exploration, have led to an increased interest in these deep learning methods among space scientists and practitioners. The goal of this review article is to analyze the latest advances in deep learning for navigation, guidance, and control problems in space. The problems of controlling the attitude and relative motion of spacecraft are considered for both traditional and new missions, such as orbital service.
           The results obtained using these methods for landing and hovering operations considering missions to the Moon, Mars, and asteroids are also analyzed. Both supervised and reinforcement learning are used to solve such problems based on various architectures of artificial neural networks, including convolutional and recurrent ones. The possibility of using deep learning together with methods of control theory is analyzed to solve the considered problems more efficiently. The difficulties that limit the application of the reviewed methods for space applications are highlighted. The necessary research directions for solving these problems are indicated.
Keywords: artificial neural network, control, deep learning, guidance, hovering, landing, navigation, reinforcement learning, spacecraft
References: 

1. Baranets N., Ruzhin Yu., Erokhin N., Afonin V., Vojta J., Smilauer J., Kudela K., Matisin J., Ciobanu M. (2014). Resonance effects of wave-particle interactions during artificial charged particle beam injections in an ionospheric plasma. Space Sci. and Technol., 20 (5), 3-26.

2. Kaptsov N. A. (1960). Radiophysical electronics. Moscow: Moscow State University Publishing House.

3. Kitsenko O. B., Stepanov K. M. (1961). About the passage of a beam of charged particles through a magnetoactive plasma. Ukr. J. Phys., 6 (3), 297-307.

4. Kovalenko V. P. (1983). Electron bunches in nonlinear collective interaction of beams with plasma. Soviet Physics Uspekhi, 139 (2), 223-263.
https://doi.org/10.3367/UFNr.0139.198302b.0223

5. Mikhailovskij A. B. (1975). Theory of plasma instabilities. Moscow: Atomizdat. Vol. 1.

6. Nezlin M. V. (1976). Waves with negative energy and the anomalous Doppler effect. Soviet Physics Uspekhi, 120 (3), 481-495.
https://doi.org/10.3367/UFNr.0120.197611g.0481

7. Albert J. M. (2000). Gyroresonant interactions of radiation belt particles with a monochromatic electromagnetic wave. J. Geophys. Res., 105 (A9), 21191-21209.
https://doi.org/10.1029/2000JA000008

8. An X., Bortnik J., Van Compernolle B., et al. (2017). Electrostatic and whistler instabilities excited by an electron beam.Phys. Plasmas, 24, 072116.
https://doi.org/10.1063/1.4986511

9. An X., Van Compernolle B., Bortnik J., et al. (2016). Resonant excitation of whistler waves by a helical electron beam. Geophys. Res. Lett., 43 (6), 2413-2421.
https://doi.org/10.1002/2015GL067126

10. Baranets N., Ruzhin Yu., Dokukin V., et al. (2017). Injection of 40kHz-modulated electron beam from the satellite: I. Beamplasma interaction near the linear stability boundary. Adv. Space Res., 59 (12), 2951-2968.
https://doi.org/10.1016/j.asr.2017.03.030

11. Baranets N., Ruzhin Yu., Dokukin V., et al. (2020). Injection of 40-kHz-modulated electron beam from the satellite: II. Excitation of electrostatic and whistler waves. Adv. Space Res., 65 (1), 30-49.
https://doi.org/10.1016/j.asr.2019.08.027

12. Baranets N., Ruzhin Yu., Erokhin N., et al. (2012). Acceleration of energetic particles by whistler waves in active space experiment with charged particle beams injection. Adv. Space Res., 49 (5), 859-871.
https://doi.org/10.1016/j.asr.2011.12.001

13. Bell T. F., Buneman O. (1964). Plasma instability in the whistler mode caused by a gyrating electron stream. Phys. Rev., 133 (A5), A1300-A1302.
https://doi.org/10.1103/PhysRev.133.A1300

14. Borg G. G., Harris J. H., Martin N. M., et al. (2000). Plasmas as antennas: Theory, experiment and applications. Phys. Plasmas, 7 (5), 2198-2202.
https://doi.org/10.1063/1.874041

15. Briggs R. J. (1964). Electron-stream interaction with plasmas. Cambridge. Massachusets: The M. I. T. Press.
https://doi.org/10.7551/mitpress/2675.001.0001

16. Denig W. F., Maynard N. C., Burke W. J., et al. (1991). Electric field measurements during supercharging events on the MAIMIK Rocket Experiment. J. Geophys. Res., 96 (A3), 3601-3610.
https://doi.org/10.1029/90JA02103

17. Fried B. D., Conte S. D. (1961). The plasma dispersion function. New York: Academic Press.

18. Fu X. R., Cowee M. M., Liu K., et al. (2014). Particle-in-cell simulations of velocity scattering of an anisotropic electron beam by electrostatic and electromagnetic instabilities. Phys. Plasmas, 21, 042108.
https://doi.org/10.1063/1.4870632

19. Kiraga A., Klos Z., Oraevsky V. N., et al. (1995). Observation of fundamental magnetoplasma emissions excited in magnetosphere by modulated electron beams. Adv. Space Res., 15 (12), 21-24.
https://doi.org/10.1016/0273-1177(95)00004-X

20. Lizunov G., Volokitin A., Blazhko I. (2002). Dynamics and relaxation of an artificial electron beam. Adv. Space Res., 29 (9), 1391-1396.
https://doi.org/10.1016/S0273-1177(02)00192-8

21. Němeček Z., Šafránková J., Přech L., et al. (1997). Artificial electron and ion beam effects: Active Plasma Experiment. J. Geophys. Res., 102 (A2), 2201-2211.
https://doi.org/10.1029/95JA03571

22. Přech L., Němeček Z., Šafránková J., et al. (2002). Actively produced high-energy electron bursts within the magnetosphere: the APEX project. Ann. Geophys., 20, 1529-1538.
https://doi.org/10.5194/angeo-20-1529-2002

23. Přech L., Ruzhin Yu. Y., Dokukin V. S., et al. (2018). Overview of APEX project results. Front. Astron. Space Sci., 5, Id. 46. DOI:10. 3389/fspas. 2018. 00046.
https://doi.org/10.3389/fspas.2018.00046

24. Stenzel R. L. (1976). Antenna radiation patterns in the whistler wave regime measured in a large laboratory plasma. Radio Sci., 11 (12), 1045-1056.
https://doi.org/10.1029/RS011i012p01045

25. Stenzel R. L. (1999). Whistler waves in space and laboratory plasmas J. Geophys. Res., 104 (A7), 14,379-14,395.
https://doi.org/10.1029/1998JA900120

26. Timofeev I. V., Volchok E. P., Annenkov V. V. (2016). Theory of a beam-driven plasma antenna. Plasma Phys., 23, 083119. https: doi. org/10. 1063/1. 4961218
https://doi.org/10.1063/1.4961218