Abstract
Background: With the rapid development of spatial technology and mankind's continuous exploration of the space domain, expandable space trusses play an important role in the construction of space station piggyback platforms. Therefore, the study of the in-orbit assembly strategy for space trusses has become increasingly important in recent years. The spatial truss assembly strategy proposed in this paper is fast and effective, and it is applied for the construction of future large-scale space facilities effectively.
Objective: The four-prismatic truss periodic module is taken as the research object, and the assembly process of the truss and the assembly behaviors of the spatial cellular robot serving for on-orbit assembly are expressed.
Methods: The article uses a reinforcement learning algorithm to study the coupling of truss assembly sequence and robot action sequence, then uses a q-learning algorithm to plan the strategy of the truss cycle module.
Results: The robot is trained through the greedy strategy and avoids the failure problem caused by assembly uncertainty. The simulation experiment proves that the Q-learning algorithm of reinforcement learning used for planning the on-orbit assembly sequence of the truss periodic module structures is feasible, and the optimal assembly sequence with the least number of assembly steps obtained by this strategy.
Conclusion: In order to address the on-orbit assembly issues of large spatial truss structures in the space environment, we trained the robots through greedy strategy to prevent failure due to the uncertainty conditions both in the strategy analysis and in the simulation study. Finally, the Q-learning algorithm in reinforcement learning is used to plan the on-orbit assembly sequence in the truss cycle module, which can obtain the optimal assembly sequence in the minimum number of assembly steps.
Keywords: Space truss, spatial cellular robot, four-prismatic truss on-orbit assembly, reinforcement learning, Q-learning algorithm.
Graphical Abstract
[http://dx.doi.org/10.1109/AERO.2002.1035334]
[http://dx.doi.org/10.1063/1.1867238]
[http://dx.doi.org/10.1007/978-1-4615-3634-5_2]
[http://dx.doi.org/10.1007/3-540-44869-1_43]
[http://dx.doi.org/10.1080/0020754042000203894]
[http://dx.doi.org/10.1109/21.260667]
[http://dx.doi.org/10.1109/IROS.1993.583103,1993]
[http://dx.doi.org/10.1109/ROBOT.1994.351161]
[http://dx.doi.org/10.1016/S0377-2217(00)00103-X]
[http://dx.doi.org/10.1016/j.actaastro.2017.01.021]
[http://dx.doi.org/10.3901/JME.2019.10.001]
[http://dx.doi.org/10.1016/j.cad.2020.102962]
[http://dx.doi.org/10.1038/srep28341] [PMID: 27320492]
[http://dx.doi.org/10.1109/AERO.2008.4526312,2018]
[http://dx.doi.org/10.1016/S0045-7949(00)00182-6]
[http://dx.doi.org/10.5194/ms-11-233-2020]
[http://dx.doi.org/10.1016/j.procir.2018.03.212]
[http://dx.doi.org/10.1360/N972016-00741]
[http://dx.doi.org/10.1109/ICCA.2019.8899478]