EI、Scopus 收录
中文核心期刊

基于深度强化学习的磁浮列车悬浮架协同控制研究

RESEARCH ON COOPERATIVE CONTROL OF MAGLEV TRAIN SUSPENSION SYSTEM BASED ON DEEP REINFORCEMENT LEARNING

  • 摘要: 由于磁浮列车悬浮架中存在多电磁铁耦合问题,运行过程中耦合效应会引起悬浮架的不稳定悬浮,为了保证悬浮架中多电磁铁在外界干扰下的稳定运行,提出了一种电磁悬浮(EMS)型磁浮列车悬浮架深度强化学习协同控制方法。首先,在考虑耦合情况下对磁浮列车悬浮架多电磁铁进行动力学建模并分析其耦合性;其次提出了基于SAC算法的悬浮架多电磁铁协同控制方法(SAC-CC),构建了深度强化学习协同控制算法框架,将悬浮架多电磁铁的动力学模型转换为深度强化学习环境模型并为此模型设计了奖励函数;然后在静态起浮环境下进行训练得到了SAC-CC控制器;最后将训练得到的SAC-CC控制器用于不同工况下悬浮架多电磁铁的悬浮控制及协同控制,通过与传统的比例-积分-微分(PID)控制方法进行对比验证所提出的控制器的有效性和鲁棒性。结果表明:在不同工况下,相较于PID控制器,本文所提出的SAC-CC控制器不仅能够有效控制悬浮架中多电磁铁稳定悬浮在平衡点位置附近,还显著减小了电磁铁之间的耦合作用,具有更加优秀的悬浮控制性能和协同控制性能,不同工况下的SAC-CC控制器悬浮控制性能和协同控制性能分别提升了30%-99%和30%-75%左右。

     

    Abstract: Due to the problem of multi-electromagnet coupling in the suspension frame of maglev train, the coupling effect will cause the unstable suspension of the suspension frame during operation. In order to ensure the stable operation of the multi-electromagnet in the suspension frame under external interference, a deep reinforcement learning collaborative control method for the suspension frame of electromagnetic levitation (EMS) type maglev train is proposed. Firstly, the dynamic modeling of multiple electromagnets in maglev suspension frame is carried out and their coupling characteristics are analyzed. Secondly, the multi-electromagnet cooperative control method (SAC-CC) based on SAC algorithm is proposed, and the collaborative control algorithm framework of deep reinforcement learning is constructed. The dynamic model of multi-electromagnet is converted into a deep reinforcement learning environment model, and the reward function is designed for this model. Then, the SAC-CC controller is obtained by training in static floating environment. Finally, the trained SAC-CC controller is applied to the suspension control and cooperative control of multiple electromagnets in the suspension frame under different working conditions. The effectiveness and robustness of the proposed controller are verified by comparing with the traditional proportional integral-differential (PID) control method. The results show that: Under different working conditions, compared with PID controller, the SAC-CC controller proposed in this paper can not only effectively control the multiple electromagnets stably suspended near the equilibrium point in the suspension frame, but also significantly reduce the coupling effect between electromagnets, and has better suspension control performance and collaborative control performance. The suspension control performance and cooperative control performance of SAC-CC controller under different working conditions are improved by about 30%-99% and 30%-75% respectively.

     

/

返回文章
返回