航空航天领域机器人化智能装配技术综述
董云龙,李祥飞,刘行,赵欢,葛东升,尹业灿,陈旷达,黄庭安,袁烨,丁汉
摘要(Abstract):
零构件装配是航空航天装备制造的最终阶段和关键环节,机器人是提高航空航天装备零构件装配自动化智能化水平的重要载体,也是当前装配和机器人研究领域的难点和前沿。为此,本文从航空航天领域装配需求出发,通过剖析复杂零件、可变形线性零件、大型构件这三类典型零构件的机器人装配过程可知,航空航天零构件机器人装配的核心在于解决机器人的顺应、灵巧和协同问题。然后,从状态感知、规划与决策、力位精准调控、多机/人机协同装配四个方面系统总结当前机器人装配理论与技术的研究与应用现状。最后,探讨了航空航天领域机器人装配的未来研究方向。
关键词(KeyWords): 航空航天;机器人装配;状态感知;规划与决策;力位精准调控;多机/人机协同装配
基金项目(Foundation): 国家自然科学基金(92167201);; 中国博士后科学基金(2021M701307)
作者(Author): 董云龙,李祥飞,刘行,赵欢,葛东升,尹业灿,陈旷达,黄庭安,袁烨,丁汉
DOI: 10.16453/j.cnki.ISSN2096-5036.2022.03.001
参考文献(References):
- [1]Da Xu L,Wang C,Bi Z,et al.AutoAssem:an automated assembly planning system for complex products[J].IEEE Transactions on Industrial Informatics,2012,8(3):669-678.
- [2]王皓,陈根良.机器人型装备在航空装配中的应用现状与研究展望[J].航空学报,2022,43:626128-626128.DOI:10.7527/S1000-6893.2021.26128.
- [3]Williams G,Chalupa E,Rahhal S.Automated positioning and alignment systems[J].SAE Transactions,2000:737-745.
- [4]Jayaweera N,Webb P.Adaptive robotic assembly of compliant aero-structure components[J].Robotics and Computer-Integrated Manufacturing,2007,23(2):180-194.
- [5]Josh Bond.Raytheon:Precision in the air and on the ground[EB/OL].(2013-07-01)[2022-06-01].https://www.mmh.com/article/raytheon_precision_in_the_air_and_on_the_ground.
- [6]陶永,高赫,王田苗,等.移动工业机器人在飞机装配生产线中的应用研究[J].航空制造技术,2021,64(5):32-41+67.
- [7]T Reid E.Development of a Mobile drilling and fastening system based on a PKM robotic platform[R].SAE Technical Paper,2015.DOI:10.4271/2015-01-2509.
- [8]网络法治国际中心.深度解读美国商务部关于管制基础技术的拟议规则意味着什么[EB/OL].(2020-09-23)[2022-06-01].https://www.ershicimi.com/p/896fc1d86a44c518b6aa84b6d1af0522.
- [9]Everhart T.Neighboring mobile robot cell with drilling and fastening[R].SAE Technical Paper,2017.DOI:10.4271/2017-01-2094.
- [10]毕树生,宗光华,梁杰.机器人技术与航空制造业[J].机器人技术与应用,2009(03):25-31.
- [11]王明明,罗建军,袁建平,等.空间在轨装配技术综述[J].航空学报,2021,42(1):47-61.
- [12]ZHAW.ECHORD:Human-robot collaboration in airplane assembly[EB/OL].[2022-06-01].https://www.zhaw.ch/en/engineering/institutes-centres/ims/robotics-automation/echord/.
- [13]Muijs L,Snijders M.Collaborative Robot Applications at GKN Aerospace’s Fokker Business[R].SAE Technical Paper,2017.DOI:10.4271/2017-01-2091.
- [14]谭民,王硕.机器人技术研究进展[J].自动化学报,2013,39(07):963-972.
- [15]赵苏平.“精密1号”装配机器人在沪问世[J].科学,1995,47(04):55.
- [16]郭洪杰.飞机大部件自动对接装配技术[J].航空制造技术,2013(13):72-75.DOI:10.16080/j.issn1671-833x.2013.13.008.
- [17]李锦程.基于力控制的飞机大部件多移载工装移动搬运系统设计[D].上海交通大学,2020.
- [18]李汝鹏,薛雷,张增焕,等.从机械化到智能化的跨越-中国商飞航空制造技术的赶超之路[J].大飞机,2018(03):24-27.
- [19]汤海洋,纪柱,李论.基于力反馈牵引力导引的机器人辅助装配技术研究[J].制造业自动化,2021,43(03):9-13.
- [20]冯华山,秦现生,王润孝.航空航天制造领域工业机器人发展趋势[J].航空制造技术,2013(19):32-37.
- [21]黎田,胡晓雪,姚为,等.机器人在航天装备自动化装配中的应用研究[J].航空制造技术,2014(21):102-104+108.
- [22]Mei Z,Maropoulos P G.Review of the application of flexible,measurement-assisted assembly technology in aircraft manufacturing[J].Proceedings of the Institution of Mechanical Engineers,Part B:Journal of Engineering Manufactu re,2014,228(10):1185-1197.
- [23]R Santana E.Humanoid Robots and Artificial Intelligence in Aircraft Assembly:A case study and state-of-the-art review[J].2018,71.
- [24]赵欢,葛东升,罗来臻,等.大型构件自动化柔性对接装配技术综述[J].机械工程学报,2022,58:1-21.
- [25]Iskandar M,Ott C,Eiberger O,et al.Joint-level control of the DLR lightweight robot SARA[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).IEEE,2020:8903-8910.
- [26]Li R,Qiao H.A survey of methods and strategies for high-precision robotic grasping and assembly tasks-some new trends[J].IEEE/ASME Transactions on Mechatronics,2019,24(6):2718-2732.
- [27]Yuan X,Shi J,Gu L.A review of deep learning methods for semantic segmentation of remote sensing imagery[J].Expert Systems with Applications,2021,169:114417.
- [28]Tang T,Lin H C,Zhao Y,et al.Autonomous Alignment of Peg and Hole by Force/Torque Measurement for Robotic Assembly[C]//IEEE International Conference on Automation Science and Engineering (CASE).IEEE,2016:162-167.
- [29]Jia Z,Bhatia A,Aronson R M,et al.A survey of automated threaded fastening[J].IEEE Transactions on Automation Science and Engineering,2018,16(1):298-310.
- [30]Oikawa M,Kusakabe T,Kutsuzawa K,et al.Reinforcement learning for robotic assembly using non-diagonal stiffness matrix[J].IEEE Robotics and Automation Letters,2021,6(2):2737-2744.
- [31]Wang Q,Jiao W,Yu R,et al.Virtual reality robot-assisted welding based on human intention recognition[J].IEEE Transactions on Automation Science and Engineering,2019,17(2):799-808.
- [32]Zeng Y,Tian W,Li D,et al.An error-similarity-based robot positional accuracy improvement method for a robotic drilling and riveting system[J].The International Journal of Advanced Manufacturing Technology,2017,88(9):2745-2755.
- [33]Karlsson M,Robertsson A,Johansson R.Detection and control of contact force transients in robotic manipulation without a force sensor[C]//IEEE International Conference on Robotics and Automation (ICRA).IEEE,2018:4091-4096.
- [34]Ma Y,Xie Y,Zhu W,et al.An Efficient Robot Precision Assembly Skill Learning Framework Based on Several Demonstrations[J].IEEE Transactions on Automation Science and Engineering,2022:1-13.DOI:10.1109/TASE.2022.3144282.
- [35]人民日报.碧空追梦人丹心报国志[EB/OL].(2018-05-03)[2022-06-01].http://www.xinhuanet.com/info/2018-05/03/c_137153221.htm.
- [36]Ardelean E V,Babu?ka V,Goodding J C,et al.Cable effects study:tangents,rabbit holes,dead ends,and valuable results[J].Journal of Spacecraft and Rockets,2015,52(2):569-583.
- [37]Sanchez J,Corrales J A,Bouzgarrou B C,et al.Robotic manipulation and sensing of deformable objects in domestic and industrial applications:a survey[J].The International Journal of Robotics Research,2018,37(7):688-716.
- [38]Zhu J,Navarro B,Fraisse P,et al.Dual-arm robotic manipulation of flexible cables[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).IEEE,2018:479-484.
- [39]Zhu J,Cherubini A,Dune C,et al.Challenges and Outlook in Robotic Manipulation of Deformable Objects[J].IEEE Robotics and Automation Magazine,2021.DOI:10.1109/MRA.2022.3147415.
- [40]Yin H,Varava A,Kragic D.Modeling,learning,perception,and control methods for deformable object manipulation[J].Science Robotics,2021,6(54):eabd8803.
- [41]Kim H,Ohmura Y,Kuniyoshi Y.Transformer-based deep imitation learning for dual-arm robot manipulation[C]//IEEE/RSJInternational Conference on Intelligent Robots and Systems (IROS).IEEE,2021:8965-8972.
- [42]Chen Z,Du F,Tang X.Position and orientation best-fitting based on deterministic theory during large scale assembly[J].Journal of Intelligent Manufacturing,2018,29:827-837.
- [43]Tzafestas S G.Mobile robot control and navigation:A global overview[J].Journal of Intelligent&Robotic Systems,2018,91(1):35-58.
- [44]Zake Z,Chaumette F,Pedemonte N,et al.Vision-based control and stability analysis of a cable-driven parallel robot[J].IEEERobotics and Automation Letters,2019,4(2):1029-36.
- [45]Ata A A.Optimal trajectory planning of manipulators:a review[J].Journal of Engineering Science and Technology,2007,2(1):32-54.
- [46]陈冠宇,成群林,张解语,等.基于多传感器测量的航天器舱段自动对接位姿调整方法[J].北京航空航天大学学报,2019,45(6):1232-1239.
- [47]Bogue R.The growing use of robots by the aerospace industry[J].Industrial Robot:An International Journal,2018,45(6):705-709.
- [48]Pan Z,Zhang H,Zhu Z,et al.Chatter analysis of robotic machining process[J].Journal of Materials Processing Technology,2006,173(3):301-309.
- [49]Klimchik A,Pashkevich A.Robotic manipulators with double encoders:accuracy improvement based on advanced stiffness modeling and intelligent control[J].IFAC-Papers On Line,2018,51(11):740-745.
- [50]Devlieg R.Expanding the use of robotics in airframe assembly via accurate robot technology[J].SAE International Journal of Aerospace,2010,3(1):198-203.
- [51]Mohebbi A,Keshmiri M,Xie W F.An eye-in-hand stereo visual servoing for tracking and catching moving objects[C]//IEEEChinese Control Conference,2014:8570-8577.
- [52]Keshmiri M,Xie W F,Mohebbi A.Augmented image-based visual servoing of a manipulator using acceleration command[J].IEEE Transactions on Industrial Electronics,2014,61(10):5444-5452.
- [53]Di P,Huang J,Chen F,et al.Hybrid vision-force guided fault tolerant robotic assembly for electric connectors[C]//International Symposium on Micro-Nano Mechatronics and Human Science.IEEE,2009:86-91.
- [54]Tan S,Yunlong D,Dingxin H,et al.Online identification of time-varying dynamical systems for industrial robots based on sparse Bayesian learning[J].Science China Technological Sciences,2022,65:386-395.
- [55]王志军,王凯,刘宣佑.六维力传感器解耦综述[J].机械工程与自动化,2018(02):220-221.
- [56]Moreira G R,Lahr G J G,Boaventura T,et al.Online prediction of threading task failure using convolutional neural networks[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).IEEE,2018:2056-2061.
- [57]Kim Y L,Song H C,Song J B.Hole detection algorithm for chamferless square peg-in-hole based on shape recognition using F/T sensor[J].International journal of precision engineering and manufacturing,2014,15(3):425-432.
- [58]Qin F,Xu D,Zhang D,et al.Robotic skill learning for precision assembly with microscopic vision and force feedback[J].IEEE/ASME Transactions on Mechatronics,2019,24(3):1117-28.
- [59]Xu J,Hou Z,Liu Z,et al.Compare contact model-based control and contact model-free learning:A survey of robotic peg-inhole assembly strategies[EB/OL].(2019-04-10)[2022-06-01].https://arxiv.org/pdf/1904.05240.pdf.
- [60]Whitney D E.Quasi-static assembly of compliantly supported rigid parts[J].Journal of Dynamic Systems,Measurement,and Control,1982,104(1):65-77.
- [61]Liu S,Li Y F,Xing D.Sensing and control for simultaneous precision peg-in-hole assembly of multiple objects[J].IEEETransactions on Automation Science and Engineering,2019,17(1):310-324.
- [62]Jasim I F,Plapper P W.TS fuzzy contact state recognition for compliant motion robotic tasks using gravitational search-based clustering algorithm[C]//2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).IEEE,2013:1-8.
- [63]Brignone L M,Howarth M.A geometrically validated approach to autonomous robotic assembly[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems.IEEE,2002,2:1626-1631.
- [64]Jakovljevic Z,Petrovic P B,Hodolic J.Contact states recognition in robotic part mating based on support vector machines[J].The International Journal of Advanced Manufacturing Technology,2012,59(1):377-395.
- [65]Debus T J,Dupont P E,Howe R D.Contact state estimation using multiple model estimation and hidden markov models[J].The International Journal of Robotics Research,2004,23(4-5):399-413.
- [66]Vecerik M,Sushkov O,Barker D,et al.A practical approach to insertion with variable socket position using deep reinforcement learning[C]//International Conference on Robotics and Automation (ICRA).IEEE,2019:754-760.
- [67]Inoue T,De Magistris G,Munawar A,et al.Deep reinforcement learning for high precision assembly tasks[C]//IEEE/RSJInternational Conference on Intelligent Robots and Systems (IROS),IEEE,2017:819-825.
- [68]Xu J,Hou Z,Wang W,et al.Feedback deep deterministic policy gradient with fuzzy reward for robotic multiple peg-in-hole assembly tasks[J].IEEE Transactions on Industrial Informatics,2018,15(3):1658-1667.
- [69]Li Y,Zhang L,Wang Y Z.An optimal method of posture adjustment in aircraft fuselage joining assembly with engineering constraints[J].Chinese Journal of Aeronautics,2017,30(6):2016-2023.
- [70]Fan W,Zheng L,Ji W,et al.A machining accuracy informed adaptive positioning method for finish machining of assembly interfaces of large-scale aircraft components[J].Robotics and Computer-Integrated Manufacturing,2020,67:102021.
- [71]Brillinger C,Susemihl H,Ehmke F,et al.Mobile laser trackers for aircraft manufacturing:Increasing accuracy and productivity of robotic applications for large parts[R].SAE Technical Paper,2019.DOI:https://doi.org/10.4271/2019-01-1368.
- [72]Lei P,Zheng L.An automated in-situ alignment approach for finish machining assembly interfaces of large-scale components[J].Robotics and Computer-Integrated Manufacturing,2017,46:130-143.
- [73]Qin Z,Wang P,Sun J,et al.Precise robotic assembly for large-scale objects based on automatic guidance and alignment[J].IEEE Transactions on Instrumentation and Measurement,2016,65(6):1398-1411.
- [74]陈冠宇,成群林,张解语,等.基于多传感器测量的航天器舱段自动对接位姿调整方法[J].北京航空航天大学学报,2019,45(6):1232-1239.
- [75]Liu H,Zhu W,Dong H,et al.An adaptive ball-head positioning visual servoing method for aircraft digital assembly[J].Assembly Automation,2019,39(2):287-296.
- [76]Peng Y C,Jivani D,Radke R J,et al.Comparing Position-and Image-Based Visual Servoing for Robotic Assembly of Large Structures[C]//IEEE International Conference on Automation Science and Engineering (CASE),2020:1608-1613.
- [77]Jiang J,Huang Z,Bi Z,et al.State-of-the-Art control strategies for robotic Pi H assembly[J].Robotics and Computer-Integrated Manufacturing,2020,65:101894.
- [78]胡瑞钦,张立建,孟少华,等.基于柔顺控制的航天器大部件机器人装配技术[J].机械工程学报,2018,54(11):85-93.
- [79]Fernandez S R,Olabi A,Gibaru O.Multi-Surface Admittance Control Approach applied on Robotic Assembly of Large-Scale parts in Aerospace Manufacturing[C]//International Conference on Advanced Robotics (ICAR).IEEE,2019:688-694.
- [80]Zeng C,Yang C,Chen Z,et al.Robot learning human stiffness regulation for hybrid manufacture[J].Assembly Automation,2018,38(5):539-547.
- [81]Luo J,Solowjow E,Wen C,et al.Reinforcement learning on variable impedance controller for high-precision robotic assembly[C]//International Conference on Robotics and Automation (ICRA).IEEE,2019:3080-3087.
- [82]Ren T,Dong Y,Wu D,et al.Learning-based variable compliance control for robotic assembly[J].Journal of Mechanisms and Robotics,2018,10(6):061008.
- [83]Johannsmeier L,Gerchow M,Haddadin S.A framework for robot manipulation:Skill formalism,meta learning and adaptive control[C]//2019 International Conference on Robotics and Automation (ICRA).IEEE,2019:5844-5850.
- [84]Beltran-Hernandez C C,Petit D,Ramirez-Alpizar I G,et al.Learning force control for contact-rich manipulation tasks with rigid position-controlled robots[J].IEEE Robotics and Automation Letters,2020,5(4):5709-5716.
- [85]Tang T,Lin H C,Zhao Y,et al.Teach industrial robots peg-hole-insertion by human demonstration[C]//2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).IEEE,2016:488-494.
- [86]KRONANDER K,BURDET E,BILLARD A.Task transfer via collaborative manipulation for insertion assembly[C]//Workshop on human-robot interaction for industrial manufacturing,robotics,science and systems.Citeseer,2014.
- [87]SONG Jingzhou,CHEN Qingle,LI Zhendong.A peg-inhole robot assembly system based on Gauss mixture model[J].Robotics and Computer-Integrated Manufacturing,2021,67:101996.
- [88]Marvel J A,Bostelman R,Falco J.Multi-robot assembly strategies and metrics[J].ACM Computing Surveys (CSUR),2018,51(1):1-32.
- [89]Sun D,Mills J K.Adaptive synchronized control for coordination of multirobot assembly tasks[J].IEEE Transactions on Robotics and Automation,2002,18(4):498-510.
- [90]Seenu N,RM K C,Ramya M M,et al.Review on state-of-the-art dynamic task allocation strategies for multiple-robot systems[J].Industrial Robot:the International Journal of Robotics Research and Application,2020,47(6):929-942.
- [91]Binetti G,Naso D,Turchiano B.Decentralized task allocation for heterogeneous agent systems with constraints on agent capacity and critical tasks[C]//2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).IEEE,2012:1627-1632.
- [92]Rojas J,Peters R A.Analysis of autonomous cooperative assembly using coordination schemes by heterogeneous robots using a control basis approach[J].Autonomous Robots,2012,32(4):369-383.
- [93]Tereshchuk V,Stewart J,Bykov N,et al.An Efficient Scheduling Algorithm for Multi-Robot Task Allocation in Assembling Aircraft Structures[J].IEEE Robotics and Automation Letters,2019,4(4):3844-3851.
- [94]Gan Y,Duan J,Chen M,et al.Multi-robot trajectory planning and position/force coordination control in complex welding tasks[J].Applied Sciences,2019,9(5):924.
- [95]Wang L,Liu S,Liu H,et al.Overview of human-robot collaboration in manufacturing[C]//Proceedings of 5th international conference on the industry 4.0 model for advanced manufacturing.Cham:Springer,2020:15-58.
- [96]Ding H,Yang X,Zheng N,et al.Tri-Co Robot:a Chinese robotic research initiative for enhanced robot interaction capabilities[J].National Science Review,2018,5(6):799-801.
- [97]Park K M,Park Y,Yoon S,et al.Collision Detection for Robot Manipulators Using Unsupervised Anomaly Detection Algorithms[J].IEEE/ASME Transactions on Mechatronics,2021.
- [98]Pareek P,Thakkar A.A survey on video-based human action recognition:recent updates,datasets,challenges,and applications[J].Artificial Intelligence Review,2021,54(3):2259-2322.