Skip to content
2000
Volume 19, Issue 8
  • ISSN: 1872-2121
  • E-ISSN: 2212-4047

Abstract

In the current modern manufacturing industry, the demand for product quality control is increasing, as is the need for automation. However, the manual inspection may need to be noticed or undetectable in the complex production process. To solve this phenomenon, machine vision-based inspection of machine tools and their product features has become one of the key technologies in intelligent manufacturing. The basic principle of machine tool machine vision inspection is to transmit the object to be inspected to the computer through efficient image acquisition. Then, image processing or deep learning algorithms classify, locate, segment, and process the features of the thing. Finally, the computer makes the judgment of whether it is qualified. According to recent numerical analysis data, compared with traditional methods, machine tool machine vision inspection can improve the inspection efficiency by 30%, and the accuracy has reached 98%, much higher than manual inspection accuracy. This study provides an in-depth review of representative patents and machine tool vision inspection patents, and it comprehensively summarizes the research results from various dimensions in recent year. In the past five years, the average annual growth rate of machine tool vision inspection technology has reached 15%, showing the rapid development momentum of this field. The research content mainly focuses on designing vision detection structures, algorithm optimization designs, and personalized solutions for object differences.

Loading

Article metrics loading...

/content/journals/eng/10.2174/0118722121299730240424100312
2024-05-27
2025-12-15
Loading full text...

Full text loading...

References

  1. WangT. ChenY. QiaoM. SnoussiH. A fast and robust convolutional neural network-based defect detection model in product quality control.Int. J. Adv. Manuf. Technol.2018949-123465347110.1007/s00170‑017‑0882‑0
    [Google Scholar]
  2. LiaoZ. AbdelhafeezA. LiH. YangY. DiazO.G. AxinteD. State-of-the-art of surface integrity in machining of metal matrix composites.Int. J. Mach. Tools Manuf.2019143639110.1016/j.ijmachtools.2019.05.006
    [Google Scholar]
  3. KimD.H. KimT.J.Y. WangX. KimM. QuanY-J. OhJ.W. MinS-H. KimH. BhandariB. YangI. AhnS-H. Smart machining process using machine learning: A review and perspective on machining industry.Int. J. Precis. Eng. Manuf. Green Technol.20185455556810.1007/s40684‑018‑0057‑y
    [Google Scholar]
  4. BulnesF.G. UsamentiagaR. GarciaD.F. MolledaJ. An efficient method for defect detection during the manufacturing of web materials.J. Intell. Manuf.201627243144510.1007/s10845‑014‑0876‑9
    [Google Scholar]
  5. SongK. YanY. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects.Appl. Surf. Sci.201328585886410.1016/j.apsusc.2013.09.002
    [Google Scholar]
  6. ZhangH. ShenX. BoA. LiY. ZhanH. GuY. A multiscale evaluation of the surface integrity in boring trepanning association deep hole drilling.Int. J. Mach. Tools Manuf.2017123485610.1016/j.ijmachtools.2017.07.005
    [Google Scholar]
  7. RaoX. ZhangF. LuY. LuoX. ChenF. Surface and subsurface damage of reaction-bonded silicon carbide induced by electrical discharge diamond grinding.Int. J. Mach. Tools Manuf.202015410356410.1016/j.ijmachtools.2020.103564
    [Google Scholar]
  8. MitalA. GovindarajuM. SubramaniB. A comparison between manual and hybrid methods in parts inspection.Integrated Manuf. Syst.19989634434910.1108/09576069810238709
    [Google Scholar]
  9. MalamasE.N. PetrakisE.G.M. ZervakisM. PetitL. LegatJ-D. A survey on industrial vision systems, applications and tools.Image Vis. Comput.200321217118810.1016/S0262‑8856(02)00152‑X
    [Google Scholar]
  10. KopardekarP. MitalA. AnandS. Manual, hybrid and automated inspection literature and current research.Integrated Manuf. Syst.199341182910.1108/09576069310023838
    [Google Scholar]
  11. ChenS.Y. ChengY.C. YangW.L. WangM-Y. Surface defect detection of wet-blue leather using hyperspectral imaging.IEEE Access2021912768512770210.1109/ACCESS.2021.3112133
    [Google Scholar]
  12. TaoX. ZhangD. MaW. LiuX. XuD. Automatic metallic surface defect detection and recognition with convolutional neural network.Appl. Sci.201889157510.3390/app8091575
    [Google Scholar]
  13. CaiX. ChenY. MaH. QiuG. KangY. Visual inspection method of steel pipe surface cracks based on dry magnetic particle feature enhancement.Nondestruct. Test. Eval.202338225427410.1080/10589759.2022.2114475
    [Google Scholar]
  14. CuiA. SunW.L. ZhangH. A vision system based online quality monitoring method.C.N. Patent 10,706,309,9B2019.
    [Google Scholar]
  15. XiaoR.S. HuangT. YangH.Q. An automatic precision laser welding based on CCD vision inspection method.C.N. Patent 11,023, 852,0B2021.
    [Google Scholar]
  16. LiuC. ChenS. HuangJ. Machine vision-based object detection strategy for weld area.Sci. Program.2022202211210.1155/2022/1188974
    [Google Scholar]
  17. WangH. LuR. YuD. Machine vision nondestructive inspection system assisted by industrial iot supervision mechanism.Math. Probl. Eng.2022202211110.1155/2022/8449518
    [Google Scholar]
  18. BenbarradT. SalgaouiM KenitarS.B. AriouaM. Comparative assessment of common pre-trained CNNs for vision-based surface defect detection of machined components.Journal of Sensor and Actuator Networksvol. 10, no. 1,p. 7, 2023.10.3390/jsan10010007
    [Google Scholar]
  19. Di LeoG. LiguoriC. PietrosantoA. SommellaP. A vision system for the online quality monitoring of industrial manufacturing.Opt. Lasers Eng.20178916216810.1016/j.optlaseng.2016.05.007
    [Google Scholar]
  20. SunT.H. TienF.C. TienF.C. KuoR.J. Automated thermal fuse inspection using machine vision and artificial neural networks.J. Intell. Manuf.201627363965110.1007/s10845‑014‑0902‑y
    [Google Scholar]
  21. WangQ.G. XiaoQ.P. WangS.P. A kind of machine tool parts inspection device based on vision system.C.N. Patent 21,636,900,7U2022.
    [Google Scholar]
  22. ZengW.Q. Visual inspection-devices.C.N.Patent 21,470,334,5U2021.
    [Google Scholar]
  23. ChenZ.G. WangJ.X. Device to realize precision machining on CNC machine tools by visual inspection of contours.C.N. Patent 21,925,605,1U2023.
    [Google Scholar]
  24. HouX.F. ZhangC. ZhuL. An automotive parts conveyor with vision inspection.C.N. Patent 21,684,751,2U2022.
    [Google Scholar]
  25. YeX.Q. LiC.H. JiaJ.D. An automatic visual inspection device without datum positioning.C.N. Patent 21,821,117,8U2023.
    [Google Scholar]
  26. WangZ.L. ZhangX.J. NingX.Y. A visual inspection device for CNC machine tool machining.C.N. Patent 21,632,702,0U2022.
    [Google Scholar]
  27. YinX.W. An automated machine tool vision inspection device.C.N. Pantent 21,531,744,4U2021.
    [Google Scholar]
  28. LiuX.C. HuY.G ChenZ.R. A multi-part loading device with visual inspection function.C.N. Pantent 21,231,120,9U2021.
    [Google Scholar]
  29. YangW.H. YangJ.W. ChengC. XvZ. A kind of composite material machine tool processing cut surface machine vision inspection deviceC.N. Patent 21,225,503,5U2020.
    [Google Scholar]
  30. WangH.T. LiX. GuoC.S. MuM.H. An online sample visual inspection and coding processing equipment.C.N. Patent 20,981,147,3U2019.
    [Google Scholar]
  31. YangC.R. LianG.W. An in-line visual inspection system for connection holes.C.N. Pantent 20,878,014,4U2019.
    [Google Scholar]
  32. XvL.L. ShenY.J. ZhouX.L. A kind of automatic visual inspection equipment for shaped parts.C.N. Patent 20,870,524,4U2019.
    [Google Scholar]
  33. ZhouY. ChenL. QiuP. YanY. QiuS. Methods of inspecting parts to be measured by visual inspection equipment and Visual inspection equipment.C.N. Patent 11,435,926,6A2022.
    [Google Scholar]
  34. JiangG.B. A five-axis CNC machine tool multifunction based on machine vision inspection device.C.N. Patent 21,521,858,7U2021.
    [Google Scholar]
  35. LinX. LinB. PanY.F. Visual inspection device for industrial parts production inspection and method of use.C.N. Patent 11,341,855,0B2021.
    [Google Scholar]
  36. YanG.Q. A visual recognition-based control system for CNC machine tools.C.N. Patent 11,285,974,2B2021.
    [Google Scholar]
  37. ShaoX.Y. ShenZ.P. ShaoP. Machine vision-assisted unmanned CNC turning machines.C.N. Patent 11,151,541,4A2020.
    [Google Scholar]
  38. CaiD.S. XueX.D. ZhangH.B. A kind of parts appearance visual inspection equipment.C.N. Patent 21,888,576,0U2023.
    [Google Scholar]
  39. ZhangL.Y. TongK.K. YeN. On-machine visual inspection of engraved shapes on chemically milled adhesive films.C.N. Patent 10,890,789,7B2020.
    [Google Scholar]
  40. ZhangX.Y A visual inspection device for CNC machine tool automation.C.N. Patent 21,902,686,2U2023.
    [Google Scholar]
  41. LiuW. Highly dynamic large range arbitrary contour error monocular for CNC machine tools Six-dimensional measuring method.C.N. Patent 10,797,183,1B2019.
    [Google Scholar]
  42. ChenQ.W. ZhouK. LiJ.Y. Machine vision-based CNC flexible machining system for wheel hubs.C.N. Patent 10,624,969,5B2018.
    [Google Scholar]
  43. QiT.J. Processing equipment equipped with vision sensors to confirm the presence of foreign objects equipment.C.N. Patent 10,572,922,9B2018.
    [Google Scholar]
  44. ZhouR.Q. A kind of machine vision based CNC machine tool processing workpiece anomaly detection device Abnormal detection device.C.N. Patent 21,500,502,6U2021.
    [Google Scholar]
  45. ShiX.D. I5 CNC visual recognition function for high-precision positioning of shaped parts Positioning tools.C.N. Patent 21,574,787,3U2022.
    [Google Scholar]
  46. GuoY.C. ShiG.T. "Automatic Parking System Based on Improved Neural Network Algorithm and Intelligent Image Analysis".Computational Intelligence and Neuroscience202314391864202110.1155/2021/4391864
    [Google Scholar]
  47. WangH. ChenZ.H. LiangB.Y. WangY.B. LiuJ.Y. Stroke sensor and machine vision based coil length measurement for coil winding machines. Coil length measurement method.C.N. Patent 10,944,322,0B2021.
    [Google Scholar]
  48. ZhaoQ. MeiS. A machine vision-based surface defect detection algorithm.C.N. Patent 10,949,031,6B2021.
    [Google Scholar]
  49. FengX. WuJ.J. AnW. Automatic measuring system for large-size workpieces based on machine vision.C.N. Patent 10,961,239,0A2019.
    [Google Scholar]
  50. YangL.X. LiaoR.T. WangY.Y. ZhangX.F. DengT.Q. Deep learning and hough transform based hexagonal bolt loosening motion detection method.C.N. Patent 11,009,753,6B2023.
    [Google Scholar]
  51. YangY. A vision-based precision inspection of electronic assembly parts assembly method.C.N. Patent 11,024,612,1B2021.
    [Google Scholar]
  52. LuoG.F. Machine vision based part inspection methods.C.N. Patent 11,312,930,4B2022.
    [Google Scholar]
  53. WangX.R. WangC.L. YangY. HouX.N. LiuQ.X. ZhanM.H. Machine vision based mass part feature detection method, systems, media and equipment.C.N. Patent 11,326,976,7A2021.
    [Google Scholar]
  54. JiangL. Intelligent inspection method, system and product inspection system based on image recognition.C.N. Patent 11,380,811,6A2021.
    [Google Scholar]
  55. SunX. GuJ. HuangR. ZouR. PalomaresG.B. Surface defects recognition of wheel hub based on improved faster R-CNN.Electronics20198548110.3390/electronics8050481
    [Google Scholar]
  56. WangF.J. LiuW. PanY. Three-dimensional measurement of contour error on cnc machine tools based on monocular vision measurement method.C.N. Patent 10,834,021,1B2019.
    [Google Scholar]
  57. DengX.L. WangH.L. LiL. A machine vision-based surface defect detection of plastic cylinders method.C.N. Patent 10,883,083,2B2021.
    [Google Scholar]
  58. TangY.P. A machine vision based fabric inspection device and method.C.N. Patent 10,892,181,9A2018.
    [Google Scholar]
  59. JiaZ.Y. LiuW. ZhaoK. Accurate part positioning method based on the binocular micro stereo vision.C.N. Patent 10,324,702,3B2015.
    [Google Scholar]
  60. ZhaoN.N. WuJ.H. WangY.C. A visual inspection device for missing round parts and a method.C.N. Patent 11,108,062,3B2023.
    [Google Scholar]
  61. LaiC.J. LiuJ.F. ChenK. A machine vision inspection system.C.N. Patent 11,140,223,4A2020.
    [Google Scholar]
  62. ZhangH.G. LuJ.W. KuangG.W. ChenZ.B. Twin network based weakly supervised visual detection algorithm for industrial defects.Electron. Info. Sci.2023406657654
    [Google Scholar]
  63. LiuZ.T. JiY.Q. A 3D vision algorithm based deviation detection system for high precision parts measurement system.C.N. Patent 11,201,378,9B2021.
    [Google Scholar]
  64. LiuX.H. ZhangK.H. ChenY.F. ZhangW. D. A machine vision-based method for analyzing the traceability of industrial product production process.C.N. Patent 11,258,093,5A2021.
    [Google Scholar]
  65. LiG.L. ZhouS.L. WangQ.J. A monocular machine vision spherical motor position detection algorithm Data set acquisition device.C.N. Patent 11,271,023,0A2021.
    [Google Scholar]
  66. ChenW.X JiangF.H. A deep learning based weld seam on the top cover of lithium battery cell appearance detection algorithm.C.N. Patent 11,411,946,4A2022.
    [Google Scholar]
  67. ChenX.S. ZhangZ. NiuC.F. ShangT. Inspection of machine tool castings based on visual analysis of mineral materials.C.N. Patent 11,622,877,1A2023.
    [Google Scholar]
  68. KangJ.J. WangR.L ZhaoT.H. A vision-based bolt loosening angle detection algorithm test testing platform device.C.N. Patent 21,964,089,7U2023.
    [Google Scholar]
  69. AmitA.M. SamirS.B. Automatic tuning and calibration of computer vision systems.U.S. Patent 20,221,015,58, A12022.
    [Google Scholar]
  70. Al-ShareedaM.A. ManickamS. COVID-19 vehicle based on an efficient mutual authentication scheme for 5G-enabled vehicular fog computing.Int. J. Environ. Res. Public Health202219231561810.3390/ijerph19231561836497709
    [Google Scholar]
  71. Al-ShareedaM.A. AnbarM. ManickamS. HasbullahI.H. Towards identity-based conditional privacy-preserving authentication scheme for vehicular ad hoc networks.IEEE Access2021911322611323810.1109/ACCESS.2021.3104148
    [Google Scholar]
  72. MohammedB.A. Al-ShareedaM.A. ManickamS. Al-MekhlafiZ.G. AlreshidiA. AlazmiM. AlshudukhiJ.S. AlsaffarM. FC-PA: Fog computing-based pseudonym authentication scheme in 5G-enabled vehicular networks.IEEE Access202311185711858110.1109/ACCESS.2023.3247222
    [Google Scholar]
  73. ChenX.B. LiangW.Y. XiJ.T. Orthogonal visual inspection system for end mills wear detection system.C.N. Patent 10,256,431,4B2014.
    [Google Scholar]
  74. QuanY.M. DangX.C. XieD.H. Machine vision-based tool-in-place detection system for machine tools.C.N. Patent 10,282,550,5A2012.
    [Google Scholar]
  75. ZhaoX. WangD.P. YangY. A tool breakage degree based on visual inspection of CNC machine tools detection method.C.N. Patent 10,723,448,8A2017.
    [Google Scholar]
  76. HouQ. SunJ. HuangP. A novel algorithm for tool wear online inspection based on machine vision.Int. J. Adv. Manuf. Technol.20191019-122415242310.1007/s00170‑018‑3080‑9
    [Google Scholar]
  77. LiuJ.C. JiangJ.J. KeX.L. An on-machine visual inspection method for rotary tools and its inspection device inspection device.C.N. Patent 10,918,724,9B2021.
    [Google Scholar]
  78. YangJ.Z. SongS.J. XiangD.Q. A vision-based broken knife detection method and system.C.N. Patent 10,950,065,7A2019.
    [Google Scholar]
  79. YeZ.K. WangY.L. HeY. An intelligent mobile monitoring system for tool damage in the workshop or production line intelligent mobile monitoring system and method for tool damage in workshop or production line.C.N. Patent 11,106,997,6A2020.
    [Google Scholar]
  80. CaoY. ZhangP.G. A tool vision automated inspection system and its operation method method.C.N. Patent 11,173,041,1B2023.
    [Google Scholar]
  81. SuZ.X. WangY. XvS.S. An online tool parameter detection based on computer vision method.C.N. Patent 11,255,854,6A2021.
    [Google Scholar]
  82. ZhangJ. LiuZ. YinJ. Machine vision-based tool type discrimination and geometric parameter Inspection methods and systems.C.N. Patent 11,268,319,3B2022.
    [Google Scholar]
  83. ChenX.Q. MengJ.J. YeX.Y. A CNC machining center tool wear visual online detection system System.C.N. Patent 21,455,950,3U2021.
    [Google Scholar]
  84. WeiW. YinJ. ZhangJ. ZhangH. LuZ. Wear and breakage detection of integral spiral end milling cutters based on machine vision.Materials20211419569010.3390/ma1419569034640087
    [Google Scholar]
  85. LiuJ.C. SuJ.F. ChenY.J. A retractable stereo vision inspection device for cutting tools installation.C.N. Patent 21,783,292,4U2022.
    [Google Scholar]
  86. GeraldW.B. Automated detection system for broken tools in CNC machining centers using advanced machine vision technologies.U.S. 20,050,222,705, A12005.
    [Google Scholar]
  87. LinX.H. LiY. WuS.X. A new energy vehicle motor spindle ai vision inspection equipment.C.N. Patent 21,923,316,5U2023.
    [Google Scholar]
  88. GaoC.H. CaoJ. MaE.G. A kind of automatic inspection equipment for shaft parts based on machine vision equipment.C.N. Patent 21,252,501,3U2021.
    [Google Scholar]
  89. WangP.S. WangQ. A kind of shaft parts visual inspection device.C.N. Patent 21,185,637,9U2020.
    [Google Scholar]
  90. WuF.J. HuangC.H. LinJ.H. A kind of shaft parts visual inspection device.C.N. Patent 20,829,677,5U2018.
    [Google Scholar]
  91. SongS. YangY. ZhuJ.D. A kind of inspection device for long shaft parts based on visual recognition.C.N. Patent 20,740,791,6U2018.
    [Google Scholar]
  92. YeJ.H. HuangW.D. A five-axis CNC machine tool rotary axis error detection equipment.C.N. Patent 20,534,266,7U2016.
    [Google Scholar]
  93. ZhangX.N. WangD. Shaft parts surface defect visual inspection method and device.C.N. Patent 11,588,030,5B2023.
    [Google Scholar]
  94. CaoP. YangY.Y. XiaoX. An online inspection system for shaft dimensions.C.N. Patent 11,294,509,9B2022.
    [Google Scholar]
  95. WuY.C. YanJ.C. A system and method for detecting and predicting vibration anomalies of a motor wheel shaft.C.N. Patent 11,266,926,2B2023.
    [Google Scholar]
  96. DingL.C. LiX. LiuW Binocular vision based error detection of the rotary axis of CNC machine tools methods.C.N. Patent 10,503,325,9B2017.
    [Google Scholar]
  97. SunH.J. JiangH.H. HuangX.M Machine vision-based error detection of the rotary axis on 5-Axis CNC machine tools and measurement methods.C.N. Patent 10,332,322,9A2013.
    [Google Scholar]
  98. WenS. ChenZ. LiC. Vision-based surface inspection system for bearing rollers using convolutional neural networks.Appl. Sci.2018812256510.3390/app8122565
    [Google Scholar]
  99. ZhouY.J. LuoC. SunR.M. Machine vision-based online inspection device and method for chain plate defects.C.N. Patent 10,982,987,6A2019.
    [Google Scholar]
  100. MaoK.J. LiY. ChenX.M. A machine vision-based surface micro-defects of metal parts Detection device.C.N. Patent 11,557,540,1B2023.
    [Google Scholar]
  101. ZhouH. Online inspection method for machine parts based on machine vision.C.N. Patent 11,560,136,1B2023.
    [Google Scholar]
  102. JiangZ. LiZ.G WangL. A high-speed rotating workpiece visual inspection system.C.N. Patent 20,858,004,2U2018.
    [Google Scholar]
  103. ZhuoJ.Q. ZhuoZ.L. HuangC.H. A kind of visual inspection system for fabric defects of double needle bed warp knitting machine System.C.N. Patent 20,930,757,6U2019.
    [Google Scholar]
  104. ZhengS. A non-destructive inspection device for parts based on image vision.C.N. Patent 21,048,764,6U2020.
    [Google Scholar]
  105. WuY. ZhouH. PengZ. Fully automatic mechanical parts visual defect detection equipment.C.N. Patent 21,246,888,2U2021.
    [Google Scholar]
  106. DuL. FeiR.D. LiL.J. A kind of fabric inspection machine based on visual inspection.C.N. Patent 21,258,623,9U2021.
    [Google Scholar]
  107. LiF. An industrial camera vision inspection device for irregular parts.C.N. Patent 21,302,143,8U2021.
    [Google Scholar]
  108. JiangY.Q. PanB.K. A kind of workpiece visual inspection device.C.N. Patent 21,506,620,1U2021.
    [Google Scholar]
  109. ZhouP. ZhangC.C. ZhouG.B. Whole surface defect detection method for bearing rings based on machine vision.Meas. Sci. Technol.2023341
    [Google Scholar]
  110. MuL.T. QuanC. An online visual recognition device for workpiece features of CNC machine tools.C.N. Patent 21,509,244,5U2021.
    [Google Scholar]
  111. LiB. YinX.P. ZhangZ.X. Machine vision based defect detection system for mechanical parts processing system.C.N. Patent 21,586,605,7U2022.
    [Google Scholar]
  112. ZhangY.P. A kind of metal parts processing visual recognition inspection equipment.C.N. Patent 21,750567,1U2022.
    [Google Scholar]
/content/journals/eng/10.2174/0118722121299730240424100312
Loading
/content/journals/eng/10.2174/0118722121299730240424100312
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error
Please enter a valid_number test