The new display industry is an important foundation for strategic emerging information industries.Under the active guidance and continuous investment of various national industrial policies,China's new display industry has rapidly developed and has become one of the most dynamic industries.The industry scale accounts for up to 40％of the global dis-play industry,ranking first in the world.Under the background of the current digital information age,the demand for con-sumer electronics,such as smart phones,tablets,computers,displays,and televisions,in various occasions,is con-stantly rising.This phenomenon results in a yearly rising trend in the global demand for liquid crystal display(LCD)and organic light-emitting diode(OLED)screens and other display panels.The manufacturing process of LCD and OLED is complex,and every stage of the production process will inevitably produce various defects,affecting the visual effect and user experience and even leading to serious quality problems.Fast and accurate defect detection is crucial to improving product quality and production efficiency.Therefore,the defect detection in the production process of LCD and OLED is necessary.This article reviews the research progress of defect detection methods for LCD/OLED based on machine vision in the past 20 years to provide valuable reference.First,the structure and manufacturing process of commonly used TFT-LCD and OLED are given.The defects on the surface of the LCD/OLED are classified in accordance with the causes of defects,defect size,and defect shape.The definitions of the defects are presented,and the causes of the defects are briefly described.The quantitative indicators of defects SEMU and DSEMU are given.The difficulties of surface defect detection of LCD/OLED screens based on machine vision are also explained.This paper focuses on the defect detection methods based on image processing.In actual production,the images to be detected are captured by industrial cameras,and their images are easily affected by noise and light source.First,the image preprocessing of image denoising and image bright-ness correction is introduced.Then,eliminating the interference of texture background before segmentation and localiza-tion of defects is necessary due to the texture background of the collected LCD/OLED images.The repetitive texture back-ground elimination is elaborated,and the defect detection method based on background suppression method is introduced from the three methods of polynomial fitting,discrete cosine transform,and statistical analysis.The measurement stan-dards of background suppression are also presented.Mura defects are characterized by low contrast,blurred edges,and irregular shape.Thus,traditional edge detection and threshold segmentation methods are unsuitable for Mura defect seg-mentation,and achieving reliable detection of Mura defects is difficult.Therefore,improved defect segmentation methods are introduced in three sections:threshold and cluster segmentation,active contour model-based method,and edge and shape detection.The evaluation indexes of defect segmentation effects are also given.Image features are the most basic attributes that characterize an image.One of the methods of defect detection is extracting and classifying local or global fea-tures of images.The defect detection methods based on feature recognition,which extract image features and use tradi-tional machine learning such as support vector machine,support vector data description,fuzzy pattern recognition,and random forest,are explained.Considering the traditional feature extraction method or the classical background reconstruc-tion method,the missing rate of low contrast and small area defects is still substantially high.The traditional defect detec-tion is conducted in multiple steps,which leads to the loss of defect information,resulting in the absence of low contrast defect and restricting the detection accuracy.The poor expression capability of manually extracted features also leads to the limitation of detection accuracy.In recent years,deep learning has achieved remarkable success in object detection,which can achieve fast and accurate target identification and detection.Thus,an increasing number of scholars have applied this method to the defect detection of LCD/OLED.This paper reviews the defect detection methods based on deep learning.According to the number of samples in different periods of production line,unsupervised and supervised learning,as well as transfer learning and defect sample generation methods are summarized.Unsupervised learning based on deep learning includes generative adversarial network and auto-encoder to learn the defect-free samples,reconstruct the defective image in the test,and obtain the residual image for defect detection.Supervised learning requires a large number of defect samples to overcome the problems of texture background interference,different defect sizes,and uneven samples.No pub-lic dataset based on display defects is currently available.This paper summarizes a series of general texture surface defect data sets that can be used for texture-based background defect detection,which can be employed for transfer learning and algorithm universality verification,and evaluation indicators of model performance are introduced.Finally,the existing problems in the current LCD/OLED defect detection methods are identified.Complex background problems are still unavoidable in the detection process due to the detection difficulties caused by the characteristics of Mura defects such as low contrast and blurred edges.Limited datasets and real-time algorithm problems are also encountered.The future research direction is prospected,and important research directions in the future include dataset expansion,sample equal-ization,enhanced algorithm generality,transferable algorithm,deep learning model acceleration,and curved screen defect detection.Such research direction may considerably promote the application of machine vision technology in LCD/OLED defect detection.
NETL
NSTL
万方数据
