Adaptive decolorization method based on t-SNE maximization
Objective Image decolorization converts a color image into a grayscale one.It aims to maintain important fea-tures of the original color image as much as possible.It is normally used in the preprocessing stage of pattern recognition and image processing systems,such as extracting fingerprint features,face recognition,and medical imaging.Given that image decolorization maps color images in three dimensions into grayscale images in one dimension,it is a dimensionality reduction process essentially.Thus,the loss of information is inevitable.Accordingly,the major task for researchers can be expressed as preserving important features such as contrast,detail information,and hierarchy of the original color image as much as possible.In the process of acquiring grayscale images,the most basic method is to extract the luminance chan-nel of color images directly.However,acquiring only the luminance information tends to lose the contrast details and appearance features of the input image.In recent years,researchers have focused more on whether grayscale images match the perception of color of the human visual system,and many classical image decolorization algorithms have been pro-posed.These color-to-gray conversion methods generally fall into two main categories:local mapping methods and global mapping methods.In the local mapping method,the mapping function is spatially varying,that is,the mapping functions of pixels at different spatial locations often differ.The grayscale image obtained by the local mapping method can keep part of the image structure information and local contrast information.However,such methods tend to lose the overall informa-tion of the image.They can also produce certain phenomena such as halo and noise enhancement.Some researchers have proposed the global mapping method to address the shortcomings of the abovementioned methods.In the global mapping method,the same mapping function is used for the entire image,and the grayscale value is only related to the color of the original color image.However,many of these methods focus excessively on pixels with large amplitude values,which tend to produce visual overfitting and cause difficulty in retaining information in areas with small contrast.A novel image decol-orization method is proposed,in combination with t-distributed stochastic neighbor embedding(t-SNE),to address the problems of insufficient contrast maintenance,blurred details,and lack of hierarchy in grayscale images obtained by the traditional color-to-gray conversion method.This method is simpler and more efficient.Method In this study,considering that t-SNE can better preserve the important features and intrinsic connections of the original high-dimensional spatial data points,we introduce the idea of t-SNE dimensionality reduction into the process of color-to-gray conversion.A new model of color image grayscale is also designed based on t-SNE maximization.In this model,the similarity between any pixel in the original color image is represented by the joint Gaussian probability,while the similarity between any pixel in the corre-sponding grayscale image is represented by the joint Gaussian probability.The energy function is maximized such that the contrast areas of the original color image with less contrast can be appropriately enlarged or maintained after grayscale.Accordingly,the grayscale image can better maintain the contrast characteristics and the sense of hierarchy of the original color image.In addition,an adaptive contrast retention strategy is designed in this study and introduced into the new model to better preserve the details and contrast information of the original color image.The strategy defines a contrast retention coefficient that can adaptively adjust the graying intensity of different regions of the original color image based on the color contrast information.Given that the proposed maximization model is highly nonlinear,the solution using traditional meth-ods such as gradient descent and iterative method will be particularly complex and time consuming.For this reason,we adopt an efficient discrete search strategy to solve the model.It transforms the continuous parameter optimization problem into a discrete parameter space search to quickly obtain grayscale images,which greatly improves the overall efficiency of the model.Result To demonstrate the effectiveness of the proposed method,we conducted an experimental comparison with various other traditional color-to-gray conversion methods on three different types of datasets,namely,Cadik,complex scene decolorization dataset(CSDD),and Color250.Experimental results show that the proposed method can better main-tain the contrast,detail features,and hierarchy of the original color image.For the color contrast preserving ratio(CCPR)metric,the average CCPR values of the proposed method are 0.874,0.862,and 0.864 for the three datasets when the contrast threshold values range from 1 to 15,respectively,which are better than the average CCPR values of the conven-tional grayscale method.Comparing the efficiency of different grayscale methods on the same hardware shows that the method has the shortest running time when inputting a raw color image of size 396 × 386 pixels,which is real-time speed.In addition,volunteers were randomly invited to complete preference experiments and accuracy experiments to more compre-hensively evaluate the visual effects of grayscale images obtained by different grayscale methods.The experiments showed that the volunteers preferred the grayscale images obtained by the proposed method in this study.Therefore,the proposed method in this study was more consistent with the visual perception of human eyes.Conclusion In this study,we analyze the problems of tradi-tional color-to-gray conversion methods and propose an adaptive decolorization method based on t-SNE maximization.The experi-mental data based on three datasets show that the proposed method in this study not only maintains the contrast,detail characteris-tics,and hierarchy of the original color image better but also has better performance in subjective and objective evaluations.
NETL
NSTL
万方数据
