Aiming at the problem that the current face relighting algorithm can not accurately reflect the face reflection,a face image specular removal algorithm and a relighting algorithm based on the improved Phong illumination model are proposed.The algo-rithm includes three parts.1)According to the illumination model,rendered synthetic data to train the neural network to remove highlights.2)The semi-supervised learning is used to transfer the ability of specular removal to real faces.3)After specular remov-al,face image is decomposed into components related to illumination and component unrelated to illumination.The component relat-ed is replaced to illumination ande the image is recombined to achieve face illumination.Experimental results show that the im-proved algorithm can improve the relighting accuracy and visual effect.