The source verification of freight transportation is the key to conducting source overload control.The traditional method relies on ledger statistics has the shortcomings of being time-consuming and labor-intensive.Compared to the method,remote sensing technology has the advantages of wide area coverage which effectively improve work efficiency for freight source verification.Among them,interpreting symbols is an important basis for analyzing and applying the source of freight transportation using remote sensing images.However,no remote sensing interpretation sample library for freight sources is publicly available currently.Thus,this paper proposed a YOLOX based method for establishing remote sensing interpretation sample library of freight sources.Firstly,based on the verification standards of freight sources,a standard for establishing the interpretation sample library for four types of freight source stations and four types of enterprises was proposed.Then,an automatic detection method for remote sensing images of freight sources was established based on YOLOX.The experimental results were compared with the results of expert interpretation.The AP values of the proposed method for identifying railway freight yards,ports,ores,and sand and gravel enterprises were all above 0.50.The results prove that the method can realize automatically establishment of a remote sensing interpretation sample library for freight sources,which provide technical support for freight source verification using remote sensing images,and significantly improve the efficiency of freight source verification work.