Calculation of Chinese Characters Entropy and Its Scientific Significance
The calculation of entropy of Chinese characters is the prerequisite and foundation for determining the encoding form of Chinese characters.The calculation of entropy of Chinese characters is a cross disciplinary research.The calculation of entropy of characters needs to rely on the information theory,probability theory and Shannon's formula for calculation of the entropy of English letter.The basis of Chinese character encoding is the"channel coding theorem".The first calculation of the entropy of Chinese characters was carried out in the mid-1970s by Chinese scholar Feng Zhiwei through manual operation.This research has important scientific significance.It provides linguistic evidence for the later multi-octal double byte encoding of Chinese character.And it has made important contributions to the rapid development of Chinese information processing technology in China.
information theorychannel encoding theorementropy of Chinese charactersencoding of Chinese characters