The hydropower generating units' vibration parameter is an important index to monitor its operating stability. To measure the low-frequency vibration of the large and middle scale of hydropower generating units, according to frequency characteristic compensation principle of the vibration sensor, a low-frequency compensating circuit is designed to extend the frequency characteristics to the low frequency region. To make the design of compensating circuit convenient, the equivalent quality factor Q is brought in. The mathematical model of the magnetoelectric vibration sensor and the design of the compensation circuit are described in detail. The amplitudefrequency characteristics of the sensor and its mathematical model are comparatively analyzed before and after compensation respectively. The experimental result shows that the design could extend the amplitude-frequency characteristics to the low frequency region, and have good stability and linearity.