Three different conditions of a gear, normal condition, crack in root of tooth, broken-tooth, are diagnosed by calculating the correlation dimension in the fractal theory. In order to weaken the effect of the noise on the precision of calculating , a new approach to filter based on EMD is put forward to pre-conduct the signal sampled. Through experiment with a gear box, this method is proved to be feasible and valid.