Despite the known morphological differences (e.g., brain shape and size) in the brains of populations of different origins (e.g., age and race), the Chinese brain atlas is less studied. In the current study, we developed a statistical brain atlas based on a multi-center high quality magnetic resonance imaging (MRI) dataset of 2020 Chinese adults (18–76 years old). We constructed 12 Chinese brain atlas from the age 20 year to the age 75 at a 5 years interval. New Chinese brain standard space, coordinates, and brain area labels were further defined. The new Chinese brain atlas was validated in brain registration and segmentation. It was found that, as contrast to the MNI152 template, the proposed Chinese atlas showed higher accuracy in hippocampus segmentation and relatively smaller shape deformations during registration. These results indicate that a population-specific time varying brain atlas may be more appropriate for studies involving Chinese populations.