Objective To investigate the effect of proprioception training on rehabilitation of the elderly patients with decreased walking ability. Methods A total of 68 elderly patients with decreased walking ability were selected for the study, who were hospitalized in Xijing Hospital of Air Force Medical University from March 2017 to July 2019, and they were randomized into study group and control group (34 patients each). The control group received conventional training in walking ability, while the study group received additional proprioception training. The two groups were compared in changes in Holden′s functional ambulation classification (FAC), Berg balance scale (BBS), passive position sense (PAPS) and gait speed (GS) before and 8 weeks after the treatment. SPSS statistics 23.0 was used for data analysis. Student t-test, rank test andχ² test were performed for comparison between the two groups. Results FAC, BBS, PAPS and GS of the two groups were significantly improved after treatment (all P<0.01), and there was no statistically significant difference in the incidence of falls (P＞0.05). After treatment, FAC [4(3,5) vs 3(3,4)points; P=0.023] and BBS [(48.5±3.5) vs (45.6±4.2)points; P= 0.002] of the study group were significantly higher than those of the control group. After 8 weeks of treatment, the required walking time of 10m in the study group was significantly lower than that of the control group [ (11.0±2.1) vs (12.4±2.5)s; P=0.014]. The study group had significantly lower PAPS value than the control group [1(1,1) vs 2(2,3)degree; P＜0.001]. Conclusion Proprioception training combined with conventional treatment is more effective than conventional treatment in the elderly patients with decreased walking ability and can effectively improve their walking function, balance ability and proprioception of lower limb joints, contributing to the reduced risk of fall and the improved rehabilitation of the elderly patients.