Objective To explore the influencing factors of mild cognitive impairment (MCI) in type 2 diabetes patients with poor glycemic control in order to provide the reference for the control and prevention. Methods A total of 181 patients [105 males and 76 females, at an age of(59.0±8.5) years, ranging from 45 to 75] with type 2 diabetes mellitus (T2DM) admitted in the Department of Endocrinology from 2 hospitals from October 2014 to May 2015 were enrolled in this study. Montreal Cognitive Assessment (MoCA) was used to assess the subjects for cognitive impairment, and the influencing factors were analyzed. SPSS statistics 16.0 was used to analyze the data. Student’s t test or Chi-square test were used to compare the differences between groups. Univariate analysis was adopted to obtain the factors affecting the cognitive function of T2DM patients, and then logistic regression analysis was employed to analyze the risk factors for MCI. Results About 52.5% of T2DM patients with poor glycemic control experienced mild cognitive impairment. The univariate analysis showed that age, gender, educational level, monthly income of a family, drinking, smoking, history of cerebral infarction, diabetic peripheral neuropathy, history of hypoglycemia and ratio of albumin to creatinine (A/C) were related with MCI (P<0.05). The multivariate logistic regression analysis indicated that age was positively correlated with MCI (OR=1.437, 95%CI 1.017-2.029, P<0.05), while educational level and history of hypoglycemia were negatively correlated with MCI (OR=0.326, 95%CI 0.197-0.539, P<0.05; OR=0.400,5%CI 0.167-0.958, P<0.05). Conclusion Physicians should pay attention to the cognitive function in the T2DM patients with poor glycemic control, and take various measures to slow the cognitive decline.