Skip to main content

Hyperglycemia screening based on survey data: an international instrument based on WHO STEPs dataset

Abstract

Background

Hyperglycemia is rising globally and its associated complications impose heavy health and economic burden on the countries. Developing effective survey-based screening tools for hyperglycemia using reliable surveillance data, such as the WHO STEPs surveys, would be of great importance in early detection and/or prevention of hyperglycemia, especially in low or middle-income regions.

Methods

In this study, data from the nationwide 2016 STEPs study in Iran were used to identify socioeconomic, lifestyle, and metabolic factors associated with hyperglycemia. Furthermore, the ability of five commonly used machine learning algorithms (random forest; gradient boosting; support vector machine; logistic regression; artificial neural network) in the prediction of hyperglycemia on STEPs dataset were compared via tenfold cross validation in terms of specificity, sensitivity, and the area under the receiver operating characteristic curve.

Results

A total of 17,705 individuals were included in this study, of those 29.624% (n = 5245) had (undiagnosed) hyperglycemia. Multivariate logistic regression analysis showed that older age (for the elderly group: OR = 5.096; for the middle-aged group: OR = 2.784), high BMI status (morbidly obese: OR = 3.465; obese: OR = 1.992), having hypertension (OR = 1.647), consuming fish more than twice per week (OR = 1.496), and abdominal obesity (OR = 1.464) were the five most important risk factors for hyperglycemia. Furthermore, all the five hyperglycemia prediction models achieved AUC around 0.70, and logistic regression (specificity = 70.22%; sensitivity = 70.2%) and random forest (specificity = 70.75%; sensitivity = 69.78%) had the optimal performance.

Conclusions

This study shows that it is possible to develop survey-based screening tools for early detection of hyperglycemia using data from nationwide surveys, such as WHO STEPs surveys, and machine learning techniques, such as random forest and logistic regression, without using blood tests. Such screening tools can potentially improve hyperglycemia control, especially in low or middle-income countries.

Peer Review reports

Background

Hyperglycemia is a metabolic disorder characterized by a high level of blood glucose, which in the intermediate stages appears in disguise of prediabetes—i.e. presence of impaired fasting blood glucose (IFG) and/or impaired glucose tolerance (IGT), or high glycated hemoglobin (HbA1c)—and could develop to diabetes mellitus (DM) if untreated [1]. Hyperglycemia is rising globally. Recent estimations show that 1 in 11 adults aged 20–79 have diabetes (463 million), and the global prevalence of IGT is estimated to be 7.5% (374 million) in 2019, accounting for 1 in 13 adults, and is projected to reach 8.0% (454 million) by 2030 and 8.6% (548 million) by 2045 [1, 2].

It is well-known that hyperglycemia is a precursor to a wide spectrum of non-communicable diseases (NCDs) such as DM, (cardio)vascular complications, diabetic retinopathy, and chronic kidney disease [1, 3]. These health complications in conjunction with the economic burden they impose on the countries necessitate serious measures for early detection and/or prevention of hyperglycemia [4]. To help better healthcare policymaking in this regard and to provide the information necessary for prevention programs, the STEPwise approach to surveillance (STEPs instrument) was proposed by the World Health Organization (WHO) as a standard and sustainable framework for collecting national data on risk factors of NCDs such as hyperglycemia [5, 6].

Several studies have documented an increasingly high prevalence of hyperglycemia in Iran. A recent study has reported the prevalence of prediabetes and diabetes 25.8% and 16.1% respectively among adults aged 20–69 years living in Yazd Province, Iran [7]. Another similar study has reported prevalence of prediabetes and diabetes 30.8% and 15.3% respectively among Iranian adults aged 20–65 living in Khuzestan Province, Iran, between 2016 and 2018 [8]. National surveys, conducted based on WHO STEPs instrument between 2005 and 2011, estimate 1 in 4 Iranian adults suffers from clinically significant abnormalities in glucose metabolism, and there has been a 5% annual increase in diabetes prevalence from 2005 to 2011. It is estimated that nearly 9.2 million Iranians are likely to have diabetes by 2030, and direct and indirect costs of diabetes alone will nearly triple from 2009, surpassing $9 billion in 2030 [4]. In developing countries like Iran, economic and financial restrictions to fully conduct national prevention programs, insufficient insurance coverage for laboratory and advanced technology diagnostics, and low access to standard diagnostic facilities in rural healthcare centers are amongst the main obstacles in controlling hyperglycemia [4]. Thus, developing simple and inexpensive screening tools for hyperglycemia would be of great importance.

Over the past few years, applications of machine learning (ML) in the screening and/or diagnosis of glycemic-based disordered have been well investigated. While most of the work in this area has focused on screening and/or diagnosis of diabetes [9, 10], there has also been some recent interest in shifting the focus towards hyperglycemia prediction as a precursor to diabetes. For instance, Choi et al. [11] and Deberneh et al. [12] have developed intelligence-based screening tools for hyperglycemia in the Korean population, demonstrating that ML methods can be useful in screening hyperglycemia. In another similar study, De Silva et al. [13] have employed ML techniques to identify predictors of hyperglycemia using a nationally representative sample of the US population.

In the present work, we aim to apply the five commonly used ML techniques (random forest; gradient boosting; support vector machine; logistic regression; artificial neural network) to the data from the nationwide 2016 STEPs study in Iran to identify non-invasive factors associated with hyperglycemia and develop predictive ML models using these factors. As a result, we propose ML predictive models for survey-based hyperglycemia screening, which can assist healthcare systems, especially in low or middle-income countries.

The structure of the paper is as follows: The mythology of the investigation is discussed in Methodology. The results are presented in Study population and discussed in Variable definitions and cutoff points. The conclusion of the paper is presented in Data analysis methods.

Methodology

Study population

Data from the latest Surveillance of Risk Factors of Non-communicable Disease (STEPs study) in Iran, conducted in 2016 based on WHO STEPs instrument, were used in this study [6]. The data comprise a sample of size n = 30,541 of Iranian population aged 18 and over, collected via cluster sampling from all provinces of Iran (except Qom province) in 2016; details of the Iran 2016 STEPs survey are discussed in [6, 14]. The final dataset used for analysis was formed from the original dataset according to the following inclusion–exclusion criteria: Participant for whom 1) Blood sugar measurements (fasting blood sugar (FBS) or HbA1c) were not provided, or 2) have already been diagnosed with hyperglycemia, or 3) have been taking medication for raised blood sugar, were excluded from the study. Pregnant women were also excluded from the study as their anthropometric measurements were not provided. The number of individuals who met the inclusion–exclusion criteria was 17,705, of which 12,460 (70.4%) had normal blood sugar, and 5245 (29.6%) had (undiagnosed) hyperglycemia. The baseline characteristics of the sample are presented in Table 1.

Table 1 Socioeconomic characteristics of the study participants

Variable definitions and cutoff points

Blood sugar level was determined based on FBS measurements in mg/dl, or HbA1c values. Hyperglycemia (the outcome variable) was defined as FBS ≥ 110 mg/dl according to WHO criterion [15], or HbA1c ≥ 5.7% according to the American Diabetes Association HbA1c criterion [3].

The 18 non-invasive principal input variables were selected based on the literature or their statistical significance in the univariate analysis. The principal input variables comprise socioeconomic variables, lifestyle variables (dietary pattern; smoking and alcohol consumption; physical activity), and metabolic risk factors (body-mass-index (BMI) status; abdominal obesity (AO); blood pressure (BP) status, hypertension history; having hypercholesterolemia (HC); history of HC).

Socioeconomic variables include: Living area (Urban/Rural); Gender (Male/Female); Age group (Teenager (age < 20); Young (age 20–45); Middle-aged (age 45–60); Elderly (age ≥ 60)); Income level (Very low; Low; Middle class; Upper-middle-class or higher); Education level (Illiterate; Elementary school; High school; Academic); Marital status (Married/Single); and Family type (Armed force households/Others).

Dietary pattern was determined using diet health level and fish consumption. Diet health level (poor diet; risky diet; healthy diet) was determined based on diet health score (DHS) in the range 0–12, calculated as the sum of the scores in the range 0–2 of six items (daily fruit/vegetable/dairy consumption; oil type used for cooking; salt consumption in each meal; monthly fast food consumption) according to IraPEN instructions [16]. Poor diet was defined as DHS < 5, risky diet was defined as DHS equal to 5 or 6, and healthy diet was defined as DHS ≥ 7. Fish consumption was determined based on weekly consumption in three categories (never/rarely; once or twice per week; more than twice per week).

Smoking status was defined based on daily cigarette smoking status at three levels: Non-smoker; former smoker; current smoker. Alcohol consumption was categorized as regular drinking (i.e. drinking at least 3 times per month) and non-regular drinking (including alcohol abstinence). Physical activity (PA) status was determined at four levels (low; moderate; high; intensive) based on weekly physical activity measured in MET-minutes using the Global Physical Activity Questionnaire [17]. Low/insufficient PA was defined as PA less than 600 MET-minutes per week; Moderate PA was defined as PA in the range 600–1500 MET-minutes per week; High PA was defined as 1500–3000 MET-minutes per week; Intensive PA was defined as PA at least 3000 MET-minutes per week [18].

BMI status was determined based on BMI values—calculated as weight measured in kilograms (kg) divided by the square of height measured in meters (m)—at five levels [19]: Underweight (BMI < 18.5); Normal BMI (18.5 ≤ BMI < 25); Overweight (25 ≤ BMI < 30); Obese (30 ≤ BMI < 40); Morbidly obese (BMI ≥ 40). Waist circumference (WC) and hip circumference were measured in cm. Abdominal obesity was defined based on WC or waist-to-hip ratio (WHR) criterion [19]: WC > 102 or WHR ≥ 90 for men, and WC > 88 or WHR ≥ 0.85 for women.

BP status was determined based on systolic blood pressure (SBP) and diastolic blood pressure (DBP), measured in mmHg, in three categories [20]: Normal BP (SBP < 120 and DBP < 80); Prehypertension (120 ≤ SBP < 140 or 80 ≤ DBP < 90); Hypertension (SBP ≥ 140 or DBP ≥ 90, or taking antihypertensive drugs). Pulse rate (PR) was defined as the number of heartbeats per minute. Pulse pressure (PP) was defined as \({\text{SBP}} - {\text{DBP}}\), and mean arterial blood pressure (MAP) was defined as \({{\left( {{\text{SBP}} + 2{\text{DBP}}} \right)} \mathord{\left/ {\vphantom {{\left( {{\text{SBP}} + 2{\text{DBP}}} \right)} 3}} \right. \kern-\nulldelimiterspace} 3}\). Hypertension history was defined as being diagnosed with high BP by a medical expert in the past. Having hypercholesterolemia (HC) was defined as being diagnosed with HC by a medical expert or taking medication for HC within the last year. Being diagnosed with HC in the past was defined as having an HC history.

Data analysis methods

Statistical analysis of the data was performed by STATA v16.0 and statsmodels v0.13.1 module in Python. Categorical variables were presented by absolute frequency (n) and relative frequency (%), and were analyzed by Pearson's chi-squared test. Numerical variables were presented by mean ± standard deviation (SD) and were analyzed by Welch's ANOVA test. Multivariate logistic regression analysis was used to assess the simultaneous effect of the principal variables on the outcome variable (i.e. blood sugar status). In all the statistical tests a p-value less than 0.05 (p < 0.05) was regarded as statistically significant.

Data cleaning and preprocessing

The dataset was thoroughly checked for the presence of inconsistencies or missing values. Inconsistences in the data were corrected according to the instructions in WHO STEPs Analysis Programs Documentation [21]. Missing values were imputed by the most frequent value (mode) for categorical variables, and mean value for numerical variables. Numerical variables were scaled via robust scaling technique, in which the values of each numerical variable are subtracted from their median and are divided by the interquartile range to reduce the effect of the outliers.

Machine learning

Five commonly used machine learning algorithms—Random Forest (RF), Extreme Gradient Boosting (XGBoost), Support Vector Machine (SVM), Logistic Regression (LR), and Artificial Neural Network (ANN)—were developed to predict hyperglycemia. To optimize the performance of the models, hyperparameter optimization was done using the Bayesian optimization technique, as implemented in Python library scikit-optimize v0.8.1, with fivefold cross validation.

The Python machine learning library scikit-learn v0.24 was used to develop LR, RF, and SVM models. The XGBoost open-source software was employed to develop the XGBoost model. The ANN models were developed via Keras, the Python deep learning library, with 1 hidden layer (ANN1) and 2 hidden layers (ANN2) separately. The number of neurons in each hidden layer was determined via hyperparameter tuning while fitting the model. The ReLU function was used as the activation function for the input and hidden layers, and the sigmoid function was used as the activation function for the output layer. For training the ANN models, the categorical cross-entropy loss function was used, and the weights were optimized using Adam optimizer through 200 epochs.

For each of the five ML algorithms, four types (A, B, C, and D) of models were developed: Models of Type A are the baseline models built using the 18 principal input, ordinal encoded, categorical variables. Models of Type B were developed using dummy encoding of the principal input variables. Models of Type C and Type D are similar to models of type A and Type B respectively except that some additional numerical variables (age; the age of quitting smoking; log transform metabolic equivalent of task (MET); BMI; WC; WHR; pulse rate; pulse pressure; MAP) were included in the respective models.

Model validation

The performance of the models was estimated via tenfold cross validation, and the mean ± SD value for performance metrics across the folds, as well as 95% confidence intervals (CI), were reported. The metrics used to measure the performance of the models include accuracy (Acc), specificity (SP), sensitivity (SN), and F1-score defined as follows in terms of the true positive (TP), false positive (FP), true negative (TN), and false negative (FN) cases [22]:

$$\begin{array}{c}\mathrm{Acc}=\frac{\mathrm{TN}+\mathrm{TP}}{\mathrm{TN}+\mathrm{TP}+\mathrm{FN}+\mathrm{FP}},\\ \begin{array}{c}\mathrm{SP}=\frac{\mathrm{TN}}{\mathrm{TN}+\mathrm{FP}},\\ \begin{array}{c}\mathrm{SN}=\frac{\mathrm{TP}}{\mathrm{TP}+\mathrm{FN}},\\ \mathrm{F}1=\frac{\mathrm{TP}}{\mathrm{TP}+\frac{1}{2}\left(\mathrm{FP}+\mathrm{FN}\right)}.\end{array}\end{array}\end{array}$$

The model performances were also compared in terms of the area under the receiver operating characteristic curve (AUC), which summarizes model performances in terms of sensitivity and specificity [22].

Results

Characteristics of the study participants

A total of 17,705 individuals with mean ± SD age 45.57 ± 15.263 were included in this study. The socioeconomic characteristics of the study participants are presented in Table 1. According to the table, almost half of the subjects were female (52.62%) and were young (52.28%), and most of the subjects were urban-dwellers (63.95%) and were married (82.27%).

The lifestyle and metabolic characteristics of the study participants are presented in Tables 2 and 3 respectively. According to the tables, around 70% of the subjects had unhealthy (poor or risky) diet, whereas a relatively low prevalence of current smoking (9.78%), regular alcohol drinking (0.83%), and low PA (13.75%) was observed among the subjects. Only 29.89% of the subjects had normal BMI, and 70.58% of the subjects were suffering from AO. More than half (66.59%) of the subjects had high BP, and 10.92% were suffering from HC.

Table 2 Lifestyle characteristics the study participants
Table 3 Metabolic characteristics of the study participants

The mean FBS of the subjects was 92.719 ± 20.804 mg/dl and the mean value for HbA1c was 5.485 ± 0.629. The prevalence of hyperglycemia in the sample was 29.624% (n = 5245), and the prevalence of hyperglycemia among men (30.11%) was slightly higher than women (29.19%), although the difference was not statistically significant. The mean age of the participants was 45.57 ± 15.263, and the mean age of the hyperglycemic subjects (54.36 ± 14.83) was significantly (p < 0.0001) higher than the mean age of the non-hyperglycemic subjects (41.874 ± 13.865).

Predictors of hyperglycemia

The result of the multivariate logistic regression analysis for identifying significant predictors of hyperglycemia is presented in Table 4. Among the socioeconomic factors, gender, age group, and education level were significantly associated with hyperglycemia. While male gender (OR = 1.101) and older age (for the elderly group: OR = 5.096; for the middle-aged group: OR = 2.784) were identified as risk factors for hyperglycemia, higher education level was identified as a protective factor against hyperglycemia (for academic level: OR = 0.767; for high school level: OR = 0.851).

Table 4 Multivariate logistic regression analysis: Significant predictors of hyperglycemia

Among the lifestyle factors, consuming fish more than twice per week (OR = 1.496), and current smoking (OR = 1.306) were identified as significant risk factors for hyperglycemia, whereas intensive PA was found to be a protective factor against hyperglycemia (OR = 0.038). As for metabolic factors, the results indicate that having abnormal BMI and high BP are significantly associated with increased odds of having hyperglycemia. It was also found that subjects with abdominal obesity (OR = 1.464) and HC (OR = 1.27) are more likely to have hyperglycemia.

Model performances

Five commonly used ML algorithms (RF; XGB; SVM; LR; ANN) were used for the prediction of hyperglycemia, and for each algorithm, four types of models (A, B, C, and D) were developed depending on the method of encoding used for categorical variables and inclusion of the numerical variables in the models. Among the four types of models developed for each ML algorithm, the RF Type D, XGB Type D, SVM Type C, LR Type C, ANN1 Type C, and ANN2 Type D were selected as the optimal models in terms of AUC, SN, and SP. The performance of the optimal models is presented in Table 5 and is compared in Fig. 1. The highest accuracy and specificity were achieved by RF Type D (Acc = 70.47%; SP = 70.75%) and LR Type C (Acc = 70.21%; SP = 70.22%) respectively. The highest sensitivity was achieved by XGB Type C (SN = 72.58%) and ANN2 Type D (SN = 71.52%) respectively. The AUC of all models was around 0.7, but the XGB Type D (0.7048) and RF Type C (0.7027) achieved the highest AUC respectively. Although all the models had similar performance in terms of AUC, the RF Type D and LR Type C were selected as the optimal models for predicting hyperglycemia as they had the optimal balanced performance in terms of AUC, specificity, and sensitivity.

Table 5 Performance of the optimal models via tenfold cross validation
Fig. 1
figure 1

Performance of the optimal models

Discussion

In this study, the data of 17,705 records from the nationwide 2016 STEPs study in Iran were used for identifying socioeconomic, lifestyle, and metabolic factors associated with hyperglycemia. Furthermore, prediction models for the diagnosis of hyperglycemia were developed using five ML algorithms, and their performance was compared using tenfold cross validation in terms of accuracy, specificity, sensitivity, and AUC.

Factors associated with hyperglycemia

Multivariate logistic regression analysis showed that socioeconomic factors (gender; age group; education level), lifestyle factors (weekly fish consumption; daily smoking), and metabolic factors (BMI status; abdominal obesity; BP status; having HC) were significantly associated with hyperglycemia. The five most influential risk factors were older age (for the elderly group: OR = 5.096; for the middle-aged group: OR = 2.784), high BMI status (morbidly obese: OR = 3.465; obese: OR = 1.992), having hypertension (OR = 1.647), consuming fish more than twice per week (OR = 1.496), and abdominal obesity (OR = 1.464).

The direct association between age and risk of having hyperglycemia, as well as the significant role of metabolic risk factors, such as obesity, (pre)hypertension, and having HC, in having hyperglycemia is quite well-established in the literature [3, 8, 23, 24].

The results of the study showed that men are slightly more susceptible to hyperglycemia than women (OR = 1.101), which is in accordance with several previous studies in Iran [8, 25], and the South Korean population [24]. The observation that higher education is protective against hyperglycemia has also been confirmed by several other studies in Iran [8, 25], but in a study based on the South Korean population, no significant association between education level and hyperglycemia have been reported [24].

Univariate and multivariate analysis did not show a significant association between the living area and hyperglycemia. However, some studies in Iran and other countries have confirmed that diabetes is more prevalent in urban areas whereas prediabetes is more prevalent in rural areas [8]. Although a significant association (p = 0.0149) between income level and hyperglycemia was observed in the univariate analysis, the multivariate logistic regression analysis did not show a significant association in presence of other factors. This observation is consistent with [24] but inconsistent with some other studies which show a direct association between income level and blood glucose level [2]. The observation that the prevalence of hyperglycemia is significantly higher (p < 0.0001) among married (30.24%) than single (26.76%) subjects is consistent with some studies in Iran [26]. However, no significant association between marital status and hyperglycemia was found in the multivariate analysis in presence of other factors, which contrasts some reports which suggest being single is protective against hyperglycemia [25].

We did not find a significant association between diet health levels, determined using IraPEN guidelines, with hyperglycemia. However, frequent fish consumption (more than twice per week) was found to be a significant risk factor for hyperglycemia (OR = 1.496). Inconsistent with this observation, some studies have not reported a significant association between fish consumption and diabetes [27], and some studies have reported an inverse relationship between fish consumption and the risk of diabetes [28]. These inconsistencies can in part be explained by the differences in the quantity and type of fish consumed, and also the differences in cooking methods in different food cultures [27, 29].

Multivariate regression analysis showed that subjects with intensive weekly PA are less likely to have hyperglycemia compared to those with low PA (OR = 0.871). Several studies have also reported the benefits of physical activity in the prevention of hyperglycemia [3, 30].

The role of smoking as a significant risk factor for hyperglycemia has been confirmed by many previous studies [8, 24], and a similar result was obtained in the present study. As for alcohol consumption, although hyperglycemia was found to be significantly more prevalent (p = 0.0108) among regular alcohol drinkers, no significant association between alcohol consumption and hyperglycemia was found in multivariate logistic regression analysis in the presence of other factors, which is contrary to the findings of some similar studies [23, 24, 31]. This inconsistency may in part be explained by a different pattern of alcohol consumption in Iran due to cultural and religious considerations.

Prediction models for hyperglycemia

Among the models developed using the five ML algorithms, the LR Type C (AUC = 0.7021; SP = 70.22%; SN = 70.20%) and RF Type D (AUC = 0.7027; SP = 70.75%; SN = 69.78%) had the optimal balanced performance in terms of AUC, sensitivity, and specificity.

Logistic regression has previously been proposed as an optimal model for the prediction of hyperglycemia in several similar studies. In a study based on data from Tehran Lipid and Glucose Study in Iran [32], the proposed LR model (AUC = 0.71; SP = 65.58%; SN = 71%) was reported to outperform the ANN model in the diagnosis of hyperglycemia, similar to the findings of the present study. In several studies based on the Finnish Diabetes Risk Score, the sensitivity of the proposed LR models, using various combinations of variables, in the diagnosis of prediabetes was reported in the range 60–84%, whereas their specificity was reported in the range 53–61% [33, 34]. In comparison, the proposed LR Type C model in the present study seems to have a more balanced performance in terms of both specificity and sensitivity.

Several similar studies have also proposed the RF algorithm as an optimal algorithm for the prediction of hyperglycemia. In a study based on a nationally representative sample of the US population [13], a model based on RF (AUC = 0.7001; SP = 59.22%; SN = 72.33%) was reported to outperform LR, SVM, ANN, and gradient boosting algorithms in the prediction of prediabetes. Another study based on data from the South Korean population [12], compared predictive power of RF, SVM, LR, and XGBoost for prediabetes, and reported a similar performance for all the models, with slightly better performance for SVM (Acc = 73%; SN = 74%) and RF (Acc = 73%; SN = 72%) models. In comparison, the proposed RF Type D model in the present study seems to have a similar predictive power without using biochemical variables (such as triglycerides, uric acid) unlike the two aforementioned models [12, 13].

Maeta et al. [35] in a study based on data from a single facility in Tokyo, Japan, compared the performance of XGBoost and LR algorithms in the prediction of prediabetes using various combinations of features, including blood sugar measurements, and concluded that the XGBoost algorithm (AUC = 0.90; SN = 40.4%; SP = 97.4%) outperforms LR algorithm. In comparison, the proposed XGBoost model in the present study has lower AUC (0.7048) and specificity (68.37%), but has achieved a higher sensitivity (72.58%), and seems to have a more balanced performance in terms of sensitivity and specificity without using blood sugar measurements as an input variable.

Models based on the SVM algorithm were reported to perform better than the LR model in the prediction of prediabetes in some studies. Choi et al. [11] in a study based on the South Korean population compared the predictive power of SVM, ANN, and LR in the prediction of prediabetes, and reported SVM (AUC = 0.731; SP = 65.3%; SN = 69.4%) as the optimal model. In comparison, the SVM Type C model presented in this study has a lower AUC (0.7012) but has better performance in terms of SP (69.85%) and SN (70.39%). In another study based on data of 6500 subjects from 2005–2009 STEPs study in the Hamadan province, Iran, Tapak et al. [36] reported that the SVM algorithm (AUC = 0.979; SP = 100%; SN = 82%) outperforms LR and ANN algorithms in the prediction of hyperglycemia.

Although many studies, in accordance with the findings of the present study, have reported a weaker performance of ANN models in the prediction of hyperglycemia [13, 32], in a study by Liu et al. [9] the ANN model was reported to outperform LR and decision tree algorithm in the prediction of diabetes.

Limitations

The present study has two main limitations. Firstly, at the time of preparing this work data from Iran's 2021 STEPs study, as well as STEPs studies conducted before 2016, were not available from National Institute for Health Research, Iran. These additional data could have been used for external validation, as well as developing more robust models. Another limitation is concerning the performance of the prediction models. Although all the proposed models achieved a fair performance (AUC ≥ 0.70), further performance improvement is necessary. Several studies have confirmed that prediction of hyperglycemia is more difficult than diabetes alone [11, 12], and the main reason for this seems to be the class overlap problem [37], caused by the similarity between characteristics of healthy and patients with prediabetes [12]. Therefore, developing techniques to overcome the class overlap problem in the context of hyperglycemia prediction seems to be necessary for significant improvement in prediction models.

Conclusion

This study shows that it is possible to develop survey-based screening tools for early detection of hyperglycemia using data from nationwide surveys, such as WHO STEPs surveys, and machine learning techniques, such as random forest and logistic regression, without using blood tests. Such screening tools can potentially improve hyperglycemia control, especially in low or middle-income countries.

Availability of data and materials

The data that support the findings of this study are available from the National Institute for Health Research of Iran (NIHR) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. However, the data are available from the corresponding author upon reasonable request and with permission of NIHR.

Abbreviations

Acc:

Accuracy

ANN:

Artificial neural network

AO:

Abdominal obesity

AUC:

Area under the receiver operating characteristic curve

BP:

Blood pressure

BMI:

Body mass index

CI:

Confidence interval

DM:

Diabetes mellitus

FBS:

Fasting blood sugar

HC:

Hypercholesterolemia

LR:

Logistic regression

OR:

Odds ratio

PA:

Physical activity

RF:

Random forest

SD:

Standard deviation

SN:

Sensitivity

SP:

Specificity

SVM:

Support vector machine

XGBoost:

Extreme gradient boosting

References

  1. Hostalek U. Global epidemiology of prediabetes - present and future perspectives. Clin Diabetes Endocrinol. 2019;5(5):1–5.

    Google Scholar 

  2. Saeedi P, Petersohn I, Salpea P, Malanda B, et al. Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: Results from the International Diabetes Federation Diabetes Atlas, 9th edition. Diabetes Res Clin Pract. 2019;157:107843. https://doi.org/10.1016/j.diabres.2019.107843.

  3. American Diabetes Association. 2. Classification and Diagnosis of Diabetes: Standards of Medical Care in Diabetes-2020. Diabetes Care. 2020;43(Suppl 1):S14-S31.https://doi.org/10.2337/dc20-S002. 

  4. Noshad S, Afarideh M, Heidari B, Mechanick JI, Esteghamati A. Diabetes Care in Iran: Where We Stand and Where We Are Headed. Ann Glob Health. 2015;81(6):839–50.

    Article  Google Scholar 

  5. WHO. STEPwise approach to surveillance (STEPS) [cited 2021]. Available from: https://www.who.int/ncds/surveillance/steps/en/.

  6. Djalalinia S, Modirian Sheidaei A, Yoosefi M, Zokaiee H, Damirchilu B, Mahmoudi Z, et al. Protocol Design for Large-Scale Cross-Sectional Studies of Surveillance of Risk Factors of Non-Communicable Diseases in Iran: STEPs 2016. Arch Iran Med. 2017;20(9):608–16.

    Google Scholar 

  7. Mirzaei M, Rahmaninan M, Mirzaei M, et al. Epidemiology of diabetes mellitus, pre-diabetes, undiagnosed and uncontrolled diabetes in Central Iran: results from Yazd health study. BMC Public Health. 2020;20:166. https://doi.org/10.1186/s12889-020-8267-y.

    Article  CAS  Google Scholar 

  8. Hariri S, Rahimi Z, Hashemi-Madani N, et al. Prevalence and determinants of diabetes and prediabetes in southwestern Iran: the Khuzestan comprehensive health study (KCHS). BMC Endocr Disord. 2021;21:135. https://doi.org/10.1186/s12902-021-00790-x.

    Article  CAS  Google Scholar 

  9. Liu S, Gao Y, Shen Y, et al. Application of three statistical models for predicting the risk of diabetes. BMC Endocr Disord. 2019;19:126. https://doi.org/10.1186/s12902-019-0456-2.

    Article  CAS  Google Scholar 

  10. Pei D, Gong Y, Kang H, et al. Accurate and rapid screening model for potential diabetes mellitus. BMC Med Inform Decis Mak. 2019;19:41. https://doi.org/10.1186/s12911-019-0790-3.

    Article  Google Scholar 

  11. Choi SB, Kim WJ, Yoo TK, Park JS, Chung JW, Lee YH, Kang ES, Kim DW. Screening for prediabetes using machine learning models. Comput Math Methods Med. 2014;2014:618976. https://doi.org/10.1155/2014/618976.

  12. Deberneh HM, Kim I. Prediction of Type 2 Diabetes Based on Machine Learning Algorithm. Int J Environ Res Public Health. 2021;18(6):3317.

    Article  Google Scholar 

  13. De Silva K, Jönsson D, Demmer RT. A combined strategy of feature selection and machine learning to identify predictors of prediabetes. J Am Med Inform Assoc. 2020;27(3):396–406.

    Article  Google Scholar 

  14. Ministry of Health and Medical Education (Iran), National Institute of Health Research, Ministry of Health and Medical Education (Iran), Tehran University of Medical Sciences. Atlas of Non-Communicable Diseases Risk-Factors Surveillance in the Islamic Republic of Iran (STEPs 2016)2016. Available from: https://www.who.int/ncds/surveillance/steps/STEPS_2016_Atlas_EN.pdf.

  15. World Health Organization & International Diabetes Federation. Definition and diagnosis of diabetes mellitus and intermediate hyperglycaemia : report of a WHO/IDF consultation. World Health Organization; 2006. https://apps.who.int/iris/handle/10665/43588.

  16. Hadavandsiri F, Khalili D, Hashemi Nazari SS, Ostovar A, Mahdavi A. Adherence to Iran’s Package of Essential Noncommunicable Diseases (IraPEN) Program for Regular Follow-up to Reduce the Risk of Cardiovascular Disease in Healthcare Centers. Iranian Journal of Endocrinology and Metabolism. 2020;22(2):116–26.

    Google Scholar 

  17. Armstrong T, Bull F. Development of the World Health Organization Global Physical Activity Questionnaire (GPAQ). J Public Health. 2006;14:66–70.

    Article  Google Scholar 

  18. Guidelines for data processing analysis of the International Physical Activity Questionnaire (IPAQ) - Short and long forms. 2005. [2015-01-29]. webcite http://www.ipaq.ki.se/scoring.pdf.

  19. World Health Organization. Waist circumference and waist-hip ratio: report of a WHO expert consultation. Geneva: World Health Organization; 2008.

    Google Scholar 

  20. Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, et al. Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure. Hypertension. 2003;42(6):1206–52.

    Article  CAS  Google Scholar 

  21. World Health Organization. Noncommunicable Diseases and Mental Health Cluster. WHO STEPS surveillance manual: the WHO STEPwise approach to chronic disease risk factor surveillance / Noncommunicable Diseases and Mental Health, World Health Organization. World Health Organization; 2005. https://apps.who.int/iris/handle/10665/43376.

  22. Panesar A. Machine Learning and AI for Healthcare [Internet]. Apress; 2019. Available from:http://dx.doi.org/10.1007/978-1-4842-3799-1.

  23. Siddiqui S, Zainal H, Harun SN, Sheikh Ghadzi SM, Ghafoor S. Gender differences in the modifiable risk factors associated with the presence of prediabetes: A systematic review. Diabetes Metab Syndr. 2020;14(5):1243–52.

    Article  Google Scholar 

  24. Lee H, Kim B, Song Y. Related Factors for Impaired Fasting Glucose in Korean Adults: A Population Based Study. BMC public health. 2021;21(1):2256.

    Article  CAS  Google Scholar 

  25. Hadaegh F, Derakhshan A, Zafari N, Khalili D, Mirbolouk M, Saadat N, et al. Pre-diabetes tsunami: incidence rates and risk factors of pre-diabetes and its different phenotypes over 9 years of follow-up. Diabet Med. 2017;34(1):69–78.

    Article  CAS  Google Scholar 

  26. Derakhshan A, Sardarinia M, Khalili D, Momenan AA, Azizi F, Hadaegh F. Sex specific incidence rates of type 2 diabetes and its risk factors over 9 years of follow-up: Tehran Lipid and Glucose Study. PloS one. 2014;9(7):e102563-e.

    Article  Google Scholar 

  27. Ramezan M, Asghari G, Mirmiran P, Tahmasebinejad Z, Azizi F. Mediterranean dietary patterns and risk of type 2 diabetes in the Islamic Republic of Iran. East Mediterr Health J. 2019;25(12):896–904.

    Article  Google Scholar 

  28. Rylander C, Sandanger TM, Engeset D, Lund E. Consumption of Lean Fish Reduces the Risk of Type 2 Diabetes Mellitus: A Prospective Population Based Cohort Study of Norwegian Women. PLoS ONE. 2014;9(2): e89845.

    Article  Google Scholar 

  29. Xun P, He K. Fish Consumption and Incidence of Diabetes: meta-analysis of data from 438,000 individuals in 12 independent prospective cohorts with an average 11-year follow-up. Diabetes Care. 2012;35(4):930–8.

    Article  CAS  Google Scholar 

  30. Colberg SR, Sigal RJ, Yardley JE, Riddell MC, Dunstan DW, Dempsey PC, et al. Physical Activity/Exercise and Diabetes: A Position Statement of the American Diabetes Association. Diabetes Care. 2016;39(11):2065–79.

    Article  Google Scholar 

  31. Liu C, Yu Z, Li H, et al. Associations of alcohol consumption with diabetes mellitus and impaired fasting glycemia among middle-aged and elderly Chinese. BMC Public Health. 2010;10:713. https://doi.org/10.1186/1471-2458-10-713.

    Article  Google Scholar 

  32. Kazemnejad A, Batvandi Z, Faradmal J. Comparison of artificial neural network and binary logistic regression for determination of impaired glucose tolerance/diabetes. East Mediterr Health J. 2010;16(6):615–20.

    Article  CAS  Google Scholar 

  33. Tankova T, Chakarova N, Atanassova I, Dakovska L. Evaluation of the Finnish Diabetes Risk Score as a screening tool for impaired fasting glucose, impaired glucose tolerance and undetected diabetes. Diabetes Res Clin Pract. 2011;92(1):46–52.

    Article  Google Scholar 

  34. Zhang Y, Hu G, Zhang L, Mayo R, Chen L. A novel testing model for opportunistic screening of pre-diabetes and diabetes among U.S. adults. PLOS One. 2015;10(3):e0120382.

    Article  Google Scholar 

  35. Maeta K, Nishiyama Y, Fujibayashi K, Gunji T, Sasabe N, Iijima K, et al. Prediction of Glucose Metabolism Disorder Risk Using a Machine Learning Algorithm: Pilot Study. JMIR Diabetes. 2018;3(4):e10212.

    Article  Google Scholar 

  36. Tapak L, Mahjub H, Hamidi O, Poorolajal J. Real-Data Comparison of Data Mining Methods in Prediction of Diabetes in Iran. Healthcare informatics research. 2013;19(3):177–85.

    Article  Google Scholar 

  37. Vuttipittayamongkol P, Elyan E, Petrovski A. On the class overlap problem in imbalanced data classification. Knowl-Based Syst. 2021;212: 106631.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank the National Institute for Health Research (NIHR), Iran, for providing free access to the original data (2016 STEPs study) used in this study.

Funding

This study was conducted without any financial support.

Author information

Authors and Affiliations

Authors

Contributions

M.M.A and H.A. had the initial idea for this work and were equally involved in the study design, and proofreading the manuscript. P.M. performed the literature search, data, and machine learning analysis, and prepared the manuscript. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Mohammad Meskarpour Amiri.

Ethics declarations

Ethics approval and consent to participate

Ethics approval for this study was obtained by Iran National Committee for Ethics in Biomedical Research (ID: IR.BMSU.REC.1399.194), and all methods were performed in accordance with the relevant guidelines and regulations. This study uses secondary de-identified data, and the need for informed consent is waived by the Iran National Committee for Ethics in Biomedical Research.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moradifar, P., Amini, H. & Amiri, M.M. Hyperglycemia screening based on survey data: an international instrument based on WHO STEPs dataset. BMC Endocr Disord 22, 316 (2022). https://doi.org/10.1186/s12902-022-01222-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12902-022-01222-0

Keywords