Interpretable Decision Tree for Predicting High Self-Reported Happiness Using Digital Behavior and Lifestyle Indicators

Rafika Damayanti Sururin Nufus(1*), Fiandra Lazuart Adi Hafizh Arraszaq(2),

(1) Telkom University, Surabaya
(2) Telkom University, Surabaya
(*) Corresponding Author

Abstract


Research on digital well-being is dominated by text-derived features and post hoc explanations, leaving limited evidence on whether compact behavioral data can support an inherently interpretable happiness classifier without obscuring predictive trade-offs. This study develops and audits an inherently interpretable decision tree for classifying high self-reported happiness from age, screen time, sleep quality, stress, offline days, exercise, gender, and social-media platform. The contribution is a leakage-safe evaluation that combines nested cross-validation, comparison with Random Forest, logistic regression, and radial-basis-function support vector machine, out-of-fold discrimination and calibration, a one-standard-error tree-selection rule, bootstrap stability, and sensitivity analyses. Across five outer folds, the decision tree obtained balanced accuracy 0.779 ± 0.049, macro-F1 0.778 ± 0.050, ROC-AUC 0.869 ± 0.045, and Brier score 0.146 ± 0.028. Random Forest achieved the highest mean balanced accuracy (0.820), whereas logistic regression achieved the highest ROC-AUC (0.913) and lowest Brier score (0.122). The selected depth-three tree retained eight leaves and used daily screen time and stress as its primary decision pathways. In 200 bootstrap samples, stress was selected in 100.0% of trees and screen time in 86.5%; however, the root alternated between stress (53.5%) and screen time (45.0%), indicating stable relevance but unstable ordering. Results remained similar with the four-feature subset, while performance changed across happiness thresholds. The model therefore offers transparent decision rules at a modest predictive cost, but the cross-sectional, single-dataset design supports predictive association rather than causal or clinical interpretation


Keywords


Digital Well-Being; Happiness Classification; Interpretable Machine Learning; Decision Tree; Nested Cross-Validation; Calibration

Full Text:

PDF

References


J. M. Hofman et al., “Integrating explanation and prediction in computational social science,” Nature, vol. 595, no. 7866, pp. 181–188, Jun. 2021, doi: 10.1038/s41586-021-03659-0.

D. A. Parry, J. T. Fisher, H. Mieczkowski, C. J. R. Sewall, and B. I. Davidson, “Social media and well-being: A methodological perspective,” Curr. Opin. Psychol., vol. 45, p. 101285, Jun. 2022, doi: 10.1016/J.COPSYC.2021.11.005.

J. A. Hall, “Ten Myths About the Effect of Social Media Use on Well-Being,” J. Med. Internet Res., vol. 26, no. 1, p. e59585, Nov. 2024, doi: 10.2196/59585.

D. Liu, X. L. Feng, F. Ahmed, M. Shahid, and J. Guo, “Detecting and Measuring Depression on Social Media Using a Machine Learning Approach: Systematic Review.,” JMIR Ment. Health, vol. 9, no. 3, p. e27244, Mar. 2022, doi: 10.2196/27244.

N. Han et al., “Sensing Psychological Well-being Using Social Media Language: Prediction Model Development Study,” J. Med. Internet Res., vol. 25, no. 1, p. e41823, Jan. 2023, doi: 10.2196/41823.

S. Hinduja, M. Afrin, S. Mistry, and A. Krishna, “Machine learning-based proactive social-sensor service for mental health monitoring using twitter data,” International Journal of Information Management Data Insights, vol. 2, no. 2, p. 100113, Nov. 2022, doi: 10.1016/J.JJIMEI.2022.100113.

C. Mimikou et al., “Explainable Machine Learning in the Prediction of Depression,”, vol. 15, no. 11, p. 1412, Jun. 2025, doi: 10.3390/DIAGNOSTICS15111412.

I. D. Mienye et al., “A survey of explainable artificial intelligence in healthcare: Concepts, applications, and challenges,” Inform. Med. Unlocked, vol. 51, p. 101587, Jan. 2024, doi: 10.1016/J.IMU.2024.101587.

K. Battista, L. Diao, K. A. Patte, J. A. Dubin, and S. T. Leatherdale, “Examining the use of decision trees in population health surveillance research: an application to youth mental health survey data in the COMPASS study,” Health Promotion and Chronic Disease Prevention in Canada, vol. 43, no. 2, pp. 73–86, Feb. 2023, doi: 10.24095/HPCDP.43.2.03.

M. Saarela and S. Jauhiainen, “Comparison of feature importance measures as explanations for classification models,” SN Applied Sciences, vol. 3, no. 2, Art. no. 272, Feb. 2021, doi: 10.1007/S42452-021-04148-9.

Z. Ding et al., “Trade-offs between machine learning and deep learning for mental illness detection on social media,” Sci. Rep., vol. 15, no. 1, Art. no. 14497 Apr. 2025, doi: 10.1038/s41598-025-99167-6.

J. Wainer and G. Cawley, “Nested cross-validation when selecting classifiers is overzealous for most practical applications,” Expert Syst. Appl., vol. 182, p. 115222, Nov. 2021, doi: 10.1016/J.ESWA.2021.115222.

F. Pedregosa et al., “Scikit-learn: Machine Learning in Python,” Journal of Machine Learning Research, vol. 12, no. 85, pp. 2825–2830, 2011, Accessed: Jun. 27, 2026. [Online]. Available: http://jmlr.org/papers/v12/pedregosa11a.html

S. Bates, T. Hastie, and R. Tibshirani, “Cross-Validation: What Does It Estimate and How Well Does It Do It?,” J. Am. Stat. Assoc., vol. 119, no. 546, pp. 1434–1445, 2024, doi: 10.1080/01621459.2023.2197686.

“Mental Health & Social Media Balance Dataset.” Accessed: Jun. 27, 2026. [Online]. Available: https://www.kaggle.com/datasets/prince7489/mental-health-and-social-media-balance-dataset

L. Liou et al., “Assessing calibration and bias of a deployed machine learning malnutrition prediction model within a large healthcare system,” npj Digit. Med., vol. 7, no. 1, Art. no. 149, Jun. 2024, doi: 10.1038/s41746-024-01141-5.

P. M. Valkenburg, “Social media use and well-being: What we know and what we need to know,” Curr. Opin. Psychol., vol. 45, p. 101294, Jun. 2022, doi: 10.1016/J.COPSYC.2021.12.006.

J. Kim, D. Lee, and E. Park, “Machine learning for mental health in social media: Bibliometric study,” J. Med. Internet Res., vol. 23, no. 3, p. e24870, Mar. 2021, doi: 10.2196/24870.

E. Oparina et al., “Machine learning in the prediction of human wellbeing,” Sci. Rep., vol. 15, no. 1, pp. Art. no. 1632, Jan. 2025, doi: 10.1038/s41598-024-84137-1.

I. Ahmed, A. Brahmacharimayum, R. H. Ali, T. A. Khan, and M. O. Ahmad, “Explainable AI for Depression Detection and Severity Classification From Activity Data: Development and Evaluation Study of an Interpretable Framework.,” JMIR Ment. Health, vol. 12, no. 1, p. e72038, Sep. 2025, doi: 10.2196/72038.

T. Mokheleli, T. Bokaba, and E. Mbunge, “Explainable Artificial Intelligence for Workplace Mental Health Prediction,” Informatics 2025, Vol. 12, Page 130, vol. 12, no. 4, p. 130, Nov. 2025, doi: 10.3390/INFORMATICS12040130.

R. D. Sururin Nufus, B. Susetyo, B. Sartono, and Efriwati, “Exploring the Potential Impact of Ginger Consumption on the Duration of COVID-19 Recovery: A Propensity Score Matching using Random Forest,” IOP Conf. Ser. Earth Environ. Sci., vol. 1359, no. 1, p. 012139, Jun. 2024, doi: 10.1088/1755-1315/1359/1/012139.

M. Shankleman, L. Hammond, and F. W. Jones, “Adolescent Social Media Use and Well-Being: A Systematic Review and Thematic Meta-synthesis,” Adolescent Research Review, vol. 6, no. 4, pp. 471–492, Apr. 2021, doi: 10.1007/S40894-021-00154-5.

I. Beyens, J. L. Pouwels, I. I. van Driel, L. Keijsers, and P. M. Valkenburg, “Social Media Use and Adolescents’ Well-Being: Developing a Typology of Person-Specific Effect Patterns,” Communic. Res., vol. 51, no. 6, pp. 691–716, Aug. 2024, doi: 10.1177/00936502211038196.

P. Verduyn, N. Gugushvili, and E. Kross, “Do Social Networking Sites Influence Well-Being? The Extended Active-Passive Model,” Curr. Dir. Psychol. Sci., vol. 31, no. 1, pp. 62–68, Feb. 2022, doi: 10.1177/09637214211053637.

A. Orben, A. Meier, T. Dalgleish, and S. J. Blakemore, “Mechanisms linking social media use to adolescent mental health vulnerability,” Nat. Rev. Psychol., vol. 3, no. 6, pp. 407–423, May 2024, doi: 10.1038/s44159-024-00307-y.




DOI: http://dx.doi.org/10.61944/bids.v5i1.153

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Rafika Damayanti Sururin Nufus, Fiandra Lazuart Adi Hafizh Arraszaq

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Bulletin of Informatics and Data Science
Asosiasi Peneliti Data Science Indonesia
Email: pdsi.bids@gmail.com
This work is licensed under a Creative Commons Attribution 4.0 International License.