Main Article Content
Abstract
Background: Continued use of digital learning platforms is often explained by perceived experience quality. Public application store reviews, however, offer no individual-level retention data, so it is unclear how far stated intentions can stand in for actual retention.
Objective: To determine how often educational application reviews state explicit continuance or discontinuance intentions, and how these relate to complaints about system quality, information quality, and technical burden.
Methods: GenAI-EdSent was analyzed as a cross-sectional review corpus. Multi-stage filtering of 480,831 catalog rows from 22 educational applications left 204,294 unique English reviews (2021 to 13 August 2025). Lexical rules separated explicit discontinuance, explicit continuance, and unstated intentions before DeLone–McLean and Expectation-Confirmation coding, without human annotation. Exact conditional odds ratios (ORs), 95% exact confidence intervals (CIs), Fisher's exact tests, and Benjamini–Hochberg false discovery rate (q) adjustment were used.
Results: Only 220 reviews (0.108%) stated an explicit intention: 180 discontinuance and 40 continuance. System quality issues appeared in 10/180 (5.6%) versus 1/40 (2.5%) reviews (OR = 2.29; 95% exact CI: 0.31–102.08; p = 0.694), information quality issues in 13/180 (7.2%) versus 1/40 (2.5%) (OR = 3.02; 95% CI: 0.43–132.28; p = 0.474), and technical burden in 2/180 versus 0/40, an unbounded OR (95% CI: 0.04–∞; p = 1.000; all q = 1.00). Multivariable regression was withheld because only 34 continuance comparators existed across three eligible applications.
Conclusion: Large review catalogs do not guarantee enough explicit intention outcomes for adjusted modeling. The estimates are imprecise crude associations, not measures of retention.
Keywords
Article Details
Copyright and licence. Authors retain copyright and unrestricted publishing rights in their article. By publishing in Enigma in Education, authors grant the journal the non-exclusive right of first publication. The Version of Record is distributed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International Licence (CC BY-NC-SA 4.0). Users may share and adapt the work for non-commercial purposes provided appropriate credit is given, a link to the licence is supplied, changes are indicated, and adaptations are distributed under the same licence.
References
- 1. DeLone WH, McLean ER. The DeLone and McLean model of in-formation systems success: a ten-year update. J Manag Inf Syst. 2003;19(4):9-30. doi:10.1080/07421222.2003.11045748
- 2. Bhattacherjee A. Understanding information systems continu-ance: an expectation-confirmation model. MIS Q. 2001;25(3):351-370. doi:10.2307/3250921
- 3. Nourbakhsh E. GenAI-EdSent dataset [dataset]. CC BY-NC 4.0 license. Hugging Face; 2025. Available from: https://huggingface.co/datasets/Erfan-Nourbakhsh/GenAI-EdSent
- 4. Mazaherian A, Nourbakhsh E. Unveiling user perceptions in the generative AI era: a sentiment-driven evaluation of AI educa-tional apps role in digital transformation of e-teaching. arXiv [Preprint]. 2025:arXiv:2512.11934. Available from: https://arxiv.org/abs/2512.11934
- 5. Virtanen P, Gommers R, Oliphant TE, et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat Methods. 2020;17(3):261-272. doi:10.1038/s41592-019-0686-2
