MemoCare: An Interactive Multimodal Mobile System for Automated Cognitive Screening
MemoCare is a React Native mobile system for automated multimodal cognitive screening in English and Vietnamese. It integrates speech, temporal and spatial orientation, touchscreen interaction, and visuoconstruction. Google Speech-to-Text transcripts are scored with deterministic, task-specific rules. GPS-grounded current and historical administrative names support location scoring, touch events verify actions, and lightweight convolutional neural networks evaluate drawings. A separate model provides visual interpretation. Software verification passed 151/151 predefined language, spatial-answer, and touch-scoring regression cases and 48/48 fixed-coordinate spatial tests across four countries. Transcript-based tests exclude speech recognition accuracy. On a locked 71-image test set, validation-selected ShuffleNetV2 x1.5 achieved 91.33% mean balanced accuracy and 78.87% exact three-criterion accuracy. Four clinician co-authors rated the workflow (pooled median 4/5 across eight criteria; item medians 3-4.5), highlighting improvements needed in speech handling, response acceptance, and result transparency. The workflow automatically produces item-level and total scores.