Evaluating Usage and Reliability of Tests in the TestMyBrain Digital Neuropsychology Toolkit

Shifali Singh, PhD

McLean Hospital
Evaluating Usage and Reliability of Tests in the TestMyBrain Digital Neuropsychology Toolkit

Scientific Abstract


Background: The TestMyBrain Digital Neuropsychology Toolkit (DNT) is a not-for-profit, web- based tool that was developed and disseminated to clinicians and researchers in the wake of the COVID-19 pandemic. The DNT consists of web-based, self-administered tests that are similar to traditional neuropsychological tests, but can be administered remotely by neuropsychologists looking to conduct evaluations while adhering to social distancing guidelines. Participants and

Methods: An initial survey was conducted to gather user data, but once given access to the DNT, no further clinician or user data were collected to preserve anonymity. Thus, the reported reliabilities are based on a mixed sample of individuals, with no knowledge of various patient referral questions, diagnoses, or specific use cases.

Results: Regarding user data, as of August 2020, there were 1205 requests for access to the DNT. Of those requests, 78.2% reported using the DNT for clinical purposes. Others reported requesting access for research (10.9%), educational/training purposes (8.5%), a combination of clinical and research purposes (1.2%), personal use (0.8%), or exploration (0.4%). Split-half reliability was used to measure internal consistency across DNT tests, including verbal and visual pairs, reaction time, trail making tests parts A and B, matrix reasoning, continuous performance test, and digit symbol matching.

Internal reliability across these tests ranged between 0.84 and 0.98. Test correlations were also comparable for forward and backward digit span (r = 0.57).

Conclusions: Based on these analyses, there is good internal reliability across DNT tests. Due to the nature of the sample and the unknown number of tests that were used solely for clinical purposes, future research should aim to conduct studies evaluating the internal reliability of the TestMyBrain DNT tests for specific clinical populations.

Live Zoom Session – April 21st

research Areas


Shifali Singh, PhD, Naomi Chaytor, PhD, ABPP-CN, Eliza Passell, B.A., Laneé Jung, B.A., Laura Germine, PhD

Affiliated Website