<p>Model performances.</p>

We developed a method to convert longitudinal reaction-time data into images and applied deep survival modelling to predict disability progression in relapsing-remitting MS (RRMS). In this cohort study, clinical data were obtained from the MSBase registry and cognitive data from the MSReactor computerised cognitive battery between February 2016 and September 2022, with a median follow-up of 3.2 years.

The serial reaction-time data from three tasks (psychomotor function [R], attention [G], and working memory [B]) were converted into multicolour images using RGB encoding. We extracted the key features from the images using a convolutional neural network and combined them with clinical variables in a Transformer-based survival model (MS-TranSurv) to predict time to confirmed disability progression. Discrimination, calibration, and accuracy were assessed using the C-index, integrated Brier score (iBS), and time-dependent area under the receiver operating characteristic (tAUROC).