Holger Holst, Mattias Ohlsson, Carsten Peterson and Lars Edenbrandt A confident decision support system for interpreting electrocardiograms Clinical Physiology 19, 410-418 (1999) Abstract: Computer-aided interpretation of electrocardiograms (ECGs) is widespread but many physicians hesitate to rely on the computer, because the advice is presented without information about the confidence of the advice. The purpose of this work was to develop a method to validate the advice of a computer by estimating the error of an artificial neural network output. A total of 1249 ECGs, recorded with computerized electrocardiographs, on patients who had undergone diagnostic cardiac catheterization were studied. The material consisted of two groups, 414 patients with and 835 without anterior myocardial infarction. The material was randomly divided into three data sets. The first set was used to train an artificial neural network for the diagnosis of anterior infarction. The second data set was used to calculate the error of the network outputs. The last data set was used to test the network performance and to estimate the error of the network outputs. The performance of the neural network, measured as the area under the receiver operating characteristic (ROC) curve, was 0.887 (0.845±0.922). The 25% test ECGs with the lowest error estimates had an area under the ROC curve as high as 0.995 (0.982±1.000), i.e. almost all of these ECGs were correctly classified. Neural networks can therefore be trained to diagnose myocardial infarction and to signal when the advice is given with great confidence or when it should be considered more carefully. This method increases the possibility that artificial neural networks will be accepted as reliable decision support systems in clinical practice. LU TP 98-31