The present invention is a computer system, known as DELTADELTA, which takes as input an initial fault hierarchy KB0 and a set of annotated session transcripts C={<??j,rj >}, where ??j includes the answers to all tests presented to the expert system, and the correct repair rj is supplied by a human expert.