Accurate prediction of current and future conditions of sewer systems is crucial to manage the sewer system wisely, cost-effectively and efficiently. The application of historical databases of visual inspection data to sewer deterioration modeling seems common sense. However, in The Netherlands, sewer inspection data is only used to determine the direct need for rehabilitation. This paper outlines the possibilities of using inspection data for deterioration modeling and discusses the problems encountered. A case study was performed on the modeling of the condition aspect ‘surface damage by corrosion or mechanical action’ using a Markov model.