A pothole is a bowl-shaped indentation in the road surface, less than 1 meter in diameter. The presence of potholes on the highway can endanger the safety of road users, so repairs need to be done as soon as possible. Images of potholed roads have high complexity, variations consisting of color contrast, hole size, presence of puddles or not, lighting when taking pictures, background and others. For this reason, an approach is needed that can classify images with a high degree of variation by extracting the important information contained in them. Judging from the potential success of using the Convolutional Neural Networks (CNN) approach in identifying images of potholes that will be reported for entry into the Public Works Service's road improvement record, the authors propose the idea of "Pothole Image Classification on Asphalt Road Surfaces with the Convolutional Neural Networks (CNN) Method”.