Garbage generated every day can be a problem because some types of waste are difficult to decompose so they can pollute the environment. Waste that can potentially be recycled and has a selling value is inorganic waste, especially cardboard, metal, paper, glass, plastic, rubber and other waste such as product packaging. Various types of waste can be classified using machine learning models. The machine learning model used for classification of waste systems is a model with the Convolutional Neural Network (CNN) method. The selection of the CNN architecture takes into account the required accuracy and computational costs. This study aims to determine the best architecture, optimizer, and learning rate in the waste classification system. The model designed using the Xception architecture with the Adam optimizer and a learning rate of 0.001 has an accuracy of 87.81%.