Early detection of Down syndrome is crucial for enabling early intervention and providing healthcare education for children. Down syndrome is associated with specific facial features, such as distinct characteristics of the eyes, nose, lips, face shape, hair, and skin color, which can be analyzed using computer vision techniques. This study aims to classify Down syndrome, especially in the Asian Region, which includes countries with medium/low SDI. The study proposed a CNN based on the VGG16 and VGG19 architectures by implementing transfer learning and augmentation. Augmentation is performed to balance the number of images between classes, while transfer learning is used to train the model first on ImageNet data. The dataset used consists of two categories, Down syndrome and Healthy. The results indicate that the VGG16 model has higher sensitivity and is able to classify more cases of Down syndrome, but has a fairly large prediction error. However, VGG19 model has a better specificity value and has a smaller potential for prediction error. The best model in this study was selected based on the highest validation accuracy value, where VGG19 achieved an accuracy of 93% in its best iteration, and VGG16 achieved an accuracy of 91%. These findings suggest that the proposed models, particularly VGG19, exhibit optimal performance in classifying Down syndrome, especially in the Asian region, with a lower prediction error rate.