Deep learning plays a crucial role in modern computer vision due to its ability to automatically extract hierarchical features from large-scale image data. Among various architectures, Convolutional Neural Networks (CNNs) have been extensively utilized for image pattern interpretation, including in agricultural product inspection. Straw mushrooms (Volvariella volvacea) are important agro-industrial commodities in Indonesia; however, their quality assessment still relies on subjective manual evaluation based on the Indonesian National Standard (SNI:01-6945-2003), leading to inconsistency in grading results. To address this limitation, this research proposes an Improved Hybrid GoogLeNet model integrated with a YOLO-based detection framework and hybrid preprocessing to enhance feature clarity and classification robustness. The system is capable of conducting object detection, 3-class morphological quality classification (Pure White, Oval, and Black Spot/Defect), and automatic diameter measurement using calibrated pixel-to-centimeter conversion. Performance evaluation is carried out by benchmarking the proposed model against several popular deep learning architectures including YOLOv5, LeNet, AlexNet, VGGNet, and ResNet. Experimental results demonstrate that the Improved Hybrid GoogLeNet achieves the highest performance with precision of 97.99%, recall of 96.07%, and F1-score of 96.98%, along with low misclassification rates across all classes. These results indicate that the proposed method provides accurate, reliable, and efficient quality assessment that supports standardized automated grading in industrial applications. Therefore, this study contributes to the advancement of intelligent computer vision solutions for digital transformation in the Indonesian mushroom agro-industry.