Today, image classification methods are widely utilized on agricultural products or in agricultural applications. However, many of these methods based on traditional approaches remain unsatisfactory in terms of obtaining effective results. Within this context, this study aimed to classify lentil images by machine learning algorithms, a current and effective method. In line with this purpose, first of all, a camera system was prepared primarily and a dataset was created by recording lentil grains at 225 × 225 resolution via this system. The dataset contains a total of 33,938 data obtained from 3 lentil species as green, yellow, and red. SqueezeNet, InceptionV3, DeepLoc, and VGG16 architectures, among the CNN methods, were used in order to extract features from the recorded images. Lastly, Artificial Neural Network (ANN), Naive Bayes (NB), Random Forest (RF), Adaptive Boosting (AB), and Decision Tree (DT) algorithms were utilized with the aim of creating models for lentil images’ classification. The classification success of the created machine learning models was calculated and the results were analyzed. The highest classification success with the deep features obtained from the SqueezeNet model, 99.80%, was achieved in the ANN algorithm. The results also revealed that grain size and shape features in image classification can yield much more detailed and precise data than can be obtained practically with manual quality assessment.