Survey on Neural Network Types and Hybrid Techniques for Plants Classification

Abstract

Today, computer science is increasingly involved in agricultural and food sciences. Various artificial intelligence and soft computing techniques are used to classify plants and detect defects to provide a better quality product to the final consumer. This article focuses on advances in automatic plant classification using soft computing techniques. Various ANN, CNN, PNN as well as Heuristic and meta heuristic optimization techniques are reviewed for plants classification. There are several meta-heuristic optimization algorithms developed on inspiration from nature.The review of Neural networks like ANN,CNN,PNN as well as some of the hybrid artificial neural networks with optimization methods like Genetic Algorithm(GA), Ant Bee Colony(ABC), Differential Evolution (DE), Group Search Particle Swarm Optimization (GSPSO), Firefly method, etc.are applied for benchmark data sets and to specific real-time experiments for plants classification are discussed.

Keywords

Automatic Plants Classification; Artificial neural network; PNN; CNN meta-heuristic optimization algorithms; classification

Introduction

In the ecological, the main sources of energy for the animals are plants. Agriculture is a major contributor to the country's growth, but there has been a decline in crop production due to poor cultivation, lack of maintenance, manual control, ignorance of techniques conservation and features. Furthermore, rising labor costs, skilled workers lack, and the requirement to improve production processes have given the pressure on producers and processors for an inspection method. Climate change is also a factor in plants that causes disease. Plant diseases are unavoidable, so leaf detection plays an important role because these diseases can spread throughout the farm and this will result in huge losses for both the farmer and the entire agricultural economy. Plants are also useful as food, as medicine, and also in many industries. The classification of plants can ensure the protection and survival of natural life. Plant recognition can be performed using different techniques on plant leaves. Traditionally, the most common method for classifying medicinal plants was manual identification. First, with the use of human organs, people were able to obtain characteristics such as shape, color, as well as texture of the entire plant or individual sections (bladder, fruit). Therefore, they were able to determine plant species based on a reference or experience. However, practice has shown that this method of identification is highly dependent on the level of competence and experience, not just heavy workload and low performance. This approach is difficult for non-experts due to lack of experience. This represents a formidable challenge for beginners who want to learn about organisms.

Literature Review

In fact, automatic computer image recognition is widely used in image processing technologies and pattern detection development. The availability of related technologies such as digital cameras, mobile devices, remote data access, advanced image processing techniques, and pattern recognition have made automatic species identification a reality. There is a great variety of plants such as fruits, flowers, vegetables, etc. For the identification of plants, leaves are considered. The sheets are easily collected, they can be purchased through any camera, mobile phone or scanner. Computer-based plant identification is used to classify the plant type. Initially, a database is created using sample images of all types of leaves. Each image of the leaf is related to the relevant details of the plant.

ANN Techniques for plants classification

Boran Sekeroglu et.al presented that from the rise of smart applications on different platforms such as desktop and mobile sheet recognition has gained importance. To correctly recognize the type of leaf, each leaf contains a unique distinct pattern that has been contained to provide efficient input for neural networks. Furthermore, using the back propagation neural network, an intelligent recognition system is presented to recognize and identify 27 different types of leaves and the results show that the developed system is excellent for recent research with an identification rate of 97.2%.

Identification method for leaf which is used to extract characteristics. All characteristics can be extracted from the digital image of the leaf plant. With one exception, all functions are extracted automatically. For classification once the captured image is pre-processed, extract the color consistency vector feature and heraldic features, later send it to the ANN classifier. The main improvement relates to feature extraction and the classifier. To automate the detection of plant leaves, the Artificial Neural Network (ANN) classifier is used. A neural network method for leaf identification is introduced. By re positioning the leaf images on the computer, the computer can automatically detect the leaf. ANN is presumed to have a fast training method to classify the leaf. The experimental result specifies that the method is effective with greater precision than the previous methods; This technique is quick to execute, skillful to identify, and simple to implement.

The biometric feature to classify plant leaf images. The classification is facilitated by the biometric characteristics of the plant leaves, such as the vein. The biometric characteristics of the leaf are analyzed using a computer-based method, such as morphological characteristics analysis, and the classifier based on the artificial neural network take the input as a morphological characteristic of the leaf vein and classify them into four different species. In model training, the accuracy of this classification based on leaf rib is achieved 96.53% for the classification of leaves provide an accuracy of 91% in the tests to classify leaves images The classification of plants is obtained based on the morphology characteristics of the leaf vein with. The ANN-based classification model trained with 96.53% accuracy provides 91% accuracy in tests to classify leaf images with their biometric vein morphological characteristics (Table 1) ^[1].

Table 1: PNN technique with methods and result on plants Classification.

They proposed an algorithm to identify plants using three separate steps that are pre processing the data set, and then applying the extraction of the characteristics that ultimately contribute to the classification of the plant. The authors used characteristics of the leaves for identification and classification, which are morphological characteristics, as well as Fourier descriptors and characteristics that define the shape. For the artificial neural network (ANN)the values obtain from these characteristics of the leaves are used as an input vector as well as the data set used for this research is based on training through 817 leaf samples from 14 different fruit trees. Moreover, the research has been proven effective on the Flavia and ICL data sets and provides 96% accuracy for both data sets. In this case, processing, is the technique used to enhance data images prior to computational processing.

The presented a new computationally efficient system that takes into account the combination of color, shape, morphological and characteristics of the tooth. The feature extraction step derives features based on the color and shape of the sheet image. Furthermore, the functionalities are used as input to the classifier for efficient classification and the results are then tested and compared using the Artificial Neural Network (ANN) and Euclidean (KNN) classifiers. Furthermore, the proposed approach by using ANN classifier is 93.3% accurate, and the comparison of classifiers shows that ANN takes fewer mean times to execute than the Euclidean distance method. To identify a complex image, the proposed work can be further expanded with clustered petioles and leaves and real-time images of the leaf (Table 2) ^[2].

Table 2. Comparison of advantages and disadvantages.

To obtain data performance classification of leaf disease is presented by using the artificial neural network was successfully analyzed through image processing method and classified using neural network. The objective of classifying healthy or unhealthy leaves of medicinal plants was achieved by acquiring and analyzing data from leaf images using the image processing method. In addition, from the image processing method, the algorithm of contrast adjustment, segmentation and feature extraction is used to extract the image and obtain data. In the image processing method, all three methods are included. Using the artificial neural network, the results of the experiment were carried out. The multilayer feed forward neural networks are the multilayer perceptron and the radial basis function RBF the network structures used to classify healthy or unhealthy leave. Also, in the last experiment, the result shows that the RBF network performs better than the MLP network.

Automated baseline identification techniques of three Ficus species based on the collection of leaf images using the pattern recognition approach presented. Two machine learning algorithms were used, to build the identification model: ANN and SVM. Both models obtained a satisfactory result that proved their usefulness in identification tasks. The study showed that computerization classification of selected Ficus species that had similar leaf shapes is feasible based on leaf images. Furthermore, in the future, the robustness of the system could be improved by including more Ficus species.

Presented the plant morphology as well as features of domain-related visual plant leaf are analyzed and extracted. Moreover, for recognizing plant leaf using artificial neural network an approach is brought forward. A series of experiments are carried out to demonstrate the efficacy of the proposed methods. The result of the experiment demonstrates the efficacy and superiority of the methods.

CNN techniques for plants classification

They propose the Convolution Neural Network (CNN) to classify the type of plants by collecting sequences of images from smart stations. First, lighting variations are depicted and smudges are removed with a few pre-processing steps. In addition, the convolutional neural network architecture is used to extract features from the image. The results obtained through the CNN model are compared with those acquired by the SVM classifier with different kernels, to evaluate the performance of the approach, as well as feature descriptors such as LBP and GIST. The outcome of the research on the TARBIL data set confirms that the designed method is quite impressive.

Presented an application which classifies the tree type based on leaves pictures. In an android mobile application to sort out natural images of leaves, the system developed for this research use a convolution neural network. For leaf classification, an application is represented by utilizing a convolution neural network. If an application of this type put on a mobile device, could be useful for Biology students learning about trees during their field work. It could also be helpful in using the leaves to recognize trees by researchers who are not experts. To learn more about the trees around them, the outdoor admirer also can get benefit from this application.

PNN techniques for Plants Classification

Represented for fast speed on training and simple structure PNN is adopted which implements a leaf recognition algorithm using easy-to-extract features as well as high efficient recognition algorithm. On feature extraction and the classifier, is the main improvements are. From digital leaf image, all features are extracted. To form the input vector of PNN, 12 features are extracted and processed by PCA. By 1800 leaves to classify 32 kinds of plants, the PNN is trained with an accuracy greater than 90%.

Optimization techniques

Soft computing techniques are increasingly important, as the power of computer processing devices increases. To make a complex system you need intelligent systems by choosing the best results from many possibilities, using complex algorithms. This requires fast processing power and large storage space that is recently become available in latest years to many research centers, universities as well as technical institutes at a very less cost.

In the real world to enable solutions, the fusion of engineering methodologies is soft computing as well as a consortium of methodologies that works in synergy and provides, in one way or another, flexible information processing capabilities for management. The guiding principle is to invent calculation methods that lead to an acceptable solution at low cost, seeking an approximate solution to a problem formulated inaccurately or precisely.

In general there are two kinds of optimization techniques such as Heuristic and Meta heuristic. Generally, heuristics means to "find" or find out by trial and error.

These algorithms can be expected to work for most, but not all time. A further development of heuristic algorithms is the so-called meta heuristic algorithm. Here, Meta means "beyond" or "higher level" and these algorithms in general work better than simple heuristics. Furthermore, all meta heuristic algorithms use certain offsets from randomization and local search. It should be noted that it was not agreed there are definitions of heuristics and meta heuristics in the literature; some use the terms heuristics and meta heuristics interchangeably. However, the recent trend tends to give it a name all stochastic algorithms with randomization and local search as meta heuristics. Heuristic optimization techniques such as swarm intelligence, taboo search, simulated annealing, genetic algorithm, etc. and meta heuristics can be classified in many ways. One way is to classify based on population or trajectory. For example, genetic algorithms are population based because they use a set of strings; so are the optimization of the particle swarm, the Firefly Algorithm (FA), and the search for the cuckoo, which use multiple agents or particles.

Hybrid optimization techniques for plants classification

Optimization means choosing the ‘best’ strategy among the multiple options.Depending upon the situation, the best path is chosen. In optimization the main objective could be simply to minimize the production cost as well as maximize the production efficiency.The process of optimization algorithm executed repeatedly by comparing various solutions till an optimum or a satisfactory solution is found. The two main types of optimization algorithm which are widely used today (a) Deterministic algorithm (b) Stochastic algorithm. Deterministic as name implies use specific rule for moving one solution to other where stochastic algorithm are random in nature.The reviews of some of these hybrid artificial neural networks with optimization methods like Genetic Algorithm (GA), Ant Bee Colony (ABC), Differential Evolution (DE),Group Search Particle Swarm Optimization (GSPSO), Firefly method, etc. are applied for benchmark data sets and to specific real-time experiments for plants classification are discussed.

To optimize feature selection by combining the characteristics of Ant Colony and Artificial Bee Colony (ABC) algorithms a new Swarm based hybrid algorithm AC-ABC Hybrid is proposed. Eliminate stagnation behavior of the ants as well as for time consuming global search is the initial solutions, the employed bees algorithms are hybridized. In the proposed algorithm, to determine the best Ant and best feature subset, Ants use exploitation by the Bees; bees change the feature subsets generated by the Ants as their food sources. For the evaluation purpose, the algorithm consists of thirteen UCI (University of California, Irvine) benchmark data sets have been used. By the experimental results, the behavior of the proposed method of increasing the classification accuracy and optimal selection of features ^[3].

Genetic Algorithm to optimize the weight of the network during training, Digital Evaluation is optimized. By using NPD-dimensional, Differential Evolution (DE) is a parallel direct search method of parameter vectors. Differential Evolutionary Mutation, Crossover and Selection. To maintain a population of structures which are candidate solutions for specific domain challenges, a genetic Algorithm is an iterative procedure. With specific genetic operators like reproduction, crossover, and mutation, a new candidate solutions-population is formed. Using MATLAB, the features were extracted. To train the classification algorithms, the features extracted method were adopted. The proposed hybrid algorithm based on DE and GA improves the classification accuracy of the neural network is shown by an experimental result. The percentage of classification accuracy is determined by a proposed optimized Differential Evolution as well as GA optimization algorithms.

For the purpose of better classification accuracy Genetic weight optimization-based neural network systems of diseased plant leaf classification is proposed. As features five attributes, such as contrast, correlation, energy, homogeneous and area of the leaf was used. Initially, from the segmented image after prepossessing the features of leaves were extracted. By Genetic algorithm for specified iterations, the weight of the neural network is updated. In the end the performance is analyzed in different classes of diseased plant leaves by using classification accuracy. For better classification accuracy, Genetic weight optimization-based neural network systems of diseased plant leaf is classified ^[4].

Presented a new hybrid approach of PSO (Particle Swarm Optimization) and IWD (Intelligent Water Drop) as hybrid IWD-PSO approach for the optimization of ANN for Iris classification as well as compared its execution with the individual approaches PSO and IWD. The outcomes of the model clarify the better performance of the hybrid IWD-PSO approach in terms of accuracy and SSE as compared to IWD and PSO stand alone with reference to the number of hidden layers as well as hidden nodes. By using this hybrid algorithm, a better search results can be received. As optimization the IWD, PSO, and IWD-PSO are utilized approaches for Ann. The result of comparison represented that IWD-PSO-ANN accomplished IWD-ANN and PSO-ANN in terms of SSE and accuracy rate. It can be concluded that the proposed hybrid IWD-PSO approach is suitable for use as an optimization approach for ANNs. The outcomes of the study also show the fact that in enhancing the performance of a neural network a comparative analysis of different optimization approaches is always supportive. Moreover, this hybrid IWD-PSO approach can be applied to deal with more optimization problems in future scope.

Presented a hybrid algorithm known as the Group Search Particle Swarm Optimization (GSPSO) which is based upon Particle Swarm Optimization (PSO) and here the GSO has been proposed wherein a PSO model along with the GSO model is made use of. PSO and the good performance is done in the GSO. Form of the many-valued logic the Fuzzy classifier is derived from the theory of a fuzzy set. Moreover, for classification, a Multilayer Perceptron Neural Network (MLPNN) concept is used. Such type of techniques is selected as they can provide a training that is faster to solve the problems of pattern recognition by using the technique of numerical optimization. Therefore, in this work, an optimal and deterministic feature subset has been chosen by using a technique of a hybrid GSO. This algorithm has been inspired by the social search behavior of the animals in the global performance of which has been now proved to be very competitive. In case of the GSPSO algorithm, any PSO model can be used for identifying one good search space where a point of global optimization has been contained having a very high degree of probability. For this technique, the GSO is used to make a search within its local search space and rangers used for revising the space simultaneously.

Sajad Sabzi et.al.purposed a hybrid approach,is used in classification which consists of artificial neural networks and particle swarm optimization algorithm (PSO).According to research, in four farms of Agria potato mixture; under controlled lighting conditions using white LED lamps, image capture was presented. A decision tree is used in terms of difference between potato plants and weeds, to select the 6 most significant features. The database was divided into two groups to evaluate the proposed model:

• Training data, which is used to train the hybrid ANN PSO
• Test and validation data to evaluate the network.

In conclusion, to classify the inputs as potato plants or weeds, ANN-PSO method is applied. Moreover, a comparison is presented by using a Bayesian classifier.

A novel fruit-classification tool is offered. The methodology which is presented consists of different processes: First of all, a four-step pre-processing was performed, followed by he color, shape, texture features were combined. Later, for feature reduction, principal component analysis was employed. Furthermore, method with the combination of “Hybridization of PSO and ABC (HPA)” and “single-hidden layer feed forward neural-network (SLFN)”, this was termed as HPA-SLFN is presented as a novel classification. The research results demonstrated that the in compared to existing method, proposed HPA-SLFN achieved an accuracy of 89.5%. The proposed HPA-SLFN was effective ^[5].

Conclusion

On the basis of the study carried out, it was derived that soft computing models have shown extraordinary performance in the plants leaf classification. While a number of promising technologies exist, non-destructive evaluation of plants. Using computer vision systems and flexible computer models, the classification is carried out. For plants classification,various ANN, CNN, PNN as well as Heuristic and Meta heuristic optimization techniques are reviewed .Algorithms must be selected and combined to form hybrid optimization techniques, to maintain good compensation.

To form hybrid approaches, the algorithm are chosen, that should be in the category of one asset with an exploration rate and the other with a good exploitation rate. Consequently, details of some hybrid classifiers developed by combining ANN, with different Meta Heuristic Optimization Techniques (MHOA) in the literature are briefly provided. There are still many ongoing experiments with ANN optimized in different domains to determine solutions for everyday problems. In the future, the plants industry should get big benefits by using more robust software computer models.

References

1. Suchitra A, et al. Automated skin defect identification system for fruit grading based on discrete curvelet transform. IJET. 2013;5:3251-3256.
2. Blasco J, et al. Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features. Biosystems Engineer. 2009;103:37-145.
3. Remya A, et al. Analysis of Classification Algorithms for Plant Leaf Disease Detection.IEEE. 2019
4. Kan HX, et al. Classification of medicinal plant leaf image basedon multi-feature extraction. Patt Recog Image Anal. 2017;581-587.
5. Wäldchen J, et al. Plant species identification using computer vision techniques: A systematic literature review. Arch Comput Methods Eng. 2018;25:507-543