ISSN ONLINE(2319-8753)PRINT(2347-6710)

All submissions of the EM system will be redirected to Online Manuscript Submission System. Authors are requested to submit articles directly to Online Manuscript Submission System of respective journal.

Genetically Optimized Multiple ANFIS Based Discovery and Optimization of Catalytic Materials

Virendra Nayak1, Y.P. Banjare2, M. F. Qureshi3
  1. Ph.D. Scholar, Department of Mechanical Engineering, Dr. C.V. Raman University, Bilaspur, India
  2. Associate Professor, Department of Mechanical Engineering, Govt. Engineering College, Jagdalpur, India
  3. Professor, Department of Electrical Engineering, Govt. Polytechnic College, Narayanpur, India
Related article at Pubmed, Scholar Google

Visit for more related articles at International Journal of Innovative Research in Science, Engineering and Technology

Abstract

A soft computing technique based on the combination of Multiple Adaptive Neuro-Fuzzy Inference System (M-ANFIS) and a Genetic Algorithm (GA) has been developed for the discovery and optimization of new materials when exploring a high-dimensional space. This technique allows the experimental design in the search of new solid materials with high catalytic performance when exploring simultaneously a large number of variables such as elemental composition, manufacture procedure variables, etc. This integrated architecture (M-ANFIS+GA) allows one to strongly increase the convergence performance when compared with the performance of conventional GAs. It is described how both soft-computing techniques are built to work together. The proposed optimization architecture has been validated using two hypothetical functions, based on the modeled behavior of multi-component catalysts explored in the field of combinatorial catalysis. The method consists of following stages. First, prior to feature extraction, some preprocessing techniques, Secondly, the six salient feature sets are input into the multiple ANFIS combination with genetic algorithms (GAs) for discovery and optimization of new materials. The proposed method is applied for discovery and optimization of new materials and testing results show that the multiple ANFIS combination can reliably recognize, discover and optimize new materials, which has a better performance compared to the individual GA based on ANFIS.

INTRODUCTION

Optimization of a multiple output system, whose function is only approximately known and is represented in tabular form, is modeled and optimized by the combined use of a neuro-fuzzy network and optimization techniques which do not require the explicit representation of the function. Neuro-fuzzy network is useful for learning the approximate original tabular system. However, the results obtained by the neuro-fuzzy network are represented implicitly in the network. The M-ANFIS neuro-fuzzy network, which is an extension of the ANFIS network.the multiple output system and a genetic algorithm is used to optimize the resulting multiple objective decision making problem.
Research in catalysis that applies accelerated experimental tools combined with powerful computational techniques constitutes what is called combinatorial catalysis. An important issue in combinatorial catalysis is how to design the experiments in order to explore and optimize the high-dimensional solution space while minimizing the number of trials to achieve a solution. The approach employed for experimental design is stochastic procedures like simulated annealing or Genetic Algorithms (GAs). An important issue in combinatorial science is the analysis and mining of the raw multi-dimensional experimental data (Kim etal. 1998), in such a way that knowledge can be systematically extracted and used to establish multi-factor relationships and patterns amongst input variables (catalyst composition, preparation and reaction conditions), output variables (catalyst characterization and catalytic performance) and also theoretical parameters concerning the catalyst components (electro-negativities, ionization energies, enthalpies of formation, etc.). Several data-mining techniques have been applied in combinatorial chemistry; examples include clustering models and non-linear regression models, statistical models, association rules and decision trees, rule induction, Kohonen and Artificial Neural Networks (ANNs). ANNs have been applied successfully in modeling catalytic systems; especially interesting here is their application in modeling complex multi-dimensional data derived from HT experimentation (Ortiz etal 2001). A promising novel approach (Khuri etal 1981) is the combination of powerful data-mining tools with high-dimensional optimization algorithms, in such a way that the knowledge extracted from all the previous experimentation can be applied in the design of the new subset of catalysts to be experimentally screened in the next optimization step. In the present work, we described a new optimization procedure employing a combination (hybrid) of a Multiple ANFIS (M-ANFIS) and a genetic algorithm (GA). Hence, the Multiple ANFIS finds the internal relationships between catalyst variables in the data from the screening of the previous generations, and the optimization algorithm (GA) designs the next generation of catalysts to be screened taking into account the knowledge extracted from the Multiple ANFIS model.
Multiple response optimization deals with systems that have more than one response. However, since many practical systems are complicated and highly nonlinear, and thus, linear regression is not suitable, we shall adopt a much more powerful neuro-fuzzy approach, namely, the multiple adaptive neuro-fuzzy inference system (M-ANFIS), to model the system responses. M-ANFIS is a generalization of the neuro-fuzzy system ANFIS (Serra etal 2004) to handle multiple outputs or multiple responses. A neuro-fuzzy system is a nonparametric regression tool, which models the regression relationship nonparametrically without reference to any prespecified functional form, and it is capable of modeling highly nonlinear and approximately known systems. Many approaches have been proposed to solve the multiple response optimization problems. Furthermore, since the functional form of the model is unknown, optimization methods, which require the explicit expression of the functional form cannot be directly applied. In this work, a genetic algorithm (GA) is employed to search the optimal solution on the response surfaces modeled by M-ANFIS. In the next section, the architecture of M-ANFIS and its learning process are summarized. The formulation of the multiple response optimization problems is presented and the genetic algorithm is used to search for the optimal solution.
The adaptive neuro-fuzzy inference system (ANFIS) is a hybrid model which combines the ANNs adaptive capability and the fuzzy logic qualitative approach (Ortiz etal 2001). ANFIS harnesses the power of the two paradigms: ANNs and fuzzy logic, and overcomes their own shortcomings simultaneously. Recently the combination of Multiple ANFIS has been intensively studied to overcome the limitations of individual ANFIS and achieve higher performance (Ortiz etal 2001). Multiple ANFIS differing in feature set usually exhibit complementary optimization behavior. Thus, if the optimization results of Multiple ANFIS, which employ the same optimization engine but different input feature sets, are combined by integration techniques to yield the final optimization result, the final performance may be superior to the best performance of a single ANFIS on one feature set (Ames etal 1981). The weighted averaging technique is the simplest and most widely used technique combining Multiple ANFIS, which assigns a nonnegative weight to each individual ANFIS. By optimizing an objective function, the Multiple ANFIS weights can be estimated using various techniques. The weighted averaging technique with GAs is employed to combine the outputs of the six ANFISs and come up with the final optimization results. The proposed method is applied for Discovery and Optimization of Catalytic Materials and a desired result has been obtained adopting the combination of multiple ANFISs via Gas

SOFT COMPUTING ALGORITHM-PROPOSED ARCHITECTURE AND IT’S WORKING

In this work, a new optimization architecture based on combination of a M-ANFIS and a genetic algorithm (soft computing technique) will be described, this technique being specially suited for the discovery and optimization of catalytic materials, when exploring a high-dimensional space (Fig.1). In the setting-up process, the optimization variables of the material are defined considering the state of the art. Afterwards, the GA parameters are established. Moreover, an initial set of materials is obtained following a process that guarantees population diversity. This process consists of creating several random generations and carrying out a statistical population study in order to select the most diverse population.
Furthermore, the selected initial population is tested experimentally and these experimental data are subsequently used in M-ANFIS modeling, where different ANFISs and several training algorithms are tested. As a result of this study, a suitable M-ANFIS model is selected for predicting the catalytic performance. Regarding the M-ANFIS retraining step, new experimental data derived from the testing of each succeeding generation is divided into training and testing data. The training set is used to re-train the stored M-ANFIS,
image
image
image
image
image
image
image
image
image

CONCLUSIONS

This new optimization architecture for the intelligent discovery of new catalytic materials integrates an M-ANFIS and a genetic algorithm, being the integration/interaction between both very strong. Therefore, this approach is especially appropriate for high dimensional optimization (GA) while keeping in memory (M-ANFIS) the whole history of the search, reducing the experimental screening of statistically poor active materials. This integrated architecture allows one to increase strongly the convergence performance when compared with the performance of conventional genetic algorithms. The genetic algorithms and artificial neural networks are fully integrated for the design of experiments in the field of combinatorial catalysis, following the concepts already stated in Ortiz etal 2001.In this paper, we proposed the combined use of a neuro-fuzzy learning network, namely, the M-ANFIS network, and a derivative free optimization technique, namely, the genetic algorithm, to model and to solve a multiple nonlinear response system. The neuro-fuzzy network replaces the modeling or the usually used regression techniques, which cannot handle complicated nonlinear and approximately known systems. Since the results are implicitly represented by the M-ANFIS and the explicit functional form is unknown, some optimization approaches which does not require the explicit representation of the model must be used. Genetic algorithm is an ideal approach to serve this purpose.

References

  1. C. Bishop, “Neural Networks for Pattern Recognition”, Oxford Clarendon Press, Oxford, UK, 1966.

  2. B. D. Ripley, “Pattern Recognition and Neural Networks”, Cambridge University Press., Cambridge, UK, 1996.

  3. J. M. Serra, “Combinatorial Catalysis: Development of New Techniques and Applications of Interest”, Ph.D. Dissertation, (70 – 72) pp 55 – 56, April 2004.

  4. S. Valero, E. Argente, V. Botti, J. M. Serra, A. Corma, “Soft Computing Techniques Applied to Catalytic Reactions in: Proceedings CAEPIA 2003”, Vol. 1, pp. 213 – 222, 2003.

  5. R. C. Rowe, R. J. Roberts, “Intelligent Software for Product Formulation”, Taylor and Francis Ltd, London, 1998.

  6. A. Zell, G. Mamier, M. Vogt, “SNNS– Stuttgart Neural Network Simulator”. User Manual 4.1, University of Stuttgart, Stuttgart, Germany, 1995.

  7. J. A. Freeman, D. M. Skapura, “Neural Networks: Algorithms”, Applications and Programming Techniques, Addison-Wesley, Boston, MA, 1992.

  8. A. B. Bulsari, “Neural Networks for Chemical Engineers”, Elsevier, Amsterdam, The Netherlands, 1995.

  9. F. Herrea, M. Lozano, J. L. Verdegay, “Tackling real-coded genetic algorithm. Operators and tools for behavioural analysis, in: Artificial Intelligence Review”, Kluwer Academic Publishers, Dordrecht, The Netherlands, Vol. 12, pp. 265 – 319,1998.

  10. E. Goldberg, “Genetic Algorithms in Search, Optimization and Machine Learning”, Addison-Wesley, Boston, MA, 1989.

  11. D. Ortiz, C. Hervas, J. Munoz, “Genetic algorithm with crossover based on confidence interval as an alternative to traditional nonlinear regression methods”, ESANN 2001, Bruges, Belgium, pp. 193 – 198,2001.

  12. S. Valero, E. Argente, V. Botti, J. M. Serra, A. Corma, “Soft Computing Techniques Applied to Catalytic Reactions, in: E. Conejo, M. Urretavizcaya, J. L. Perez-de-la-Cruz (Eds.), Current Topics in Artificial Intelligence”, Springer, Heidelberg, Germany, Vol. 3040,pp. 536 – 545. 2004

  13. L. Baumes, “Combinatorial Stochastic Iterative Algorithms and High-Throughput Approach: from Discovery to Optimization of Heterogeneous Catalysts”, Ph.D. Dissertation, , (Lyon), pp. 149 – 192, 2004.

  14. J.-S.R. Jang, “ANFIS: Adaptive-network-based fuzzy inference system, IEEE Transactions on Systems”, Man and Cybentetics 23 (3), pp 665-684, 1993.

  15. G. Derringer and I. Suich, “Simultaneous optimization of several response variables”, Journal of Quality Technology 12,pp 214-219, 1980.

  16. C.B. Cheng and ES. Lee, “Applying fuzzy adaptive network in fuzzy regression analysis”, Computers Math. Applic. 38 (2), pp 123-140, 1999.

  17. A.I. Khuri and M. Conlon, “Simultaneous optimization of multiple responses represented by polynomial regression functions”, Technometrics23, pp 363-375, 1981.

  18. J.J. Pignatiello, Jr., “Strategies for robust multiresponse quality engineering”, IIE Transactions 25, pp 5-15,1993.

  19. A.E. Ames, N. Mattucci, S. MacDonald, G. Szonyi and D.M. Hawkins, “Quality loss functions for optimization across multiple response surfaces”, Journal of Quality Technology 29, pp 339-346,1997.

  20. G.G. Vining, “A compromise approach to multiresponse optimization”, Journal of Quality Technology 30 (4), pp 309-313, 1998.

  21. R.H. Myers and W.H. Carter, “Response surface techniques for dual response systems”, Technometrics 15 (2), pp 301-317,1973.

  22. D. Lin and W. Tu, “Dual response surface optimization”, Journal of Quality Technology 27, pp 34-39, 1995.

  23. K.-J. Kim and D. Lin, “Dual response surface optimization: A fuzzy modeling”, approxh, Journal of Quality Technology 30 (l),pp l-10, 1998.

  24. H.-J. Zimmermann, “Fuzzy programming and linear programming with several objective functions”, fuzzy Sets and Systems 1,pp 45-55, 1978.

  25. Y.-J. Lai and S.I. Chang, “A fuzzy approach for multiresponse optimization: An off-line quality engineering problem”, Fz1z.z~Sets and Systems 63, pp 117-129, 1994.

  26. J.-S.R. Jang and C.-T. Sun, “Nemo-fuzzy modeling and control”, Proceedings of the IEEE 83 (3), pp 378-406,1995.

  27. T. Takagi and M. Sugeno, “Fuzzy identification of systems and its application to modeling and control”, IEEE „Transactions on Systems, Man, and Cybernetics 15 (l), pp 116-132, 1985.

  28. C.B. Cheng and ES. Lee, “Response surface based on fuzzy adaptive network”, International J. Fuz.zy Systems 1, pp 14-24, 1999.

  29. J.H. Holland, “Adaptation in Natural and Artificial Systems”, University of Michigan Press, Michigan, 1975.

  30. R.H. Myers and D.C. Montgomery, “Response Surface Methodology”, John Wiley & Sons, New York, 1995.