Institutional Repository [SANDBOX]
Technical University of Crete
EN  |  EL

Search

Browse

My Space

On the use of random-walk based training algorithms for neural networksapplied in environmental engineering

Nikolos Ioannis, Trichakis Ioannis, Karatzas Giorgos

Full record


URI: http://purl.tuc.gr/dl/dias/74FECAF2-8496-45C8-9BEF-140FDE4A5927
Year 2010
Type of Item Conference Full Paper
License
Details
Bibliographic Citation I.C. Trichakis, I.K. Nikolos, G.P. Karatzas. (2010, June). On the Use of Random-Walk Based Training Algorithms for Neural Networks Applied in Environmental Engineering. Presented at XVIII International Conference on Water Resources. [Online]. Available: http://www.researchgate.net/publication/228747668_ON_THE_USE_OF_RANDOM-WALK_BASED_TRAINING_ALGORITHMS_FOR_NEURAL_NETWORKS_APPLIED_IN_ENVIRONMENTAL_MODELING
Appears in Collections

Summary

Neural networks have found their way in environmental modeling and their use increases with time. The physical systems though are quite complicated and difficult to describe. This may result in poor training when a traditional method like Back-Propagation (BP) or even a more advanced like Conjugate Gradient (CG) is applied. These methods have the advantage that they converge to a minimum after a finite number of iterations, but this minimum could be a local one. In this work, a neural network that simulates the change to an aquifer's level between successive days, using hydrological and meteorological parameters as inputs, is trained using different algorithms in order to evaluate whether the conventional, widely accepted, methods may be trapped in local minima. An alternative training procedure, a random walk (RW) based training algorithm, proposed by Tan and Gu 1 is used as a better methodology to explore the solution hyperspace. The alternative algorithms are tested in two field cases, related to karstic aquifers, where adequate field measurements are available. One must never forget though that algorithms like the random-walk based one may provide better results than BP or CG but on the cost of large computational times. As a second remark these methods' convergence rate depends on the selection of the method's parameters. The use of RW based algorithms could prove to be valuable when a researcher is trying to discover if the widely used methods converge to a subpar local optimum.

Available Files

Services

Statistics