Το έργο με τίτλο Υπερπαραμετροποιημένα νευρωνικά δίκτυα βαθείας μάθησης: Ιδιότητες σύγκλισης και γενίκευσης από τον/τους δημιουργό/ούς Polyzos Christos διατίθεται με την άδεια Creative Commons Αναφορά Δημιουργού 4.0 Διεθνές
Βιβλιογραφική Αναφορά
Χρήστος Πολύζος, "Υπερπαραμετροποιημένα νευρωνικά δίκτυα βαθείας μάθησης: Ιδιότητες σύγκλισης και γενίκευσης", Διπλωματική Εργασία, Σχολή Ηλεκτρολόγων Μηχανικών και Μηχανικών Υπολογιστών, Πολυτεχνείο Κρήτης, Χανιά, Ελλάς, 2023
https://doi.org/10.26233/heallink.tuc.97293
In this thesis, we consider deep neural networks for Machine Learning. We depict neural networks as weighted directed graphs and we represent them as parametric functions that receive an input and compute an output, or prediction, given some fixed parameters, the weights and the biases. The quintessence of a neural network is the feed-forward model, in which the underlying graph does not contain cycles (acyclic graph) and the parametric function is defined in a compositional, or hierarchical, way.Throughout our presentation, we focus on a supervised learning setting, where our neural network model, or learner, has access to a training set that contains examples of how pairs of input-output data are related. In other words, supervised learning amounts to learning from examples. Given a training set, depending whether the outputs have real or categorical values, we consider regression and logistic regression. For each setting, we provide the basic statistical framework and construct a loss function known as the empirical risk. We train our neural network by minimizing the empirical risk w.r.t. its parameters by using gradient-based optimization methods. The gradient of the loss function is computed via the back-propagation algorithm.We showcase the convergence and generalization properties of different algorithms (deep neural network models and optimization methods) using real-world data.