Selected Topics in ASC (STASC)5 ECTS
(englische Bezeichnung: Selected Topics in ASC)
(Prüfungsordnungsmodul: Technische Wahlpflichtmodule)

Lectures:

• • Selected Topics on Machine Learning
    (Vorlesung, Gastredner, Mon, 8:15 - 9:45, 05.025; Tue, 14:15 - 15:45, 05.025; Wed, 16:15 - 17:45, 05.025; Thu, 10:15 - 11:45, 05.025; Fri, 12:15 - 13:45, 05.025; from 24.6.2019 to 26.7.2019)

Inhalt:

Introduction: What is Machine Learning, some typical examples

Learning in Parametric modelling- Basic Concepts: Parametric vs non-parametric modelling, regression, least squares, classification, supervised vs unsupervised and semisupervised learning, bias and unbiased estimation, MSE optimal estimation, the bias-variance trade-off, inverse problems and overfitting, regularization, the maximum likelihood method, curse of dimensionality, cross validation.

Classification-A tour to the Classics: Bayes optimal classification, minimum distance classifiers, the naïve Bayes classifier, risk optimal classification, nearest neighbor classifiers, logistic regression, decision trees.

Learning in reproducing kernel spaces: The need for nonlinear models, Cover’s theorem and capacity in linear dichotomies, reproducing kernel Hilbert spaces, kernels and the kernel trick, representer theorem, kernel ridge regression, support vector regression, margin classifiers and support vector machines.

Bayesian Learning: Maximum likelihood, Maximum a-posteriori, Bayesian approach, the evidence function and Occam’s razor rule, Laplacian approximation, the exponential family of probability distributions, latent variables and the EM algorithm, linear regression via the EM algorithm, Gaussian mixture models, variational approximation to Bayesian learning, variational Bayesian and linear regression, variational approach and mixture modelling, the relevance vector machine framework, Gaussian processes, nonparametric Bayesian learning: Chinese restaurant process and indian buffet process.

Neural Networks and deep learning: The perceptron and the perceptron rule, feed-forward neural networks, the backpropagation algorithm, selecting the cost function and the output nonlinearity, diminishing and expanding gradients, the ReLU activation function, pruning networks and the dropout method, universal approximation properties of neural networks, the need for deep architectures: representation, optimization and generalization properties, convolutional networks, convolution over volumes, 1X1 convolution, inception and residual networks, recurrent neural networks, adversarial training, transfer learning, generative adversarial networks, capsule modules, deep belief networks, autoencoders.

Lernziele und Kompetenzen:

The students analyze and explain recent research results presented by prominent guest professors with high international scientific reputation. The students incorporate the addressed topics and research results into their own experiences and knowledge in signal processing and communications. They use the material presented in this course in their major or minor project and/or in their Master Thesis. They develop new scientific results in the addressed research fields.

Bemerkung:

The course is given by the guest lecturer Sergios Theodoridis (Professor of Signal Processing and Machine Learning in the Department of Informatics and Telecommunications of the University of Athens)

Weitere Informationen:

Verwendbarkeit des Moduls / Einpassung in den Musterstudienplan:

1. Communications and Multimedia Engineering (Master of Science)
   (Po-Vers. 2011 | TechFak | Communications and Multimedia Engineering (Master of Science) | Gesamtkonto | Wahlpflichtmodule | Technische Wahlpflichtmodule)

Studien-/Prüfungsleistungen:

Selected Topics in Signal Processing and Communications (Prüfungsnummer: 572396)

(englischer Titel: Selected Topics in Signal Processing and Communications)

Prüfungsleistung, Klausur, Dauer (in Minuten): 90, benotet

Anteil an der Berechnung der Modulnote: 100.0 %

Erstablegung: SS 2019

1. Prüfer:

André Kaup