87994 - PATTERN RECOGNITION

Scheda insegnamento

SDGs

L'insegnamento contribuisce al perseguimento degli Obiettivi di Sviluppo Sostenibile dell'Agenda 2030 dell'ONU.

Salute e benessere Istruzione di qualità Parità di genere Imprese innovazione e infrastrutture

Anno Accademico 2020/2021

Conoscenze e abilità da conseguire

At the end of this course the student will learn the principles and commonly used paradigms and techniques of pattern recognition. In particular he/she will be able to: - explain and compare a variety of pattern classification techniques, - apply performance evaluation methods for pattern recognition, - apply pattern recognition techniques to real-world problems in the Applied Physics field, - implement simple pattern classifiers, - demonstrate successful applications to process and analyze data (e.g. images), and make automatic decisions based on extracted feature information.

Contenuti

24 hours (3 CFU) Castellani

Introduction Probability Theory, Probability densities, Expectations and covariances, Bayesian probabilities, Bayesian curve fitting, Model Selection, the Curse of Dimensionality, Statistical Inference and decision, loss functions for regression

Probability Distributions Binary and Multinomial Variables, Beta, Dirichlet and Gaussian Distribution, Gaussian Mixtures, the Exponential Family, maximum likelihood and sufficient statistics, Conjugate priors, Noninformative priors, Nonparametric Methods Inference and association test

Linear models for Regression and Classification Linear Basis Function Models, Bias-Variance Decomposition, Bayesian Linear Regression, Bayesian Model Comparison, Discriminant Functions, Probabilistic Generative and Discriminative Models

Neural Networks Learning rules, Hebbian,BCM and Hopfield model, Feed-forward Network Functions, Network Training, Error Backpropagation, Regularization,

Introduction to Kernel methods and Graphical models

24 hours (3 CFU) Remondini

Feature extraction & optimal projection:

Principal Component Analysis, Singular Value Decomposition, Factor Analysis, Multi-Dimensional Scaling, ISOMAP, Relation to cost function maximization and eigenvalue problem (Rayleigh quotient), Practical aspects: data regularization and normalization.

Supervised classification:

Support Vector Machine, Discriminant Analysis, Random Forest.

Unsupervised clustering:

Hierarchical, k-means, spectral clustering techniques.

Introduction to Deep Learning:

Error minimization: the backpropagation algorithm.,Feedforward Neural Networks., Convolutional Neural Networks.

Robust analysis

Bias-variance dilemma, Best practices, Crossvalidation procedures

Testi/Bibliografia

Bishop - Machine learning and pattern recognition

Tibshirani Tusher - Methods of statistical learning

Metodi didattici

Slides and blackboard

Modalità di verifica dell'apprendimento

roject, literature study and questions.

Strumenti a supporto della didattica

Programming environment and server connection

Orario di ricevimento

Consulta il sito web di Gastone Castellani

Consulta il sito web di Daniel Remondini