40720 - Data Mining

Academic Year 2022/2023

Course contents

The course is organized on two modules. The first one is shared by both the students from Ingegneria e Scienze Informatiche (ISI), and the strudents from Digital Transformation Management (DTM). The second module is specific to each degree.

------------ Module I: Data Mining (ISI + DTM)

1. Introduction to Data Mining: areas of applicability

2. The knowledge discovery process

  • Designing a Data Miing Process
  • The CRISP-DM methodology

3. Understanding and preparing data

  • Features of different data types
  • Statistical data analysis
  • Data quality
  • Preprocessing: attributes selection and creation
  • Measuring similarities and dissimilarities

4. Data mining techniques

Classification through decision trees and bayesian networks

  • Association rules
  • Clustering
  • Outlier detection

5. Data understanding and validation

6. The Weka software [http://www.cs.waikato.ac.nz/ml/weka/]

7. Case studies analysis

------------ Modulo II ISI: Text Mining (Prof. Gianluca Moro)

Text Mining techniques

  • Information Retrieval for Text Mining
  • Text categorization
  • Opinion Mining

------------ Modulo II DTM: Machine Learning (Prof. Guido Borghi)

1. Neural Network & Pattern Recognition

  • Neural Networks (NN)
  • Introduction to Deep Learning
  • Introduction to Pattern Recognition
  • Convolutional Neural Networks (CNN)

2. Data science Lab in Python

  • Data acquisition and processing
  • Public datasets
  • Feature Extraction
  • Metrics


------------ Modulo I: Data Mining (ISI + DTM)

Pang-Ning Tan, Michael Steinbach, Vipin Kumar Introduction to Data Mining. Pearson International, 2006.

------------ Modulo II ISI: Text Mining (Prof. Gianluca Moro)

Christopher Manning, Hinrich Schutze, Prabhakar Raghavan. Introduction to Information Retrieval. Cambridge University Press, 2008.

Teaching methods

Lessons and practical exercises

Assessment methods

Oral examination and discussion of a project. The project must be decided with one of the two lecturers and can be either the implementation of mining algorithm or the analysis of a dataset using data and text mining techniques.

The goal of the assessment is to verify the cohmprension of the sudied techniques as well as the pratical capability to analyze data and understand and discover the hidden information.

Grades are assigned on the basis of an overall assessment of knowledge, skills, presentation and discussion skills of the topics covered. The ranges of grades correspond can be described as follows:

18-23: the student has sufficient preparation and analytical skills, spread however, over just few topics taught in the course, the overall jargon is correct

24-27: the student shows and adequate preparation at a technical level with some doubts over the topics. Good, yet not to articulate analytical skills with the use of a correct jargon

28-30: Great knowledge about most of the topics taught in the course, good critical and analytical skills, good usage of the specific jargon

30L: excellent and in depth knowledge of all the topics in the course, excellent critical and analytical skills, excellent usage of specific jargon.

Teaching tools

Practical exercises will be carried out using the open source Weka, R and Python (Colab)

Office hours

See the website of Matteo Golfarelli

See the website of Gianluca Moro