Selected Topics on Deep Learning over Structured Data

A course given at the Henry and Marilyn Taub Faculty of Computer Science, Technion - Israel Institute of Technology

Students
Projects
Instructor Prof. Benny Kimelfeld
Meetings Lecture + Tutorial
Credits 3 credits
Contact Course staff

Course Overview

This course studies machine learning methods for structured data, with an emphasis on relational databases, tables, and graphs. We will examine how these data representations are connected, and how learning methods can move between database-specific, schema-aware, and cross-schema settings.

Topics include feature engineering and automated feature generation, vector embeddings, graph neural networks, transformer-based foundation models, and explainability methods for model predictions. Tutorial sessions will focus on implementing the covered methods using modern libraries for machine learning, deep learning, and graph processing.

Tabular ML Graphs Graph Neural Networks Relational Databases Relational Deep Learning Relational Foundation Models

Course Staff

Resources

Teaching materials for the course, including slide decks and video playlists where available.

Lecture Modules

Module 1

Fundamental Concepts in Structured ML

101 pages

Module 2

Structured Learning via Tabular Learning

100 pages

Module 4

Crash Course on Deep Learning

73 pages

Module 5

Message-Passing Graph Neural Networks

98 pages

Module 6

Relational Foundation Models

98 pages

Tutorials

Tutorial 1

Deep Learning Review

28 pages

Slides
Tutorial 2

Tabular Feature Engineering

33 pages

Slides
Tutorial 3

Graph Feature Engineering

30 pages

Slides
Tutorial 4

Dimensionality Reduction

26 pages

Slides
Tutorial 5

Embedding

30 pages

Slides
Tutorial 6

Intro to GNNs

40 pages

Slides
Tutorial 7

Scalability of GNNs

33 pages

Slides
Tutorial 8

Expressivity

31 pages

Slides
Tutorial 9

Attention and Transformers

23 pages

Slides

More Resources

Code Starter notebooks