Artificial Models for Multimodal Creativity: Part 1

The content on this page was translated automatically.

Subject according curriculum

Multimedia

Teachers

Scope

Each session will take place from 2:30 p.m. to 7:30 p.m. on the following dates: October: 16, 23, 30; November: 6; December: 4, 18 (online).

Room

ELA 5 (Grün 005)

Duration

2 Semesterwochenstunden

Description

This practical course provides the foundational skills needed to integrate machine learning into creative work. Through intensive seminars, students will gain hands-on experience in generating and manipulating audio and video using contemporary AI models.

Core Topics:
1. Technical setup, essential libraries, and notebooks.

2. ML Fundamentals: Core concepts of neural networks and data preprocessing for art.

3. Audio Generation: Hands-on work with models such as RAVE and FluCoMa for analysis and synthesis, with a focus on dataset curation and deployment in environments such as Max/MSP.

4. Video Generation: Practical application of Stable Diffusion and TouchDesigner for creating and controlling generative video.

Literature

1. Sofian Audry: "Art in the Age of Machine Learning," MIT Press, 2021;
2. David Foster: "Generative Deep Learning: Teaching Machines to Paint, Write, Compose, and Play" (2nd edition), O'Reilly, 2023 – (excerpts);
3. Additional material provided by the instructor;

Credits

4 Creditpoints

Comments

The course is conducted in English and is offered in person. It is structured as an annual program, and students are strongly encouraged to attend the entire course to get the most out of it. Although prior knowledge of Python is not required, students are expected to independently acquire the basic Python skills necessary to understand the essential concepts covered in the course. During the first class, suggestions and links for learning the fundamentals of Python online will be provided.

For further details, contact the instructor at alessandro [dot] anatrini [at] hfmt-hamburg [dot] de

Modules

CoPeCo, Multimediale Komposition (Jazzkomposition Master), Technisches Wahlmodul 1 Multimediale Komposition Master, Technisches Wahlmodul 2 Multimediale Komposition Master, Berufsvorbereitendes Wahlmodul Master, Wahlmodul freie Wahl (alle Studiengänge), Wissenschaftliches Modul Multimediale Komposition Master