Sensorium: Perceptual Construction as Artistic Process

Fach laut Studienplan

Multimediale Komposition

Lehrende

Yuri Akbalkan

Semester

Wintersemester 2023/2024

Termin

noch zu vereinbaren

Raum

siehe Aushang

Dauer

0.75 Semesterwochenstunden

Beschreibung

[Auf Englisch] Overview and the course goals: By this course, the aim is to explore perceptual construction as artistic process in terms of multimedia art. The course is designed to communicate academia and art community. Learning materials are expected to be graspable by artists from different branches of art as well as to be available to the general public and people interested in the cross-section between art and science.
By the end of this course, you will have a much greater understanding of what perceptual construction is, and how it relates to art. We are going to review the most revealing example artworks to show how human perception can be constructed in a deliberate way, as well as to analyse these works by linking them to the corresponding sensory modalities. The information covered in this course will also provide insight into how this knowledge has been and can be applied by artists in order to create art. After all, you will have a rich array of different perceptual-construction techniques to explore.

Abstract: Perceptual-construction techniques have been exploited by artists and engineers over the centuries. In particular optical, auditory, and space perception constructs were always used by painters, composers, and architects. All these techniques were barely systematically and consistently examined in their entirety. This brings us to the main goal of this course which is to explore perceptual construction as an artistic tool.
In this usage, the term ‘perceptual construct’ refers to the construction of perception through sensory modalities. This concept also includes or can be linked to Gestalt psychology, top-down/bottom-up processing approaches, and other theories that aim to show and describe how human perception can be constructed in a deliberate way. The following species of perceptual constructs are included in the course: optical, auditory, haptic, olfaction, taste, proprioception, kinaesthesia, nociception, temperature, time, and space perception constructs.

Target groups: The course is designed for both professionals (composers, multimedia artists, art theorists, artists from different branches of art) and the general public (people interested in cross-section between art and science).

Literatur

[Vision]: Bachmann, T. (2016). Perception of Pixelated Images. Academic Press. DOI: 10.1016/B978-0-12-809311-5.00011-8.
Da Vinci, L. & Pedretti C. & Biblioteca ambrosiana (c. 1478–1518; 1978-1979). The Codex Atlanticus of Leonardo da Vinci: a catalogue of its newly restored sheets. Johnson Reprint Corporation, Harcourt Brace Jovanovich Publishers, New York. URL: http://codex-atlanticus.ambrosiana.it/
Harmon, L. D. (1973). The recognition of faces. Scientific American, 229(5), 71–82. URL: https://www.scientificamerican.com/magazine/sa/1973/11-01/
Harmon, L. D. & Julesz, B. (1973). Masking in Visual Recognition: Effects of Two-Dimensional Filtered Noise. Science, 180, 1194-1197. URL: http://www.hms.harvard.edu/bss/neuro/bornlab/qmbc/beta/day4/harmon-julesz-lincoln-science1973.pdf
Harmon, L. D. & Knowlton, K. C. (1969). Picture Processing by Computer: Computers which process graphical material are new, powerful tools for science, engineering, education, and art. Science, 4 Apr 1969, Vol 164, Issue 3875, pp. 19-29. DOI: 10.1126/science.164.3875.19
Julesz, B. (1971). Foundations of Cyclopean Perception. University of Chicago Press. URL: https://psycnet.apa.org/record/1973-26089-000/
Lacan J. & Miller J.-A. & Sheridan A. (1994). The four fundamental concepts of psycho-analysis (Reprinted with an introduction). Penguin.
Martinez-Conde, S. & Conley, D. &, Hine, H. & Kropf, J. & Tush, P. & Ayala, A. & Macknik, S. L. (2015). Marvels of illusion: illusion and perception in the art of Salvador Dali. Frontiers in Human Neuroscience, Sep 29, 2015. DOI: 10.3389/fnhum.2015.00496
Smith, A. R. (1995). A Pixel Is Not A Little Square, A Pixel Is Not A Little Square, A Pixel Is Not A Little Square! (And a Voxel is Not a Little Cube). Microsoft, Technical Memo 6, July 17, 1995. URL: http://alvyray.com/Memos/CG/Microsoft/6_pixel.pdf
Stromeyer, C. F. & Julesz, B. (1972). Spatial-frequency masking in vision: critical bands and spread of masking. Journal of the Optical Society of America, 62 10, 1221-32. https://doi.org/10.1364/JOSA.62.001221/
The Millennium Project. The one hundred most influential works in cognitive science. From the University of Minnesota's Center for Cognitive Sciences. In: https://web.mnstate.edu/schwartz/cogsci100.htm

[Audition]: Békésy, G. von (1961). Concerning the pleasures of observing, and the mechanics of the inner ear. Nobel Lecture. URL: https://www.nobelprize.org/prizes/medicine/1961/bekesy/lecture/
Braus, I. (1995). Retracing One’s Steps: An Overview of Pitch Circularity and Shepard Tones in European Music, 1550–1990. Music Perception: An Interdisciplinary Journal, 12(3), 323–351. DOI: 10.2307/40286187.
Bregman, A. S. (1990). Auditory Scene Analysis. The Perceptual Organization of Sound. MIT Press. ISBN: 9780262022972.
Butler, D. (1979). A further study of melodic channeling. Perception & Psychophysics, 25, 264–268.
Butler, D. (1979). Melodic channeling in a musical environment. Paper presented at the Research Symposium on the Psychology and Acoustics of Music, Kansas.
Carlson, S. (1996). Dissecting the brain with sound. Scientific American, 275(6), 112–115.
Deutsch, D. (1974). An illusion with musical scales. Journal of the Acoustical Society of America, 56, s25. DOI: 10.1121/1.1914084
Deutsch, D. (1975). Musical Illusions. Scientific American, 233(4), 92–104. URL: https://www.scientificamerican.com/article/musical-illusions/
Deutsch, D. (1975). Two-channel listening to musical scales. Journal of the Acoustical Society of America, 57, 1156-1160. URL: http://deutsch.ucsd.edu/pdf/JASA-1975_57_1156-1160.pdf
Deutsch, D. (1979). Binaural integration of melodic patterns. Perception and Psychophysics, 25, 399-405. URL: http://deutsch.ucsd.edu/pdf/PandP-1979_25_399-405.pdf
Deutsch, D. (1982). The Psychology of Music (3rd ed. 2013). San Diego: Elsevier. DOI: 10.1016/C2009-0-62532-0
Deutsch, D. (1982). The Psychology of Music. Academic Press Series in Cognition and Perception. New York: The Academic Press. URL: https://books.google.lu/books?id=YW1aBQAAQBAJ&hl
Deutsch, D. (1983). Auditory illusions, handedness, and the spatial environment. Journal of the Audio Engineering Society, 31, 607-618
Deutsch, D. (1985). Dichotic listening to melodic patterns, and its relationship to hemispheric specialization of function. Music Perception, 3, 1-28. URL: http://deutsch.ucsd.edu/pdf/MP-1985_3_127-154.pdf
Deutsch, D. (1986). Auditory pattern recognition. In Boff, K. & Kaufman, L. & Thomas, J. (Eds.) Handbook of Perception and Human Performance, Wiley, 32, 1-44.
Deutsch, D. (1987). Illusions for stereo headphones. Audio Magazine, March, 1987, 36-48. URL: http://deutsch.ucsd.edu/pdf/Audiomag-1987.pdf
Deutsch, D. (1999). Grouping mechanisms in music. In D. Deutsch (Ed.) The psychology of music, 2nd Edition, Academic Press, 299-348. URL: http://deutsch.ucsd.edu/pdf/PsychMus_Ch9.pdf
Fletcher, H. (1940). Auditory Patterns. Reviews of Modern Physics, 12 (1). 47-65. DOI: 10.1103/RevModPhys.12.47
Hajdu, G., Loui, P., MacCallum, J., Burger, B., & Wöllner, C. (2021). The Science of Music. MUTOR 2.0 (MUsic Technology Online Repository). URL: https://mutor-2.github.io/MUTOR/
Helmholtz, H. L. F. (1875). On the Sensations of Tone as a Physiological Basis for the Theory of Music. Cambridge University Press, 3rd edition, 2009. ISBN: 9780511701801. DOI: 10.1017/CBO9780511701801.
MacCallum, J. & Einbond, A. (2008). Real-Time Analysis of Sensory Dissonance. Kronland-Martinet, R., Ystad, S., Jensen, K. (eds) Computer Music Modeling and Retrieval. Sense of Sounds, LNCS 4969, pp. 203-211. DOI: 10.1007/978-3-540-85035-9_13
Mathews, M. V. (1963). The digital computer as a musical instrument. Science 142, 553–557. DOI: 10.1126/science.142.3592.553.
Plomp, R. & Levelt, W. J. M. (1965). Tonal Consonance and Critical Bandwidth. The Journal of the Acoustical Society of America 38, 548. DOI: 10.1121/1.1909741
Risset, J. C. (1986). Pitch and Rhythm Paradoxes: Comments on ‘Auditory Paradox Based On Fractal Waveform’. Journal of the Acoustical Society of America, 80(3): 961–962. DOI: 10.1121/1.393919
Shepard, R. N. (1964). Circularity in Judgements of Relative Pitch. Journal of the Acoustical Society of America 36 (12), 2346–2353. DOI: 10.1121/1.1919362
Stevens, S. S. & Volkmann, J. (1940). The Relation of Pitch to Frequency: A Revised Scale. The American Journal of Psychology, 53(3), 329–353. DOI: 10.2307/1417526.
Stevens, S. S. & Volkmann, J. & Newman, E. B. (1937). A Scale for the Measurement of the Psychological Magnitude Pitch. The Journal of the Acoustical Society of America 8, 185-190 DOI: 10.1121/1.1915893.

[Time and Space Perception]: Bergson, H. (1889). Time and Free Will: An Essay on the Immediate Data of Consciousness. Translated by Frank Lubecki Pogson. George Allen & Company, Ltd. 1913. URL: https://www.gutenberg.org/ebooks/56852.
Fabian, J. (1983, ed. 2014). Time and the Other: How Anthropology Makes Its Object. Columbia University Press. DOI: 10.7312/fabi16926.
Heidegger, M. (1927). Sein und Zeit. De Gruyter, 2006. ISBN: 978-3-484-70153-3.
Klein, S. (2007). The Secret Pulse of Time: Making Sense of Life's Scarcest Commodity. Da Capo Lifelong Books. URL: https://www.hachettebookgroup.com/titles/stefan-klein/the-secret-pulse-of-time/9780738212562/
Klein, S. (2008). Time out of Mind. New York Time, OpEd, March 7, 2008. URL: https://www.nytimes.com/2008/03/07/opinion/07klein.html
Klein, S. (2008). Zeit: Der Stoff, aus dem das Leben ist. Eine Gebrauchsanleitung. URL: https://www.fischerverlage.de/buch/stefan-klein-zeit-9783104032511
McTaggart, J. M. E. (1908). The Unreality of Time. Mind, 17(68), 457–474. URL: http://www.jstor.org/stable/2248314
Merleau-Ponty, M. (1962). Phenomenology of perception. London: Routledge.
Smolin, L. (2013). Time Reborn: From the crisis in physics to the future of the universe. Houghton Mifflin Harcourt.

Credits

3 Creditpoints

Bemerkung

Raum: ligeti zentrum, Veritaskai 1, 21079 Hamburg

Module

Wissenschaftliches Modul Multimediale Komposition Master