Art project translates music from Teenage Engineering's OP-Z synth into AI-generated imagery

W. ShanklinNovember 15, 2022 6:30 PMIn this short article: news, equipment, synthesizer, secure diffusion, Teenage Engineering, synesthesia, amusement, synth, AI artworkModem

AI-produced artwork is a new frontier rife with probable. But for each thorny question about copyright and the opportunity for widespread manipulation, produced artwork can also inspire ponder and awe. For example, search no even more than this AI-run experiment that creates kaleidoscopic visible landscapes for composed audio.

A collaboration in between quirky synth and hardware brand Teenage Engineering and style and design studios Modem and Bureau Interesting, the task draws inspiration from the neurological problem synesthesia. This scarce phenomenon leads the brain to perceive sensory enter for numerous senses alternatively of a single. For instance, a listener with synesthesia might see music alternatively of only hearing it, observing coloration, movement and form in reaction to musical styles. Conversely, a synesthetic particular person may perhaps flavor styles, feel words from a novel or listen to an summary painting.

The audiovisual experiment works by using the Teenage Engineering OP-Z sequencer as the tunes supply that is then translated into AI artwork. In true-time, Modem and Bureau Cool’s “digital extension” translates musical qualities into textual content prompts describing shades, shapes and movements. These prompts then feed into Secure Diffusion (an open up-resource software related to DALL-E 2 and Midjourney) to make dreamy and synesthetic animations.

Flip on browser notifications to acquire breaking information alerts from EngadgetYou can disable notifications at any time in your configurations menu.Not nowTurn onTurned onTurn on

Modem co-founder Bas van de Poel sees the experiment as gas for artists’ imaginations. “With the venture, we see the potential for musicians to take a look at new kinds of creative imagination, facilitating a joint performance amongst human and device,” van de Poel instructed Engadget today.

iThis content is not obtainable because of to your privacy tastes. Update your settings here, then reload the webpage to see it.

If you’re a musician who owns Teenage Engineering’s OP-Z, you cannot nonetheless use the extension on your own — but that may possibly eventually transform. Van de Poel tells Engadget that the organizations are “exploring the likely of launching a community version.”

This AI-dependent undertaking is not the to start with to bring synesthetic properties to the masses. Past yr, Google Arts & Tradition designed an exhibition that flipped the strategy close to, bringing device-studying-developed sound to Vassily Kandinsky’s paintings.

All products and solutions proposed by Engadget are picked by our editorial staff, unbiased of our mother or father firm. Some of our tales involve affiliate links. If you acquire one thing by means of one particular of these one-way links, we might earn an affiliate commission. All selling prices are suitable at the time of publishing.


Some parts of this article are sourced from:
engadget.com