Digital Craft Minor 4th Year: Cybernetics

Project 1: Critical Making exercise

Reimagine an existing technology or platform using the provided sets of cards. For this first project, I grouped up with Tutu, Thijs and Naima and we picked three random cards each from different category.

Inspiration

Our starting point

Prototype

Project 2: Cybernetic Prosthetics

Starting Point

Our first inspiration from nature, as a biomimicry was how whales communicate underwater. They communicate ultrasonic sound.

Research

There were several interesting facts on how whales communicate and various examples how the ultrasonic can be used in real world.

Insight from Research

However, we could not really drag one new idea we can work on derived from ultrasonic. We were watching some youtube video with whale sound and found that it is actually used for calming effect, and meditation usage. From this, we were thinking it would be nice to actually feel and hear as if we were under the sea. What if we make a device transform our surrounding to underwater by means of sound?

Plan

We decided to use a hydrophone, a jar, and a recorder with which we can hear the input directly monitored to the headphone. However a hydrophone was too expensive, so we asked Rob in Image and Sound station and he recommended us to cover a regular microphone with a condom.

First Testing

Making Prototype

Final Result

Aquatic Acoustic

Video Link : https://vimeo.com/292687674

Project 3: From Devices to systems

Cassette recorder to Electromagnetic noise detector

Final Project (RESEARCH DOCUMENT)

Position Paper_H Jung

Introduction

I take art as a mode of communication, which shows the exploration of my interests and thoughts. I try to capture how I am conscious with my surroundings and intrigue the audiences to question their own. I have been experimenting with different media, mainly photography, text, and sculpture, and came to the new media technology facing the fact that it is an inevitable yet fascinating medium. In spite of my fascination to technology, I could not develop my skillset in this field due to my broad interests. Therefore I chose Digital Craft as Minor to limit myself to actually work in certain context. I believe limitation gives you even more freedom and focusing on certain media and deepening is very important. As an artist, you should be able to utilise any media which is the most suitable to your work. The immersive effect of new media technology is very powerful. Since I become more aware of my recurring theme, I wanted to find the most effective way to express my contemplation. My work has been more of presenting art objects which derived from my own experience and has narratives behind. However, for me, art is not necessarily about delivering messages. It is more about providing a moment, event, environment by sending an invitation to people to meditate, be in the moment with the artwork. I found the connection between my works and the context of Digital Craft as immersion of new media and an interactive conversation of the audiences and their surroundings. Moving things and images, bright screens, LED lights, amplified sounds, new media brought us next level of immersion in our daily lives. However, such an effect made us to easily lose our concentration, mindfulness and need stronger stimulus. I wanted to make use of new media technology to provide audiences immersive effects and question the meaning of being conscious at the same time. Such as how important it is to be mindful in reality. I wanted to know what media technologies are out there nowadays and what kind of topics are being discussed at the moment. Besides, I also like the concept of combining digital and analogue, respecting the value of craftmanship. I appreciate physicality in art form, and working with spatial functionality enables me to create a zone with the artwork and give an immersive effect on audiences.

Research Question

Sound is the most immediate and immersive media to me. It is abstract yet very tangible and physical at the same time. We respond on in directly which I conceive as a bodily reaction. Therefore, my starting point of this project was 'sound' which developed into making use of sound for an interactive installation to make people conscious of their surroundings combined with other new media technologies. Sound has been my all time biggest interest. I have been always fascinated by weird noise and electronic music. Therefore I decided to research on digital audio processing and how to produce electronic music. Besides, I chose to do something has to do with audio for the former exercises to narrow down which aspects and elements of sound I want to further develop specifically. In exercise 2, as a group, we made a device to experience being underwater, using water as an analogue sound filter for surrounding. In exercise 3, I dissembled a tape player and transformed it into an electromagnetic noise detector using the tape head reads sound when it was close to magnetic. From exercise 2 and 3, I dragged my research topic as our perception to sound around us. I pointed the hypnotising and meditating effect of sound since it brings us to another state of mind. I also wanted to identify myself what is the border between sound art and music. Therefore, my research question became “How do we perceive sound around us? How does it affect us? How do we find it meaningful?”

Research Approach

(how do you define and design your research? what activities/approaches/methods will you pursue while conducting your research?)

My research process is mainly divided into two parts. Firstly, I read much literatures and information to find some interesting and relevant feature to me from the broad context and then narrow down to few things from which I would develop further, connecting them to do some practical exercises. Second, I do practical research on certain material, methodologies, skills by working on them. This two researches can go back and forth since I actually always come across with unexpected features and have new idea by doing practical research. It never really worked out as I assumed with theoretical and thought research, and the conclusion has always changed. Therefore, I would like to keep my research question open, but still limiting the main theme since I can be lost easily from too broad context and topics. By keeping the research question open, I can analyse the process and formulate rather specific questions inside. At the beginning of this project, I didn't know which elements and aspects of sound I wanted to further work on yet. However from the exercises I dragged my research question as "How we perceive sound around us and how does it affect us?" From this point, I will do more experiments extended from the former exercise of using hydrophone water as an analogue filter. From this, I will figure out if it works. If it doesn't, at least I know what works and not and there should be some other aspects come up afterwards, for instance from the contact microphone or the material and size of the jar, etc.

Inspiration/Reference

Sound art, using sound as an art medium, has been explored a lot in last decades. There are also many well-known and overlapping terms such as Experimental music, Avant-garde music, Electroacoustic music etc. To position my topic within the art context, I researched the relevant history of Experimental music and Sound art, and contemporary practitioners to whom I can relate. I am quite familiar with the history of Electronic music, Dance music especially, so it was interesting to make connection between them and juxtapose.

Historical context

Electroacoustic Music

Electroacoustic music is a style of Western art music which originated around the middle of the 20th century, following the incorporation of electric sound production into compositional practice. All electroacoustic music is made with electronic technology, specifically a device – usually a loudspeaker – that transduces electrical energy to acoustic energy. I found this relevant to my practice since I want to combine electronic sound with physical, acoustic elements. Music Concrete

John Cage

Indeterminacy in music, Silence lectures and writing by Cage

Indeterminate/aleatoric music

chance-controlled, composed for prepared piano music

Pierre Schaeffer

Musique Concrete, Found Sound, Sampler, In Search of a Concrete Music

Musique Concrete

Acousmatic music

Live music

Contemporary practitioners

When I was researching to figure out on which aspect of sound I could work, I came across with several musicians and artists inspired me. The Netherlands itself has been a leading scene for electronic music pioneers.

Dick Raaijmakers

Phono-kinetic object

He is considered as someone who combines disciplines such as visual art, film, literature and theatre with the world of music. One of his most important books is The Method (1985), in which he describes in an exact but also poetic way how motion, cause and effect and their perception are interrelated.

Caterina Barbieri

Caterina Barbieri is a Berlin-based Italian composer who explores themes related to machine intelligence and object oriented perception in sound through a focus on minimalism. Caterina explores the psycho-physical effects of repetition and pattern-based operations in music, by investigating the polyphonic and polyrhythmic potential of sequencers to draw severe, complex geometries in time and space. Approaching music practice as an integrative cognitive feedback between humans and technology lies at the core of her current sonic research. Barbieri holds a diploma in classical guitar and a bachelor's degree in electro- acoustic music from the conservatory of Bologna, Italy, alongside a bachelor's degree from the Faculty of Humanities and Philosophy of Bologna with a thesis in Ethnomusicology about Hindustani music and minimalism. She gave me insights about minimalist music and process music.

Tomoko Sauvage

Japanese musician and artist active since mid 2000’s, investigates the sculpturality of sound and improvisation in relation to the environment. Mainly known for a musical / visual research about ‘natural synthesizer’ of her invention, composed with diverse fluid, bowls, ceramic, light and underwater amplification, Sauvage’s approach is attached to questions of alchemy, meditation and balance between hazard and mastery. Under the form of performances, installations and musical compositions, her work is regularly presented in Europe, Asia and America. For more than ten years, Tomoko Sauvage has been investigating the sound and visual properties of water in different states, as well as those of ceramics, combined with electronics. China bowls of different sizes, filled with water and amplified via hydrophones (underwater microphones), waterbowls is a kind of natural synthesizer that generates fluid timbre using waves, drops and bubbles. These recipients resonate and also produce subaquatic feedback, an acoustic phenomenon that requires fine tuning depending on the amount of water, a subtle volume control and interaction with the acoustic space. Through primordial materials and playful gestures, Tomoko Sauvage searches for a fragile balance between randomness and discipline, chaos and order.

Field Research/Events

While doing researches and working on the project, I visited several events, performances and exhibitions for inspirations and see how the relevant practices are held in real world.

V2 Klankvorm

I am doing volunteer work in V2 and had a chance to do a shift during this event. I was interested in the organisation Klankvorm already from their concept and performance idea. There were 3 different commissioned performances which were specifically installed in V2 space.

The Rest is Noise - Alva Noto

As a part of Amsterdam Art Weekend, there were many interesting music events. I knew the record Raster Noton and listened to the collaboration album by Alva Noto and Ryuichi Sakamoto. So I really wanted to see his performance since he was combining it with coded visual. It was held in het muziekgebouw IJ in Amsterdam.

WORM Instruments Make Play

https://worm.org/production/instruments-make-play-2018/

Experiments

I tried several things to be ended up with my final process. First I tried to make an analogue sound filter for the space. Second, I wanted to explore algorithmic composition with coding and combined with coded visual such as Processing. In the end, I decided to make an interface/installation.

Contact Microphone

As an extension from the second project, I wanted to try out if the contact underwater microphone would work as a water filter in our surroundings. I decided to make a hydrophone myself with two piezo elements and xlr mic cable. I followed the instruction of this. The microphone worked well. For the trial, I put it under the bucket as the former exercise, connected it to audio interface as input connected loud speakers for the output. However, it did not have the effect I wanted when I put it underwater. Because it only captured the sound from the physical contact, it was to clean and crisp for the atmospheric usage which I was imagining. I expected it to have delay, echo effects from the feedback loop of realtime sound input and the filtered output. But then, I still wanted to try with some other audio effect using Ableton. I found that Resonator can work interesting with contact microphone. It made some cool sound but I could not really come up with anything I can go further with this. I also found a very interesting project from an artist Joo Won Park, called Toccata using contact microphone and SuperCollider. From this, I wanted to research what SuperCollider is.

Synthesis, Algorithmic Composition

SuperCollider Algorave

Paul Prudence

João Martinho Moura

Insights from Experimentation

The two experiments has been completely different approach. First idea was about using the existing sound around us and transforming it with water as an analogue filter, more natural, acoustic way without using programming. The second idea was about sound synthesis itself, especially in digital way with programming. I was really exited when I found the programming language SuperCollider, from the idea that I can code the sound and even composition. There were many interesting way to use this combining with other interactive elements and programmes. However, since I am fairly novice to programming and unintuitive interface for making sound and music, I gave up to use this programme for this project for efficiency issue. It is also because I didn't know that much about audio synthesis terms and elements. So I decided to move on to use Ableton again which I am bit more familiar with. But I really want to get back to learn SuperCollider at some point. The idea of Algorave, live coding party, is also very exciting. I missed one party at Utrecht but would really want to experience when it is held around me.

Process

sound perception can be divided into six cognitive processes. They are: pitch, duration, loudness, timbre, sonic texture and spatial location (Burton 2015, 22–28).

Ableton Live

At the beginning I decided to make a composition with Ableton. Ableton is really good with sampling playing around with musical ideas. I like when found sound was used as the musical sources, so I tried out some found sound beats.

Perception of Sound, pattern, repetition

Nowadays we are living in the age of mechanical reproduction and it somehow changed our perspective on beauty. Whenever I walk down the streets, I hear the noise of construction works such as drills, banging hammers that become repetitive in my head and suddenly become a rhythm and then music. I decided to make a drum machine interface where audiences can create their own beat from the found sounds. Then I wanted to visualise the patterns and repetition of the beats. I wanted to visualise it as a movement using motors. I thought this way of creating optical kinetic installation would be effective to show the mesmerising effect of the repetition of the patterns.

Found sound, audio edit, effect

First I did some field recordings and manipulated them in DAW Ableton. Some of the found sound, I used it from freesound.org/. I warped, cropped the sound and put audio effects to recreate the sound. I put the recorded found sounds in the drum rack to use each elements as a percussion sound.

Mono Sequencer for Synth

I wanted to add some synth patterns as well.

Technical aspects

Electronics

By using Max for Live connection kit, I could directly connect it to Arduino for inputs and outputs. I decided to use Servo motors because they are easy to control with Ableton and I thought the movements of motors and sound wave vibration matches to create the pattern and repetition in different forms. I was planning to use 12 to 16 servo motors to control each sounds. But I didn't know that I need extra power source to use more that several motors by using Arduino since it only provides 5V and they take a lot of electricity. The easy way to use many servo motors with Arduino is using a shield. A shield for Arduino is sort of extension plug-in, which gives Arduino more functionalities. By googling, I decided to use this Adafruit 16 servo shield https://learn.adafruit.com/adafruit-16-channel-pwm-slash-servo-shield/overview

OSC

Open Sound Control (OSC) is a protocol for networking sound synthesisers, computers, and other multimedia devices for purposes such as musical performance or show control. OSC's advantages include interoperability, accuracy, flexibility and enhanced organisation and documentation. With the Ableton Connection Kit (https://www.ableton.com/en/packs/connection-kit/), it is easy to control motors, LED, etc via Arduino. However, since I am planning to use 12 servo motors and using a shield for Arduino, the digital outputs have been changed. So Ableton could not read the shield. I asked Mike in interaction station for a help, and he suggested me to send OSC to Processing and connect it to Arduino.

Input

I used TouchOSC https://hexler.net/software/touchosc software to control MIDI for Ableton Live. You can use mobiles and pads for this programme. It works with Wifi connection so I need to know the host IP of my laptop and connect it from the software with iPad. So when people touches certain button in iPad it sends the signal to Ableton, to the set sound.

Material exploration/Visual aesthetics

Using metal was pretty intuitive decision for me since I have worked with metal for a while to make sculptures. I used to make bent, plasma cut, welded geometric steel sheet sculpture to demonstrate my notion of object and space and their relationship. I like the aesthetics of cold, sharp steel sheet. Therefore it was reasonable process for me to further work with it. This time it was used to as a base panel to support the motors, Arudino and all the electronics.

Metal Sheet (Steel), Wire, Found/Scrap object, colour points, Moving creature

Realised work

(what did you actually make) (what have you pulled from your hands on practice based research?)

Patterns of Consciousness

Found sound (surrounding, environment), pattern, repetition, time-based

being in the moment, consciousness

indeterminacy

phono-kinetic object, acoustic

interaction/interface installation

movement (creating awareness, attention catching)

Reflection

(what was the point? what do you take away?) What worked? What missed? How to improve? Context Medium

From the exhibition, I figured out that my work was quite self-explaining which worked in a good way. When people wore the headphone and touched the iPad, they realised the interaction between their touch, sound and the motor. And then they played with it for a while.

However, I think there should be some ways to enhance the whole experience with each elements as a whole. The sound from the headphone was of course my main purposed sound, but there was another sound coming from the movement of the motors and their scratches on the metal sheet. This was my intention to have as well but when the audiences wear the headphone, the two sounds are disconnected.

The interface for the audience input is quite minimally intuitive. However, I could have used each colours, shapes more relevant to the physical objects. Apart from that, I actually want to make another physical input device or environment, not with a touch pad.

Questions for the presentation

Image 1: What did you make? (Show one image of your semester work that was the most inspiring)

Image 2: What did you miss? (What do you to connect to, bring in, or explore that is not covered by the curriculum)

Image 3: What is your topic of interest? (Explain though a visual what area you wish to further explore)

Image 4: What is your medium? (Explain what materials and tools you wish to use)

Image 5: What is your question? (Try to formulate one (preliminary research) question that will guide your investigation)

Final Conclusion

How I redefined my position within my art practice. Interaction became important element to me. Conversation with the moment/surrounding. To make oneself more conscious of the surrounding, to be in the moment. how to make an interactive installation using new media technology to make people aware of their surroundings by means of sound

Next step? Similar thing? mindfulness, meditation (how to be immersed in the surrounding) conversation with the environment (how we are conscious of it) transformation of the moment/surrounding spacetime effect of sound spatiality location

context of digital craft immersive effects of new media technology interaction, intriguing, invitation

pattern, repetition, time-based, process music in real time

There are several many ways I want to take from now on. Mostly, I want to develop the interactive sound installation with more spatial merged quality and various elements. I would like to study circuit bending and sound generation technique with electronics in depth. By doing so, I could make my own instrument as well as an extension of the interactive sound installation. I want to focus on the interface to make it as a whole, providing it as a performative scene. At the same time I would like to try performance with my potential sound installation/instrument as well. https://worm.org/production/the-sound-of-ketelmuziek-10/

Bibliography

(what did you reference in this text (other texts, images, films, exhibitions)? Remember to use proper in-text citing!!!!!!!!!!

Klankvorm @V2
The Rest is Noise: Alva Noto
Instrument Make Play @Worm