Home » Forum » Hey there... »
Sonification – experimental off-topic

Sonification – experimental off-topic

posted on #1
MySounds Supporter
Posts: 132
Joined: 19.03.2022
I sometimes follow up on ideas that are way off the beaten path and this is one of them.

I have recently experimented with sonification, basically the translation of non-audio information into sound.
In a business setting one application may be to create a beat (rhythm and/or sound) that represents the smooth running of the business to which additional sounds are added as negative events (loss of a customer, collegues sick etc.) take place.

The result of this would be a benchmark sound that represents “all is well” versus a sound that signifies “problem”, rather like an engineer listens to a machine to determine if it`s running smootly rather than looking at technical data.

Still with me?

So this new idea came up in a discussion with another loopie. Can we create a collection of different 20 second soundbites that represent a “good day” and a “bad day”? How would loopies sonify their personal well-being when limited by a 20 second rule? Would the soundbite be focused on a particular instrument, a beat, a combination…..?

I have posted this here before actually uploading any tracks because I wanted to first wanted to find out what the community thinks of the idea (apart from the fact that it`s a mad and bonkers idea 😊 )

One additional potential outcome could be the creation of a wikiloops mood collection that everyone can use for their own purposes when creating loop mixes

Any thoughts?
(Heavy stuff, I know)
+6
posted on #2
Woxbox Supporter
Posts: 15
Joined: 14.01.2019
Fascinating idea. Is it your thought to interpret this non-audio information subjectively as a musician, or to collect raw data and translate it through some sort of mathematical process into sound? As I'm sure you know, this latter process has been experimented with -- the "sound" of planets in their orbits, even the music that can be extracted from DNA gene sequences.
+3
Harley Benton TE-52 NA Vintage Series
Harley Benton TE-52 NA Vintage Series
Electric Guitar
159 €
iThis widget links to Thomann, our affiliate partner. We may receive a commission when you purchase a product there. Shop besuchen
posted on #3
MySounds Supporter
Posts: 132
Joined: 19.03.2022
Oh no, the idea would be to let everyone contribute their own 20 second segment. I just think it would be interesting to create a loopie catalogue of 'feel good' or 'feel bad' loops. Just think of the many different instruments, sounds, effects, beats people might use as their mood signal.
+3
posted on #4
Dick Supporter
Posts: 2843
Joined: 30.12.2010
Hey MySounds :)
That's not just a nice idea, its a bunch of ideas, and since you asked for opinions, here's mine:

I'd say, "sonifying" some kind of data to be able to hear the state of some application (of course me thinks of turning the wikiloops visitor flow into sound, first) is interesting. Me thinks, different metrics like "currently online users", "servers CPU load" and "database load" might be represented by different sounds, or one could increase speed tied to one of the metrics (many visitors = quick tempo).
Now, let's think this thru a little:
Assumed there was a beat resembling the number of visitors, that could be varied in speed,
and there was a bassline resembling the system load, then one would ideally need a bassline that can be adjusted in tempo so it matches the drums at all times. So, if tempo is out of bounds, you may say little CPU load is resembled by the low E, and increase the bass rootnote as the CPU load rises. That could work, BUT...
If you want to integrate a third permanent metric, let's say database load represented by guitar and would let the guitar respond by shifting notes as well, your statistic would sound bad most of the time, simply because your notes don't harmonize.
If your stats read
500 visitors per minute -> 145 BPM
10% cpu load -> Bass is on F
25% database load -> guitar is on G#
then that might sound really bad, see what I mean?
So, maybe another approach that would workaround any disharmonic experiences would be to map the "loads" not on notes, but to note-lengths, then that might be interesting :) Just let the bass switch between full notes, halfs and quarters, 8ths, 16ths etc to indicate what is going on,
that might give you one song that gets faster and slower, and more or less hectic on bass and or guitar - and you could lean back and say: "yeah that's a quite fast tune right there, but look, the bass is all calm, all is good." :)

I also like the idea of incorporating extra sounds for certain events, applied to wikiloops one could include a cheer when someone supports wikiloops, or some sound when a new track has been uploaded, a little "bling" whenever someone gives a thumbs up... sure, that'd be cool, too.

Now, where I was left puzzled was your idea to have a lot of people record their positive or negative sounds.
I'd agree that it'd be interesting to have some sort of mood declaration on wikiloops tracks, but I don't really get how you'd want to use the desired collection to sonify some sort of data.
If you programmed something that implemented a logic like "if event A happens, play a random sound from the "positive mood" collection", then the audible result would be much harder to interpret, and you have little chance to have some sort of musical result -
if you'd collect vocals only that might sound like a live audience going "boo" and cheering "yay" depending on what happens.
If you do allow/ask for instruments, you may find that some feel very positive about quite harsh sounds, which may not be interpreted as positive signals... hope you see what I'm trying to point at :)
+5
posted on #5
GBD
Mitglied
Posts: 132
Joined: 14.09.2016
Different modes are often used to express feelings if you know the scale & key you can join in. Many Korean shows in some parts will use just a piano I can often tell whats happing by the backing track without seeing the video. Classic Chinese operas during speaking parts will often use different percussive instruments thinking is usually a tic tic sound then a cymbal that changes pitch upward when they get a idea using percussion you can add almost anything.
+4
posted on #6
Shi Supporter
Posts: 357
Joined: 03.02.2013
what an interesting discussion :) I think music is something that is an inate part of being and it is woven through our lives so deeply that certain songs can take us directly back to a moment in time and rekindle thoughts and feelings and emotions. It is very powerful but also can bring healing, it can be calming and soothing, or can lift mood and reduce stress, bringing happy or sad memories and also be a means of escape. For me, music is like breathing... it is the very oxygen that sparks my life. The Loops is an amazing thing almost with a life of it's own in that you never know where a track will take you :) What an adventure !
+7
posted on #7
abuitremorem Supporter
Posts: 64
Joined: 06.07.2014
Here I answer to the first discussion point "Sonification". I think our Waterval experience with sonification of audio data might add something to this discussion.

In order to convert non-audio information into sound, "translators" are needed. How can I translate "table" into grades?

Methods may be infinite, but rules are needed. The easiest way is via the alphabet. Letters can be made audible via appropriate octave repetitions and the use of easily processable midi tone numbers. If we also classify these, we can arrive at note values. A second external translation system is helpful, here Morse, which encodes letters in different “lengths” and produces a rhythm.

But emotions are missing from this music and they are not evoked either. Therefore, "human" post-processing wanted to correct something in the mix.
As an example we take the welcome text from Wikiloops: wikiloops.com is a meetingplace... which was implemented in track #239095. Make up your own mind :)
+3
posted on #8
josepssv
Mitglied
Posts: 76
Joined: 21.09.2013
Yes. Lots of ideas!

I try to simplify basic feelings by relating sounds to color qualities and emojis

Bright :-)
https://www.wikiloops.com/backingtrack-jam-190114.php

Grey :-|
https://www.wikiloops.com/backingtrack-jam-190113.php

Dark :-(
https://www.wikiloops.com/backingtrack-jam-189967.php

Vivid :-D
https://www.wikiloops.com/backingtrack-jam-189966.php


In a few seconds it is easy to expose a feeling
+3
Harley Benton G112 Celestion V30
Harley Benton G112 Celestion V30
Cabinet for Electric Guitar
169 €
iThis widget links to Thomann, our affiliate partner. We may receive a commission when you purchase a product there. Shop besuchen
posted on #9
AKchen
Mitglied
Posts: 40
Joined: 26.01.2015
Hello :)
the main opinion is, music is sound with a certain feeling or creating a feeling in someone´s inner or expressing the own .. a talk, monologue, spectacle, exchange a.s.o. ... communication

MikeB´s adds with René´s sound experiment #239095 shows, how the human add gives life into a dry emotionless sound, Rene´s sound alone is a base here, nonemotional

"non audio into sound" you can find here, were plants electric signals set into sound:
https://www.youtube.com/watch?v=iuISRGgg2mM
do you feel emotion by the plants signals ? I do ... maybe "non audio into sound"-emotion is just possible by sounds from alive creatures ?
"MySounds", the creator of this post ... maybe your idea could work, just try ;)

I´m in love with John Cage´s sight about SOUND here in this video ;)
[youtube]pcHnL7aS64Y[/youtube]

an add would be for me to say, random is surprising, who needs sense
Who has seen the wind, who does the sound ?
+5
posted on #10
AKchen
Mitglied
Posts: 40
Joined: 26.01.2015
josepssv wrote:
Yes. Lots of ideas!

I try to simplify basic feelings by relating sounds to color qualities and emojis

Bright :-)
https://www.wikiloops.com/backingtrack-jam-190114.php

Grey :-|
https://www.wikiloops.com/backingtrack-jam-190113.php

Dark :-(
https://www.wikiloops.com/backingtrack-jam-189967.php

Vivid :-D
https://www.wikiloops.com/backingtrack-jam-189966.php


In a few seconds it is easy to expose a feeling


How did you create the sounds ?
:)
+3
posted on #11
josepssv
Mitglied
Posts: 76
Joined: 21.09.2013
Thnks!
Yes Andrea, I like your two links. Plants have created our atmospheric and terrestrial environment and we are their children, and J. Cage's wonderful idea
For those tracks I used my own whistles, but the important thing and maybe that is your question is how the emotion arises in a song or in this case in those fragments.
The simplest is the neutral one that after a while can be transformed into the others
I guess my experience in the bush where I recorded them and the memories could make the melodies of the other modes.
I remember imagining birds jumping or sad, but also other songs, I guess. It is difficult to explain the creative process, even more than composing.
It seems that it is more difficult to study language in high school than to speak :D
+2
posted on #12
MySounds Supporter
Posts: 132
Joined: 19.03.2022
Sorry that I wasn't able to comment on all your ideas and input. Had to focus on non loopie topics this week. I'll try to get back up to speed this weekend.
+2
Harley Benton G112 Celestion V30
Harley Benton G112 Celestion V30
Cabinet for Electric Guitar
169 €
iThis widget links to Thomann, our affiliate partner. We may receive a commission when you purchase a product there. Shop besuchen
posted on #13
AKchen
Mitglied
Posts: 40
Joined: 26.01.2015
josepssv wrote:
Thnks!
Yes Andrea, I like your two links. Plants have created our atmospheric and terrestrial environment and we are their children, and J. Cage's wonderful idea
For those tracks I used my own whistles, but the important thing and maybe that is your question is how the emotion arises in a song or in this case in those fragments.
The simplest is the neutral one that after a while can be transformed into the others
I guess my experience in the bush where I recorded them and the memories could make the melodies of the other modes.
I remember imagining birds jumping or sad, but also other songs, I guess. It is difficult to explain the creative process, even more than composing.
It seems that it is more difficult to study language in high school than to speak :D


life - transformation - random - surprise :D .. interesting - development - open - free
+1
posted on #14
abuitremorem Supporter
Posts: 64
Joined: 06.07.2014
josepssv wrote:
Yes. Lots of ideas!

I try to simplify basic feelings by relating sounds to color qualities and emojis

Bright :-)
https://www.wikiloops.com/backingtrack-jam-190114.php

Grey :-|
https://www.wikiloops.com/backingtrack-jam-190113.php

Dark :-(
https://www.wikiloops.com/backingtrack-jam-189967.php

Vivid :-D
https://www.wikiloops.com/backingtrack-jam-189966.php


In a few seconds it is easy to expose a feeling

+1
wikiloops online jamsessions are brought to you with friendly support by:
user profile image
A friendly and welcoming place, it gives me the chance to be creative and have so much fun with an amazingly talented community. Thanks!
Shi

wikiloops.com verwendet Cookies um Dir die beste Nutzererfahrung zu ermöglichen.
Erfahre mehr in unseren Datenschutzbestimmungen.