Why I hate repetition and what can be done about it
So why am I so distressed by a little repetition? Think of any sound that might repeat itself, and then think carefully about that sound. A dripping tap, bouncing a ball and footsteps are all good examples of sounds that repeat cyclically, but if you really listen and analyse the sounds themselves you realise that they are not exact replicas of the same sound. Bounce a ball sometime and see if you can get exactly the same sound twice in a row, let alone for longer. Each bounce is subtly different, the downward pressure you apply to the ball, the angle on which it might land and the surface on which the ball bounces will all alter the sound, they may not alter it much, but it doesn’t take much variation at all to break up a repetitive cycle. In fact it’s the super subtle differences that really make the difference. If you isolate a single tic toc from the sound of a clock, loop it and listen back to it, it does sound like a clock, but there is something about it that just doesn’t sound quite right.One of the issues with modern video games and CG films is that they are becoming very close to being indistinguishable from real life; close, but not yet completely there, and that’s one of the problems. The closer you get to making something that reflects reality the more the subtle differences stand out. So with audio, a bouncing ball or ticking clock sound that repeats is pretty close to how a ball or clock may really sound, but the subtle difference tells the listener that what they are listening to is not the real thing. In this case and to help create many other types of repetitive sounds, subtle variations can go a long way to convince a listener they are listening to the real thing.
To use the ball analogy lets assume we are creating a basketball game. One of the main audio elements we require is the sound of the ball being bounced. With sound files time equals memory, at 44.1 KHz, 16 bit mono, a ten second long sound is 860Kb, this is almost a megabyte of memory for only ten seconds of sound. So we would not want to record long samples of someone bouncing a ball to add to the game as we would quickly run out of memory. Alternatively if we use a recording of a single bounce it will result in very obvious repetition.
If we use 5 or 6 different recordings of a single bounce they can be used as a pool of sounds to draw from. Randomly selecting a different recording to play for each bounce event will instantly add more variety than using a single bounce. Adding a very slight variation of pitch each time a ball bounce is played will produce more variation and represent slightly more forceful or less forceful bounces. Finally adding a very slight volume variation to each bounce will add even more variety. In the end these three simple steps can turn a selection of 5 sound files into a sound event that can play endlessly without ever sounding like it is repeating. This effect has been achieved using a small number of files that will not use much memory, this is particularly important for smaller consoles like a Nintendo DS or for iphone apps.
A single bounce sound file, looped to repeat four time
No variation in pitch, volume or time.
Five unique bounce sound files played in sequence
Each bounce is different in sound and pitch, volume and time spacing.
I want to return to why I dislike repetition, and look at it from a different angle. As I mentioned, initially it was from frustration at being presented games that appeared to have poor or lazy sound design. As I looked into solutions to this issue so I would not fall into the same trap I realised that the randomisation of sound might even improve the overall feel of a game. Several years ago I read an article where some film makers were previewing their latest project to a test audience. They showed the audience two versions of the film and asked for their reactions. The vast majority of those surveyed said the second version was much better, they claimed the special effects were better and the pace and editing was improved. The amazing thing was that visually both versions were identical. The only difference was the music and sound effects used. Now obviously this can be seen as a good example of how important sound is for supporting visuals, but more than that it demonstrates that sound can even alter how someone perceives visuals. It has been well documented that altering a musical score can seriously change the feel of a film, adding ominous music to a scene can make even the most angelic character seem disturbing and playing the theme to Benny Hill has the disturbing effect of making the most horrific footage feel like a comedy routine. Music affects human’s emotional state to a level we still do not fully understand, so it is not surprising that it can have this kind of influence when accompanying a movie clip, but what about sound effects?
Recently I was asked to write an article about using FMOD Designer for sound event creation. I have been using FMOD for many years as it allows me to create sounds with a large level of variation. For the purposes of the article I wanted to include a film clip of an explosion. Most people respond to visuals, so adding a film clip to watch helps convey the idea more easily. I chose a clip from a friend I have worked with of a mine exploding and added an appropriate sound effect. The effect was generated in FMOD as it would be in a game situation. I had set up the event to randomize the sound each time it played, so the explosion would always sound different. I recorded a series of this sound so I could choose which version I wanted to add to the clip. When it came to editing the clip I found lots of versions of the sound that worked really well. I added one to the clip and uploaded it for the article.