Reactive Audio | Idea

For some time now I’ve been trying to create a way to add audio
to some of the subjects I shoot, as a way to enhance the storytelling
of a series of photographs in the digital environment.
Reactive audio to what someone is seeing.

The primary issue I found with single audio tracks playing
over the top of a series of photographs is everyone views
the images at different speeds. The result is audio that doesn't fit
exactly with what you're seeing and therefore distracts
instead of enhances. Using music is a nice addition but it still
lacks a certain connection.

I asked a genius friend of mine Rowan Hogan (
for some coding and design wizardry that would create reactive audio
to what a person was seeing on a webpage, whilst remaining discrete. 

Changing audio every image would really fucking distract
at higher scrolling speeds. However having general ambient sounds
that change at key moments in a story could be that
little cream on top of the buckwheat pancakes.

I’m happy to say that the first version of this experiment is complete. 
We decided the initial exploration should be done with
Stephanie & Matthew’s four day wedding in France.
Alongside photographing, I recorded audio to break into seven
ambient soundtracks that fade in and out depending
where you are in the story. 

During this first experiment I’ve learnt a lot about what sounds
work best and what starts to distract from the photographs.
From here it will become an exploration of improving and pushing this
idea further.

You can see our first attempt here.