My final film for the Royal Institution features engineer Hugh Lewis and explores the growing problem with space debris. With over 18,000 objects being tracked in orbit and another 170 million too small to be tracked – the problem threatens not only our satellite infrastructure, but the future of space travel as well.
What is in the contents of your head at the moment of the beep?
This film was commissioned as part of a residency within the Wellcome Collection’s Hubbub Group and exhibited at the “Rest & its discontents” exhibition at Mile End Art Pavilion, London October 2016.
Using playful imagery the film presents a collection of short vignettes that explore the strange and often abstract nature of our everyday inner experiences.
The experiences were documented through a process called descriptive experience sampling (DES), a technique developed by American psychologist Russel Hurlburt that aims to document inner experiences – the thoughts, feelings, sensations and bodily experiences that constitute our everyday consciousness.
Participants of DES wear a small beeper which sounds randomly throughout the day, at the moment of the beep, individuals are instructed to note down the exact contents of their experience (this could include internal monologues, physical sensations or visual imagery).
Follow up interviews tease out the information of the experiences and distill them into short summaries. These so called “beep summaries” provide wonderfully vivid depictions, almost like a dream diary, for seemingly mundane everyday experiences.
Using material gathered by several members of the Hubbub team, this film translates and re-interprets the contents of the beep summaries, referencing the distortions and adaptations that occur when we try to conceptualise our inner experiences with others.
The film was shot over the summer of 2016 on a Sony A7s. I used old M42 lenses to help give the piece a faded, dream like quality – which was further aided by adding film grain and muting the colours slightly in post. Most of the portraits were shot on an old Takumar 50mm 1.4 lens which has a beautiful vintage bokeh, which is full of character and lacks the somewhat clinical precision of a modern lens.
Find out more about the Hubbub Research group here: hubbubresearch.org
There was a lovely edition of BBC R4’s “Four Thought” broadcast last week called “Capturing Moonlight”. In this short programme, poet Astrid Alben discusses her experiences of using art and science together to better understand the nature of moonlight. What is particularly interesting to me is hearing about Astrid’s endeavour to navigate the complexities of science in order to deepen her own artistic practice.
Back in 2015 I collaborated with Astrid and Hester Aardse of the PARS Foundation to produce a listening experience for a Wellcome Collection event called ‘Some Like Dark‘, which formed part of her investigation into moonlight.
Together we crafted an audio work which centred around an interview recorded with physicist Sir John Pendry. The piece explores how our modern understanding of light developed through investigations by James Clerk Maxwell in the 19th Century and concludes with a playful discussion about trying to capture moonlight in a box (excerpt 4).
The 30 minute piece also included readings and audio works from theatre maker Jan van den Berg, lighting designer; Jennifer Tipton and sound poet; Jaap Blonk.
You can listen to excerpts below:
Two new videos produced recently for the Royal Institution that take you inside the ISIS Neutron and Muon Facility in Oxfordshire.
This is a scientific research facility that uses a high-energy proton accelerator to generate neutrons which are then used by visiting scientists to research the structure and properties of materials.
Find out about how they power the facility and an example of the cutting edge research taking place in the videos below!
Proteins and Particles
How to Power a Particle Accelerator
Video produced for the Royal Institution, for the 2015 Advent Project “A Place Called Space”. The piece is composed from multiple interviews with astronauts that were recorded between September – November 2015.
The film features 4 astronauts (Dan Tani, Helen Sharman, Jean-François Clervoy , Mike Barratt) and uses NASA archive footage to explore the ins and outs of living in space (spoiler alert: it’s fun, but it ain’t easy!).
All interviews were transcribed and then common threads were grouped together and collected on an edit timeline. The audio segments were cut down and edited together, then brought into FCPX where they were combined with video footage. I spent quite a while searching and logging appropriate NASA archive footage. Once the rough form was assembled, I introduced some music and refined the edit to work with the tracks I’d chosen.
Occurring without warning, the panic attack is a crippling and cruel symptom of many anxiety disorders. These debilitating episodes thrust individuals into intense bouts of terror, leaving them fighting to regain control of their own body.
The piece combines interview material recorded with a friend and abrasive sound design to pull the listener into the experience of a panic attack. It was produced as part of the Hubbub Relaxation / Cacophony tape, commissioned by the Wellcome Trust and featured during the Lates Spectacular event in September 2015.
Listen to the Relaxation / Cacophony Tape in full here: www.inthedarkradio.org/the-dark-room…e-collection/
Image: cristina – www.flickr.com/photos/cristinafo…rafia/5025559787/
My latest film for The Ri Channel takes a look at the placebo effect and it’s central paradox – if we have the ability to cure our symptoms of illness when taking a placebo- why can’t we just do this all the time?
The film looks at the ‘WHY’ rather than the ‘HOW’ of the placebo effect and features Professor Nicholas Humphrey – an evolutionary psychologist who has contributed a significant amount of work to our understanding of consciousness and the evolutionary context of the placebo effect.
I was aware of how the body is able to reduce pain through the use of it’s own internal painkillers (the endogenous opiates) – but I’d never really considered the evolutionary context of the placebo effect. WHY can’t we just deploy it whenever we want, why is it that a sugar pill can somehow grant us permission to do this and what information are we acting upon when we take placebo medications.
The film was created as part of a YouTube Super Collaboration (possibly the first in its kind) – which brought together 10 Science YouTube Channels each exploring 10 unanswered questions in science – the project was coordinated by the Channel AllTime10s – a monumental effort cajoling all ten channels into meeting the same deadline! You can view the AllTime10s video below, which links to all the videos in the collaboration:
Video creators include VSauce, Veritasium, Minute Physics and ASAPscience.
AllTime10s asked us to produce a video on the placebo effect and we had a very tight deadline for this film (about a month to conceive and produce!) – after a bit of mild panic and some research we were delighted to have Professor Humphrey on board – he was incredibly helpful in informing this project.
Due to limited time we decided to shoot this in the format of an interview and cut the audio together to present a logical argument. I think the most difficult aspect in producing this film was in conveying the information succinctly, in the right order and deciding what to leave out. Obviously there was a lot of nuance and detail that we simply couldn’t afford to go into – so there was a lot of careful consideration involved in presenting these arguments concisely to a YouTube audience. As it often goes with the editing process – there were some painful moments having to excise sections from the film.
Professor Humphrey had a number of thought experiments to help illustrate his arguments and I was keen to use these within the film, as they help to add real-world context from which to grasp these ideas. One of these was an anecdote of a schoolboy falling over in the playground and experiencing pain – with this section I was particularly conscious that we needed some sort of visual aid to augment the story.
At first I started with simple static slides created in Key Note, but found myself longing for something more dynamic. These slides then became placeholders and I later revamped them in Motion. This was true for the rest of the film as well, we were dealing with a lot of talking-head footage and I wanted to add in some motion graphics to help break this up and provide moments of pause between sections. I must say I’m completely new to using Motion and animation – so they are simplistic, but it was a great way of teaching myself how to do these things.
The style of these animations was very much guided by the central anecdote in the film (the schoolboy story) and this is why we see a chalkboard, wobbly text (it’s not Comic Sans!), simplistic stick men (I’m also a bit crap at graphics) and playful music.
I also really like the opening titles – although I’ll admit they’re not entirely keeping with the rest of the film’s style.
The film was shot with a Panasonic AF101, Nikon D7100 and edited on FCPX.
More on the placebo paradox:
Non-linear use of Multimedia
I was recently made aware of the online platform Thinglink.com – which essentially allows you to ‘tag’ an image and embed media from around the web – such as from YouTube and Soundcloud. Anyway this really got me thinking about some of the potential that such a platform offers – images provide a really powerful and direct way of communicating something (an image is worth a thousand words, bla bla) – and being able to combine an image with additional multimedia or information can offer a much richer experience to the audience.
For example, you could use an image as a backdrop for presenting other media (such as related video and audio), or you could expand upon an image, by tagging key areas and providing additional context with video, audio, text and other images.
I thought a lot about how this could be used in terms of story telling and perhaps even communicating science, particularly by augmenting image diagrams. There’s loads of cool interactive / animated diagrams and educational apps already out there, that essentially bring textbooks into the digital sphere, but they take a lot of ‘know-how’ and time to develop. Thinglink offers a quick and accessible route for users to create their own interactive diagrams and multimedia packages, through which to share a rich wealth of information and also tell stories through non-linear pathways.
So I took my recent audio documentary on the vOICe technology (you can listen to it here) and I cut out sections that matched up with a diagram I found in a New Scientist article on the same subject (you can read it here).
I then uploaded my clips to Soundcloud here:
and used Thinglink to embed the short sound files into the New Scientist diagram image – to produce an interactive diagram of sorts. The audio accompaniments augment the visual impact of the New Scientist diagram with some added ‘context’ from my documentary. Users can explore the subject at their own pace and explore the clips in any order they choose. Click here to see it all together.
This was just a really quick proof of concept mock up, using existing work – but I’m really keen to start using this platform as a way of quickly creating rich multimedia packages, which combine images, video and audio to communicate stories, ideas and information in a non-linear fashion.
Seeing with your ears.
An audio feature I produced over the summer for Pod Academy, exploring the development of the vOICe technology and it’s impact on blind users. The vOICe is a computer program developed by dutch engineer Dr Peter Meijer which essentially converts images into sound. Through training and experience blind users can learn to interpret these sounds as a sort of ‘synthetic vision’. The piece explores the technology from the perspective of blind user Pat Fletcher, and uncovers some of the science and technology behind its use with it’s creator Dr Peter Meijer and cognitive psychologist Dr Michael Proulx (University of Bath).
It was my thought that technology and the computer would be my way out of blindness.
-Pat Fletcher, vOICe user
Download it HERE
Essentially, the software takes spatial information captured by a camera and converts this into a coded soundscape. Users can then learn how to decode this auditory signal into a visual one thanks to a process known as ‘sensory substitution’, where information from one sense is fed to the brain via another. Fundamentally what the vOICe is doing is re-routing information usually obtained by the eyes and delivering it through another sense organ, the ears.
Although the neuroscience and psychology behind the technology is still largely unknown, it is thought that the visual cortex is eventually recruited to process the incoming auditory information and through experience, is able to decode it as spatial / visual information. There’s a great article over at New Scientist that goes into greater depth about the neuroscience behind it – including a useful diagram depicting how the technology works.
The software is currently freely available and can be used with virtually any imaging device, from webcams to camera-mounted glasses – there’s even an android version available for mobile devices! With the increasing prevalence of mobile computing, the vOICe technology is liberating users from their blindness, allowing them to step outside and experience the world through a completely new visual perspective.
For more information visit: http://www.seeingwithsound.com/ where you can experiment with the vOICe for youself and learn more about how it works. I’ve also prepared a page with a collection of images as heard through the vOICe software, including some featured within the piece above.
- Hypermagic – Start Again Start
- Ed Prosser – Untitled
- – – b31
- No Color – L’Aube
- Hpermagic – Pico Bisco
- Ed Prosser – Untitled
- Marcel Pequel – Four
Freesound Credits (freesoundarchive.com)
- Alarm Clock – 14262__xyzr-kx__alarm-clock
- Camera Shutter – 16071__heigh-hoo__nikonf4
- Data sound – 3647__suonho__futuretrocomputing-10-suonho
I’ve recently started producing podcasts for a new non-profit organisation called Pod Academy – they release weekly podcasts on academia and research, covering everything from the arts and culture to science and the environment. There’s a really nice range of subjects covered by the podcasts and their library is growing on a weekly basis. You can browse what they have to offer here.
My latest offering takes a trip around the morgue of the Sunderland Royal Infirmary, with pathologist Dr Stuart Hamilton as a guide. The piece provides a glimpse into mortuary life, from working with the dead on a daily basis, to dealing with cross dressing ‘auto-erotic asphyxiation’ fatalities.
You can listen to the piece over at the Pod Academy website here. Or download it here. The piece takes material recorded for my larger documentary piece ‘The D-Word’.
If you want to stay up to date with the podcasts you can subscribe to their podcast feed via iTunes.