Resident home (day 289)

The last day of the residency was June 9th. We toured the NFB StereoLab in the morning. They have a great setup with many passive polarized projection systems matched with SANDDE 3D drawing stations. That week they also happened to be testing out the Panasonic twin lens 3D camera. The Director of Photography didn't give it great marks mostly because of bad compression artifacts and poor performance in low light. When I saw the footage I didn't think it was that bad. They were just starting to work with it and it was a pre-production model so it is quite possible their opinion will change. But for $22,000 the expectations are high.
In the afternoon, Valerie Walker of Studio XX interviewed Leila and I for her radio show. She is a skilled interviewer and it was great to talk with her about the project. The interview will air shortly. I'll post a link as soon as it does.
The rest of the afternoon and early evening, we packed up the studio and transferred files.  We ended the day at Mochica, a Peruvian restaurant on St-Denis.  Great food as always.  I will miss the easy access to delicious food, the warm nights, and the street level terraces.  Such great sounds.

I finally got around to posting a partial documentation of the work done at Oboro. It doesn't include most of the sounds that we recorded, and that were used during the artist talk in a live mix. What it does show is a trio of lungs breathing at different rhythms, with distinct videos and breath sounds. The three breath sounds match the breathing rate. Anyway, here it is. I'll post more as it becomes available.


lung trio from Maria Lantin on Vimeo.

Bacterial Update:  It has been a while since I posted a bacterial update.  I was slightly worried about going away for almost three weeks but everything worked out fine.  I put the Kefir grains in a dormant state in the fridge with twice the amount of milk I would normally give them.  When I took them back out they recovered right away and I would say are going through a growth spurt.
For the Kombucha I started a new brew about 6 days before I left and just assumed that the brew would be ruined when I got back but that the scoby would be fine.  Turns out the brew was fine, quite fine.  It was a batch I brewed with Pu-Erh tea and red rose buds.  You can really taste the roses (yum!). I just started a new brew today, Pu-Erh tea and Chrysanthemum flowers.

A song for this post.

Life Support (day 238)

I took a breather today.  After attending the Masters of Digital Media graduation ceremony (which was awesome), I arrived home around 4pm and decided to make some tea, eat some chocolate from chocolate arts, and spend some time with a book that I've been meaning to re-open: "The Art of Projection" edited by Stan Douglas and Christopher Eamon.  A few pages in I started to get some ideas about the screenshots and snapshots I've been collecting.  I started to think of what it feels like to be observed by my own computer.  At the beginning I was self-conscious, then I became annoyed, then oblivious, then embarrassed, then impatient.  As the shots pile up, I've become somewhat anxious about what the end game is.  What will I do with all these?  Steve asks me every now and then.  I've always replied that I didn't know.  Today I had an idea.  The sketch is below.  A LCD screen shows a video of the screenshots, and the top of the screen where a camera would usually be, a miniature projector projects the portrait snapshots onto a suspended concave structure (textured material, probably paper clay).  In between the two, embedded in a supporting plinth is an organ-like inflatable structure that 'breathes' (mechanics and electronics inside the plinth).  The sound is similar to a life support respirator in a hospital.  I'm not clear on the form of the breathing structure.  Probably amorphous.  I'd like it to be uncanny, like an organ.  With an affect similar to the organic game pod in Cronenberg's Existenz.

A song (clip) for this post.

Email Apnea (day 77)

An unexpected find today had be smiling all the way to the bus stop.  I was listening to the Spark podcast of November 3rd (which is a great one btw, two longer interviews both on fascinating topics).  Nora interviewed Linda Stone who coined the term 'email apnea' to refer to the lack or shallow breath that happens when we are anticipating the next email, tweet, or txt.  This is wonderfully in line with the investigation in the Breath I/O project.    This is an excerpt from our grant application:

We have chosen to work with lungs as a visceral representation of personal interior space that is in a direct relationship of exchange with the environment. Even more directly than the heart, the lungs are a link to life and health. They offer the first clue to the quality of the surrounding environment, and breathing patterns are in a reciprocal relationship with emotional states. With these traits in mind, sounds and image streams are added to the environment of the lungs to mimic our modern situation of being surrounded and sometimes overwhelmed with images and sounds. Our relationship with media sources competing for our attention is often one of unconscious ingesting in a constant search for meaning, connection, diversion. This can be compared to shallow breathing where the body is forgotten and left to react to a starving mental state. Conversely, images and sounds may bring attention to the body by matching its rhythm or otherwise bringing the mind out of its usual patterns, triggering curiosity or calm attention. This can be compared to deep mindful breathing. Breath I/O intends to investigate the individual and collective act of apprehending media spaces as it relates to personal history and the physical body.

I was so happy to hear/read Linda Stone talk about her breathing practice and how she noticed that when she sat down in front of the computer her breath became shallow and sometimes stopped.  She has since studied the phenomenon and how it relates to the sympathetic nervous system.  She has written an article about this in the Huffington Post and this is an excerpt from her interview with Nora Young (starts at about 28 minutes into the podcast).

...email apnea means...temporary cessation of breath or shallow breathing in front of any screen it could be a computer screen it could be a television set it could be a mobile device.  ...with anticipation most mammals humans most certainly do a sharp intake of breath like that and so between the inhale not exhaling because of our posture we were breath holding and many people think of breathing really as an inhale take a deep breath and they go but the really most important part of breathing is the exhale...There are a number of things that begin to happen when you cumulatively over time shallow breathe or breath hold the first is that it kicks sometimes low level sometimes not so low level flight or fight stress response.  The part of the autonomic nervous system that is all about flight or fight is the sympathetic nervous system so this breath holding up regulates or really activates the sympathetic nervous system sending us into flight or fight.  A few things happen when we're in fight or flight.  The part of our brain that creates habit is activated, it blooms so to speak. and we become more compulsive in all our bevaviours and I'm sure that we've experienced and those listening can recognize gee I just can't stop texting or I just can't stop checking my email.  It activates actually the part of our brain that compulsively behaves.

The interview is really interesting and I highly recommend hearing it in its entirety.  I completely relates to what she is saying and I would love to integrate some of the thinking into the Breath I/O project, particularly integrating some of the sounds of our devices that call us to immediate attention: the small chirp of TweetDeck, the trill of the iPhone when a new txt comes in, the ding dong of a new email.  The moment where there is nothing happening and we wait for it like a kid anticipating the movement of a monster in the closet.  Or we stop waiting for it and turn on the light and look everywhere.   For me the sounds are much more evocative of what she is talking about than the actual content of the information that is constantly pouring in.  It would be great to bring the affect of that anticipation into the chorus of lungs.

A song for this post.

Feel the lungs (day 59)

Today I had lunch with Joy James and we talked about the Breath I/O project.  She asked me some interesting questions about the type of affect we would like the piece to have.  Why do what we are doing?  How will people feel the experience of the lungs and the video and the sound and the interface?  As she was talking and asking questions I could feel my mind going from the how to the why.  I am so often preoccupied with the technical details of doing something.   It felt nice to speak of the audience, to picture them in the room,  to imagine the sounds they might hear.  At first I pictured only one person entering a large dark room (the mocap studio actually) where the sound was louder than the picture.  The sounds were enveloping, breath like, rhythmic and calm.  There are several places to sit down near the ground and in front of each seat there is an object, each one different.  The lungs are in a chorus formation breathing in sync, the video interchanges between them.  The person picks up an object and holds it.  One of the lungs gradually takes on more importance visually and the video is more consistent and clear.  The sound of the video is heard over the breath.  The singled out lungs have more personality and are not so in sync with the rest of the chorus which has faded to the background.  The lungs are reacting to the video that is playing within them, sometimes sighing, sometimes coughing, sometimes fast breathing, sometimes deep breathing.   The object vibrates in a association with the lungs.   When more objects are picked up more lungs approach and start to interact with each other and the objects. 

The feeling of the environment to be calm and conducive to a reflection on the bittersweet nature of life,  the life cycles, the exchanges we have with people, the constant give and take of life.  The preciousness and sadness of being human.  The joy of movement and breath, of health.

Thanks for the talk Joy.

A song for this post.

Emotional breather (day 18)

I described the Breath I/O project earlier in which lungs will be used as vessels for video and sound. 

I've been wondering if it would be possible to annotate video with emotional content so when they are mapped onto the lungs the breathing style could vary to match or enhance the emotion.   Since at this point we are not planning on using dynamic video, it may be feasible and desirable to manually annotate the video with some state parameter corresponding to the type of breathing that would be appropriate.  From there the lungs could alter their breathing and seamlessly blend between states. 

A quick search later, I just found the specs for MPEG 7 video standard.  It allows for just the kind of annotation that we would need.  I'm not sure what the status is on mpeg7 and whether any of the applications we are currently using (Virtools, Touch Designer, Field) will even play it.  It's been around for a bit so perhaps it's more integrated than I think.  Regardless, we could use some of the concepts in the specifications and roll our own little annotated video player.

The more I think about it, the more I can see interesting uses to the new annotation standard.  Obviously many people have been thinking about this for a while on the standards side, but its interesting to me that it hasn't hit the mainstream yet in terms of all the possible uses and proper tools to support those.  The Wikipedia entry contains some examples of what people have done with the standard so far.  The IBM video annotator VideoAnnEx seems like it might be interesting for us.  There is also a Java library to extract annotation that we could use in Field.

There may be more appropriate standards or ways to do this, I'm not sure.  It made me happy to see mpeg7.  It seems like a good starting point to start making enquiries about the field.

A song for this post.

The last breath (day 16)

There will be a last breath.  Just like there was a first.   Sometimes I visualize the last breath and what it might be like to not breathe in again.  Would it be better to know and be absolutely conscious of the last breath?  In that case, would the last breath be somewhat willed?  How is it that whatever it is that makes us breathe in again just doesn't activate after the last breath?  Is that when the fear sets in?  Is it like drowning or floating?   Or maybe the last few breaths are more and more willed until you realize that you are just delaying the inevitable.  The last breath is then the final renunciation.  In some ways I prefer that scenario because it allows for a certain control about when the last breath will be.  The first scenario is much more of an imposition.

I have a friend who was declared dead for a few moments before being revived.  She says that first breath back was violent and highly unwelcome.  She had been going somewhere better.  Dr. Jill Bolte Taylor also died for a moment when she had a stroke and she speaks of not knowing how she would ever get back into her body, her consciousness having become so spacious.   It's almost as if the breath is the thing that keeps us attached to our bodies.  Our consciousness passes through it like a funnel and becomes contained by it, by its rhythm and boundaries.

It's maddening that so many humans have had a last breath and yet each one of us has to wonder what it's like still.  And when I go through it, if I'm conscious, I wonder if I'll have the unsatisfiable urge to tell everyone.

A song for this post.

Sensual water breathing (day 7)

Steve came back from swimming and said the water felt good. It surrounded his body, gently, sensually. I immediately could relate to what he was saying. I know that sensation of floating, gliding, blowing air bubbles, being surrounded.

This feeling of being surrounded by water is the metaphor I would like to invoke in relation to the lungs being in an environment filled with image and sound. The problem is that generally people associate the combination of lungs and water with anxiety and death. My intuition is that there is a way to depict the lungs in water without triggering this association. Char Davies' work Osmose associates breathing with movement in a way that could make you forget that you may have been moving in environments inhospitable to human breath. I think if the lungs weren't breathing, the water surroundings could seem peaceful, like in so many images we see of babies in utero and like the feeling that Steve described. The problem is really about the lungs breathing. So perhaps it may work to automatically create space around the lungs when they breathe out. A kind of air bubble that slowly dissipates. This way perhaps the feeling of suffocation or breathing water would not arise. There is still the issue of breathing in, but I wonder if we could deal with that by creating many small air bubbles as the lungs breathe in. The lungs would be creating their own air as they chose the media to breathe in. Could be an interesting effect.

The contrast between having the lungs in or out of the water could be quite evocative. The water environment is much slower, enclosed, sheltered, quiet, mysterious. The air environment is much more direct, insistent, dangerous, spacious, loud, social. Playing with these contrasts may work to invoke some of the feelings associated with different media environments and our reactions to them. What does it look like to be assaulted by media? What does it look like to be lured and seduced? What does it look like to like what we see or hear, hate, dislike? add on? forward? share? There are so many ways in which we are affected by media and participate in its affect on others.

In the next month we'll be working on getting a prototype of the lungs ready and creating visual effects reminiscent of water, fog, air movement, etc. It would be great at the beginning of next month to have the lungs animated and surrounded by media, not necessarily breathing the media yet, but just be able to see which environments we'd like to work with for the next iteration.

Take a deep breath and... (day 2)

first breath
breathe easy
take my breath away
breathless
hold your breath
don't hold your breath
the breath of life
hard breathing
bad breath
shallow breath
just breathe
breathe deeply
foul breath
last breath

I'm working on a research project called Breath I/O along with Leila Sujir, Joy James, and Ron Burnett. We feel very lucky to have this project funded by SSHRC for three years through their research/creation program (on hold for the moment). It is luxury...working with a team of researchers and students (Miles Thorogood, and Thea Jones are research assistants) for an extended period of time like this.

The form of the project is a virtual stereoscopic video sculpture with lungs as its subject. The lungs (single, multiple - a chorus of lungs) are in a constant exchange with the environment which is filled with sound, image and video.

The choice of not breathing cannot be sustained. We breathe and know something about where we are. We breathe and others know something about how we are. This idea of being subject to and indebted to the environment is what is compelling to me. In relation to the environment of sound, image and video (perhaps text?) I would like to know what it is to breathe image and sound. I read recently that the CEO of netflix thinks that web 3.0 will be a full video web. Like watching TV all over again but this time...with feeling? I don't know. I'm assuming he means that it will be democratic this time. That it will be the whole world cooking up a media storm for a public banquet of (biblical?) proportions. Or maybe more of a potluck...more like YouTube feels like now but less clicking. Who knows. My lungs will know if they are breathing the foul air of fast food.

The investigation has just started. We have a prototype but it's not quite right. We'll keep working at it, creating lungs that breathe naturally, convincingly. We'll come up with ways of seeing video mingling in the environment and finding its way into the lungs which take and give back. We'll find ways for people to converse with the virtual chorus with their hands and voices.