Stereo ahoy! (day 35)

This week Leila and Thea were here from Montreal to work on the Breath I/O project.  It was worth the stress of carving time from a busy schedule to work on the project in a more sustained way.  The main thing we are trying to work out is a workflow for the output of the Sony HDR-TG1 cameras we are using to shoot stereoscopic footage.   We had great hopes for the little Sony's and I think they will work out in the end but we've hit many walls along the way.  The TG1 is ideal for us because of its small size.  We can mount two TG1s beside each other on a Slik twin camera mount and shoot stereo at varying inter-ocular distances.   Miles built us a remote that controls both cameras so we can start/stop and zoom them in tandem.  Another ideal aspect of the TG1 is that they record surround sound.   With such a small microphone we wondered how good the sound would be.  It turns out to be quite good!   Overall we were pleased with the output of the camera but we started to hit some snags when it came time to edit the video.  The footage is in AVCHD format and the sound is Dolby Surround.   Here is what we know so far:

• The Picture Motion Browser software that comes with the camera will export the video to mpg2 or wmv with surround sound but not full resolution (it downgrades to 720x480)
• Final Cut Pro downgrades the audio to stereo
• Adobe Premiere can import the mts with surround sound and full res, but cannot output surround sound.  We did find a plug-in that may help but it's $295 and at this point we haven't given up on a cheaper solution.  CS4 says it comes with a trial version of said plug-in but we don't seem to have it.
• Stereoscopic Player does not play the surround sound (this is just a minor irritant since eventually we'll be playing the stereoscopic footage in a virtual environment)
• Interlacing is an issue.  The TG1 records at 1080 60i and needs to be deinterlaced to 1080 30p.  

So we currently don't have a workflow that preserves both resolution and surround sound.  The belief that this it must be possible keeps us searching.

Despite these setbacks we had some nice stereoscopic results with the footage that Leila shot of her nephews in track and field, and hockey.  The twin camera mount needs a level so some of the footage  had some vertical disparity but we were able to fix that in post-processing.  We tested the stereo footage on the old lung prototype and it looked interesting.  It kind of looked like the lungs were transparent.  Not exactly what we were looking for but perhaps with a little bit of a bumpy surface on the lungs, they won't look so mirror-like or transparent.

Another highlight was Trent's new model of the lungs.  They look great!  With any luck we'll be working with these on Monday (Leila's last day).

Miles was also around working with different sounds.  Making soundtracks on the fly for the silent videos we were playing.   We talked about different ways of teasing out the deeper resonance of someone voice in real-time.  He showed us an effect in super-collider which may be the start of what we're looking for.

A song for this post.