Just ran across some amazing work being done by Dan Goldman, who did his doctoral work at University of Washington and is currently working as a Senior Research Scientist at Adobe in Seattle.

The research is focused on interacting with video and with objects in video and relies on current work in computer vision. The technology allows users to interact in some really amazing ways with video for annotation and motion analysis. The process uses a storyboard metaphor to visualize a short video clip in a static image. The user can manipulate spatial relationships in the storyboard image in a natural way to interact with the video stream. Some details and references are available on the Adobe Technology Labs site. Check out the technology in action in this amazing video clip on Vimeo:

Dan Goldman - Interactive Video Object Manipulation Project

Saw an interesting post on TechCrunch yesterday. YouTube recently rolled out a new feature that is a welcome addition to their toolbox: deep linking to a point inside a video stream. It's a very easy implementation, as well. All you need to do is add a '#' at the end of the YouTube URL and then reference the time code following the '#' sign. For example:

http://www.youtube.com/watch?v=1flVlL4Mf8k#t=0m20s

Very useful!

Microsoft Research recently released a great little panorama image stitching utility. You can check it out at the Microsoft ICE project site. The utility is a free download.

One of the really nice features of this tool is that it can export to many different image formats. Once exported, one could bring the image into, for example, a video editing package to do pan and zoom effects for video. In addition, there is an export option for Deep Zoom Tileset that creates a series of stitched images and some XML data that allows the image to playback on the web inside of Microsoft's SliverLight 2 browser plugin. The result is a nice pan and zoom image similar to what one gets with a QuickTime VR movie. You might have seen this in Microsoft's PhotoSynth tool. And this is all free. Grab the software and have some fun!

I'm hoping to get a couple of experiments up soon, but I'm waiting on a server configuration change for the SilverLight files to run correctly in the browser. I'll post them when that happens.

Well, another SIGGRAPH is history. It's been a terrific creative battery recharge. Thursday and Friday highlights include a really cool Production Session on how the various visual effects companies that made Speed Racer went about replicating the look and feel of anime in a live action motion picture, a very entertaining and interesting overview on the use of Adobe Flash for animation, and an absolutely fascinating class on transportation visualization.

[More]

It's been an inspiring conference so far. The classes I've attended have been excellent. On Monday I attended the half-day course on projectors and spatial augmented reality for (I think) the 4th year running. Ramesh Raskar and Oliver Bimber were fantastic as usual. They were joined this year by Aditi Majumber who spoke about large-format displays and Hendrik Lensch who spoke on computational illumination for 3D scene modeling. One of the things I really get excited about in this class is what Raskar calls RFIG. In essence, this entails adding a photosensor to an RFID tag and then projecting structured light from a handheld projector on the photosensor in order to acquire a relative position for the tagged item. With the unique identifier and the relative position, we can query a database and then project useful information about the identified items directly on the items themselves using our handheld projector. All this is made possible by very small and relatively inexpensive handheld computers with wireless network access and attached projectors. You can check out their work, including the full-text of their book, Spatial Augmented Reality, on the supporting website: SpatialAR.com. Great stuff.

[More]

I arrived at the Los Angeles Convention Center today and picked up my credentials for this year's SIGGRAPH Conference. If you're unfamiliar with the organization or the conference, it's a part of the Association for Computing Machinery; SIGGRAPH is the largest SIG (Special Interest Group) in the ACM. The full name is the Association for Computing Machinery Special Interest Group on Graphics and Interactive Techniques, which is more than a mouthful.

[More]

At the beginning of last week, I had the pleasure of participating in a workshop hosted by the Innovative Learning Center on Digital Storytelling. The workshop was led by two great facilitators from the Center for Digital Storytelling based in Berkeley, California. Daniel Weinshenker, the Director of the Denver Office, and Jessica McCoy, an instructor based at the Berkeley office, did a wonderful job leading the workshop. If you're unfamiliar with Digital Storytelling, take a look at the Center's website. Jessica is also involved with an organization called Stories for Change. Both websites host several amazing examples of digital stories.

[More]

Just read a nice article on New Scientist about work by Microsoft and Mitsubishi on a novel approach to handling the occlusion problem and the "fat finger" problem of current multi-touch interfaces. There's also a video of a prototype of the LucidTouch device.

The current prototype device uses a camera on a boom focused on the hands on the back of the device. An overlay shadow is superimposed over the image showing the location of the hands without occluding the display. Active finger touch points are shown and a very intuitive method for showing the hand-off of selected items between fingers is also used. It's a nice glimpse of what's ahead in the multi-touch arena.

In preparing for a class on PowerPoint 2007, I ran across a little tutorial on YouTube outlining how to embed a YouTube video in a PowerPoint 2007 presentation. Unfortunately, the audio in the tutorial is really poor, so I thought I'd list the steps here and create a Captivate animation for it as well.

To embed a YouTube video in PowerPoint 2007 follow these simple steps:

1. First turn on the Developer Tab on the Ribbon by clicking on the Microsoft logo at the top left of the window and selecting PowerPoint Options all the way at the bottom of the menu. Next put a check next to the unchecked item to show the Developer Tab
2. Go to YouTube and select a video to embed
3. Copy the URL
4. On the Developer menu choose "More Controls"
5. Select Shockwave Flash Object
6. Click and drag on the PowerPoint slide to add the Flash object
7. Right Click the object placeholder and select properties
8. Set the Movie property to the URL you copied
9. In the URL delete "watch?" and change the "=" sign to a ⁄
10. Adjust the options for Looping or AutoPlay if desired

Make sure to test the presentation and keep in mind that the video is streaming from YouTube, so an Internet connection is required at the time of presentation.

In an earlier post, I wrote about Microsoft's Surface technology and work done at NYU on multi-touch display technology. Peter Hutterer at the University of South Australia's Wearable Computer Lab has just demoed a new version of his MPX, Multi-Pointer X Server under Linux. There's an article on his blog and a video of his multi-touch extension of MPX under Ubuntu. Here are the hardware details. Now I just need to get my hands on a compatible touch screen and try this out