Great Dance
Great Dance Blog



March 10, 2006

Spreading Dance with Mashups

Over the past few weeks, I've posted articles and podcasts that cover a range of approaches to creating interactive dance performances. There are telematic performances that unite multiple sites via high-speed Internet connections, There are mediated dance programs where dancers are outfitted with sensors and other devices, which control video, audio and images in real-time. And there are many technologies from wearable computers, motion capture and motion tracking that provide choreographers and dancers with many ways to explore their creative impulses.

But one area that I haven't touched upon is how end users - dance fans and enthusiasts - can play a role in creating or manipulating their own digital-based dance performances.

Before I explain what I mean I have to give some background about a hot trend called mashups. Mashups are a type of digital mixing of sounds, videos and pictures that just about anybody can create with relatively easy-to-use software.

Mashups

The first type of mashup was created by taking a vocal track from a song and adding it to an instrumental mix. While most of these mixes are unauthorized, they are widely available because of the many sound editing software programs and digitized songs available online. (This week's edition of Newsweek has a good introduction to Mashups.)

The Beastie Boys are joining the mashup craze by making authorized acappella tracks available for download so that their fans can create their own remixes.

Beastie Boys

Mashups are not just limited to mixing audio tracks. Here's an example of "Film Genre Remix" from Mashup Mansion (via: Micro Persuasion). The goal with these genre remixes is to create your own movie trailer for a film from one genre (such as horror films) and add your own voiceover to make it seem that the film is of a completely different type (such as a romantic comedy).

There are new online video editing apps being introduced all the time that let you create your own video mixes. Here's one Eyespot that I came across on the Mashable blog.

Web-based applications are also part of the boom in Mashups. The idea is that you take data from one source such as Google Maps or Flickr photos and build a new front-end so that your website visitors can access this data in new and innovative ways. Here are some sample applications so you can see what I'm talking about:

- The Geography of Seinfeld combines mapping data from Google with address information for famous New York City locations featured in this popular TV series. By clicking on, say, "Soup Nazi" or "Elaine's Apartment," you can instantly see on a map where they are located.

- Retriever is a mashup that allows you to upload or draw an image, and then the application will pull pictures from Flickr that match the structure and colors of your starting image. From my brief experiments, it doesn't seem that this application works too well, but it's amusing to experiment with.

Retriever

You can find a whole bunch of Flickr Mashups on Webmonkey.

Back to Dance

Mashups are proliferating because they are fun and they put creative control in the hands of millions of Internet users. My purpose for writing this post was to consider whether there were opportunities for creating mashups for dance so that millions of online users could create their own dance remixes?

Dancers, choreographers and new media artists are already creating their own dance mashups - even though that's not what they would call their video creations. This is what Jimmy Miklavcic of Another Language does during InterPlay performances when he takes video feeds from multiple performance sites and mixes them together into abstract videos (listen to podcast). The same is the case for the global performance events hosted by the Digital Worlds Institute when they overlay a musician from one continent with a video feed of dancers from another continent (listen to podcast). And I'll write about the video mixing work of new media artist and professor John Crawford next week that combines pre-created video with live dancers and other imagery.

But what happens if dance enthusiasts are provided with videos of different styles of dance in various settings? Maybe some of the dance videos could be shot in chroma key (against a blue or green background) so that these images could be easily mixed with different backgrounds. Videos of dancers could also be combined with abstract imagery or distorted in various ways. I'm sure there are hundreds of possibilities.

Would dancers and choreographers be willing to make videos available online for the purpose of creating video remixes? Could this help dance companies reach larger audiences by giving fans direct digital control over the final output? Could dancers generate greater levels of interest in their upcoming performances by sponsoring a dance mashup competition that incorporates video of dancers who will be performing in this upcoming program? Or does the thought of making this video widely available scare you to death?

Posted by Doug Fox on March 10, 2006 2:54 PM

Trackback Pings

TrackBack URL for this entry:
http://greatdance.com/mtadmin/mt-tb.cgi/382

3 Comments


simon fildes said:

If you look at the hyperchoreography.org site this is something we've been trying to explore now for a while. I guess the work that's there is a half-way house to what you and Matthew G are proposing but its something that choreographers and dancers felt comfortable with (and we did start the project in 2001 with Flash 4 on a dialup connection so forgive us.)

The works allow a degree of user interplay without letting them become too undefined or mashed. Matthew's development of the hyperchoreography concept has been very welcome but I suspect there are more possible transparent interfaces to be developed in the future using games type interfaces.

One of the first steps in the process I believe, is having good metadata tags attached to video clips to allow fast searching and filtering. I believe that Google video is developing these possibilities and maybe this is one place to start building a library of quality raw material. Or is that TOO scarey!

Added: March 21, 2006 6:02 AM | Permalink

Doug Fox said:

Hi Simon,

Thanks for post about your work. Here's a link to your Hyperchoreography website for readers who haven't experimented with your online, interactive dance pieces.

It's stunning the number of new Web 2.0 applications that have been introduced lately that allow users to tag and categorize all types of data. My guess is, though, that we aren't really there yet in terms of the collaborative tools for tagging videos. It would be nice to have a tool like del-icio.us that let's you bookmark and tag videos from anywhere on the web and then share your video categorizations publicly.

Even when these tools are available, do you see large numbers of people tagging and organizing dance videos? How do you think it will happen? And once there is a lot of dance video categorizing taking place how do you see Hyperchoreography evolving?

Also, can you elaborate on your thoughts on game interfaces that will make the process more transparent?

Best,
Doug Fox

Added: March 21, 2006 10:43 AM | Permalink

simon fildes said:

Ok so some very quick thoughts in reply.

In terms of interfaces imagine if you could navigate through clips quickly using an PS2 or xbox style console. How you would use this to quickly select from a particular pool of short clips that havent been pre- arranged? I'm not sure yet but maybe there would be some intelligent system that could respond to the tags and for example shot size. so you could explicitly tell the system from the console to move from wide shot to close up but the system might make an intelligent choice based on whether you were in a fast movement tagged section or a particular location or dance style or whatever. Much scope for experimentation.

Matthew's drag and drop to timeline is an obvious approach and would be perfect for searching and user creativity but it would be nice to have nothing on the screen but video dance and control that in a fluid way.


Metatagging not just complete works but deconstructed works is the key to this so we could really explore an interesting space. I'd like to pull together fragments and video clips from artists all over the world and make my own work from them but as is acknowledged - will we ever let go of our sense of ownership of our work and let it happen?

I was at a seminar over a year ago run by a British telecom research group at Martlesham and they demonstrated a system that would make an edit of video material based on keywords I wish I had got hold of it to experiment.

For me its about starting at the beginning so when we set out to make a new film or video work we plan for the nonlinear possibility and maybe during the edit we can tag and comment our rushes clips (as you would anyway) and once the linear edit is complete don't just dump everything but then put them into a communal expanding online database.

Hands up whose first?!

Making our own mini self contained hyperchoreographic works is where we are at right now. Maybe when people get used to the idea we can make some of these bold steps.

Added: March 23, 2006 8:58 AM | Permalink

Leave a Comment




© 2007 Great Dance. All rights reserved.
Great Dance is a registered trademark.