This is our first project for Live Experimental Interactive TV. We tried to do some live mash-up video. Our audience are texting some samples of the lyrics to our system and we display it on the video with audio. I worked with Edward Gordon(Gordie), Adam Harvey and Jeff Howard for this project.
System has 3 different parts. First part is the TextMarks system and php code. User sends a text to TextMarks and php code saves it in a text file. Then, there is a processing application keeps checking the the text messages that user send and matches them with the ones in the song. Processing checks the text file in every half second. Then, processing application sends the keyword to Max/Msp by using OSC. Then in Max/Msp we have a video that skips to marked keyword points audio, that matches with video and also an audio part that plays under the video.
I think our work was creative and fun to play. Also it worked so well. I think some additions could be, not using a song but some other mesh-up thing that is not related to time. Also, maybe some more reflection of the user on the video would be useful.