Abstract:

The video tag game is a multi-player game where users annotate streaming video with tags. Based on temporal tag agreement with other users in the game they can receive points. I.e. they will receive more points for a tag, if an other player has entered the same tag close in time, compared to the case where there exists more time between entering the tags. The points received for each tag is regulated by a time-based scoring mechanism where users can receive between 2-20 points for a tag, depending on the temporal agreement with other users. We have run a small user-study at SIGIR 2007 in Amsterdam, where 59 participants enjoyed playing the game in a setting similar to that of a game room. In this paper we present the outcome of this user study, which provides some insights into the capabilities of users when it comes to annotation of streaming video. Currently, we are aiming to release the video tag game on the Yahoo! network to collect more data using a large pool of users, more videos, and more games per video. Ultimately, the data collected allows for the retrieval of video fragments based on human-annotations, which in many cases still performs better than content-based retrieval approaches.