Kinemetagraph is an interactive installation that invites the visitor to explore his or her physical relationship to the cinematic image.
First prize winner at the 2015 NYC Media Lab Summit

ClientTyler Henry

Kinemetagraph reflects the bodily movement of the visitor in real time with a matching pose from the history of Hollywood cinema. To achieve this, it correlates live Kinect-based “skeleton tracking” to an open-source computer vision research dataset of 20,000 Hollywood film stills with included character pose metadata for each image.

(projector output from a previous version)

HD Projector, Kinect depth sensing camera, Mac Mini.
Built in OpenFrameworks by way of the ofxNI2 and ofxCSV addons, MatLab, and the FLIC dataset.