Eyeline Match traces the evolution of the gaze from cinema to the emerging era of intelligent sensing machines. The project is a personalized “smart film” that edits itself based on how it is watched. Using gaze-tracking hardware, the viewer’s eye-movements are monitored and analyzed by machine learning algorithms that detect patterns of visual interest, and search a database of iconic cinematic imagery to generate subsequent frames of the film. The viewer gradually becomes aware of how the algorithms’ decisions correspond to his or her own activity of seeing. In the end, the viewer must learn to navigate the gaze in order to become a user.
“The gaze, mechanized in the 20th century, has become digitized in the 21st. It is evolving into a sensory technology that empowers algorithms to scrape the physical world for quantitative input. Each of us, as we pass under surveillance satellites or simply take a selfie, is reflected as an actor in this new networked database narrative. Our images become identities that circulate from camera, to algorithm, to eye, and back again.”
Presentation slides from the AIGA/NY Fresh Grad showcase for more information.