Faculty of Engineering and Natural Sciences
Intelligent User Interfaces for Natural Human Computer Interaction
T. Metin Sezgin
Sketching is a natural mode of interaction used in a variety of settings. For example, people sketch during early design and brainstorming sessions to guide the thought process; when we communicate certain ideas, we use sketching as an additional modality to convey ideas that cannot be put in words. The emergence of hardware such as PDAs and Tablet PCs has enabled capturing freehand sketches, enabling the routine use of sketching as an additional human-computer interaction modality.
But despite the availability of pen based information capture hardware, relatively little effort has been put into developing software capable of understanding and reasoning about sketches. To date, most approaches to sketch recognition have treated sketches as images (i.e., static finished products) and have applied vision algorithms for recognition. However, unlike images, sketches are produced incrementally and interactively; one stroke at a time and their processing should take advantage of this.
In this talk, I will describe ways of doing sketch recognition by extracting as much information as possible from temporal patterns that appear during sketching. I will present a sketch recognition framework based on hierarchical statistical models of temporal patterns. I will present a statistical framework based on Dynamic Bayesian Networks that can learn temporal models of object-level and stroke-level patterns for recognition. Time permitting, I will also briefly touch on other threads of current work on intelligent interfaces.
Dr. Sezgin graduated summa cum laude with Honors from
University in 1999. He received his MS in 2001 and his PhD in 2006, both from Massachusetts Institute of Technology. He joined the
Cambridge Computer Laboratory as a Postdoctoral Research Associate in 2006. As of Jan 2009, he has been an Assistant Professor of Computer Engineering at Koc¸ University,
Dr. Sezgin leads the Intelligent User Interfaces Lab at Koc¸, and his main research goal is enabling people to interact with computers in a more natural fashion by combining techniques from computer vision, machine learning, computer graphics and human-computer interaction.
March 12, 2009, 13:40,