but we still see limited progress in overcoming the traditional interfaces in user performance.
My approach is to computationally search for optimal user interfaces by utilizing models of
human perceptual, motor, and cognitive systems. The approach is based on 1) information
theoretical measurement of skilled motor performance to identify candidates for highest throughput,
2) formal analysis of UI design spaces, 3) predictive modeling of user performance, and
4) computational search for UIs that maximize user performance. Three examples will be discussed:
designing keyboards for two-thumb text entry on tablet devices with touchscreens, autostereoscopic
display of mobile mixed reality content, and full-body control of first person shooter games in Kinect.
User interface design is a recent discipline and has been largely based on trial and error and simple guidelines.
The presented approach allows aggressive and systematic exploration of design space and increases
understanding of the limiting factors and involved trade-offs.