The beam splitters and lenses are represented by physical objects, and the system projects down the laser beam path.

(Laughter)

Google the App Engine Datastore actually has some of these limitations.

It's completely intuitive there's no instruction manual.

Hit me.

We have so much technology nowadays that these interfaces should start conforming to us.

We have perception, computation and non visual interfaces.

We're 25, 26 years after the advent of the Macintosh, which was an astoundingly seminal event in the history of human machine interface and in computation in general.

There's no interface, again. It really allows anybody to kind of go in and it just does what you'd expect, you know?

We're not accessing it.

The sensors that are used can see through the dark, the fog and rain.

The term Widget refers to the basic building block of a computer program's interface.

So for this, we developed many different types of non visual user interface technology.

I'm telling you it's there.

Then, on the side, we've got the Web and, increasingly, the cloud, which is fantastic, but also in the regard in which an interface is fundamental kind of a distraction.

What's really interesting here is what you can do with it and the kind of interfaces you can build on top of it.

There's also companies like Google that are using the technology to create interfaces between mobile phones, tablets and the real world.

I mean it's been 25 years.

And, so, we have what I think is the easiest to use and I hope most enjoyable subtitling interface anywhere.

I thought, Why can I not connect the normal interface of a physical sticky note to the digital world?

I can do it simultaneously, holding this down, and gripping on another one, stretching this out.

Well we need a neural interface, a way to connect to our nervous system or our thought processes so that it's intuitive, it's natural,

So I'd like to show you a few examples, because there are many possible applications for this new interface.

But Alex was preparing a little, sort of obscure, indie, arthouse film called Minority Report for Steven Spielberg, and invited us to come out from MlT and design the interfaces that would appear in that film.

So we're moving away from the instructional cue devices, and we're now focusing more on the informational devices.

So this led full circle, in a strange way, to build these ideas into what we believe is the necessary future of human machine interface the Spatial Operating Environment, we call it.

So this is a musical interface built by a student from Italy, and he's now turning this into a product.

Now, this is an interesting little message, and it's a lesson that has since, I think, been forgotten or lost or something, and that is, namely, that the OS is the interface.

When they're laid out, I can pull things to new locations or delete things or just quickly sort a whole pile, you know, just immediately, right?

As you can see, I can use the same two fingered gestures to go down and go in really seamlessly.

Just imagine, in a classroom a teacher writes on the blackboard and a blind student can see what's written and read using these non visual interfaces.

The DOM is an interface to the structure of an HTML.document, for example, the head or body element.

And one of the reasons why I think that is will be helped by things like graphics and visualization and inference tools, but I also think a big part of it is going to be having better interfaces, to be able to drill down into this kind of data, while still thinking about the big picture here.

Directive

We just came up with that on the spot, it's probably not the right thing to do, but there's such interesting things you can do with this interface.

It's a great example of the kind of research I really love all this compute power to make things do the right things, intuitive things, to do exactly what you expect.

Interaction design five to six years ago meant solving and thinking through kind of the choreography of information and feedback and interfaces around a product.