Gest: Work With Your Hands

Gest: Work With Your Hands Gest

Gest is a wearable device that allows you to control your computer or mobile device with your hands.

Work with your hands

Over a year ago, we set out to find a better way to interact. We wanted a device that got back to the basics of how we use computers. We’re used to old tools like the keyboard and mouse, but they’re starting to make less sense as our devices get smaller and more embedded in our lives. That’s why we created Gest. 

Gest lets you work with your hands in a more intuitive way. Switch between apps just by twitching your finger. Point at your screen to move the mouse around. Twist your palm to adjust sliders in Photoshop. Rotate a 3D object by literally grabbing it and rotating your hand. You don’t have to think about what you’re doing, just do it. 

The coolest part is that Gest is extremely versatile. You can program custom gestures into actions on your devices. Just make a movement with your hand, then tie it to any action you want. 

We don’t think the keyboard and mouse will be around forever, and with your help Gest will make that happen sooner rather than later!

Gest is a new way of working with your computer. It understands your hand and finger positions with a high degree of precision, so you can use it to get things done in a more intuitive way. It’s beautifully designed, light, and comfortable. Gest conforms to your hand size and shape through its adjustable palm strap and moldable finger mounts. Personalization We’re building Gest to be an extension of your body, as intuitive and flexible as using your own hands. For example, undoing an action could be as simple as swiping your hand to the left.While Gest may be one-size-fits-all on the outside, on the inside it’s all about you. Everyone moves their hands in unique ways; the way you point at the screen is probably different than your friend. Over time, Gest learns how you perform common gestures, like pointing, swiping, flicking, and grabbing. It also monitors your own custom gestures to ensure precision and accuracy. This is all made possible from our statistical model that adapts to each user, making Gest the most accurate gestural interface on the market today. Precision & Speed Our finger tracking technology is extremely low latency (40-60 ms), which means higher accuracy and more recognized gestures. We packed 15 discrete sensors into each hand so that Gest has an accurate picture of what your hand is doing, no matter its orientation. Whether you’re drawing, typing, modeling, presenting, or composing, Gest can learn the meaning of those motions and help you get things done fast!

What can you do with Gest?

Design

The first application integration that will be available day one is Photoshop, so anyone who designs for a living will love Gest right out of the box!

With a simple flick of a finger, you can add an adjustment layer and adjust its value. Or you can add layers, undo an action, or change your brush size, all without putting down your stylus and taking yourself out of the creative process!

A sneak peek of what you can do with Gest and Photoshop

We're also extremely excited about 3D modeling tools like Maya, 3DS and AutoCAD. 

Manipulating objects in 3D is a lot more intuitive when you can do it with your hands!

Digital Toolkit

Every Gest is also a DevKit. 

We’ve built an API so you can get access to hand position and movement data. We’ve layered a state-of-the-art machine learning stack on top of hyper-efficient motion processing algorithms to allow complex gesture recognition at extremely low latency. 

If you don’t want to use our custom skeletal models and motion processed data, you can still do whatever you want; we provide raw sensor data too! We will initially be providing Java and Python APIs.

As a developer, you'll get easy access to our hand-tracking and gesture recognition API

Typing

Gest was born out of our frustration with typing on tiny on-screen keyboards on our cellphones. We couldn’t find any portable keyboards that were efficient, comfortable, and accurate, so we initially created Gest with typing in mind. Our typing system is an experimental feature, and to make it great we need some brave folks to help test and improve the system. If you can type without looking at the keyboard and would like to try it out, make sure to select two Gest controllers to unlock typing functionality.