Recognize Hand Gestures

[ApolloZhu]

[ApolloZhu]

OpenCV

BSD License
#include <opencv2/opencv.hpp> (Objective-C++)

Documentation
Tutorials
Edge Detection
Custom Shape

Gesture

GitHub

• https://github.com/FORTH-ModelBasedTracker/HandTracker
• https://github.com/lzane/Fingers-Detection-using-OpenCV-and-Python
• https://github.com/mahaveerverma/hand-gesture-recognition-opencv

Articles

• Fingertip Detection
• Hand Tracking and Recognition With OpenCV
• What is the easiest way to recognise gestures in OpenCV using Python?
• 9 tutorials to detect and recognize hand gestures
• ... in JavaScript
• A paper
• Another paper

YouTube Videos

• https://www.youtube.com/watch?v=-klQ_bEPwfs
• https://www.youtube.com/watch?v=2Sp7oNF_qP0
• https://www.youtube.com/watch?v=4IVDdnwxxts
• https://www.youtube.com/watch?v=50j4Vb5fbZk
• https://www.youtube.com/watch?v=5LOMgs5695Y
• https://www.youtube.com/watch?v=5VWtoimnlto
• https://www.youtube.com/watch?v=5zgLtQh5_lk
• https://www.youtube.com/watch?v=6Uw_8Y1RuQQ
• https://www.youtube.com/watch?v=8Gep9EqS-Tg
• https://www.youtube.com/watch?v=9NzmeEml3Wk
• https://www.youtube.com/watch?v=A-xXrMpOHyc
• https://www.youtube.com/watch?v=ARIZzcE11Es
• https://www.youtube.com/watch?v=B4-IR8ySrSs
• https://www.youtube.com/watch?v=B4dwu3si9x0
• https://www.youtube.com/watch?v=B_UYmQJT-F0
• https://www.youtube.com/watch?v=CYJjQgV0mZY
• https://www.youtube.com/watch?v=CmBxUnp7XwM
• https://www.youtube.com/watch?v=DRU6Ns0tBpQ
• https://www.youtube.com/watch?v=DTkvaYRX8o0
• https://www.youtube.com/watch?v=EvQN1uUhcpI
• https://www.youtube.com/watch?v=EyiHqVkUmYU
• https://www.youtube.com/watch?v=Fjj9gqTCTfc
• https://www.youtube.com/watch?v=H9diqywK6NY
• https://www.youtube.com/watch?v=IJV11OGTNT8
• https://www.youtube.com/watch?v=IMsBIJP5FTY
• https://www.youtube.com/watch?v=IbJ8OjIavZU
• https://www.youtube.com/watch?v=Ih_GZ8I4r5o
• https://www.youtube.com/watch?v=IvKQS5-qomE
• https://www.youtube.com/watch?v=K1IWvU3cJvs
• https://www.youtube.com/watch?v=LjjJQ81RbX0
• https://www.youtube.com/watch?v=OLL_F4LV0YM
• https://www.youtube.com/watch?v=OfDdNv-bMBo
• https://www.youtube.com/watch?v=QsYxUqY5rLU
• https://www.youtube.com/watch?v=Rzt6WrlkHUw
• https://www.youtube.com/watch?v=S_CqA_yVOs4
• https://www.youtube.com/watch?v=TwYUm7i61JM
• https://www.youtube.com/watch?v=Ud8wbrRKPIU
• https://www.youtube.com/watch?v=UtozGpoDhwk
• https://www.youtube.com/watch?v=W4Afc9qcj4I
• https://www.youtube.com/watch?v=YLonOoXy8-Y
• https://www.youtube.com/watch?v=Z78zbnLlPUA
• https://www.youtube.com/watch?v=_N41CP0f0Mg
• https://www.youtube.com/watch?v=bUrjFGMfwas
• https://www.youtube.com/watch?v=dG-Yp-YZQNU
• https://www.youtube.com/watch?v=e1L_laHgpVA
• https://www.youtube.com/watch?v=fHgB22fIqjw
• https://www.youtube.com/watch?v=fse2t9si7go
• https://www.youtube.com/watch?v=hBbjt7JSyS8
• https://www.youtube.com/watch?v=hkol7Ml7-iA
• https://www.youtube.com/watch?v=hm-us4XrXaM
• https://www.youtube.com/watch?v=j2djD2-OfQQ
• https://www.youtube.com/watch?v=jup99fg9ioQ
• https://www.youtube.com/watch?v=kBw-xGEIYhY
• https://www.youtube.com/watch?v=kQxiFaZbOfA
• https://www.youtube.com/watch?v=kV2tWNdkLqo
• https://www.youtube.com/watch?v=khM5zCKf8Oc
• https://www.youtube.com/watch?v=lFxXhClSOhU
• https://www.youtube.com/watch?v=m0IwsxUpJFU
• https://www.youtube.com/watch?v=nXGan1JgrYs
• https://www.youtube.com/watch?v=nkklOgUyaOM
• https://www.youtube.com/watch?v=o3LSOq6OC4I
• https://www.youtube.com/watch?v=oH0ZkfFoeYU
• https://www.youtube.com/watch?v=p5HIWFzjg1I
• https://www.youtube.com/watch?v=pQYcZUBtErs
• https://www.youtube.com/watch?v=p_ooaC2ZXKw
• https://www.youtube.com/watch?v=qCjVFvZCLYM
• https://www.youtube.com/watch?v=uBdvL6F0hLE
• https://www.youtube.com/watch?v=uETHJQhK144
• https://www.youtube.com/watch?v=v-XcmsYlzjA
• https://www.youtube.com/watch?v=w4OZ6XjliXQ
• https://www.youtube.com/watch?v=worGapgXGoE
• https://www.youtube.com/watch?v=x2ZMsvpRgTo
• https://www.youtube.com/watch?v=xML2S6bvMwI
• https://www.youtube.com/watch?v=yRLa9h9iCQc

Interoperation

• Face Recognition
• https://github.com/wfratczak/Photometer

[ApolloZhu]

Depth

507: Capturing Depth in iPhone Photography
And also maybe: 508: Image Editing with Depth

This may help differentiating the hand from other objects in the background.

[ApolloZhu]

ManoMotion

Low key hiding their C# SDK from general public, requires their approval, no documentation so far. I don't know what do expect from them during the CES, but they do have a list of features that we probably need to consider about (and implement):

Demonstration: https://vimeo.com/240671606

• Hand Presence
• Fingertips
• Palm Center
• Hand Contour
• Inner Points
• Detailed Hand Pose Information
• Builtin gesture Recognition
• One Hand (L | R)
• Skeleton
• Custom gestures
• Two hands

And also how to make things more accurate: https://www.manomotion.com/summary-sdk-developers. Interestingly, they inferred that we should not turn on the flash in case of insufficient lighting condition.

[ApolloZhu]

Leap Motion

I know this one is kinda unrelated, but I would consider their product as complete and mature (and of course It's definitely more challenging for us to implement those features without having those auxiliary sensors). Still I want to mention them so we can learn from their UI/UX design based on their examples, as well as data structures based on their documentation.