Real time face tracking applied to a 2D virtual Avatar

This app uses Face detection to get the of the face landmarks coordinates from the live CameraX feed. Then it sends the data to the Rive State Machine functions to control the value of the eyes opening, the mouth smiling and the head tilt

The Animation Iam using is a simple proof of concept. Any animation can be used here such as a Vtuber avatar.

Tech stack & Open-source libraries

• build in android studio. kotlin
• Jetpack Compose
• CameraX
• Processing
• Face Detection

The Data we Get from the Face detection Library

What I learned

• using Face detection
• drawing polygons in processing
• using Rive's State Machines
• using Rive in jetpack

Architecture