Avvy | VTuber&Anime Avatar

Avvy is a smartphone application that creates and animates 2D anime-style avatars through real-time facial tracking. The app captures facial movements through the device's front camera and translates them into corresponding avatar animations, enabling performance as digital characters during live streams, video recordings, or other content creation projects.

The app is intended for content creators who want to present themselves through an animated avatar rather than appearing on camera directly. VTubers, streamers, and video creators form the primary audience, though the app is available to anyone interested in avatar-based content. Real-time performance distinguishes this approach from pre-recorded or manually-keyed animation, as avatars respond spontaneously to the creator's facial movements.

Avatar customization begins with selections across three categories: hairstyles, outfits, and colors. Users modify these elements to create a character with their desired aesthetic. The touch-based smartphone interface guides the customization process. The available options provide sufficient variation for creating distinct character appearances tailored to individual preferences.

The technical foundation relies on real-time facial detection through the smartphone's front camera. The system continuously analyzes three types of facial movement: expressions, lip movements, and eye movements. Detection occurs continuously during streaming or recording, with the camera feed processed in real time rather than through manual animation controls. The system maintains responsiveness throughout extended sessions, allowing creators to interact naturally with their audience.

Avatar animation synchronizes directly with detected facial movements. When the user smiles, frowns, speaks, or blinks, the avatar performs the corresponding action. Synchronization occurs in real time, with minimal delay between user movement and avatar response. Accurate lip-sync with audio is essential for believable character performance, and eye tracking similarly ensures the avatar's gaze direction matches the user's eye movements.

The app integrates with external streaming and recording tools, specifically supporting OBS (Open Broadcaster Software) and other compatible streaming software. This integration allows creators to use the Avvy avatar as a video source within a larger production setup. Users can route the avatar feed through streaming software to combine it with overlays, scene transitions, or other production elements. This workflow flexibility serves professional streamers and content creators who manage complex broadcasting setups.

The app supports both live streaming to video platforms and local video recording. These capabilities enable multiple content creation approaches. Creators can stream while recording, stream without recording, or focus on pre-recorded content for editing. The recording capability enables content archival for creators who want to preserve their work.

Avvy operates on a free model with no subscriptions or paywalls. Users can create and customize avatars and access all features without spending money.

The real-time approach prioritizes spontaneous performance over pre-planned animation, enabling dynamic interaction through the avatar during live or recorded sessions. This design creates an immediate and responsive performance experience, where the avatar becomes an extension of the creator's expressions and movements rather than a separate element requiring distinct control input.