Skills

Python Machine Learning C++

Job Specifications

Role: Lip Sync Engineer – Real-Time Avatar Synchronization

Duration: long term contract

Location: Remote

About the Role

We’re seeking a technically skilled Lip Sync Engineer to bring our avatars to life with natural, real-time speech synchronization. This role focuses on building systems that seamlessly integrate text, audio, and facial animation—ensuring avatars speak convincingly across languages and platforms. You’ll work at the intersection of AI, animation, and engineering to deliver lip-sync generation in under 3 seconds, enabling immersive experiences for clients and partners. The Lip Sync Engineer role focuses on developing real-time, high-accuracy lip synchronization systems for digital avatars, enabling natural speech and facial movement across multiple languages and platforms. The candidate will work at the intersection of AI, animation, and engineering to optimize performance and integration. This position emphasizes technical fluency and collaboration rather than pure development, aiming to deliver seamless, immersive user experiences.

Responsibilities

Strong technical knowledge of lip-sync technologies, phoneme/viseme mapping, and facial animation integration.
Experience working with multi-language speech synchronization and ensuring phoneme accuracy across diverse languages.
Proficiency in scripting and system optimization using Python, C++, or related languages to achieve 1–3 second lip-sync generation times.
Familiarity with ML/AI frameworks applied to speech-to-animation synchronization.
Ability to design and optimize pipelines for real-time face animation and voice integration.
Demonstrable experience in system performance tuning to meet speed and accuracy benchmarks.
Experience liaising with product, creative, or client teams to align technical outputs with user experience goals.
Knowledge of avatar expression and emotion blending techniques.
Familiarity with multilingual phoneme/viseme mapping challenges and solutions.
Experience with animation/visualization pipelines including image, audio, and video input formats.
Certifications or coursework in AI/Machine Learning applied to animation or speech processing.
Exposure to cloud-based or distributed systems supporting real-time avatars.

Qualifications

Strong technical knowledge of lip-sync technologies, phoneme/viseme mapping, and facial animation integration.

Required Skills

Strong technical knowledge of lip-sync technologies, phoneme/viseme mapping, and facial animation integration.
Experience working with multi-language speech synchronization and ensuring phoneme accuracy across diverse languages.
Proficiency in scripting and system optimization using Python, C++, or related languages to achieve 1–3 second lip-sync generation times.
Familiarity with ML/AI frameworks applied to speech-to-animation synchronization.
Ability to design and optimize pipelines for real-time face animation and voice integration.
Demonstrable experience in system performance tuning to meet speed and accuracy benchmarks.
Experience liaising with product, creative, or client teams to align technical outputs with user experience goals.
Knowledge of avatar expression and emotion blending techniques.
Familiarity with multilingual phoneme/viseme mapping challenges and solutions.
Experience with animation/visualization pipelines including image, audio, and video input formats.
Certifications or coursework in AI/Machine Learning applied to animation or speech processing.
Exposure to cloud-based or distributed systems supporting real-time avatars.

Preferred Skills

Exposure to cloud-based or distributed systems supporting real-time avatars.

About the Company

Triveni provides end-to-end information technology services. Headquartered in Rutherford, New Jersey - Triveni, as a full-service software consulting company, has have been helping businesses, from small startups to Fortune 500 companies, meet their business goals through technology innovation and adoption. As your information technology partner, Triveni can help you: - Bring innovative ideas to reality Maintain business-critical software applications Develop on-the-go mobile applications Create distinct e-commerce web store... Know more