cocos icon
lipsync v0.0.2
Creator Extension Plugins
Creator Version Required
Supported Platform
Sale Price
$ 1.42 (Individual)



rhubarb-lip-sync-ccc (short for lipsync) is a Cocos Creator extension for quickly generating 2D mouth animation from voice recordings, based on DanielSWolf/rhubarb-lip-sync. It analyzes your audio files, recognizes what is being said, then automatically generates lip sync information into Cocos Creator Animation Clip. Supports any kinds of languages.


How to use

  1. From the main menu of Cocos Creator, click【extensions】menu -> 【lipsync】-> 【launch】. Launch the panel of lipsync.
  2. Drag all the mouth shape images into the corresponding slot. Among these 9 mouth shapes, 6 of them (A, B, C, D, E, F) are necessary, while the others (G, H, X) are optional. But it's recommend to offer them so as to make the result more natural.
  3. Select a local recording file. If is recorded in another language rather than English, it's better to un-select the checkbox【Is English recording?】. (This will results in the recognizer we choose. For English recordings, we use PocketSphinx, while for other languages we use Phonetic.)
  4. Create an empty Animation Clip, and drag into the 【Target Animation Clip】slot.

After finishing the above 4 steps, click【Generate】button and the magic will begins. Now you can open the terminal panel of Cocos Creator and you will see the following logs:

isEnglish: true
extendedShapes: GHX
Generation completed!

Once you see the "Generation completed!" message, it means that the generation has been done. Now drag the overwritten Animation Clip file to the Animation component of the mouth node and see whether it works.

Tips: if you find the ouput animation clip contains no frames, try restarting Cocos Creator and it should work.

How to get help

rhubarb-lip-sync-ccc is only tested on Mac OSX. I haven't try it on Windows but some other users has reported that it works well, too.

If you comeacross any question, welcome to submit an issue to the project page. It's suggested to also attach you demo project files so that I can analyze your problem.

User Rating

Average Rating
Total users participating at this score: 1


zxcvbnm0014 2020-12-08 14:12


  • 1

2020 © Cocos.com版权所有



闽公网安备 35020302033941号