AnyPortrait > Forum > How to Use

[Archive] Creating cutscenes that support lip syncing to sound

  • This topic has 0 replies, 1 voice, and was last updated 1 week, 1 day ago by Archive AccountArchive Account.
Viewing 1 post (of 1 total)
  • Author
    Posts
  • #1241
    Archive AccountArchive Account

      Q.

      I want to create a cutscene with multiple characters.
      In particular, I want to implement “Lip-Sync” where the character’s mouth changes according to the sound.

       

      A.

      If you want to make character animations play sequentially according to the scenario, it is convenient to use Unity’s Timeline.
      You can check the method of linking Timeline and AnyPortrait character in the following manual.
      https://rainyrizzle.github.io/en/AdvancedManual/AD_Timeline.html

       

      For lip syncing, you’ll need to use a little script.
      Write a MonoBehaviour script with the following code:

      public class LipSyncScript : MonoBehaviour
      {
              public apPortrait portrait;
              public float mouthValue;

              void Update()
              {
                    portrait.SetControlParamFloat(“Mouth Open”, mouthValue);
              }
      }

      This is to make the mouth of the AnyPortrait character change according to the control parameter called “Mouth Open”, and then use a script to change the value of the control parameter every frame.

      And register the GameObject with this script to the Timeline, and control the “mouthValue” value.
      This way, the value of “mouthValue” animated by the Timeline will be passed to the AnyPortrait character, so as a result, you can control the character’s mouth with the Timeline.

      • This topic was modified 1 week, 1 day ago by Archive AccountArchive Account.
      • This topic was modified 1 week, 1 day ago by Archive AccountArchive Account.
    Viewing 1 post (of 1 total)
    • You must be logged in to reply to this topic.
    Scroll to Top