top of page

Make AI Videos with the Same Characters Every Time

May 1

3 min read

0

3

0

midjourney blog post image
A Midjourney generated image using Midjourney Automation Suite

Creating AI videos with consistent characters can be tricky. Many tools let you make amazing scenes, but keeping the same faces throughout a story is a common challenge. This guide shows you how to use Midjourney to create images with consistent characters first, and then bring them to life with AI video tools like Kling.

Step 1: Create Character Reference Photos

The first step is to create detailed reference pictures of your characters using Midjourney. Think about everything: hairstyle is very important for consistency. Also include details like ethnicity, age, and specific clothing or colors.

  • For a man, you might specify a comb over or the color and style of his shirt (e.g., light blue button lining shirt).

  • For a woman, include hair length (e.g., medium length dreads) to help Midjourney generate consistent styles. Detail her outfit (e.g., yellow sundress with thin shoulder straps).

  • Use the same camera or film type (like Kodak Portrait 400) for all character and base images to keep a consistent look.

Make sure to save these character prompts. You will need them again shortly.

Step 2: Generate Your Base Images

Next, create the scene images where your characters will appear. I call these 'base images'. Start with a prompt describing the setting and action, but not the specific people yet. For example:

A wide-angle shot of a woman and a man sitting down outside the Coliseum on a bright sunny day, Kodak portrait 400, --ar 16:9

Notice this prompt mentions "a woman and a man" but doesn't give their detailed descriptions yet.

Step 3: Inject Characters into Base Images

Now you will add your specific characters to the base images you just made. Find a base image you like. Right-click on it and select 'More', then 'Editor'.

In the editor, you'll remove the generic people and replace them with your consistent characters using their reference image URLs.

[LI]Hit Submit.[/LI>

[/UL]

Repeat this process for the second character. Go back into the editor for the base image (where one character is now injected). Copy the URL for the second character's reference photo, erase the remaining generic person, paste the URL, set it to the 'person' icon, and submit.

For a process that involves many steps and potential trial-and-error in Midjourney, consider exploring tools like the Midjourney Automation Suite from TitanXT. This can help streamline the workflow, making it easier to generate multiple character variations and base images efficiently.

Step 4: Refine and Edit for Consistency

After injecting the characters, look closely at the image for inconsistencies. Midjourney might add things you don't want or make body parts look strange.

Use the editor tool again to fix these issues. You might need to erase areas like:

  • Large or oddly shaped earrings.

  • Arms or legs that look too large or out of place.

  • Hands that don't look right.

Erase the problem area and resubmit. You might need to try a few times or even use a different character reference photo if injection isn't working well initially. Don't give up – finding the right combination can take a few attempts.

You can also add details to the main prompt to influence the character's appearance after injection (e.g., adding "the man is wearing khaki pants" might encourage Midjourney to generate full legs).

Before moving to video, remember to upscale your final images in Midjourney to get the highest possible resolution.

Step 5: Animate Your Images with AI Video

With your consistent character images ready, it's time to animate them. I used Kling AI for this step because it provides dynamic motion.

[LI]Generate the video.[/LI>

[/UL]

Kling often creates expressive human-like motions, arm gestures, and facial expressions. Be aware that AI video tools can sometimes introduce small errors or blurriness, but the overall effect can bring your characters to life effectively.

Experimenting with different video tools and prompts is key. To speed up your creative process when working with Midjourney images, leveraging automation can be a big help. Find out how the Midjourney Automation Suite by TitanXT can assist in managing your image generation workflow.

Conclusion

By following these steps – creating detailed character references, generating base scenes, injecting characters using image URLs and editing, and finally animating – you can make AI videos featuring the same characters consistently across different scenes. While it requires careful image preparation, the result is much more compelling animated stories.

May 1

3 min read

0

3

0

Comments

Share Your ThoughtsBe the first to write a comment.
bottom of page
Midjourney Automation Suite - Automate your image generation workflows on Midjourney | Product Hunt