top of page
Search

Make AI Videos with Consistent Characters

midjourney blog post image
A Midjourney generated image using Midjourney Automation Suite

Creating AI videos with the same characters in different scenes can be tricky. People often ask how to do it. We can use Midjourney to create images and then bring them to life with an AI video tool like Kling. This process is straightforward, but some small steps help get the best results. Let's go through how you can use tools like Midjourney to keep your characters looking the same story to story.

Start with Character Reference Photos

First, make reference photos for your characters in Midjourney. Be specific in your prompts. Pay close attention to hair. It is very important for consistent results. Include things like age and what they are wearing and the colors.

  • For a man, you might prompt for a haircut like a comb-over.

  • For a woman, include hair length, like medium length dreads. Midjourney can sometimes generate many different hairstyles if you don't.

  • Describe their clothes precisely, like "light blue button shirt" or "yellow sundress with thin straps."

Use the same camera or film type for all character photos. Kodak Portrait 400 was used in the example. Save these prompts. You will need them again later.

Create Your Scene Images

Next, generate the base images for your scenes. These pictures will be the backgrounds where you put your characters. For example, "a wide-angle shot of a woman and a man sitting down outside the Coliseum on a bright sunny day." This is the basic scene prompt.

[H3]Add Characters to the Base Image[/H2]

Now, add your specific characters using the prompts from your reference photos. In the scene prompt, tell Midjourney where each character is placed.

  • Start by saying "on the left" for the woman and paste her description (hair, clothing, etc.).

  • Then say "on the right" for the man and paste his details.

  • End with the same film type and the aspect ratio you want.

Check the generated images. They should have characters that look similar to your references, though maybe not exactly identical yet.

Inject Your Character References

To make the characters match your references exactly, use Midjourney's editor tool. Find your reference character photo and copy its image URL. Back in Midjourney, open the base image with the scene and characters you just made. Go to the editor.

  • Use the eraser tool to select the area you want to replace, like the head or body part of one character in the base image.

  • In the prompt area, paste the image URL of your character reference photo. Hover over the URL and click the person icon. This tells Midjourney to use that photo as a character reference for the erased area.

  • Submit the edit. Midjourney will generate options where the character looks more like your reference.

  • Repeat this step for the second character in the image.

This method works well, but sometimes you might need to try different reference photos if the injection does not look right at first. Do not give up; just try a different reference.

To make this process faster and simpler, consider using a tool designed for Midjourney automation. The TitanXT Midjourney Automation Suite can help streamline these repetitive steps, allowing you to focus more on creativity.

Refine Your Images

Even after injecting the characters, look closely for small issues. Use the editor tool again to fix anything that does not look right.

  • Erase and regenerate specific areas, like earrings you do not want, or parts of the body that look too large or out of place.

  • Check hands – they can sometimes look strange and need fixing.

Fixing these inconsistencies ensures your characters look right in every scene.

Prepare and Animate

Before animating, upscale your finished photos in Midjourney. You want the highest image quality before turning them into video.

With images ready, use an AI video tool. Kling AI is mentioned for its dynamic motion in bringing characters to life. Other tools like Runway or Luma can also be used, sometimes offering more consistency though less motion than Kling. In the video tool, upload your image and add a prompt describing the action, such as "the man and the woman speak to each other." Adjust settings if needed.

Getting characters to look consistent across multiple images is a key step in making compelling AI videos. Tools are evolving quickly to make this easier.

Looking for a way to make your Midjourney workflow more efficient when creating these sequential images? Check out the TitanXT Midjourney Automation Suite. It offers features to help manage prompt variations, batch processing, and more, saving you time and effort.

Conclusion

Creating videos with consistent characters in AI involves careful steps from generating initial references to refining the final images before animation. By following these techniques with tools like Midjourney, you can tell stories with the same people appearing convincingly in different scenes and actions.

Ready to take your Midjourney projects to the next level and potentially automate some of these manual steps? Explore the TitanXT Midjourney Automation Suite to see how it can help power your creative process.

 
 
 

Comments


bottom of page
Midjourney Automation Suite - Automate your image generation workflows on Midjourney | Product Hunt