docs

tools

Animation to animation

Animation to animation

The Animation to animation tool allows you to generate animation frames based on your descriptions and preferences. This powerful tool creates consistent character animations by generating multiple frames that maintain character appearance and style throughout the sequence.

1. Opening the Animation Window

Animation2AnimationMbutton

To get started with the "Animation to animation" feature, the first thing you'll do is open the Animation to Animation window.

2. Setting Up Your Animation

Animation2AnimationMenu

Inside the window, you'll find several settings to configure your animation.

2.1. Number of Images

At the top, you'll see a slider labeled Number of images. Use this to set how many frames you want the tool to generate for your animation sequence in one go. Keep in mind that the maximum number of frames you can generate at once might depend on your canvas size.

Animation2Animation#img

Starting Small

It's recommended to start with as few frames as possible (typically 2) to cycle through good references faster and establish a consistent character appearance.

2.2. Animation Reference

Below that, you'll see the Animation reference section. This is where you can choose to use an existing reference image or an init image. This is handy if you have a specific look or character you want to start with. We'll touch on using a generated frame as a reference later to help keep things consistent.

Animation reference settings
Animation reference settings

2.3. Description

Next is the Description field. Type in a description of the character or the art style you want to animate. For example, "man with a straw hat and blue overalls" as shown in the image.

Character description field

2.4. Action Description

In the Action description field, briefly describe the movement or action you want the character to perform, like "walk".

Action description field

2.5. Camera View

Select the perspective or camera view for your animation from the dropdown menu.

Camera view selection

2.6. Direction

Choose the direction of the action if applicable.

Direction selection

2.7. Appearance Settings

You can adjust the appearance of your animation here by picking options for outline, shading, and details. Feel free to experiment with these settings like "selective outline", "basic shading", and "medium detail" to see what fits your style best.

Outline, shading, and details settings

2.8. Advanced Options

Under the Advanced Options, you can fine-tune how the AI generates the animation:

2.8.1. AI Freedom / Robust

  • AI freedom: Influences how much creative latitude the AI takes during generation.

  • AI freedom (robust): Similar to the above, but less strict when following the template. This may offer more robust control over AI variability.

  • Guidance Weight: This controls how closely the AI sticks to your description. Adjusting these helps balance adherence to your input versus allowing the AI to add its own variations.

Guidance weight settings

3. Generating Your Animation

Once you've set up all your preferences:

  1. Click the Generate button at the bottom of the window
  2. Start with as few frames as possible to cycle through good references faster. (least amount would be 2)
  3. The tool will process your settings and generate the specified number of frames based on your input
Generate button

4. Maintaining Consistency with a Reference

When using Animation to Animation with no reference, in a perfect world after your first generation, you might get a frame you really like. To help ensure subsequent sets of frames stay consistent with that look:

  1. Take one of the generated frames that you like
  2. Go back to the Animation reference section
  3. Set that preferred frame as your reference image by checking the "Use reference image" box and "setting" your frame image there as a reference image
  4. This helps the tool keep the character and style consistent as you generate more frames
Setting reference image from generated frame
Setting reference image from generated frame
Animation to Animation generating reference frame

Repeat the generation process as needed, using the reference image to build out your full animation sequence

Manual Cleanup

While the tool gets you most of the way there, expect that you might need to do some manual cleanup on the frames afterward.

5. Workflow Tips

5.1. Starting Your Animation

  1. Begin with minimal frames: Start with 2 frames to establish your character
  2. Use clear descriptions: Be specific about character appearance and actions
  3. Experiment with settings: Try different appearance options to find your style

5.2. Building Your Sequence

  1. Find your reference frame: After the first generation, identify the frame you like best
  2. Set it as reference: Use that frame as your reference image for consistency
  3. Generate more frames: Continue generating with the reference to build your sequence
  4. Iterate and refine: Make adjustments to descriptions and settings as needed

5.3. Final Polish

  1. Review all frames: Check for consistency across your animation
  2. Manual adjustments: Use editing tools to fix any issues
  3. Test the animation: Play through your sequence to ensure smooth motion

6. Best Practices

  1. Start simple: Begin with basic actions like "walk" or "idle"
  2. Be descriptive: Provide detailed character descriptions for better results
  3. Use references: Always set a reference image after finding a frame you like
  4. Iterate gradually: Make small changes and test frequently
  5. Plan your sequence: Think about the full animation before starting

7. Common Use Cases

  • Character walking animations: Create smooth walking cycles
  • Idle animations: Add subtle movement to static characters
  • Action sequences: Generate attack, jump, or other action animations
  • Character variations: Create different versions of the same character

9. Result Preview

Animation to Animation results

10. Tutorial Videos

11. Limitations

  • Requires at least Tier 2 subscription
  • Canvas size must be one of:128x128, 64x64, 32x32, or 16x16
  • Maximum number of frames per generation depends on canvas size
  • Quality depends on the clarity of your descriptions and original Animation quality
  • May require manual cleanup for perfect results