Live-action AI-powered Frieren: Beyond Journey’s End goes viral

AIでフリーレンの実写風動画を作成しました
画像：Stable Diffusion/Midjourney
動画：Stable Video Diffusion/Pika labs
音楽：騒音のない世界

Youtube
（YouTubeへのリンクはリプに記載） pic.twitter.com/8Zb1pgp3D6

— とうや (@towya_aillust) January 6, 2024

In a surprising collaboration between artificial intelligences “Stable Diffusion“, “Midjourney“, “Stable Video Diffusion” It is “Pika Labs“, this live-action version of Frieren: Beyond Journey’s End (Sousou no Frieren) which ended up going viral. Despite the expectations generated, the video provoked mixed reactions due to the apparent lack of fluidity in the characters’ movements.

The anime adaptation of the manga Frieren: Beyond Journey’s End (Sousou no Frieren) by Kanehito Yamada It is Tsukasa Abe It ended up becoming one of the most popular anime today. The animation is from the studio Madhouse (Sonny Boy, No Guns Life, Overlord), directed by Keiichirō Saitō (Bocchi the Rock!), the script is by Tomohiro Suzuki (ACCA: 13-Territory Inspection Dept., One-Punch Man, Boogiepop and Others), the character designs are by Reiko Nagasawa (takt op. Destiny) and the song was delivered to Evan Call (Violet Evergarden, Josee, The Tiger and the Fish, Muv-Luv Alternative).

Although the character designs in the live-action version were praised for their fidelity and visual quality, the lack of naturalness in their movements generated discussion. Viewers point out that, despite the convincing appearance of the digital actors, the movements are rough and jerky, revealing the current limitations of artificial intelligence in producing realistic video sequences.

In the comments we can read:

• It seems that the AI ​​cannot draw scenes with two or more characters.
• In some parts it is very good, but in others it is very bad.
• Wow, what I’m seeing is rubbish. AIs are not ready yet.
• I feel uncomfortable seeing this kind of thing. They look like Japanese cosplayers, when the series isn’t like that.
• At times I thought the designs were extremely good. We must stop thinking that all live-action is bad, it is impossible to perfectly reflect the designs of a manga in live-action. AI presents this proposal and I consider it unbeatable.
• The elf looks like something out of Final Fantasy, I don’t think the characters should have a Japanese appearance.
• Very bright and high contrast illustrations, as always. AIs will be better when they solve this problem.
• Why are all the faces Asian?
• Their faces change with each of their movements.
• The evolution of AIs is undeniable, I wouldn’t be surprised if AIs start making CG animated films very soon.
• Once you get used to the look of the AI ​​illustrations, you may notice small changes with each movement.