The Future of AI-Based VFX

newslounge.co · Dec 19, 2023

Good Morning. Hello! I'd like to remind our new readers that we introduced the 'Tuesday Update' edition last week. In these, we'll be sharing cool and interesting finds that you can skim through in 2 mins.

Thursdays, on the other hand, are reserved for more in-depth and comprehensive content.

Additionally, please take a moment to respond to our survey(at the bottom of this email). Your feedback is invaluable in helping us improve. Feel free to reply to this email with any comments or suggestions.

Let's dive right into it.

-Ardy

was this email forwarded to you? you can sign up here.

TRENDING

Exciting updates for Unreal Engine 5.4

Unreal Engine - 2024 Roadmap

Here is a list of the new features coming to Unreal Engine 5.4 in 2024:

  • Terrain sculpting on the fly: Nanite gets dynamic displacement, letting you sculpt landscapes and add effects in real-time.

  • Nanite gets curvy: Spline meshes get performance boosts and improvements, making smooth, detailed creations easier.

  • World expansion: Unreal's world size explodes, letting you build truly massive and immersive landscapes.

  • Ray tracing rockets: Lumen's performance soars, bringing high-quality, real-time ray tracing to next-gen consoles.

  • Procedural power-up: Generate dynamic environments with more control and flexibility, using features like runtime generation and GPU-powered creation.

  • Cooking time cutlets: Faster cooking times and overall performance improvements make working on big projects a breeze.

  • Character creator's dream: New rigging tools, editor enhancements, and animation gizmos give you ultimate control over your characters.

  • Audio sleuth: The Audio Insights Debugger and Profiler let you fine-tune and troubleshoot your sounds like a pro.

  • UI makeover: Streamlined Content Browser, Viewport Toolbar, and Quick Unreal Motion Graphics UI Designer previews make navigating and creating smoother than ever.

Although artists are always excited to get their hands on new features, there are a few downsides to consider as well.

  • The constant changes can be overwhelming and frustrating for artists and developers, especially those with less experience. It can feel like they're always playing catch-up with the latest features.

  • Documentation often can't keep up with the pace of change, making it difficult to learn the new features and find solutions to problems.

💡What do you think?

-AA

🔺 Watch: Lumen vs Path Tracing in Unreal Engine 5.4

KEEPING UP WITH A.I.

The Future of AI-Based VFX

What would the world of AI-based VFX look like?

  • 3D output focuses on previs with various buffer and reinforcing images.

  • Reference photos primarily determine the look, with low-res textures or basic colors for 3D renders.

  • Animation persists, either through keyframe blocking with AI-generated in-betweens or full rendering for artistic direction.

  • Compositing shifts to latent space images, not pixel images.

  • Film plates become optional, replaced by previs/animatics and on-set reference photos.

  • Rendering and texture/shader departments shift focus to reinforcement elements, while other departments remain largely unchanged.

In summary, VFX evolves to play a more central role in film production, with most elements, including plates, handled in post-production.

This workflow still requires a lot of prep work. you can not expect to simply input the shot frames and have the desired output immediately.

This process requires eight different passes through workflows, involving over 100 hours of fine-tuning. Additionally, extensive rotoscoping work in After Effects is necessary for the masks.

🔺 Make sure to read our Thursday issue, where we'll dig a little deeper into ComfyUI workflows and solutions.

SPOTLIGHT

CAPTURE - Interview of Penelope Fairfax | Unreal Engine 5.3

CAPTURE - Vincent Toujas

Introducing "Capture" - A Cinematic Convergence of Reality and Fiction

What sets "Capture" apart is its innovative approach to filmmaking. It's a hybrid marvel, seamlessly blending live-action with real-time CGI. This fusion is not just about the technology; it's about redefining storytelling. By integrating story, acting, motion capture (mocap), and cinematography, "Capture" offers a unique cinematic experience.

Lead Role : Bess Davies

Director/animator: Vincent Toujas

TECH

Why Vision Pro Will Change Photography

Apple Vision Pro

Vision Pro introduces spatial video, a mixed-reality format that records depth and spatial information, offering a more immersive, 3D experience.

This technology, especially when viewed on Vision Pro's high-resolution display, provides a new way of experiencing videos, making them feel more like memories or real-life experiences.

📷Vision Pro could influence how photographers think about composition and framing. The large, immersive display encourages a shift from tight, close-up shots to more expansive views that include environmental details and use negative space creatively.

  • Tutorial: Maximize Your 3D Animations for Social Media

  • The Wheel of Time Season 2 - VFX Breakdown

  • Threadify: Make threads, ropes, and yarns easily in Houdini

  • Flora is a short film that tells the story of nature’s resilience and regeneration

  • Adobe and Figma ended their $20 billion acquisition dream yesterday after regulators signaled it would continue to be rough going.

  • Shocking events that The Simpsons have predicted for 2024

Rate Today’s Edition

What'd you think of today's edition?

Login or Subscribe to participate in polls.

I’ll leave you with this quote..

"Keep away from people who try to belittle your ambitions. Small people always do that, but the really great make you feel that you, too, can become great.”

Mark Twain

That’s it for today. see you on Thursday.

-newslounge