FMP – Matchmove and Particle Test
Last week, I received a reply from Gonzalo about the tracking issues with the problematic scene, but he mentioned it’s not an easy scene to track. He tried various approaches, but none worked well. He recommended refilming the footage with tracking markers on the screen. Ironically, I had already refilmed it in case a solution from him didn’t work out. I forgot to use tracking markers, but this time I used a blue screen on the phone to make separating the screen and background easier than before. Fortunately, it worked better this time, so now I can move on to creating the screen content for each scene.
With the screen replacement resolved, I moved on to matchmoving for each scene. Since all the phone scenes need reflections, I needed to create 3D scenes based on the background footage. However, when I rendered with HDRI, the atmosphere of the reflection didn’t match the background perfectly. I plan to refer to some videos I filmed previously to check the reflections. Based on these, I’ll download additional HDRIs, but if I don’t find suitable ones, I’ll look for building models on Sketchfab.
After handling simpler scenes, I moved on to tracking the building for the final scene. I encountered some trial and error at first due to camera tracking difficulties in Nuke. After several failed attempts, I tried tracking the scene in UHD. Since the project was too heavy and lagging, I reformatted all files from UHD to HD, which didn’t affect other scenes. Working with a larger footage format improved the tracking results compared to previous attempts. Once I had the correct camera data, I created a cube and matched its perspective to the footage. After aligning the cube, I reshaped it to resemble a typical 3D billboard. It matches quite well, but I couldn’t get a perfect match. I plan to cover the top area of the building with a 3D model to hide the perspective mismatch in the original footage.
After tracking, I experimented with creating the futuristic digital human character for the final scene. Since this was my first time using C4D, I relied heavily on tutorial videos. I learned the basics of the cloner and particle systems in C4D, and with these techniques, plus a model from Sketchfab and animation from Mixamo, I produced a test render. To check the atmosphere, I added a digital-looking background in After Effects. In the test video, the cloned objects flicker in each frame. As I’m new to C4D, it may take me some time to find a solution for this. In the meantime, I’ll try blocking the character’s animation with the cube I created earlier. Based on the difficulty of this process, I’ll decide whether to use motion capture.
To track my progress, I created a simple table. I feel a bit nervous since I need to handle many tasks at once, but I hope my project is heading in the right direction.
Leave a Reply