Replacing desktop screen

After finishing the marker removal process, I replaced the green screen images with a desktop image. To hint that the human character likes dogs, I downloaded an illustration of dogs and made it look like the main screen in Photoshop.

Replacing phone screen

Initially, I tracked the green screen data using the Tracker node, but it didn’t work as expected. I asked Gonzalo how to track the screen when it goes out of the footage, and he introduced me to the PlanarTracker node, which was appropriate for my situation. When I used it, the tracking data worked well, but some scenes still had issues. Therefore, I tracked one point and matched it to the tracker using the CornerPin node. It was quite challenging as I had to work manually, but I am satisfied with the result.

After this, I rotoed the figures on the desk to make them appear in front of the character in close-up scenes. As the character jumps over the figures, I added the roto after it jumps. In the static scene, it was quite simple and easy, but some moving scenes had to be done manually due to an unknown problem when using the Tracker node.

Finally, the preparation stage is done. Now, I can proceed to compositing CG and effects.