FMP – Experiment

After the previous filming, I was able to film the additional footage mentioned in my last post. I then edited a rough cut video using both the previous and new footage.

I also experimented with tracking and green screen extraction using footage from scene 2. This scene requires several steps: 1) green screen extraction, 2) scene tracking, 3) adding social media graphics (matchmove), and 4) replacing the phone screen. I haven’t yet decided whether to create the graphics in 2D or 3D, nor which software to use, but since tracking data can be used across different programs, I went ahead and tracked the scene, created a 3D camera, and added some cards to see how they would appear in the footage.

The green screen extraction process was quick and worked well. However, tracking the phone screen was challenging because my hand movement made the track quite unstable when using the PlanarTracker node. As shown in the test video, there is noticeable shaking in the screen replacement. I’ll work on finding a solution to make it more stable and plan to extract the green screen footage and replace the screen this week. I expect this will involve a good amount of work!