We planned to edit the video over the weekend, but our VR had some problems, so we had to record the VR again and match it with the live action. I had 2 days to edit and composite the video.
I had to wait till Xiaoyan gave me the video of the VR recording and she wanted to edit the audio and send it to me separately. I got all the videos and audio on Monday and then I started removing the green screen.
To remove the green screen I used Nuke, first mature I used was the IBK node and I was not that happy with the result. The curtain stand was made out of chrome, so everything was refracted because of that and the stand reflected the green screen. While removing the green screen even the stand became transparent.
The next thing I tried was to get a clean plate of the greenscreen without any props or actors and then I could use the Spill Replace and use Divide and Multiply. Later, I combined the audio with the video and I also did baes colour colouration.
I felt that the audio had some noise and it didn’t sound clean, so I put the audio into Audition and did a quick cleanup.
I also had a problem matching the audio to the video. I shot the video at 29.97 fps and Xiaoyan sent the audio which was 24 fps. I didn’t know how to fix the problem I tried to change the fps when I was rendering the video from Nuke at 24 and still didn’t work. When I spoke to Gonzalo he asked me to get the audio working file and put it on the timeline and see if that works. When I asked Xiaoyan about the working file, unfortunately, she had already deleted it. The next thing Gonzalo advised was to make sure all the elements have the same fps, like the videos, audio and timeline, but even that didn’t help.
Later that day I came home and tried to fix the problem, and I did exactly the opposite of what Gonzalo said, and I got lucky and it did work! I changed the fps of the timeline to 24 fps, the video to 29.97 fps and the audio to 29.97 fps.
This is what the final video looks like.