Category: Nuke

During this nuke class we learn how to clean up markers from someones face. We also learn how to add textures and how we use the technique to add some corrections as well. We start off by learning that we need to degrain the footage we are using before removing the markers. The idea is to first degrain the footage then remove the markers and then apply the regrain to the finished plate. For degraining and regraining we have different techniques we can use. We can denois the plate by using the “Merge (Minus)” node followed by the “Merge (plus)” node. Or we can use the “F_ReGrain” node This is a more precise way to degrain/regrain.

After Learning about how to degrain the next thing on the list was about how to Patch correctly. We have learnt about how to patch before but now we learn how to work with uneven lighting. As normally not everything is even we work with how best to remove these trackers. To get the Low frequency we use blur to tackle it and for the high frequency we use from, after we use the plus “merge” node to merge them.

For this class we got assigned a Small homework assignment regarding the patch clean up work. For this homework I used the techniques we learned during the class. I created a denoised plate and I did a simple track for each separate tracker point on her face and Rotopainted this and used the roto blur tool to individually blur the parts that needed the low frequency to work. I kept it simple Since this video does not have big light play.

For this weeks class we have worked with how to get rid of green screen and add our own backgrounds. During the classes we have talked about many different ways on working with green screen. for example we worked with the Keylight which for many people already is a well known node to work with. it is quite a standard green screen removal node and also a quite simple one. In this node you use one key that selects the green of the green screen to remove it from the scene but by using this you can see in the alpha that is does not perfectly remove the green screen. One other technique we used was with the IBK Colour and IBK Gizmo node this node system is a little bit more clean then using the keylight. Using the IBK nodes you can use the IBK color node to use the plate and try to create as close to a clean plate as u possibly can and then comp this back into the gizmo to get the results of the removal of the greenscreen.

For this weeks class we had to work on some homework for the next week. For this homework we needed to recreate a video that Gonzalo already made, for this video we got given the background plate and the foreground plate. When looking at this homework I went back into Gonzalos tips and tricks file and choose to work with one of the examples he gave during the classes (look at the images above).

Using the example for the green screen removal I started working on how to implement this in my own work. I started off by removing the greenscreen using the IBK nodes as given in the example then I used the core and gave it a filtererode to clean up the edges a bit more. Aside from that I also used a keylight to minus despill from the original footage and desaturated to remove unwanted colors. one more important part was to move the particles from the background and copy it on top of the foreground. I did this by using a grade on the background and changed the White and Black point values and merge this over the end scene.

Looking back at my work there are a few things that I had problems with or that I would like to change. One of the things is even though I have quite some detail in the hair it is still missing some of the nice glowing hairs on top and on the sides where it is blowing. I have looked at this for a long time but did not manage to get these hairs back. I need to work on this in the future. Another thing is that if you look at the fore and background together it looks a bit off. My background is quite green/dark and the Girl is quite bright and orange, this makes her stand out from the background. But overall looking at my video I think I did a good job in trying to match Gonzalos video.

For this class homework we had to green screen out the video given to us and add the background to it. I used the technique of the IBKColour and IBKGizmo node. First I created the IBKColour and tried to make it as an matched up green screen plate then I added the IBK Gizmo to get the green screen part separate and get the right alpha for the scene. I color graded the plate to match it a little bit more with the chosen background.

At the top of the screen there is a microphone that sometimes pops up in the screen, I removed this microphone using a simple Rotoscope and stencil this over the scene there the green screen is already removed. I did not have to do many extra things to the Rotoscope since it is a small area that the microphone pops up in.

Lastely I merged the foreground and background together and gave the background a little bit of an defocus to make the foreground image stand out more and give it a bit more realism.

For this weeks class we learned how to place CG objects in a composition and figured out how to grade and color correct the object so that it will fit into the plate we are working with. This months work is the Garage project we have been working on in this project we have to add a machine given to us by Nick. After that we also have to add our own environment in the scene to give it our own feeling.

Gonzalo gave us a ready made file so we could explain what we had to do for the machine step by step, one of the steps was to work with Multipass Comp, The 3D model given to us is rendered in Arnold so it is an Arnold multipass. In class we got shown how to work in the specular direct and indirect. after looking into the nodes and changing the grading we use merge plus to add it all to our comp.

We also got shown the how to give the model a proper shadow area. The shadow is a n important part to add, these are area shadows over the machine so it looks less fake in the entire scene. When adding the shadow you need to use the multiply merger to add this to your scene. The shadows will give the object more like a 3D feeling to it.

We also got shown to add the relighting and the re-texturing of the object. we got given 3 options on which texture we wanted to add to the scene, as shown I choose the option shown in the nodes image. and as for the relighting we used different passes to help us get the right alpha and then screen merge it so we could add it to a grade and give it a little bit extra lighting

We also have an master CG where we added basic grading to change the basic color of the machine given to us. we used the technique of basic grade matching. for this you pick 2 different colors in your plate, one being dark and the other being a light point.

During this class we were talking about how CG is used in Nuke. We see depending on the CG built we are giving how many more channels we have instead of only RGB. This will help us work better on the model that we get and be able to create better lighting, tones and shades. For our lightings we need to merg is down with the plus merge and if we are doing shadows we will need to work with the multiply merge node. This is a given to us by Gonzalo. During this class we learned all about the AOV’s.

AOV’s (Arbitrary Output Variables) are primarily use of the passes that create additional outputs for your render. We got given an example during class to work on. This example was a little legocar that was on a real life street. As for the Lego car image we got with different outputs. These output are for example the indirect, diffuse or specular (see the nodes above). We got to play around in these nodes to create a realistic looking Legocar in the scene given to us. So we grabbed those different outputs and graded each individual pass as we please with a grade.

For this class we also got homework for next week. It was a little bit the same as the lego car but then with a different Car and a street/plate of our choice. The image just below this texts shows you the different outputs of the CG model given to us by Gonzalo.

For this we also got an example node system going on and we could use this for giving the car. I used this example and tried to match the car with the chosen background. So again I graded the different outputs I was given and tried to match the greenish glow that the background has. The first image you see below this text is the image of the car in the chosen scene but then unedited. The one below that image has been the one I added, for color I think I have done a good job blending in the car with the plate. the only thing that is a little bit off is where it shows the glow part of what would be the light reflecting off the car.

Last time we had to play around with this same file we played around with last time. But this time instead creating the grid and point to the tracker nodes as we did last time this time we worked with as I said the same plate but we had to clean up the tracker pads that are visible in the scene and we had to create a Rotoscope for around the hole in the wall. This will be our terms project, The Idea is that we get a machine in the background of this plate. This is why we have to Rotoscope the wall.

First I started by removing the tracker nodes on the ground and on the wall. In total there are 15 trackers in this scene. 9 on the ground and 6 on the wall. I removed this using a technique Gonzalo told us during his classes. Looking at the image below this text (left) you can see the structure I used to remove the trackers. I used the Rotopaint technique where I could use the clone tool to copy the surrounding area around the trackers. I tracked the scene so I could create a card of a tracking point of the trackers. This card will move through the 3D space and will calculate the Rotoscope relying on the FrameHold where I produced my Rotoscope.

After removing all the Trackers from the scene I had to Rotoscope around the hole in the wall. For this I quite did the same as the clean up above. Hold a frame in where you can Rotoscope the part you need and then place this in a card that I created from one of the tracks that we calculated. I had to Rotoscope many different parts of the scene so that the calculation would work separably for the different parts.

Here you see my first version of the clean up I did and how I did my Rotoscope. The clean up in my opinion looks very good. You don’t see the trackers that were once on the ground anymore. But as for the Rotoscope I need to spend a littlebit more time on creating a better Rotoscope. You can see that at some parts it will move off of the bricks that it is suppose to be on. I will be working on this for the next week’s class.

For the start of this class we again looked at working in the 3D scene and worked a little bit with the 3D environment by placing a card to represent the wall and see if we could add something to the wall. We added a color-wheel, I moved this in the 3D environment to the card that will be in the same place as the wall in the video.

We also woked with the RotoPaint to patch up things that we want to remove out of our scene. This is also what we did last term but now we conclude this with the 3D camera we use. As shown in the images below we put an framehold on the video and the camera we added and Roto out the parts we want to remove. As an example he showed us how he removed a pole that is shown on the scene, I adapted to this and try the same but then with the red door. This door had what I assume are emergency exits plates on them and got rid of these

After this he also showed us how to create a 3D mesh for our 3D scene so we can get a clear vision of how we move through the 3D space in the video. For this we use the Point cloud generator node which crates a calculated number of points that track how the camera moves through the space. After using this we add the possion mesh node under this This leaves us with a almost completely closed off mesh of the 3D scene. (see images below)

We can also create our 3D mesh scene by tracking the points and creating a baked group. The bake will pop up as its own node called baked mesh, The is in my opinion a little clearer for the eye since this wont be a almost solid mesh but will show us an open mesh of where the streets would be and where the buildings are. (see images below)

As you see in the 2 meshes above that they are both quite rough sketches and this not always works for the best. You can also just use the camera tracker tool and create your own 3D cards to fill up different elements in your scene. As shown below I have tried this for the different doors. the right door was shown in class as an example and I added 2 extra examples on the left side to understand what I was doing.

For the homework we had to start on the scene he gave us. In this scene we kind of had to recreate an example he had shown us during class. This was to add 2 floors, one for the foreground and one for the background and also a wall for the background. In his example he also added some 3D objects, so for mine I added 2 cubes in the foreground and a circle in the background as a example as well. and lastly I added the red tracker pointers to the walls and the ground directing at the already physical placed in the scene.

With all these new techniques learned we got given another example of a scene were had to work with the camera tracker. In this scene Gonzalo showed us some examples he did which were creating the different cards in the scene and a door replacement. He told us to play around with this scene and see what we would be able to implement in the area that we think would work in the scene.

I searched online and found 2 different animal images that I thought would fit in the scene. I also went on my Ipad in procreate to create a graffiti like text to add to the total image.

Below this text you see how I made the scene in Nuke. I created a camera track and used the camera to implement the cards in the right places. I color correct and graded the 2 images to where it would fit better in the scene. I also gave the images some cracks with the rotoscope to give it a little bit more of a raw edge. I used corner pin to slide the image to the right position and put them next to each other on the wall. To give the scene a little bit more of a story I wrote down ‘People are animals’ and placed this text over the two posters.

Match-movement is used in nuke to track a camera movement of a video. This is used so that we the software understands where the camera is going based on a camera tracker. This tracker calculates all the movements the camera makes based on different points throughout your scene. When you track the movements you will be able to add 3D objects into your scene as desired. In nuke you can change from your 2D scene to your 3D scene using your TAB button on your keyboard.

In class we added the 3D camera tracker and removed all the tracks that were not tracking correctly. You will end up with a lot of green lines that show the path of the track. in your scene you will be able to visualize the floor selecting the different floor dots and connecting this to it being a floor. After this you can add different 3D objects into your 3D scene.

We played around with it during he class and got this added to our homework to play around with. I added a flooring to the base of the image and 2 cylinders. I connected this to a checkerboard grid so you can see it visibly in the scene. The card I used is representing the road through the scene and the 2 cylinder blocks I placed on this are shown to really get a clear image of the movement of the scene and where these objects are suppose to stay put in place.

For the last few weeks, we worked on the hot air balloon festival. This is a project where we used the balloons we made in Maya (I recreated the hot air balloon from scratch) in a template given to us (the background everybody uses) We were told to add our own composition to this, for example, we were told to add a spaceship or some rockets.

For my composition, I went with the sea life above ground. this idea I got this from Coldplay’s Up & Up video. I found these green screen images of different sea animals and added these to my project. The last time I showed a composition of my idea for the hot air balloon festival it was still a very basic overview of my idea. throughout the weeks I added my recreated hot air balloon that in my opinion is more to my liking for a hot air balloon. I think it also fits better in the scene than the hot air balloon I made before. Also when you look in the background you still see the building that will fall to the ground due to the particle force created by the orca. But now I also added the different buildings around it so it won’t be looking like a weird lonely building. After adding everything I needed to color correct everything so it all fitted a bit better into the image.

In the nodes, you can see how I added the different files that I found and a part where the particles have been put into the nuke file. I had to work with keylight to remove the green screen background and Rotoscope out different parts of the buildings so it would fit the mountain. As for the particles that move together with the orca swimming through the sky. In the end, I did these particles in Maya since it is still too difficult to create this in Nuke. I created a particle trail in the exact shape I wanted it to go in the video. I added the hot air balloon video in Maya to see the right path the orca would go in.