As a part of the solution to one of the problems I am facing, I wish to remove all the direct light sources from an image. Specifically I want it removed from the depth image of an SLS but my understanding is that I will have to use the rgb image to do so and then cut off the same part of image from depth_registered.

But, how can I cut off a direct light source (white or yellow) . ?