IR tracking with the Femto Bolt

Hello everyone,
Im working on a project with the femto bolt and Im trying to track an object with reflective stickers using the IR feed. Using the sdk and standard CV tools I get great results, the problem comes when I want to overlay this tracking info on my RGB feed. Im using the standard transformation functions that come with the kinect/orbbec wrapper, specifically the DepthToColorCustom function that requires you to pass in the depth map along with the other feed you want to transform. Since the IR stickers show up as infinite/0 in the depth feed, this actually ends up cutting a hole in my IR feed during the transformation and kills all my tracking.
Does anyone have any insight on a different way for me to transform my IR feed on the RGB feed without losing the data I need?

thank you