We propose an image reconstruction technique of a color 3-D object to perform image refocusing by combining information from bright-field image and digital holography. The key concept is first to reconstruct the 3-D object using compressive holography. Next, a binary mask is created to separate objects and transparent voxels. Then, the mask is used to assist the 3-D color object reconstruction from a bright-field image. Finally, image refocusing can be performed by convolving the 3-D object with an incoherent point spread function. We demonstrated the proposed method by conducting a simulation of two different objects. In both simulations, the reconstructed objects give good agreement with ground truth.