Article:

The use of mixed reality (MR) for landscape simulation has attracted attentionrecently. MR can produce a realistic landscape simulation by merging athree-dimensional computer graphic (3DCG) model of a new building on a realspace. One challenge with MR that remains to be tackled is occlusion. Properlyhandling occlusion is important for the understanding of the spatial relationshipbetween physical and virtual objects. When the occlusion targets move or thetarget's shape changes, depth-based methods using a special camera have beenapplied for dynamic occlusion handling. However, these methods have alimitation of the distance to obtain depth information and are unsuitable foroutdoor landscape simulation. This study focuses on a dynamic occlusionhandling method for MR-based landscape simulation. We developed a real-timesemantic segmentation system to perform dynamic occlusion handling. Wedesigned this system for use in mobile devices with client-server communicationfor real-time semantic segmentation processing in mobile devices. Additionally,we used a normal monocular camera for practice use.