Article:

In this study, we developed a method for generating omnidirectional depth imagesfrom corresponding omnidirectional RGB images of streetscapes by learningeach pair of omnidirectional RGB and depth images created by computergraphics using pix2pix. Then, the models trained with different series of imagesshot under different site and weather conditions were applied to Google streetview images to generate depth images. The validity of the generated depth imageswas then evaluated visually. In addition, we conducted experiments to evaluateGoogle street view images using multiple participants. We constructed a modelthat estimates the evaluation value of these images with and without the depthimages using the learning-to-rank method with deep convolutional neuralnetwork. The results demonstrate the extent to which the generalizationperformance of the streetscape evaluation model changes depending on thepresence or absence of depth images.