This experiment is using an undocumented part of Street View, the depth data. With that a depth map and a normal map are generated, which can be used in the shaders and to plot geometry and sprites in (almost) the correct position in 3d space.
Welcome to the jungle!
