In some examples, the RWDRS 230 may enable a seamless blending of virtual content with physical environments. Technologies to enable such RWDRS 230 may include spatial mapping, LIDAR, drones, depth perception, stereo cameras, semantic mapping, image recognition, barcode and QR code recognition, and audio recognition (such as ability to recognize song and overlay lyrics, local concert information, etc.). In some cases, the RWDRS 230 may incorporate technology for the recognition of other senses, as well as incorporate other capture capabilities and camera types.
The localizer service 235 may be responsible for tracking and mapping the xR experience 140 against the surfaces/geometries of a particular location, either in the physical world against the physical surfaces at a Location (for an AR experience), against virtual surfaces in a 3D world (for a VR experience), or based on the orientation of the user or objects in the xR experience. Thus, the localizer service 235 may be capable of making the xR experience work at a range of angles, locations, and devices (to allow interaction of many users at the same time). Localizer service 235 may also be responsible for aligning content positions and/or orientations between multiple simultaneous viewers to create the illusion of shared xR experiences. The data for the 3D surfaces and the mapping of physical (and virtual) spaces to objects (used by the localizer service) comes from the RWDRS 230. The RWDRS 230 may also provide object recognition via multiple technical approaches.