The technology generally relates to providing passengers with information about a vehicle's environment. This may include, for instance, adjusting a virtual camera's position and orientation when the vehicle is making a turn. For instance, as the vehicle performs a turn the position of the virtual camera may be rotated around the vehicle to present video within an adjusted field of view corresponding to the vehicle's anticipated heading. In this regard, a computing device within the vehicle may transmit information to a virtual camera system corresponding to the vehicle's surroundings and positioning. Based on the received information, the virtual camera system may generate the video from a perspective of the virtual camera using the received data. The video may be generated by overlaying the vehicle's projected trajectory and detected objects on a map corresponding to the route the vehicle is traveling.