In some embodiments, the media application may track a playing object in the video 305 of the live sporting event. For example, an image recognition system in the media application may use the size, shape, or color of different playing objects such as a football or other object. The media application may determine that the current circumstances of the live sporting event are changed based on a current location of the playing object in comparison to a previous location of the playing object. For example, if the line of scrimmage was originally determined to be at the San Francisco 49ers' 45-yard line and the ball is tracked from the 45-yard line to the 30-yard line, then the media application may determine the circumstances of the live sporting event have changed. In some embodiments, the media application may apply the set of rules to data representing the changed circumstance of the live sporting event to identify updated scoring scenarios in the fantasy sports event and generate for display, with the video of the live sporting event, information about the updated scoring scenarios.