Object recognition service 210 may implement interface 211 to allow clients (e.g., client(s) 250 or clients implemented internally within provider network 200, such as a client application hosted on another provider network service like an event driven code execution service or virtual compute service) to index and analyze objects included in data, such as image data (which may be found in various types of media, such as still images or video data) or other data (e.g., text/character strings for natural language processing). For example, object recognition service 210 may implement interface 211 (e.g., a graphical user interface, as discussed below with regard to FIG. 4, programmatic interface that implements Application Program Interfaces (APIs) and/or a command line interface) may be implemented so that a client can request an object recognition index be created for image data 232 stored in storage service(s) 230, and/or image data in other storage locations within provider network 200 or external to provider network 200 (e.g., on premise data storage in private networks). Interface 211 may allow a client to request the performance of analysis (e.g., to search, compare, classify, or label image data content), as discussed in detail below.