This specification begins with a general description of a provider network that implements multiple different services, including an object recognition service, which may perform filtering detected objects from an object recognition index according to extracted features. Then various examples of, including different components/modules, or arrangements of components/module that may be employed as part of implementing the object recognition service are discussed. A number of different methods and techniques to implement filtering detected objects from an object recognition index according to extracted features are then discussed, some of which are illustrated in accompanying flowcharts. Finally, a description of an example computing system upon which the various components, modules, systems, devices, and/or nodes may be implemented is provided. Various examples are provided throughout the specification.