Differential processing of data streams based on protocols
摘要
說明書
Various processors and/or layers within stream processing system 120 can be specialized to perform various types of tasks. For example, a first set of processors may be configured to transform data within the stream in real-time (e.g., to produce data in a standard format and/or one that corresponds to a report protocol) and detect (e.g., based on data included in a header of a data element) whether the transformed data includes one or more particular composites (e.g., or fields). The first set of processors may thus be configured to perform on-chip processes with low latencies.
Upon detection of such one or more particular composites within a data element, a first processor may transmit the data element (or a replicated version thereof) to one or more second processors, which may be configured to perform more specialized extraction, apply a processing of a rule (e.g., of a report protocol), request and/or retrieve data from a remote data source, and/or store data associated with the data element (e.g., in a L1, L2, or L3 Cache, a local RAM or a remote data store).
