Differential processing of data streams based on protocols
摘要
說明書
Each data element in a stream may be assigned an index. Indices may be used to monitor whether and/or an extent to which data elements are being reliably transmitted. The indices may correspond to an order in which data elements are appended to the stream. Thus, monitoring a stream-transmission reliability may then include detecting whether data elements corresponding to each of a set of sequential indices have been received.
Stream processing system 120 can be configured to receive, transform, route and/or store data elements from each of one or more streams. Stream processing system 120 can include, for example, a transaction management engine (e.g., transaction management engine 106) and/or transformative processing engine (e.g., transformative processing engine 108).
Stream processing system 120 may, in some instances, be remote from one, more or all sources of data streams being processed. Stream processing system 120 may include a server farm that may include a collection of specialized stream processing engines (e.g., each engine being a server or processing core). A stream processing engine may be specialized so as to include, for example, fast multi-lean memory buses (e.g., a 128-bit or 256-bit wide interconnections). A stream processing engine may be configured for bulk memory transfers. For example, a Stream Register File (SRF) can store stream data to be transferred to external data stores in bulks and specialized chips (e.g., the Imagine chip) can facilitate strategic flow and packing of the SRFs.
