Event stream processing - Revision history

Jlwoodwa: Change categorization templates (via redirect-helper)

2024-09-15T04:05:43Z

Change categorization templates (via redirect-helper)

← Previous revision		Revision as of 04:05, 15 September 2024
Line 1:		Line 1:
	#REDIRECT [[Stream processing]]		#REDIRECT [[Stream processing]]

			{{Redirect category shell\|
	{{R from merge}}		{{R from merge}}
			{{R with Wikidata item}}
			}}

Christian75: {{R from merge}}

2023-01-30T19:32:28Z

← Previous revision		Revision as of 19:32, 30 January 2023
Line 1:		Line 1:
	#REDIRECT [[Stream processing]]		#REDIRECT [[Stream processing]]

			{{R from merge}}

Caleb Stanford: merge content and delete duplicate page per WP:BOLD

2022-04-21T00:42:00Z

merge content and delete duplicate page per WP:BOLD

← Previous revision		Revision as of 00:42, 21 April 2022
Line 1:		Line 1:
			#REDIRECT [[Stream processing]]
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
	{{see also\|stream processing}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

	ESP enables many different applications such as [[algorithmic trading]] in financial services, [[radio-frequency identification]] (RFID) event processing applications, [[fraud detection]], [[process monitoring]], and [[location-based service]]s in telecommunications.

	==Examples==
	By way of illustration, the following code fragments demonstrate detection of patterns within event streams. The first is an example of processing a data stream using a continuous [[SQL]] query (a query that executes forever processing arriving data based on timestamps and window duration). This code fragment illustrates a JOIN of two data streams, one for stock orders, and one for the resulting stock trades. The query outputs a stream of all Orders matched by a Trade within one second of the Order being placed. The output stream is sorted by timestamp, in this case, the timestamp from the Orders stream.

	<syntaxhighlight lang="sql">
	SELECT DataStream
	Orders.TimeStamp, Orders.orderId, Orders.ticker,
	Orders.amount, Trade.amount
	FROM Orders
	JOIN Trades OVER (RANGE INTERVAL '1' SECOND FOLLOWING)
	ON Orders.orderId = Trades.orderId;
	</syntaxhighlight>

	Another sample code fragment detects weddings among a flow of external "events" such as church bells ringing, the appearance of a man in a tuxedo or morning suit, a woman in a flowing white gown and rice flying through the air. A "complex" or "composite" event is what one infers from the individual simple events: a wedding is happening.

	<syntaxhighlight lang="sql">
	WHEN Person.Gender EQUALS "man" AND Person.Clothes EQUALS "tuxedo"
	FOLLOWED-BY
	Person.Clothes EQUALS "gown" AND
	(Church_Bell OR Rice_Flying)
	WITHIN 2 hours
	ACTION Wedding
	</syntaxhighlight>

	==See also==
	* [[Complex event processing]] (CEP) - A related technology for building and managing event-driven information systems.
	* [[Data Stream Management System]] (DSMS) - A type of software system for managing and querying data streams
	* [[openPDC]] A complete set of applications for processing streaming time-series data in real-time.
	* [[Real-time computing]] - ESP systems are typically real-time systems
	* [[RFID]] - Radio-frequency identification, or RFID, recommends application of ESP to prevent from data flooding
	* [[SCADA]] - Supervisory control and data acquisition, a similar technology used in engineering applications
	* [[Apache Flink]] - An open-source stream processing framework for distributed, scalable data streaming applications
	* [https://wso2.com/analytics WSO2 Stream Processor] - An open-source [https://www.quora.com/What-is-a-Streaming-SQL-What-are-the-tools-supporting-Streaming-SQL Steaming SQL] based stream processing framework for distributed, scalable data streaming applications

	==References==
	<references/>
	* [http://www.cs.brown.edu/research/aurora MIT/Brown/Brandeis "Aurora" Stream Processing Project]
	* [http://dbs.mathematik.uni-marburg.de/Home/Research/Projects/PIPES "PIPES" Project at University of Marburg]
	* ''The Power of Events'' by David Luckham ({{ISBN\|0-201-72789-7}}), from Stanford University, a book on CEP.
	* [http://www.rfidjournal.com/article/view/1196 Separating the Wheat from the Chaff] Article about CEP as applied to RFID, appeared in RFID Journal
	* [http://www.complexevents.com Complex Event Processing & Real Time Intelligence] - A source of industry neutral information on applications, research, usecases, reference architectures, and developments in event processing, run by Prof David Luckham
	* [http://odysseus.informatik.uni-oldenburg.de/index.php?id=1&L=2 Odysseus] - An open source framework for event processing engines based on Java

	[[Category:Information systems]]
	[[Category:Cognition]]
	[[Category:Events (computing)]]
	[[Category:Radio-frequency identification]]

Caleb Stanford: Despite the last edit removing the merge request -- this really should be merged. They are identical concepts and the page is a duplicate. For now, include see also.

2022-04-21T00:37:45Z

Despite the last edit removing the merge request -- this really should be merged. They are identical concepts and the page is a duplicate. For now, include see also.

← Previous revision		Revision as of 00:37, 21 April 2022
Line 1:		Line 1:
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}		{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
			{{see also\|stream processing}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

Klbrain: Closing stale 2021 merge proposal; no case made; no support over many months

2022-04-19T15:42:12Z

Closing stale 2021 merge proposal; no case made; no support over many months

← Previous revision		Revision as of 15:42, 19 April 2022
Line 1:		Line 1:
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}		{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
	{{Merge\|Stream processing\|date=December 2021}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

AnomieBOT: Dating maintenance tags: {{Merge}}

2021-12-05T23:29:56Z

Dating maintenance tags: {{Merge}}

← Previous revision		Revision as of 23:29, 5 December 2021
Line 1:		Line 1:
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}		{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
	{{Merge\|Stream processing}}		{{Merge\|Stream processing\|date=December 2021}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

Caleb Stanford: fix merge template

2021-12-05T21:29:42Z

fix merge template

← Previous revision		Revision as of 21:29, 5 December 2021
Line 1:		Line 1:
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}		{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
	: Merge ~~with [[~~Stream processing]]		{{Merge\|Stream processing}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

Forlornacorn: Adding short description: "Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems." (Shortdesc helper)

2021-08-04T03:51:16Z

Adding short description: "Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems." (Shortdesc helper)

← Previous revision		Revision as of 03:51, 4 August 2021
Line 1:		Line 1:
			{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
	: Merge with [[Stream processing]]		: Merge with [[Stream processing]]

DannyS712 bot: Task 70: Update syntaxhighlight tags - remove use of deprecated tags

2020-05-11T17:44:48Z

Task 70: Update syntaxhighlight tags - remove use of deprecated <source> tags

← Previous revision		Revision as of 17:44, 11 May 2020
Line 8:		Line 8:
	By way of illustration, the following code fragments demonstrate detection of patterns within event streams. The first is an example of processing a data stream using a continuous [[SQL]] query (a query that executes forever processing arriving data based on timestamps and window duration). This code fragment illustrates a JOIN of two data streams, one for stock orders, and one for the resulting stock trades. The query outputs a stream of all Orders matched by a Trade within one second of the Order being placed. The output stream is sorted by timestamp, in this case, the timestamp from the Orders stream.		By way of illustration, the following code fragments demonstrate detection of patterns within event streams. The first is an example of processing a data stream using a continuous [[SQL]] query (a query that executes forever processing arriving data based on timestamps and window duration). This code fragment illustrates a JOIN of two data streams, one for stock orders, and one for the resulting stock trades. The query outputs a stream of all Orders matched by a Trade within one second of the Order being placed. The output stream is sorted by timestamp, in this case, the timestamp from the Orders stream.

	<~~source~~ lang="sql">		<syntaxhighlight lang="sql">
	SELECT DataStream		SELECT DataStream
	Orders.TimeStamp, Orders.orderId, Orders.ticker,		Orders.TimeStamp, Orders.orderId, Orders.ticker,
Line 15:		Line 15:
	JOIN Trades OVER (RANGE INTERVAL '1' SECOND FOLLOWING)		JOIN Trades OVER (RANGE INTERVAL '1' SECOND FOLLOWING)
	ON Orders.orderId = Trades.orderId;		ON Orders.orderId = Trades.orderId;
			</syntaxhighlight>
	</source>

	Another sample code fragment detects weddings among a flow of external "events" such as church bells ringing, the appearance of a man in a tuxedo or morning suit, a woman in a flowing white gown and rice flying through the air. A "complex" or "composite" event is what one infers from the individual simple events: a wedding is happening.		Another sample code fragment detects weddings among a flow of external "events" such as church bells ringing, the appearance of a man in a tuxedo or morning suit, a woman in a flowing white gown and rice flying through the air. A "complex" or "composite" event is what one infers from the individual simple events: a wedding is happening.

	<~~source~~ lang="sql">		<syntaxhighlight lang="sql">
	WHEN Person.Gender EQUALS "man" AND Person.Clothes EQUALS "tuxedo"		WHEN Person.Gender EQUALS "man" AND Person.Clothes EQUALS "tuxedo"
	FOLLOWED-BY		FOLLOWED-BY
Line 26:		Line 26:
	WITHIN 2 hours		WITHIN 2 hours
	ACTION Wedding		ACTION Wedding
			</syntaxhighlight>
	</source>

	==See also==		==See also==

Krauss at 10:59, 25 February 2020

2020-02-25T10:59:23Z

← Previous revision		Revision as of 10:59, 25 February 2020
Line 1:		Line 1:
			: Merge with [[Stream processing]]

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

← Previous revision		Revision as of 00:37, 21 April 2022
Line 1:		Line 1:
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}		{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
			{{see also\|stream processing}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

← Previous revision		Revision as of 15:42, 19 April 2022
Line 1:		Line 1:
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}		{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
	{{Merge\|Stream processing\|date=December 2021}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.

← Previous revision		Revision as of 23:29, 5 December 2021
Line 1:		Line 1:
	{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}		{{Short description\|Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems.}}
	{{Merge\|Stream processing}}		{{Merge\|Stream processing\|date=December 2021}}

	'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.		'''Event stream processing''', or '''ESP''', is a set of technologies designed to assist the construction of [[event-driven architecture\|event-driven information systems]]. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or [[complex event processing]] (CEP). In practice, the terms ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data with the goal of identifying the meaningful pattern within those streams, employing techniques such as detection of relationships between multiple events, event correlation, event hierarchies, and other aspects such as causality, membership and timing.