Complex Event Processing (CEP) Ayhan KARGIN @ Agenda What is CEP? Types Why needed? Usage Areas TTNET’s Perspective Products What is CEP? Event processing is a method of tracking and analyzing (processing) streams of information (data) about things that happen (events), and deriving a conclusion from them. Complex event processing, or CEP, is event processing that combines data from multiple sources to infer events or patterns that suggest more complicated circumstances. The goal of complex event processing is to identify meaningful events (such as opportunities or threats) and respond to them as quickly as possible. CEP as a technique helps discover complex events by analyzing and correlating other events. •Analyze stream of events or multiple streams of events in real-time •Recognize particular sequences or patterns across the streams •Infer a business significant event from the correlated events Types Most CEP solutions and concepts can be classified into two main categories: Computation-oriented CEP Detection-oriented CEP A computation-oriented CEP solution is focused on executing on-line algorithms as a response to event data entering the system. A simple example is to continuously calculate an average based in data on the inbound events. Detection-oriented CEP is focused on detecting combinations of events called events patterns or situations. A simple example of detecting a situation is to look for a specific sequence of events. Why Needed? • • • • • • • Revenue Operational Excellence Competition Customer Satisfaction Reduced Response Time (Near Real Time) Suggestions and Offers are made at a reasonable time and place to provide a better service. Faster, effective and focused service. Value of Action decreases by Time Usage Areas Adaptive Marketing Telco Track Packages against a “Plan”. Infer package delays in a proactive manner. Alert customers. Shipping by RFID. Government Fraud Detection (Security Monitoring) Track and Trace Trades/Deals/Settlements Business Activity Monitoring, Risk Management Algorithmic Stock-Trading Logistics - Track & Trace SLA (Service Assurance) Real Time Service Offers and Analytics Finance Pattern: Capture opportunity with customer while ‘the window is open’. Track and Analyze ‘patterns’ that were otherwise very difficult to detect Dynamic Resource Scheduling Real Time Optimization of Resources against a “Plan”. (Plane) Usage Areas İnternet arama motorunda "borç", "portföy" ve "hisse senetleri" gibi terimler daha az arandığında, Dow Jones endeksinde yükselme eğilimi görüldüğü belirtiliyor. Bu terimler daha çok aranıyorsa, hisse senedi endeksinde düşme bekleniyor. 2004 ve 2011 arasında bu yönteme dayalı yatırım stratejisi izlenerek, % 326 kâr elde edilebileceği hesaplandı. Bu strateji izlendiğinde % 326 oranında kâr elde edilebileceği sonucuna ulaşıldı. En basit stratejiyle, 2004'te hisse satın alınıp 2011'de satılmış olsa, kâr oranı sadece % 16 olacaktı. Warwick Üniversitesi'nden Tabias Preis, aramalardaki yükselişle piyasalardaki düşüş arasındaki bağlantının, 'kayıptan kaçınma' olgusunu gösterdiğini söylüyor; "İnsanlar sahip oldukları bir şeyi satarken, yeni bir şey satın alırken olduğundan daha çok korkar." diyor. Google's self-driving car gathers 750 megabytes of sensor data per SECOND! Google Self Driving Car Usage Areas • • • Boeing 787s to create half a terabyte of data per flight. (Last week Big data presentation) Turkcell makes offers and suggestions by GPS location of customers. If a customer call abroad 3 times in 15 minutes an abroad package suggested to customer for satisfaction TTNET's Perspective When a limited package customer exceed limit an unlimited package can be offered by call center. Stock suggestions can be done by categorizing web sites and visit statistics. Offers can be done to wifi users by time and place factors. (Example: discount for customers who use Starbucks wifi access points.) … Products Oracle Complex Event Processing (OEP) Oracle Event Processing (OEP) is a complete solution for building applications to filter, correlate and process events in real-time so that downstream applications, service oriented architectures and event-driven architectures are driven by true, real-time intelligence. (Continuous Query Language, CQL) ESPER (Open Source) Esper is a component for complex event processing, available for Java as Esper, and for .NET as Esper. Esper and NEsper enable rapid development of applications that process large volumes of incoming messages or events. Esper and NEsper enable filter and analyze events in various ways, and respond to conditions of interest in real-time. (Event Query Language, EQL) Products Microsoft StreamInsight Microsoft StreamInsight is a powerful platform that you can use to develop and deploy complex event processing (CEP) applications. Its high-throughput stream processing architecture and the Microsoft .NET Framework-based development platform enable you to quickly implement robust and highly efficient event processing applications. Tibco StreamBase The StreamBase Complex Event Processing platform is a highperformance system for rapidly building applications that analyze and act on real-time streaming data. With StreamBase, organizations rapidly build real-time systems in record time and are deployed at a fraction of the cost and risk of alternatives. Products Informatica RulePoint Deliver Proactive Monitoring and Operational Intelligence by real-time alerts and insight into pertinent information, enabling you to operate smarter, faster, more efficiently, and more competitively. Ibm Websphere Business Events It is a fully-integrated technology platform delivering functionality for the design, running and monitoring of complex business processes. Oracle Event Processing Example Oracle Event Processing Example Teşekkürler