Achieving high-throughput distributed, graph-based multi-stage stream processing
| dc.contributor.author | Suriarachchi, Amila, author | |
| dc.contributor.author | Pallickara, Shrideep, advisor | |
| dc.contributor.author | Pallickara, Sangmi Lee, committee member | |
| dc.contributor.author | Venkatachalam, Chandrasekaran, committee member | |
| dc.date.accessioned | 2016-01-11T15:13:31Z | |
| dc.date.available | 2016-01-11T15:13:31Z | |
| dc.date.issued | 2015 | |
| dc.description.abstract | Processing complex computations on high volume streaming data in real time is a challenge for many organizational data processing systems. Such systems should produce results with low latency while processing billions of messages daily. In order to address these requirements distributed stream processing systems have been developed. Although high performance is one of the main goals of these systems, there is less attention has been paid for inter node communication performance which is a key aspect to achieve overall system performance. In this thesis we describe a framework for enhancing inter node communication efficiency. We compare performance of our system with Twitter Storm and Yahoo S4 using an implementation of Pan Tompkins algorithm which is used to detect QRS complexities of an ECG signal using a 2 node graph. Our results show our solution performs 4 times better than other systems. We also use four level node graph which is used to process smart plug data to test the performance of our system for a complex graph. Finally we demonstrate how our system is scalable and resilient to faults. | |
| dc.format.medium | born digital | |
| dc.format.medium | masters theses | |
| dc.identifier | Suriarachchi_colostate_0053N_13037.pdf | |
| dc.identifier.uri | http://hdl.handle.net/10217/170271 | |
| dc.language | English | |
| dc.language.iso | eng | |
| dc.publisher | Colorado State University. Libraries | |
| dc.relation.ispartof | 2000-2019 | |
| dc.rights | Copyright and other restrictions may apply. User is responsible for compliance with all applicable laws. For information about copyright law, please see https://libguides.colostate.edu/copyright. | |
| dc.subject | complex event processing | |
| dc.subject | distributed event stream processing | |
| dc.subject | performance | |
| dc.title | Achieving high-throughput distributed, graph-based multi-stage stream processing | |
| dc.type | Text | |
| dcterms.rights.dpla | This Item is protected by copyright and/or related rights (https://rightsstatements.org/vocab/InC/1.0/). You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). | |
| thesis.degree.discipline | Computer Science | |
| thesis.degree.grantor | Colorado State University | |
| thesis.degree.level | Masters | |
| thesis.degree.name | Master of Science (M.S.) |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Suriarachchi_colostate_0053N_13037.pdf
- Size:
- 428.5 KB
- Format:
- Adobe Portable Document Format