Static scheduling for distributed streaming system
| Thesis title in Czech: | Statické plánování v distribuovaném proudovém systému |
|---|---|
| Thesis title in English: | Static scheduling for distributed streaming system |
| Key words: | statické plánování, distribuované systémy, proudové systémy, Bobox |
| English key words: | static scheduling, distributed systems, streaming systems, Bobox |
| Academic year of topic announcement: | 2018/2019 |
| Type of assignment: | diploma thesis |
| Thesis language: | angličtina |
| Department: | Department of Software Engineering (32-KSI) |
| Supervisor: | RNDr. Jakub Yaghob, Ph.D. |
| Author: |
| Guidelines |
| Execution plans for Bobox[5] streaming system are represented as oriented data flow graphs. They are usually described by Bobolang[2] description language, which can be generated by front-end query languages (SPARQL, SQL, ...). We have implemented a distributed version of Bobox capable of running in heterogeneous cluster environment, where hosts connected by some high-speed interconnection technology (MPI over InfiniBand) can be enhanced by accelerators (GPGPU, Xeon Phi, ...).
The main goals of the thesis are design and pilot implementation of an algorithm for static Bobox execution plan placement in the distributed environment using known cluster topology. Execution plan is described by one Bobolang source file. The proposed algorithm must decide the data flow graph division/distribution along with adding proper communication edges and properly transforming local execution graphs. |
| References |
| [1] Falt Z., Kruliš M., Bednárek D., Yaghob J., Zavoral F.: Towards Efficient Locality Aware Parallel Data Stream Processing, in Journal of Universal Computer Science, 20151
[2] Falt Z., Bednárek D., Kruliš M., Yaghob J., Zavoral F.: Bobolang - A Language for Parallel Streaming Applications, in Proceedings of the 23rd International ACM Symposium on High-Performance Parallel and Distributed Computing, Vancouver, ACM, ISBN: 978-1-4503-2749-7, pp. 311-314, 20141 [3] Bednárek D., Kruliš M., Malý P., Yaghob J., Zavoral F., Pokorný J.: Combining Distributed Computing and Massively Parallel Devices to Accelerate Stream Data Processing, accepted for publication in Proceedings of the The Seventh International Conference on Advances in Databases, Knowledge, and Data Applications, Řím, IARIA, pp. 1-8, 20151 [4] Čermák M., Zavoral F.: Achieving High Availability in D-Bobox, in DBKDA 2014 The Sixth International Conference on Advances in Databases, Knowledge, and Data Applications, Chamonix, IARIA, ISBN: 978-1-61208-334-6, pp. 92-97, 20141 [5] Bednárek D., Dokulil J., Yaghob J., Zavoral F.: Bobox: Parallelization Framework for Data Processing, accepted for publication in Advances in Information Technology and Applied Computing, Denpasar, AITAC, ISSN: 2251-3418, pp. 189-194, 20121 |