Abstract
The materialized view is considered as a panacea that significantly facilitates query by trading space cost for execution time. However, it also involves the expensive cost of maintenance which trades away the latency. Disk IO cost is an important factor restricting view maintenance performance. To solve this problem, we decouple a complete procedure of view maintenance into a number of tasks and execute them asynchronously. We put off the executions of those tasks until necessary data access from disk can be completed by subsequent transactions or queries. The execution of view maintenance tasks and transactions or queries can share disk IO, which fundamentally reduces IO resource consumption and view maintenance overhead. We accomplish the complete architecture of view maintenance to support IO sharing. To maximize the advantages of sharing IO, the job of view maintenance is split into fine-grained tasks. An effective cost evaluator is also proposed to select proper tasks to be executed for subsequent transactions or queries. We implement our method on the PostgreSQL. Experiments on the CH-benCHmark show it achieves better performance than existing methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
A data manipulation language (DML) is a computer programming language used to SELECT, INSERT, UPDATE, and DELETE data in a database.
References
Agrawal, P., Silberstein, A., Cooper, B.F., et al.: Asynchronous view maintenance for VLSD databases. In: SIGMOD, pp. 179–192. ACM (2009)
Ahmad, Y., Kennedy, O., Koch, C., Nikolic, M.: DBToaster: higher-order delta processing for dynamic, frequently fresh views. PVLDB 5(10), 968–979 (2012)
Chirkova, R., Yang, J., et al.: Materialized views. Found. Trends Databases 4(4), 295–405 (2012)
Cole, R.L., Funke, F., et al.: The mixed workload CH-benCHmark. In: DBTest, p. 8 (2011)
Gray, J., Chaudhuri, S., et al.: Data cube: a relational aggregation operator generalizing group-by, cross-tab, and sub totals. Data Min. Knowl. Discov. 1(1), 29–53 (1997)
Gupta, A., Mumick, I.: Materialized Views: Techniques, Implementations, and Applications (1999)
Gupta, A., Mumick, I.S., Subrahmanian, V.S.: Maintaining views incrementally. In: SIGMOD, pp. 157–166 (1993)
Katsis, Y., Ong, K.W., Papakonstantinou, Y., et al.: Utilizing IDs to accelerate incremental view maintenance. In: SIGMOD, pp. 1985–2000. ACM (2015)
Kemper, A., Neumann, T.: HyPer: a hybrid OLTP&OLAP main memory database system based on virtual memory snapshots. In: ICDE, pp. 195–206. IEEE (2011)
Larson, P., Zhou, J.: Efficient maintenance of materialized outer-join views. In: ICDE, pp. 56–65 (2007)
Lee, K.Y., Kim, M.H.: Optimizing the incremental maintenance of multiple join views. In: DOLAP, pp. 107–113. ACM (2005)
Luo, G., Yu, P.S.: Content-based filtering for efficient online materialized view maintenance. In: CIKM, pp. 163–172 (2008)
Mistry, H., Roy, P., Sudarshan, S., Ramamritham, K.: Materialized view selection and maintenance using multi-query optimization. In: SIGMOD, pp. 307–318 (2001)
Nikolic, M., Dashti, M., Koch, C.: How to win a hot dog eating contest: Distributed incremental view maintenance with batch updates. In: SIGMOD, pp. 511–526. ACM (2016)
Roy, P., Seshadri, S., Sudarshan, S., Bhobe, S.: Efficient and extensible algorithms for multi query optimization. In: SIGMOD, pp. 249–260 (2000)
Xu, M., Ezeife, C.I.: Maintaining horizontally partitioned warehouse views. In: Data Warehousing and Knowledge Discovery, pp. 126–133 (2000)
Yi, K., Yu, H., Yang, J., Xia, G., Chen, Y.: Efficient maintenance of materialized top-k views. In: ICDE, pp. 189–200 (2003)
Zhan, C., Su, M., et al.: AnalyticDB: real-time olap database system at Alibaba cloud. Proc. VLDB Endowment 12(12), 2059–2070 (2019)
Zhou, J., Larson, P., Elmongui, H.G.: Lazy maintenance of materialized views. In: PVLDB, pp. 231–242 (2007)
Acknowledgements
This is work is partially supported by National Key R&D Program of China (2018YFB1003300), Youth Program of National Science Foundation of China under grant number 61702189. The corresponding author is Huiqi Hu.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Duan, H., Hu, H., Qian, W., Zhou, A. (2020). An Asynchronous View Maintenance Approach Based on IO Sharing. In: Huang, Z., Beek, W., Wang, H., Zhou, R., Zhang, Y. (eds) Web Information Systems Engineering – WISE 2020. WISE 2020. Lecture Notes in Computer Science(), vol 12343. Springer, Cham. https://doi.org/10.1007/978-3-030-62008-0_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-62008-0_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62007-3
Online ISBN: 978-3-030-62008-0
eBook Packages: Computer ScienceComputer Science (R0)