A Slice-Based Method to Speed Up Join View Maintenance for Transactions | SpringerLink
Skip to main content

A Slice-Based Method to Speed Up Join View Maintenance for Transactions

  • Conference paper
  • First Online:
Web Information Systems Engineering – WISE 2020 (WISE 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12343))

Included in the following conference series:

  • 1243 Accesses

Abstract

With the increments of data volumes and user numbers, big data applications require higher transaction throughput but lower query latency for database systems. The materialized view accelerates analytical queries by trading space for query efficiency. Nevertheless, it has to be updated under transactional workloads to obtain up-to-second results. Unfortunately, the cost of view maintenance is expensive, which requires examining its maintenance strategies carefully. In this paper, we redesign the view maintenance strategy from the transaction perspective. Compared with conventional methods that compute the modifications of different operations separately, we implement a slice-based method that maintains the updates of several base tables with join relations in one transaction as the increments of a slice. Then we optimize the view maintenance process based on the slices such as avoiding invalid expression evaluation and base table access. We conduct experiments in PostgreSQL under CH-benCHmark. Experiments show that our method can increase transaction throughput by 17%–121%, reduce query latency by 30%–85%, and achieve 1.9\(\times \) higher query throughput than those of conventional methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 5719
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 7149
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    CH-benCHmark   [5, 14] is a well-known hybrid workload which combines the transactional workload TPC-C with the analytical workload TPC-H.

References

  1. Postgresql. https://www.postgresql.org/

  2. Agrawal, P., Silberstein, A., Cooper, B.F., Srivastava, U., Ramakrishnan, R.: Asynchronous view maintenance for VLSD databases. In: SIGMOD, pp. 179–192 (2009)

    Google Scholar 

  3. Chavan, A., Deshpande, A.: DEX: query execution in a delta-based storage system. In: SIGMOD, pp. 171–186 (2017)

    Google Scholar 

  4. Chirkova, R., Yang, J.: Materialized views. Found. Trends Databases 4(4), 295–405 (2012)

    Article  Google Scholar 

  5. Cole, R.L., Funke, F., et al.: The mixed workload CH-benCHmark. In: DBTest, p. 8 (2011)

    Google Scholar 

  6. DeHaan, D., Larson, P., Zhou, J.: Stacked indexed views in Microsoft SQL server. In: SIGMOD, pp. 179–190 (2005)

    Google Scholar 

  7. Difallah, D.E., Pavlo, A., et al.: OLTP-Bench: an extensible testbed for benchmarking relational databases. PVLDB 7(4), 277–288 (2013)

    Google Scholar 

  8. Gupta, A., Jagadish, H.V., Singh Mumick, I.: Data integration using self-maintainable views. In: Apers, P., Bouzeghoub, M., Gardarin, G. (eds.) EDBT 1996. LNCS, vol. 1057, pp. 140–144. Springer, Heidelberg (1996). https://doi.org/10.1007/BFb0014149

    Chapter  Google Scholar 

  9. Gupta, A., Mumick, I.S., Subrahmanian, V.S.: Maintaining views incrementally. In: SIGMOD, pp. 157–166 (1993)

    Google Scholar 

  10. Katsis, Y., Ong, K.W., Papakonstantinou, Y., Zhao, K.K.: Utilizing IDs to accelerate incremental view maintenance. In: SIGMOD, pp. 1985–2000 (2015)

    Google Scholar 

  11. Koch, C., et al.: DBToaster: higher-order delta processing for dynamic, frequently fresh views. VLDB J. 1–26 (2014). https://doi.org/10.1007/s00778-013-0348-4

  12. Larson, P., Zhou, J.: Efficient maintenance of materialized outer-join views. In: ICDE, pp. 56–65 (2007)

    Google Scholar 

  13. Luo, G., Yu, P.S.: Content-based filtering for efficient online materialized view maintenance. In: CIKM, pp. 163–172 (2008)

    Google Scholar 

  14. Psaroudakis, I., et al.: Scaling up mixed workloads: a battle of data freshness, flexibility, and scheduling. In: Nambiar, R., Poess, M. (eds.) TPCTC 2014. LNCS, vol. 8904, pp. 97–112. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-15350-6_7

    Chapter  Google Scholar 

  15. Qian, X., Wiederhold, G.: Incremental recomputation of active relational expressions. IEEE Trans. Knowl. Data Eng. 3(3), 337–341 (1991)

    Article  Google Scholar 

  16. Quass, D., Widom, J.: On-line warehouse view maintenance. In: SIGMOD, pp. 393–404 (1997)

    Google Scholar 

  17. Türker, C., Gertz, M.: Semantic integrity support in SQL: 1999 and commercial (object-) relational database management systems. VLDBJ 10(4), 241–269 (2001). https://doi.org/10.1007/s007780100050

    Article  MATH  Google Scholar 

  18. Xu, M., Ezeife, C.I.: Maintaining horizontally partitioned warehouse views. In: Data Warehousing and Knowledge Discovery, pp. 126–133 (2000)

    Google Scholar 

  19. Yi, K., Yu, H., Yang, J., Xia, G., Chen, Y.: Efficient maintenance of materialized top-k views. In: ICDE, pp. 189–200 (2003)

    Google Scholar 

  20. Zhou, J., Larson, P., Elmongui, H.G.: Lazy maintenance of materialized views. In: VLDB, pp. 231–242 (2007)

    Google Scholar 

Download references

Acknowledgements

This is work is partially supported by National Key R&D Program of China (2018YFB1003303), National Science Foundation of China under grant number 61772202, Youth Program of National Science Foundation of China under grant number 61702189.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huiqi Hu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Duan, H., Hu, H., Zhou, X., Zhou, A. (2020). A Slice-Based Method to Speed Up Join View Maintenance for Transactions. In: Huang, Z., Beek, W., Wang, H., Zhou, R., Zhang, Y. (eds) Web Information Systems Engineering – WISE 2020. WISE 2020. Lecture Notes in Computer Science(), vol 12343. Springer, Cham. https://doi.org/10.1007/978-3-030-62008-0_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-62008-0_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-62007-3

  • Online ISBN: 978-3-030-62008-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics