Abstract
In this paper we analyze three and a half years of HTTP traffic observed at a small research institute to characterize the evolution of various facets of web operation. While our dataset is modest in terms of user population, it is unique in its temporal breadth. We leverage the longitudinal data to study various characteristics of the traffic, from client and server behavior to object and connection characteristics. In addition, we assess how the delivery of content is structured across our datasets, including the use of browser caches, the efficacy of network-based proxy caches, and the use of content delivery networks. While each of the aspects we study has been investigated to some extent in prior work, our contribution is a unique long-term characterization.
This work is supported in part by NSF grants CNS-0831535 and CNS-0831780.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Al-Qudah, Z., Rabinovich, M., Allman, M.: Web Timeouts and Their Implications. In: Passive and Active Measurement Conference (April 2010)
Allman, M., Avrachenkov, K., Ayesta, U., Blanton, J., Hurtig, P.: Early Retransmit for TCP and SCTP, Internet-Draft draft-ietf-tcpm-early-rexmt-01.txt (work in progress) (January 2009)
Arlitt, M., Williamson, C.: Internet Web Servers: Workload Characterization and Implications. IEEE/ACM Transactions on Networking (October 1997)
Barford, P., Bestavros, A., Bradley, A., Crovella, M.: Changes in Web Client Access Patterns: Characteristics and Caching Implications. In: Proc. WWW, vol. 2 (1999)
Barford, P., Crovella, M.: Generating Representative Web Workloads for Network and Server Performance Evaluation. In: ACM SIGMETRICS, July 1998, pp. 151–160 (1998)
Barford, P., Crovella, M.: Measuring Web Performance in the Wide Area. In: Performance Evaluation Review: Special Issue on Network Traffic Measurement and Workload Characterization (August 1999)
Fielding, R., Gettys, J., Mogul, J.C., Frystyk, H., Berners-Lee, T.: Hypertext Transfer Protocol – HTTP/1.1. RFC 2068 (January 1997)
Krishnamurthy, B., Arlitt, M.: PRO-COW: Protocol compliance on the web: A longitudinal study. In: USENIX Symp. on Internet Technologies and Sys. (2001)
Krishnamurthy, B., Rexford, J.: Web Protocols and Practice. Addison-Wesley, Reading (2001)
Mondal, A., Kuzmanovic, A.: Removing Exponential Backoff from TCP. ACM Computer Communication Review 38(5) (October 2008)
Nielsen, H., Gettys, J., Baird-Smith, A., Prud’hommeaux, E., Lie, H., Lilley, C.: Network Performance Effects of HTTP/1.1, CSS1, and PNG. In: ACM SIGCOMM (September 1997)
Paxson, V.: Bro: A System for Detecting Network Intruders in Real-Time. Computer Networks 31(23–24) (1999)
Qureshi, A., Weber, R., Balakrishnan, H., Guttag, J., Maggs, B.: Cutting the Electric Bill for Internet-Scale Systems. In: ACM SIGCOMM (August 2009)
Schneider, F., Agarwal, S., Alpcan, T., Feldmann, A.: The New Web: Characterizing AJAX Traffic. In: Passive and Active Measurement Conf. (2008)
Triukose, S., Wen, Z., Rabinovich, M.: Content Delivery Networks: How Big is Big Enough? In: ACM SIGMETRICS poster (2009)
Wills, C., Mikhailov, M.: Studying the impact of more complete server information on Web caching. In: Proc. of the 5th Intl. Web Caching and Content Delivery Workshop (2000)
Zink, M., Suh, K., Gu, Y., Kurose, J.: Watch Global, Cache Local: YouTube Network Traces at a Campus Network - Measurements and Implications. In: Proc. Fifteenth Annual Multimedia Computing and Networking, ACMMCN (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Callahan, T., Allman, M., Paxson, V. (2010). A Longitudinal View of HTTP Traffic. In: Krishnamurthy, A., Plattner, B. (eds) Passive and Active Measurement. PAM 2010. Lecture Notes in Computer Science, vol 6032. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12334-4_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-12334-4_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12333-7
Online ISBN: 978-3-642-12334-4
eBook Packages: Computer ScienceComputer Science (R0)