Abstract
Controlled online experiments in which envisaged changes to a web site are first tested live with a small subset of site visitors have proven to predict the effects of these changes quite accurately. However, these experiments often require expensive infrastructure and are costly in terms of development effort. This paper advocates a systematic approach to the design and implementation of such experiments in order to overcome the aforementioned drawbacks by making use of Aspect-Oriented Software Development and Software Product Lines.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Ample project, http://www.ample-project.net/
Optimost, http://www.optimost.com/
phpAspect: Aspect oriented programming for PHP, http://phpaspect.org/
Vertster, http://www.vertster.com/
Software product lines: practices and patterns. Addison-Wesley Longman Publishing Co., Boston (2001)
Cámara, J., Kobsa, A.: Facilitating Controlled Tests of Website Design Changes using Aspect Oriented Programming and Software Product Lines. Transactions on Large Scale Data and Knowledge Centered Systems 1(1) (2009)
Colyer, A., Clement, A., Harley, G., Webster, M.: Eclipse AspectJ: Aspect-Oriented Programming with AspectJ and the Eclipse AspectJ Development Tools. Pearson Education, London (2005)
Eisenberg, B.: How to decrease sales by 90 percent, http://www.clickz.com/1588161
Eisenberg, B.: How to increase conversion rate 1,000 percent, http://www.clickz.com/showPage.html?page=1756031
Filman, R.E., Elrad, T., Clarke, S., Aksit, M. (eds.): Aspect-Oriented Software Development. Addison Wesley, Reading (2004)
Kang, K., Cohen, S., Hess, J., Novak, W., Peterson, S.: Feature-oriented domain analysis (FODA) feasibility study. TR. CMU/SEI-90-TR-21, SEI (1990)
Kang, K.C., Kim, S., Lee, J., Kim, K., Shin, E., Huh, M.: FORM: A feature-oriented reuse method with domain-specific reference architectures. Ann. Software Eng. 5 (1998)
Kohavi, R., Henne, R.M., Sommerfield, D.: Practical guide to controlled experiments on the web: listen to your customers not to the hippo. In: Proc. of KDD 2007. ACM, New York (2007)
Kohavi, R., Round, M.: Front Line Internet Analytics at Amazon.com (2004), http://ai.stanford.edu/~ronnyk/emetricsAmazon.pdf
Lee, K., Kang, K.C., Kim, M., Park, S.: Combining feature-oriented analysis and aspect-oriented programming for product line asset development. In: Proc. of SPLC 2006. IEEE, Los Alamitos (2006)
Loughran, N., Rashid, A.: Framed aspects: Supporting variability and configurability for AOP. In: Bosch, J., Krueger, C. (eds.) ICOIN 2004 and ICSR 2004. LNCS, vol. 3107, pp. 127–140. Springer, Heidelberg (2004)
Mannion, M., Cámara, J.: Theorem proving for product line model verification. In: van der Linden, F.J. (ed.) PFE 2003. LNCS, vol. 3014, pp. 211–224. Springer, Heidelberg (2004)
McGlaughlin, F., Alt, B., Usborne, N.: The power of small changes tested -change.html (2006), http://www.marketingexperiments.com/improving-website-conversion/power-small
Pettersson, U., Jarzabek, S.: Industrial experience with building a web portal product line using a lightweight, reactive approach. In: Proc. of ESEC/SIGSOFT FSE. ACM, New York (2005)
PHP: Hypertext preprocessor, http://www.php.net/
Roy, S.: 10 factors to test that could increase the conversion rate of your landing pages (2007), http://www.wilsonweb.com/conversion/sumantra-landing-pages.htm
Trujillo, S., Batory, D.S., Díaz, O.: Feature oriented model driven development: A case study for portlets. In: ICSE, pp. 44–53. IEEE, Los Alamitos (2007)
Usborne, N.: Design choices can cripple a website (2005), http://alistapart.com/articles/designcancripple
Voelter, M., Groher, I.: Product line implementation using aspect-oriented and model-driven software development. In: Proc. of SPLC 2007. IEEE, Los Alamitos (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cámara, J., Kobsa, A. (2009). Facilitating Controlled Tests of Website Design Changes: A Systematic Approach. In: Gaedke, M., Grossniklaus, M., Díaz, O. (eds) Web Engineering. ICWE 2009. Lecture Notes in Computer Science, vol 5648. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02818-2_30
Download citation
DOI: https://doi.org/10.1007/978-3-642-02818-2_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02817-5
Online ISBN: 978-3-642-02818-2
eBook Packages: Computer ScienceComputer Science (R0)