{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T19:42:55Z","timestamp":1746301375354,"version":"3.32.0"},"reference-count":60,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2005,1,31]],"date-time":"2005-01-31T00:00:00Z","timestamp":1107129600000},"content-version":"vor","delay-in-days":822,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc of Assoc for Info"],"published-print":{"date-parts":[[2002,11]]},"abstract":"Abstract<\/jats:title>Digital Community Information Systems (CIS) are increasing in both size and scale. These systems help people obtain community information (CI) for the myriad situations that arise in everyday life. As these systems migrate to the online environment, increasing complexities and scale provide the impetus for improvements in system design. System re\u2010design, however, relies on the effective evaluation of digital CIS. Despite the plethora of evaluation frameworks from the systems, organizational, and information retrieval fields, minimal research has directly addressed the issue of digital CIS evaluation. Following a selective review of digital CIS and evaluation approaches, a layered evaluation framework is proposed to guide the evaluation of digital CIS.<\/jats:p>","DOI":"10.1002\/meet.1450390127","type":"journal-article","created":{"date-parts":[[2005,1,31]],"date-time":"2005-01-31T15:52:38Z","timestamp":1107186758000},"page":"250-259","source":"Crossref","is-referenced-by-count":2,"title":["Towards effective evaluation of digital community information systems"],"prefix":"10.1002","volume":"39","author":[{"given":"Kenton T.","family":"Unruh","sequence":"first","affiliation":[]},{"given":"Karen E.","family":"Pettigrew","sequence":"additional","affiliation":[]},{"given":"Joan C.","family":"Durrance","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2005,1,31]]},"reference":[{"key":"e_1_2_7_2_1","unstructured":"Applegate R.(1993). Models of user satisfaction: Understanding false positives. RQ June 32 525\u2013539."},{"volume-title":"Digital Libraries","year":"2000","author":"Arms W. Y.","key":"e_1_2_7_3_1"},{"volume-title":"The Practice of Social Research","year":"2001","author":"Babbie E.","key":"e_1_2_7_4_1"},{"key":"e_1_2_7_5_1","unstructured":"Bertot J. C.&McClure C. R.(1996). Sailor network assessment final report: Maryland: Maryland State Department of Education Division of Library Development and Services. Retrieved September 1 2001 fromhttp:\/\/research.umbc.edu\/\u223cbertot\/sailor.final.reprt.pdf."},{"issue":"2","key":"e_1_2_7_6_1","article-title":"Measuring success, access, use and success in digital libraries","volume":"4","author":"Bishop A. P.","year":"1998","journal-title":"Journal of Electronic Publishing"},{"key":"e_1_2_7_7_1","first-page":"301","article-title":"Social informatics of digital library use and infrastructure","volume":"31","author":"Bishop A. P.","year":"1996","journal-title":"Annual Review of Information Science and Technology (ARIST)"},{"key":"e_1_2_7_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(2000)51:4<394::AID-ASI8>3.0.CO;2-Q"},{"key":"e_1_2_7_9_1","first-page":"227","article-title":"What are digital libraries?","volume":"35","author":"Borgman C. L.","year":"1999","journal-title":"Information Processing & Management"},{"volume-title":"Social Science, Technical Systems and Cooperative Work","year":"1996","author":"Bowker G.","key":"e_1_2_7_10_1"},{"volume-title":"Information seeking: Assessing and anticipating user needs","year":"1982","author":"Chen C.","key":"e_1_2_7_11_1"},{"key":"e_1_2_7_12_1","unstructured":"Computer Science and Telecommunications Board(1998). Design and evaluation.D\u2010Lib Magazine. July\/August. Retrieved November 1 2001 fromhttp:\/\/www.dlib.org\/dlib\/july98\/nrc\/07nrc.html."},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630240204"},{"key":"e_1_2_7_14_1","first-page":"167","article-title":"Users' experience of information retrieval systems","volume":"14","author":"Darlymple P. W.","year":"1992","journal-title":"Library and Information Science Research"},{"volume-title":"Handbook of Qualitative Research","year":"1994","author":"Denzin N. K.","key":"e_1_2_7_15_1"},{"key":"e_1_2_7_16_1","unstructured":"Dervin B.&Nilan M.(1986). Information needs and uses.Annual Review of Information Science & Technology. (21)3\u201333."},{"volume-title":"Information for the Community","year":"1976","author":"Dervin B.","key":"e_1_2_7_17_1"},{"key":"e_1_2_7_18_1","first-page":"61","volume-title":"Qualitative Research in Information Management","author":"Dervin B.","year":"1992"},{"volume-title":"Armed for action: Library response to citizen information needs","year":"1984","author":"Durrance J. C.","key":"e_1_2_7_19_1"},{"volume-title":"Helpseeking in an electronic world","year":"2002","author":"Durrance J. D.","key":"e_1_2_7_20_1"},{"key":"e_1_2_7_21_1","doi-asserted-by":"crossref","unstructured":"Dzida W.(1996)International Usability Standards. Computing Surveys. March 28 (1)173\u2013175.","DOI":"10.1145\/234313.234386"},{"volume-title":"Developing Library and Information Center Collections","year":"2000","author":"Evans G. E.","key":"e_1_2_7_22_1"},{"key":"e_1_2_7_23_1","doi-asserted-by":"publisher","DOI":"10.2307\/249291"},{"key":"e_1_2_7_24_1","doi-asserted-by":"crossref","DOI":"10.5040\/9798400616549","volume-title":"Barriers to information","author":"Harris R. M.","year":"1994"},{"key":"e_1_2_7_25_1","first-page":"3","article-title":"Evaluation of information systems: Appraoches, issues and methods","volume":"32","author":"Harter S. P.","year":"1997","journal-title":"Annual Review of Information Science and Technology"},{"volume-title":"Assessing Service Quality","year":"1998","author":"Hernon P.","key":"e_1_2_7_26_1"},{"key":"e_1_2_7_27_1","first-page":"203","volume-title":"Handbook of Qualitative Research","author":"Janesick V. J.","year":"1994"},{"volume-title":"Readings in information Retrieval","year":"1997","author":"Jones K. S.","key":"e_1_2_7_28_1"},{"key":"e_1_2_7_29_1","first-page":"59","article-title":"Digital library design for organizational usability","volume":"15","author":"Kling R.","year":"1994","journal-title":"Special Interest Group on Information Systems (SIGOIS) Bulletin"},{"key":"e_1_2_7_30_1","doi-asserted-by":"crossref","unstructured":"Kling R.(1999). What is social informatics and why does it matter?D\u2010Lib Magazine. 5 Retrieved January 5 2002 fromhttp:\/\/www.dlib.org\/dlib\/january99\/kling\/01kling.html.","DOI":"10.1045\/january99-kling"},{"volume-title":"Information Retrieval Systems","year":"1979","author":"Lancaster W. F.","key":"e_1_2_7_31_1"},{"key":"e_1_2_7_32_1","first-page":"3","article-title":"Needs, demands, and motivations in the use of sources of information","volume":"1","author":"Lancaster W. F.","year":"1995","journal-title":"Journal of Information, Communication and Library Science"},{"key":"e_1_2_7_33_1","unstructured":"Marchionini G. Plaisant C.&Komlodi A.(in press). The people in digital libraries: Multifaceted appraoches to assessing needs and impacts. [Electronic Version] Retrieved November 1 2001 fromhttp:\/\/www.ils.unc.edu\/\u223cmarch\/revision.pdf. In:"},{"volume-title":"Digital Library Use: Social Practice in Design and Evaluation","author":"Bishop A. P.","key":"e_1_2_7_33_2"},{"key":"e_1_2_7_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/174608.174609"},{"key":"e_1_2_7_35_1","first-page":"304","article-title":"Evaluating digital libraries: a longitudinal and multifaceted view","volume":"49","author":"Marchionini G.","year":"2000","journal-title":"Library Trends"},{"volume-title":"Quantitative Research Methods in the Social Sciences","year":"1999","author":"Maxim P. S.","key":"e_1_2_7_36_1"},{"volume-title":"Human Values and the Design of Computer Technology","year":"1997","author":"Nass C. I.","key":"e_1_2_7_37_1"},{"volume-title":"Handbook of Human Factors and Ergonomics","year":"1997","author":"Pejtersen A. M.","key":"e_1_2_7_38_1"},{"key":"e_1_2_7_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/0740-5472(94)90044-2"},{"volume-title":"Utilization\u2010Focused Evaluation","year":"1997","author":"Patton M. Q.","key":"e_1_2_7_40_1"},{"key":"e_1_2_7_41_1","doi-asserted-by":"publisher","DOI":"10.2307\/40324243"},{"key":"e_1_2_7_42_1","series-title":"Proceedings of the First ACM\/IEEE\u2010CS Joint Conference on Digital Libraries","first-page":"136","volume-title":"Public use of digital community information systems: Findings from a recent study with implications for system design","author":"Pettigrew K. E.","year":"2001"},{"key":"e_1_2_7_43_1","unstructured":"Pettigrew K. E. Durrance J. C. &Unruh K. T.(in press). Facilitating community information\u2010seeking using the Internet: Findings from three public library\u2010community network systems.Journal of the American Society for Information Science and Technology."},{"volume-title":"Cognitive Systems Engineering","year":"1994","author":"Rasmussen J.","key":"e_1_2_7_44_1"},{"key":"e_1_2_7_45_1","doi-asserted-by":"publisher","DOI":"10.1086\/629952"},{"volume-title":"New Community Networks: Wired for Change","year":"1996","author":"Schuler D.","key":"e_1_2_7_46_1"},{"key":"e_1_2_7_47_1","series-title":"Proceedings of the ACM\/SIGIR 18th Annual International Conference on Research and Development in Information Retrieval. (18)","first-page":"138","volume-title":"Evaluation of evaluation in information retrieval","author":"Saracevic T,","year":"1995"},{"key":"e_1_2_7_48_1","first-page":"350","article-title":"Digital Library evaluation: Toward an evolution of concepts","volume":"49","author":"Saracevic T.","year":"2000","journal-title":"Library Trends"},{"key":"e_1_2_7_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/0268-4012(96)00005-9"},{"key":"e_1_2_7_50_1","first-page":"810","article-title":"Relevance: The whole history. Journal of the American Society for Information","volume":"48","author":"Stefano M.","year":"1997","journal-title":"Science"},{"volume-title":"Measuring Information: An Information Service Perspective","year":"1995","author":"Tague\u2010Sutcliffe J.","key":"e_1_2_7_51_1"},{"issue":"1","key":"e_1_2_7_52_1","first-page":"4","article-title":"Analysis of search failures in document retrieval systems","volume":"3","author":"Tonta Y.","year":"1992","journal-title":"The public\u2010access computer system review"},{"key":"e_1_2_7_53_1","first-page":"155","article-title":"Redressing the Balance","volume":"4","author":"Twidale M. B.","year":"1993","journal-title":"Journal of Artificial Intelligence in Education"},{"volume-title":"Information Seeking in Context","year":"1997","author":"Vakkari P.","key":"e_1_2_7_54_1"},{"key":"e_1_2_7_55_1","doi-asserted-by":"crossref","unstructured":"Van House N. Butler M. H. Ogle V.&Schiff L.(1996). User\u2010Centered Iterative Design for Digital Libraries: The Cypress Experience.D\u2010Lib Magazine. Feb. Retrieved November 1 2001 from http:\/\/www.dlib.org\/dlib\/february96\/02vanhouse.html.","DOI":"10.1045\/february96-vanhouse"},{"volume-title":"Output Measure for Public Libraries","year":"1987","author":"Van House N.","key":"e_1_2_7_56_1"},{"key":"e_1_2_7_57_1","first-page":"294","article-title":"End\u2010User Search Behaviors and Their Relationship to Search Effectiveness","volume":"83","author":"Wildemuth B. M.","year":"1995","journal-title":"Bulletin of the Medical Library Association"},{"volume-title":"Exploring the Contexts of Information Behavior","year":"1998","author":"Wilson T. D.","key":"e_1_2_7_58_1"},{"volume-title":"The New Review of Information Behaviour Research 1","year":"2001","author":"Wilson T. D.","key":"e_1_2_7_59_1"},{"volume-title":"The New Review of Information Behaviour Research 2","year":"2001","author":"Wilson T. D.","key":"e_1_2_7_60_1"}],"container-title":["Proceedings of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.1450390127","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full\/10.1002\/meet.1450390127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,22]],"date-time":"2024-12-22T22:53:16Z","timestamp":1734907996000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/meet.1450390127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2002,11]]},"references-count":60,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2002,11]]}},"alternative-id":["10.1002\/meet.1450390127"],"URL":"https:\/\/doi.org\/10.1002\/meet.1450390127","archive":["Portico"],"relation":{},"ISSN":["0044-7870","1550-8390"],"issn-type":[{"type":"print","value":"0044-7870"},{"type":"electronic","value":"1550-8390"}],"subject":[],"published":{"date-parts":[[2002,11]]}}}