Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.

<b>Objective</b> – To investigate the reasons behind the cessation of 9 virtual (chat) reference services.<br><b>Design</b> – Multiple case‐study investigation<br><b>Setting</b> – Academic, public, and special libraries in the United States.<br>&...

Full description

Bibliographic Details
Main Author: Stephanie R. Walker
Format: Article
Language:English
Published: University of Alberta 2007-09-01
Series:Evidence Based Library and Information Practice
Subjects:
Online Access:http://ejournals.library.ualberta.ca/index.php/EBLIP/article/view/438/511
_version_ 1818301845052850176
author Stephanie R. Walker
author_facet Stephanie R. Walker
author_sort Stephanie R. Walker
collection DOAJ
description <b>Objective</b> – To investigate the reasons behind the cessation of 9 virtual (chat) reference services.<br><b>Design</b> – Multiple case‐study investigation<br><b>Setting</b> – Academic, public, and special libraries in the United States.<br><b>Subjects</b> – Five academic libraries, 1 public library, and 3 library consortia.<br><b>Methods</b> – The initial method used to identify discontinued chat reference services was via a posting to DIG_REF, the digitalreference services listserv. From this initial posting, librarians on the list also suggested other cases, for a total of 7. Two cases later came to the authors’ attention and were added. The 9 cases included academic libraries, a public library, and consortia who used tools provided by four major software vendors, giving a good cross‐section of the types of libraries participating in VR and the major software packages available at the time. A contact person for each discontinued service was invited to participate. The participants were geographically scattered, so data were collected via e‐mail questionnaires, telephone interviews, and examination of available documents describing the services, audiences, demographics, operations, and any decision‐making processes either for starting or discontinuing the service. The authors then compared and contrasted results obtained from the 9 services. The authors analysed reasons for discontinuation of services, the decision making processes, volume of questions, service hours, marketing, evaluation, and whether the service might be restarted atsome time in the future.<br><b>Main Results</b> – Although the VR services discussed were being delivered by diverse organizations, some commonalities emerged. All 9 services used existing staff and added chat reference to their duties. In all but one case, the hours of service offered when VRbegan were within the hours that the libraries were already open to the public. In the exception (Case E), there were hours of service after the libraries were closed, from 7‐10 p.m. These shifts were covered by librarians working from home. Decisions to either begin or suspend services were generally made by small informal groups or committees. Some cases began with pilot studies and received positive responses. Other than these pilot studies, little pre‐planning appeared to have been done. For example, there were noextensive advance surveys or studies to determine potential demand or markets for the service, or projected costs and benefits. Only one service had a strong, multi‐stage evaluation plan. In future launches of virtual reference services, both extensive pre‐planning and detailed measures for evaluation could be helpful in avoidingsome problems. Major reasons for discontinuation fell into 6 categories: funding problems, staffing problems, technical problems, institutional culture conflicts, low usage overall or low usage by target populations. A table (Table 1) was included that actually listed 7 categories of reasons for discontinuation, but the last one listed, “Software Change,” is discussed as part of “Technical Problems” in the text, though it is separated in the table (527). This is not immediately clear in the article, and thus the table is slightly confusing. Four cases reported funding problems as the major reason for discontinuation. Low volume or low volume for target population were primary reasons for discontinuation by4 cases, and secondary reasons for discontinuation by 4 cases. If one combines primary and secondary categories in this table, low volume is the most frequently cited reason for discontinuation. Lowvolume was determined to be “driven by a complex combination of variables including marketing strategies, insufficient hours of operation, and [failure to provide] an ample amount of time for a service to gain momentum” (527‐528). Funding was cited as the primary reason for cancellation in 4 cases. Technical problems were listed as primary or secondary factors for suspension of service in 2 cases, and software change was the secondary factor behind the suspension of service in 2 cases; one service reported that up to one third of chat sessions were ‘lost” (527). In many cases, these sites were early adopters of VR, or even beta test sites, so technical issues are perhaps not surprising. Staffing was the primary or secondary reason for discontinuation in a total of 3cases. Staffing problems included insufficient questions to keep staff interested; however, concerns about extending servicehours and thereby putting additional pressure on existing staff were also raised. Clashes in institutional cultures were reported as secondary reasons for discontinuation of the service in 2 consortia.It should be noted that the sample size is small; as the authors point out, the literature on unsuccessful or discontinued virtual reference services is quite limited. Pop‐up surveys were used by some cases to evaluate service success and user satisfaction. User satisfaction was reported as being high, but return rates for the surveys were very low, as can be expected since pop‐ups are often blocked or ignored. The authors recommend alternative means of evaluation, such as focus groups and more detailed surveys. The authors also discuss alternative technologies and user expectations for services such as IM or SMS text messaging, and suggest evaluation of user expectations and desires in these areas. One question which arose was what constituted success in chat reference – was it usage/volume, or some other measure, suchas whether chat reference queries were answered correctly more frequently than reference questions asked in other ways, such as by telephone or in person. Other key concerns identified include the importance of strong marketing, service usability, and the importance in a consortial environment of having someone responsible on a fulltime basis for directing and spearheading the project. Many of the suspended services reported that they could potentially become re‐interested in VR service, as issues are resolved and the technologies available mature. Finally, the authors provide detailed recommendations for single and consortial VR services, and offer directions for future research. Some suggestions for future research include ways to bridge the apparent gulf between expectations and technological preferences of users versus those of librarians and others staffing these services, as they often appear to have marked differences. Other areas of interest could include causes for low question volume, and possible relationships among various factors contributing to such poor usage along with an investigation of what makes successful services work well. Research on IM or SMS reference services as compared to those using other chat technologies and cost‐effectiveness studies or evaluations based on goals and measured outcomes are also needed.<br><b>Conclusion</b> – VR services have had erratic success rates and bumpy beginnings, but many libraries report continued interest The libraries in this study all indicated that they would consider, or are considering, restarting such services. Issues of staffing, technological usability and reliability, institutional culture, funding, marketing, and volume are key. As services and technologies mature, interest in offering VR services in one form or another continues to grow.
first_indexed 2024-12-13T05:29:29Z
format Article
id doaj.art-ea348f734399446a9cf6a1959c9537de
institution Directory Open Access Journal
issn 1715-720X
language English
last_indexed 2024-12-13T05:29:29Z
publishDate 2007-09-01
publisher University of Alberta
record_format Article
series Evidence Based Library and Information Practice
spelling doaj.art-ea348f734399446a9cf6a1959c9537de2022-12-21T23:58:06ZengUniversity of AlbertaEvidence Based Library and Information Practice1715-720X2007-09-012397100Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.Stephanie R. Walker<b>Objective</b> – To investigate the reasons behind the cessation of 9 virtual (chat) reference services.<br><b>Design</b> – Multiple case‐study investigation<br><b>Setting</b> – Academic, public, and special libraries in the United States.<br><b>Subjects</b> – Five academic libraries, 1 public library, and 3 library consortia.<br><b>Methods</b> – The initial method used to identify discontinued chat reference services was via a posting to DIG_REF, the digitalreference services listserv. From this initial posting, librarians on the list also suggested other cases, for a total of 7. Two cases later came to the authors’ attention and were added. The 9 cases included academic libraries, a public library, and consortia who used tools provided by four major software vendors, giving a good cross‐section of the types of libraries participating in VR and the major software packages available at the time. A contact person for each discontinued service was invited to participate. The participants were geographically scattered, so data were collected via e‐mail questionnaires, telephone interviews, and examination of available documents describing the services, audiences, demographics, operations, and any decision‐making processes either for starting or discontinuing the service. The authors then compared and contrasted results obtained from the 9 services. The authors analysed reasons for discontinuation of services, the decision making processes, volume of questions, service hours, marketing, evaluation, and whether the service might be restarted atsome time in the future.<br><b>Main Results</b> – Although the VR services discussed were being delivered by diverse organizations, some commonalities emerged. All 9 services used existing staff and added chat reference to their duties. In all but one case, the hours of service offered when VRbegan were within the hours that the libraries were already open to the public. In the exception (Case E), there were hours of service after the libraries were closed, from 7‐10 p.m. These shifts were covered by librarians working from home. Decisions to either begin or suspend services were generally made by small informal groups or committees. Some cases began with pilot studies and received positive responses. Other than these pilot studies, little pre‐planning appeared to have been done. For example, there were noextensive advance surveys or studies to determine potential demand or markets for the service, or projected costs and benefits. Only one service had a strong, multi‐stage evaluation plan. In future launches of virtual reference services, both extensive pre‐planning and detailed measures for evaluation could be helpful in avoidingsome problems. Major reasons for discontinuation fell into 6 categories: funding problems, staffing problems, technical problems, institutional culture conflicts, low usage overall or low usage by target populations. A table (Table 1) was included that actually listed 7 categories of reasons for discontinuation, but the last one listed, “Software Change,” is discussed as part of “Technical Problems” in the text, though it is separated in the table (527). This is not immediately clear in the article, and thus the table is slightly confusing. Four cases reported funding problems as the major reason for discontinuation. Low volume or low volume for target population were primary reasons for discontinuation by4 cases, and secondary reasons for discontinuation by 4 cases. If one combines primary and secondary categories in this table, low volume is the most frequently cited reason for discontinuation. Lowvolume was determined to be “driven by a complex combination of variables including marketing strategies, insufficient hours of operation, and [failure to provide] an ample amount of time for a service to gain momentum” (527‐528). Funding was cited as the primary reason for cancellation in 4 cases. Technical problems were listed as primary or secondary factors for suspension of service in 2 cases, and software change was the secondary factor behind the suspension of service in 2 cases; one service reported that up to one third of chat sessions were ‘lost” (527). In many cases, these sites were early adopters of VR, or even beta test sites, so technical issues are perhaps not surprising. Staffing was the primary or secondary reason for discontinuation in a total of 3cases. Staffing problems included insufficient questions to keep staff interested; however, concerns about extending servicehours and thereby putting additional pressure on existing staff were also raised. Clashes in institutional cultures were reported as secondary reasons for discontinuation of the service in 2 consortia.It should be noted that the sample size is small; as the authors point out, the literature on unsuccessful or discontinued virtual reference services is quite limited. Pop‐up surveys were used by some cases to evaluate service success and user satisfaction. User satisfaction was reported as being high, but return rates for the surveys were very low, as can be expected since pop‐ups are often blocked or ignored. The authors recommend alternative means of evaluation, such as focus groups and more detailed surveys. The authors also discuss alternative technologies and user expectations for services such as IM or SMS text messaging, and suggest evaluation of user expectations and desires in these areas. One question which arose was what constituted success in chat reference – was it usage/volume, or some other measure, suchas whether chat reference queries were answered correctly more frequently than reference questions asked in other ways, such as by telephone or in person. Other key concerns identified include the importance of strong marketing, service usability, and the importance in a consortial environment of having someone responsible on a fulltime basis for directing and spearheading the project. Many of the suspended services reported that they could potentially become re‐interested in VR service, as issues are resolved and the technologies available mature. Finally, the authors provide detailed recommendations for single and consortial VR services, and offer directions for future research. Some suggestions for future research include ways to bridge the apparent gulf between expectations and technological preferences of users versus those of librarians and others staffing these services, as they often appear to have marked differences. Other areas of interest could include causes for low question volume, and possible relationships among various factors contributing to such poor usage along with an investigation of what makes successful services work well. Research on IM or SMS reference services as compared to those using other chat technologies and cost‐effectiveness studies or evaluations based on goals and measured outcomes are also needed.<br><b>Conclusion</b> – VR services have had erratic success rates and bumpy beginnings, but many libraries report continued interest The libraries in this study all indicated that they would consider, or are considering, restarting such services. Issues of staffing, technological usability and reliability, institutional culture, funding, marketing, and volume are key. As services and technologies mature, interest in offering VR services in one form or another continues to grow.http://ejournals.library.ualberta.ca/index.php/EBLIP/article/view/438/511Virtual Reference Services
spellingShingle Stephanie R. Walker
Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.
Evidence Based Library and Information Practice
Virtual Reference Services
title Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.
title_full Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.
title_fullStr Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.
title_full_unstemmed Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.
title_short Low Volume, Funding, Staffing and Technical Problems are Key Reasons for Discontinuation of Chat Reference Services. A review of: Radford, Marie L., and M. Kathleen Kern. “A Multiple‐case Study Investigation of the Discontinuation of Nine Chat Reference Services.” Library & Information Science Research 28.4 (Sept. 2006): 521‐47.
title_sort low volume funding staffing and technical problems are key reasons for discontinuation of chat reference services a review of radford marie l and m kathleen kern a multiple case study investigation of the discontinuation of nine chat reference services library information science research 28 4 sept 2006 521 47
topic Virtual Reference Services
url http://ejournals.library.ualberta.ca/index.php/EBLIP/article/view/438/511
work_keys_str_mv AT stephanierwalker lowvolumefundingstaffingandtechnicalproblemsarekeyreasonsfordiscontinuationofchatreferenceservicesareviewofradfordmarielandmkathleenkernamultiplecasestudyinvestigationofthediscontinuationofninechatreferenceserviceslibraryinformationscienceresearch284sept2