7/10/2010

Observation

Observation, as an assessment tool, actually covers three distinct methods.

First, direct observation involves monitoring staff and/or patrons openly. It might be in a controlled or uncontrolled environment. It can be useful for gathering a lot of details about a certain delivery method or reference interaction, but we also know that people act differently when they know they're being watched.

The alternative, then, is hidden observation, where the librarian is watched and evaluated secretly. This might be from afar or by a "secret shopper" patron who approaches the librarian with a fake information need. The results from this are more "honest," but of course the method itself is not. If it can be done where the librarian's identity is guaranteed to remain anonymous, the ethical questions are not as stark, but it should probably not be used in smaller library systems where staff could be vulnerable. One of the best situations in which to use hidden observation is the electronic and online environment, where people can remain anonymous and the process is entirely unobtrusive:
Stacy-Bates, K. (2003). E-mail reference responses from academic ARL libraries: an unobtrusive study. Reference & User Services Quarterly, 43(1), 59-70.
Finally, the last observation method is self-imposed observation, which means librarians observing themselves individually. This is a very standard, easy to carry out method. Typically, some sort of log of number and type of questions it kept at the reference station (desk, computer terminal, telephone); logs are used either daily or on some sort of monthly or quarterly basis. The data and method is not very sophisticated, but it can be useful in tracking meaningful trends in usage. 


To see how it can be used on a large scale, check out the National Center for Educational Statistics' Library Comparison page, which allows you to search and compare academic libraries using certain parameters, including number of reference transactions.


You might also find the The READ Scale (Reference Effort Assessment Data) interesting. The READ Scale is a  metric for evaluating and weighting certain types of reference questions on a scale of 1-6 (1 being the most basic and simple and 6 being the most difficult and complex). It then provides a more sophisticated but efficient way to collect and analyze reference transaction data.

No comments:

Post a Comment