The purpose of this briefing series is to provide juvenile justice program managers with information that will help them to evaluate their programs Each briefing addresses a topic that is of particular interest to juvenile justice program managers w ID: 85056
Download Pdf The PPT/PDF document "Hiring and Working With an Evaluator Juv..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
This briefing was prepared by Stan Orchowsky, Ph.D., JRSAÕs Re-search Director, with assistance from Taj Carson, Ph.D., former JJECProject Manager, and Merideth Trahan, JJEC Project Manager. Edit-ing was provided by Nancy Michel, JRSAÕs Director of Publications. Table of ContentsIntroduction.........................................................................1Who is an Evaluator?...........................................................1What Can an Evaluator Do For You?...................................2Advantages of Hiring an Evaluator.....................................3Disadvantages of Hiring an Evaluator.................................4Selecting an Evaluator..........................................................5Developing an Evaluation Plan............................................7Specifying Evaluation Products...........................................8Maximizing Collaboration...................................................9Other Evaluation Resources...............................................10Conclusion.........................................................................12 outcomes they hope for. The purpose of this briefing is to provideabout hiring an evaluator. The briefing discusses how a qualifiedevaluator can assist a program manager in assessing her/his programÕsevaluator, and how to go about finding such a person. programs. Unfortunately, there is no easy way to identify a qualifiedprogram evaluator. For example, there are no licensing or certificationcial sciences, such as psychology, sociology, criminal justice, publicqualifications to look for when selecting a competent evaluator. aaaaaaaaaaaaaaaaaaaaaaaaaa A good evaluator is part facilitator, part researcher, and part programimprove service delivery.tasks themselves. Even with these, however, the program will benefitfrom the experience and expertise of a qualified evaluator. Think ofthe evaluation process as being like the process of building oneÕs ownfoundation, or plumbing and electrical wiring. Finally, if you havebuild your home from top to bottom. Even in this last case, however,should be painted. In this same way, programs can hire evaluators toWhat Can an Evaluator Do For You?aaaaaaaaaaaa evaluator. Some of the advantages of hiring an evaluator to help with Specialized Knowledge and Ability The primary advantage of hiring anknowledge and ability. Evaluators understand how to document pro- Objectivity The hallmark of good program evaluation is objectiv-the programÕs operations. Credibility Precisely because program evaluators are more knowl- 3A professionalevaluator hasspecializedknowledge andthe ability toobjectivelyassess programoperations. Time Although careful evaluation takes time regardless of who istake extra time on the part of the evaluator, it will also require staffthrough interviews with the evaluator, and so on.ate. If such an evaluatorÕs work is released to funders and the public,when they decide to hire a program evaluator. aaaaaaaaaaaa aaaaaaaaaaaaaSelecting an Evaluator ing how to hire an evaluator. What follows are some considerationsfor selecting an evaluator. As noted previously, very few individuals have for-training in research methods, however, usually in a social science dis-an evaluator, experience working Much has been written about how evaluationsprocess differently. For example, some evaluators may consider them-losophy, program managers and staff are seen as the experts, and employee. Carefully review the evaluatorÕs resume to determine if she/their experiences with the evaluator, including how well the evaluatorworked collaboratively with the program managers and staff. Inter-would be comfortable working. Ask for samples of the evaluatorÕsthey are written clearly, without a great deal of jargon, and in a wayaaaaaaaaaaaa When you have selected an evaluator, you must specify in writingprobation officers, as a result of your program. You and the evaluatoranswer this questionÐfor example, identifying or designing an instru-ings. These may all be responsibilities of the evaluator, or you may 7The programmanager and theevaluator needto agree onthe evaluationtasks and who is responsiblefor performingthem. However, youcounty commissioners regarding the evaluation findings. It is impor-tant that you and the evaluator agree on when the evaluatorÕs involve-ment in the process ends. For example, does the evaluatorÕs role end aaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaa staff. However, there is always the potential for conflict between thework collaboratively.together effectively.tively in implementing all phases of the evaluation plan. Specifically,one that has the endorsement of the programÕs staff and managers. aaaaaaaaaaaaaaaaaaaaaaaa However, a number of resources may be available to help you withtions about where to find a qualified evaluator. The following arelevel. Moreover, OJJDP contracts with a number of organizations andevaluate their juvenile justice initiatives. JRSAÕs Juvenile Justice Evalua-Correction and Juvenile Justice Services, along with other social ser- Depending on the size of your locality, there may bein departments of criminology, education, psychology, social work,and public policy. These departments may also have graduate aaaaaaaaaaaa aaaaaaaa can be assured of getting the assistance they need in developing per-aaaaaaaaaaaa Washington, D.C. 20002www.jrsa.org/jjec#2 Hiring and Working With an Evaluator Hiring and WorkingWith an Evaluator ProgramSeries Hiring and Working With an Evaluatorand Statistics AssociationÃs Juvenile Justice Evaluation Center (JJEC) visit our Web site athttp://www.jrsa.org/jjec,Washington, D.C. 20002http://ww available who while they may not be qualified evaluators, may As noted previously, many evaluators areCriminology, the Academy of Criminal Justice Sciences, the AmericanResources for Hiring and Working with An EvaluatorÂ¥Justice Research and Statistics Associationhttp://wwÂ¥Office of Juvenile Justice and Delinquency Preventionhttp://wwÂ¥American Evaluation Associationhttp://wwÂ¥American Educational Research Associationhttp://wwÂ¥American Society of Criminologyhttp://wwÂ¥American Psychological Associationhttp://wwÂ¥American Sociological Associationhttp://ww