Hello Evaluation community! My name is Elizabeth Silverstein and I am probably as novice an evaluator as you will ever find. Currently I am a lowly graduate student in Public Affairs in Wisconsin, but have been spending this summer interning for a government agency in DC. It was this internship that introduced me to evaluation, where I finally think I have found an intellectual home.
While I find most of evaluation fascinating, one aspect of evaluation which continues to worry me is a term we deem in our office “evaluation apprehension.” It represents all of the negative feelings that many clients seem to carry concerning evaluations. I find this idea that clients would be afraid of evaluations both baffling and frightening. For me, evaluation represents the ability to do everything cheaper, faster and more efficiently. Initially, the lack-luster performance of many innovative programs I saw during my study abroad turned me towards the evaluation light. “But wait!” I thought, “if you just thought it through, you could figure out why the new well you built is being used for garbage instead of its intended purpose!” And yet, many people see evaluators as the enemy, as someone who is coming in to tell people what they are doing incorrectly in their program.
My question for the evaluation community is, how can you help people when they are afraid of what you might find?Is this apprehension as widespread as it appears, representing perhaps a greater publicity problem for evaluators? Finally, what is the best way you have found to combat this evaluation apprehension?
Elizabeth, evaluation apprehension is definitely real, and it becomes more pronounced the closer you get the front-lines or ground level staff.
In situations where I think people will be uncomfortable with evaluation work, I stay away from jargon or any terms that may be laden with negative connotations. Never say ‘evaluation’ – say you are here to try to make things better. Never say ‘data’, say ‘information’. Just being aware of your language and the words you use can really make a difference in overcoming fears of evaluation.
Depending on your personality, you could also use emotional appeals or humor to help with the situation. Appealing to people’s desire to help others is something I’ve done in the past – so evaluation isn’t a negative activity that will force change, but rather it is a positive activity that will improve the lives of others. I’d also recommend being sympathetic to the burdens evaluation will place on people – don’t ignore these – but explain that they are necessary steps to making sure you can improve things for service recipients.
Elizabeth, it’s great that you’ve had this insight so early in your career! I’ve learned that I need to explain very early and very clearly that my work has nothing to do with personnel evaluation or finances. I’m not an auditor and I don’t hire or fire anyone. When front line staff see an evaluator walk in with a laptop or notepad, the first thing they assume is that I am evaluating THEM, not the program. If I can explain otherwise it’s much easier to help staff relax and look on the process as one of helping the program improve.
I agree with Isaac about staying away from jargon, and Maria about stressing that it’s not about individual job performance. I have worked on a few process/implementation evaluations of programs that are in early stages of development, where frontline staff can feel especially put on the spot by evaluation–they feel that evaluation means they are expected to produce significant positive results, when they are still trying to figure out how to do the program. I try to emphasize the different stages of eval, and that an important aspect of the eval process and goals is to help others (including the evaluators) learn about how the program works–the program staff are the experts on that, not me. For evals that are more outcome/impact focused, I try to make time at the beginning of the process for the frontline staff to identify questions that they have about how the program is doing and include those questions in the design. This is a way to help the program staff feel more personally invested in the process, and hopefully less threatened. Also, it’s helpful to make it clear in the initial conversations that you value staff input on how to conduct the evaluation in a way that minimizes the burdens both on the staff and the clients. And as Isaac mentions, I find it helpful to focus on how the evaluation can help bring what they know to others who are trying to do similar work.
I’d recommend cultivating greater empathy. It’s essential to recognize that your counterparts often have perfectly valid reasons for their apprehension, and some of them probably have experience that turned out differently than you expect. For instance, doing things “cheaper, faster, and more efficiently” may mean the organization needs only two program assistants where they now have three or four. That’s someone’s livelihood. As evaluators we need to know our limitations, and we typically have little control over how findings, conclusions, and recommendations are used — it is not always as we might wish.
Don’t be so quick to assume people haven’t ‘thought things through’, either. If people pick up that vibe from you, they’re right to be apprehensive. As Diane says, the program staff are the experts on what’s going on, how, and why. They may not have it assembled in an evaluation framework but they’ve thought about it for much longer and from many angles you have not considered yet. What seems obvious to a novice at first glance might be something that’s been tried and found not to work.
My experience in international development evaluation leads me to suggest deep reflection on the combat metaphor. The evaluator can’t “win”, and won’t even be there to face the evaluation’s consequences.
Promising sunshine and roses is more likely to undermine than build trust. Focus instead on working hard to learn and appreciate the local perspective. Learn about the program, and while you’re there find ways to contribute a different perspective or insights that people on the ground can use.
Thank you all for your replies! I think that all four of your responses have clear and easily implementable ways to combat this problem. I really appreciate your insight and hope to use them in my (hopefully) near future evaluations.
These comments are all excellent. I also try to remind clients that evaluation allows them to show off their successes, as well as highlight areas where they can improve. There is so much deficit focus in the current environment that non-profit and educational staff start to feel beat down and forget the impact they are having on those they serve. It is rare to have a program that does not have some level of success, and speaking with clients to find out what is important to them really helps frame the evaluation in terms that are meaningful to them. Reminding them that the end goal is to do X (help youth in detention reintegrate, etc.) and that you are there to provide information to help them reach that goal, or show in what ways they are moving toward achieving it already, makes them much more open. Of course, building trust will always take time, and you will need to be true to this throughout the evaluation process to build it.
Agen Togel Resmi dengan Hadiah 4D 10 Juta di Tahun 2024
Kumpulan agen togel terbaik dengan hadiah-hadiah terbesar yang jarang anda temukan. kami menyediakan permainan togel online yang memiliki hadiah 4D Terbesar di tahun 2024, dimana anda kan merasakan hadiah 4d 10 juta. bagi anda pemain togel jangan ragu karena Situs Togel ini sudah resmi terpercaya dengan pembayaran yang super cepat dan pastinya aman. selain itu situs ini juga memberikan bocoran bocoran angka keluar yang akan membantu anda mendapatkan hadiah terbesar yang kami sediakan. daftar sekarang juga dan rasakan kemenangan yang menakjubkan.
Togel resmi ini menawarkan pengalaman bermain togel online yang luar biasa. Dengan antarmuka yang mudah digunakan, sistem transaksi yang aman, dan dukungan pelanggan yang responsif, Situs Togel Terpercaya ini menjadi pilihan terbaik. para pemain togel dapat menikmati berbagai permainan seperti togel 4D, 3D, dan 2D dengan peluang menang yang besar.
BO Togel dengan deposit minim mulai 10 ribu menjadi pilihan populer di kalangan pecinta togel yang ingin merasakan pengalaman bermain tanpa mengeluarkan modal besar. Dengan minimal deposit yang terjangkau, pemain dari berbagai kalangan dapat ikut serta mencoba peruntungan dalam berbagai pasaran togel seperti Singapura, Hongkong, atau Toto Macau. Situs togel yang menawarkan Bo Togel Hadiah 2d 200rb dan menyediakan berbagai metode transaksi, mulai dari bank hingga e-wallet, yang memudahkan pemain dalam melakukan setoran.
Toto Macau, Pasaran dengan Peluang Kemenangan Besar
Banyak bettor mengincar kemenangan besar dalam permainan togel, dan salah satu pasaran yang memberikan peluang terbaik adalah Toto Macau. Dengan sistem pengundian yang dilakukan secara adil dan terbuka, pemain merasa lebih nyaman dalam memasang taruhan mereka. Selain itu, Toto Macau memiliki berbagai metode transaksi yang memudahkan pemain dalam melakukan deposit dan withdraw.
Ketika mencari tempat untuk memasang taruhan togel online, tentu ada banyak faktor yang perlu dipertimbangkan, mulai dari keamanan, variasi permainan, hingga bonus yang ditawarkan. Situs Toto menjadi pilihan unggulan karena menyediakan berbagai pasaran terlengkap dengan peluang kemenangan yang lebih besar. Selain itu, layanan pelanggan yang responsif memastikan setiap pemain mendapatkan pengalaman terbaik saat bermain.
Cara Bermain Slot Gacor dengan Peluang Menang Tinggi
Strategi dalam bermain slot gacor juga memainkan peran penting. Mulailah dengan menetapkan taruahan yang jelas untuk permainan Anda dan patuhi itu. Manfaatkan bonus dan promosi yang kami sedikan, seperti free spins atau bonus deposit, untuk memperpanjang waktu bermain Anda. Slot Gacor Ini tidak hanya memberi Anda lebih banyak peluang untuk menang tetapi juga membuat pengalaman bermain lebih menyenangkan. selain itu penting untuk memahami mekanisme dasar dari setiap slot yang Anda mainkan.
Rahasia scatter hitam di Mahjong Ways terletak pada kesabarannya. Slot ini sering kali memberikan kejutan besar bagi mereka yang tetap konsisten dalam bermain. Mahjong Slot adalah kunci untuk membuka peluang free spin dan pengganda besar, sehingga penting untuk terus memainkannya dengan taruhan yang bijak. Menggunakan bonus deposit atau free spin dari situs slot dapat menjadi cara cerdas untuk meningkatkan peluang Anda di tahun 2024.
Slot 5rb telah menjadi favorit banyak pemain karena memberikan akses mudah dengan modal rendah. Meskipun nominal depositnya kecil, peluang untuk mendapatkan jackpot dan bonus tetap besar di Slot Deposit 5k, apalagi jika pemain bermain di situs dengan RTP tinggi.
Dapatkan Peluang Menang Besar dengan RTP Live Slot Gacor
Ketika berbicara tentang RTP slot gacor tertinggi, tidak hanya soal persentase kemenangan, tetapi juga seberapa konsisten mesin tersebut memberikan pengembalian. RTP slot gacor mengacu pada mesin yang sering memberikan kemenangan dengan RTP tinggi. Pemain selalu mencari tahu update terbaru mengenai slot RTP tertinggi agar bisa mendapatkan keuntungan lebih.
Jika Anda sedang mencari permainan slot online dengan peluang menang tinggi, maka Toto Slot bisa menjadi pilihan yang tepat. Dengan banyaknya variasi permainan yang tersedia, pemain memiliki kebebasan untuk memilih slot yang sesuai dengan gaya bermain mereka. Selain itu, Toto Slot juga dikenal karena tingkat RTP yang tinggi, sehingga memberikan kesempatan lebih besar untuk mendapatkan keuntungan dalam jangka panjang.
Salah satu hal yang sering menjadi perhatian para pemain adalah kejujuran dalam permainan. Slot777 menerapkan sistem fair play yang memastikan bahwa setiap hasil permainan benar-benar acak dan tidak bisa dimanipulasi. Dengan menggunakan teknologi RNG (Random Number Generator), platform ini memberikan jaminan bahwa semua pemain memiliki peluang yang sama untuk menang.
Jika mengeluarkan uang secara sembarangan tanpa kontrol, www.saintjohnsbrooklyn.com Anda bisa rugi di judi bola online.
Kolaborasi ini menjamin kualitas game terbaik dalam grafis, suara, dan baanrestaurante.com bermain.
Pastikan main di situs Olahraga situs togel daring yang terpercaya dan terjamin legitimasinya.
Dengan mempelajari cara main Aktivitas Interaktif Togel158 online dan menerapkan strategi tepat, Anda bisa menang lebih.
Dengan judi Keseruan online, Anda bisa merasakan sensasi taruhan sama seperti Togel178 di kasino, namun dari
Anda https://kampuspoker.com/ akan menerima saran bagaimana mengelola saldo taruhan secara cerdas.
Dengan cara ini, Anda bisa memulai permainan Olahraga online dengan Slot menyenangkan dan menguntungkan.
Karena itu, tidak lagi rahasia bahwa sekarang masuk daftar poker online ke situs 1 - daring - dalam talian - maya - digital terbaik.
Keamanan dan kenyamanan kunci di dunia Colok178 Mainan.
Mencari situs yang menyediakan berbagai permainan menarik serta peluang kemenangan tinggi bukanlah hal yang mudah. Namun, Pedetogel hadir sebagai solusi bagi mereka yang ingin mendapatkan pengalaman bermain yang menyenangkan serta menguntungkan.
Bermain togel kini semakin praktis dan menguntungkan dengan hadirnya Pedetogel yang memberikan berbagai kemudahan bagi para pemainnya. Dengan layanan pelanggan yang siap membantu selama 24 jam, Anda tidak perlu khawatir mengalami kendala saat bermain. Situs ini juga menawarkan berbagai promo menarik yang bisa dimanfaatkan untuk menambah peluang kemenangan.
![Ann's Blog | How can you help people when they are afraid? [Guest post by Elizabeth Silverstein]](/wp-content/uploads/2014/10/emery_logo_2014-10-e1414430831606.png){kind=logo}
Isaac Castillo (@isaac_outcomes)
Sep 11, 2012 -
Elizabeth, evaluation apprehension is definitely real, and it becomes more pronounced the closer you get the front-lines or ground level staff.
In situations where I think people will be uncomfortable with evaluation work, I stay away from jargon or any terms that may be laden with negative connotations. Never say ‘evaluation’ – say you are here to try to make things better. Never say ‘data’, say ‘information’. Just being aware of your language and the words you use can really make a difference in overcoming fears of evaluation.
Depending on your personality, you could also use emotional appeals or humor to help with the situation. Appealing to people’s desire to help others is something I’ve done in the past – so evaluation isn’t a negative activity that will force change, but rather it is a positive activity that will improve the lives of others. I’d also recommend being sympathetic to the burdens evaluation will place on people – don’t ignore these – but explain that they are necessary steps to making sure you can improve things for service recipients.
Maria Gajewski
Sep 11, 2012 -
Elizabeth, it’s great that you’ve had this insight so early in your career! I’ve learned that I need to explain very early and very clearly that my work has nothing to do with personnel evaluation or finances. I’m not an auditor and I don’t hire or fire anyone. When front line staff see an evaluator walk in with a laptop or notepad, the first thing they assume is that I am evaluating THEM, not the program. If I can explain otherwise it’s much easier to help staff relax and look on the process as one of helping the program improve.
DianeSRA (@DianeSRA)
Sep 11, 2012 -
I agree with Isaac about staying away from jargon, and Maria about stressing that it’s not about individual job performance. I have worked on a few process/implementation evaluations of programs that are in early stages of development, where frontline staff can feel especially put on the spot by evaluation–they feel that evaluation means they are expected to produce significant positive results, when they are still trying to figure out how to do the program. I try to emphasize the different stages of eval, and that an important aspect of the eval process and goals is to help others (including the evaluators) learn about how the program works–the program staff are the experts on that, not me. For evals that are more outcome/impact focused, I try to make time at the beginning of the process for the frontline staff to identify questions that they have about how the program is doing and include those questions in the design. This is a way to help the program staff feel more personally invested in the process, and hopefully less threatened. Also, it’s helpful to make it clear in the initial conversations that you value staff input on how to conduct the evaluation in a way that minimizes the burdens both on the staff and the clients. And as Isaac mentions, I find it helpful to focus on how the evaluation can help bring what they know to others who are trying to do similar work.
seaelkins (@seaelkins)
Sep 13, 2012 -
I’d recommend cultivating greater empathy. It’s essential to recognize that your counterparts often have perfectly valid reasons for their apprehension, and some of them probably have experience that turned out differently than you expect. For instance, doing things “cheaper, faster, and more efficiently” may mean the organization needs only two program assistants where they now have three or four. That’s someone’s livelihood. As evaluators we need to know our limitations, and we typically have little control over how findings, conclusions, and recommendations are used — it is not always as we might wish.
Don’t be so quick to assume people haven’t ‘thought things through’, either. If people pick up that vibe from you, they’re right to be apprehensive. As Diane says, the program staff are the experts on what’s going on, how, and why. They may not have it assembled in an evaluation framework but they’ve thought about it for much longer and from many angles you have not considered yet. What seems obvious to a novice at first glance might be something that’s been tried and found not to work.
My experience in international development evaluation leads me to suggest deep reflection on the combat metaphor. The evaluator can’t “win”, and won’t even be there to face the evaluation’s consequences.
Promising sunshine and roses is more likely to undermine than build trust. Focus instead on working hard to learn and appreciate the local perspective. Learn about the program, and while you’re there find ways to contribute a different perspective or insights that people on the ground can use.
Elizabeth Silverstein
Sep 13, 2012 -
Thank you all for your replies! I think that all four of your responses have clear and easily implementable ways to combat this problem. I really appreciate your insight and hope to use them in my (hopefully) near future evaluations.
usefuleval (@usefuleval)
Sep 21, 2012 -
These comments are all excellent. I also try to remind clients that evaluation allows them to show off their successes, as well as highlight areas where they can improve. There is so much deficit focus in the current environment that non-profit and educational staff start to feel beat down and forget the impact they are having on those they serve. It is rare to have a program that does not have some level of success, and speaking with clients to find out what is important to them really helps frame the evaluation in terms that are meaningful to them. Reminding them that the end goal is to do X (help youth in detention reintegrate, etc.) and that you are there to provide information to help them reach that goal, or show in what ways they are moving toward achieving it already, makes them much more open. Of course, building trust will always take time, and you will need to be true to this throughout the evaluation process to build it.