Hello Denise
You have just described my BARS instrument that you are using in your classroom
(it first appeared in the Summer, 1985 issue of JME's predecessor, OBTR or The
Organizational Behavior Teaching Review)! I am very happy that you are having
some success with it and will share some of my experiences (and those of some of
my colleagues) over the past 12 years with it. First of all, I have now
upgraded it to a 10 dimension instrument and edited it for gender neutrality; I
will be happy to send it to you if you wish. Re your other points, I am a firm
believer in showing everyone the results of their classmates' feedback. This can
be done anonymously or for attribution. I generally do it anonymously except in
MBA classes that are focused on collaborative learning or teambuilding. I also
have students fill out a self-assessment using the same dimensions. AND I may
fill one out, too, or at least comment on each student's self-appraisal. I do
this at mid-term and at the end of the term. At mid-term, students must take
notes on their feedback and come up with at least 2 objectives to pursue in
connection with their participation for the second half of the term. At term's
end, they all see their classmates' results, but then I collect them and pass
back their final participation grade (usually 10-15% of their grade in OB
courses) with their final exams or projects. In a 25 student class, I average 1
student who overrates him/herself, and 1 who underrates her/himself in
comparison with what I think are appropriate ratings. I meet personally with any
students who seem to have totally miscalculated the effect of their
participation or non-participation. On balance, students take it pretty
seriously and seem to be honest with themselves and others, especially if I give
them a pep talk beforehand on the value of honest feedback and the fact that
they will rarely be in a position to get such honest concrete feedback from so
many peers again. I almost never have to censor any feedback. Just to cover your
worry about feedback honesty in terms of the exact numbers, I would tell
students that the numbers are advisory or are averaged in or combined with the
instructor's rating to determine the final participation grade. I have done lots
of other things with this instrument in connection with peer appraisal,
including mini-performance appraisals, face-to-face with adult students, but
this may be enough to spur your imagination on the subject! If anyone else is
interested in the updated survey, let me know....
Best,
Bill
Denise Bane wrote:
> Greetings!
>
> I teach an MBA-level OB course. I assign a group project, which includes a
> paper and presentation. All group members get the same grade on the
> project. In addition, five percent of each student's final grade is based
> on peer evaluation. The students use a BARS format instrument to evaluate
> each member of the team on the following eight dimensions (0 to 100):
>
> + willingness to volunteer
> + ability to communicate verbally
> + listening/attentiveness
> + preparation
> + ability to work toward consensus
> + courtesy, tact, sense of humor
> + open-mindedness
> + ability to offer/accept criticism
>
> The peer evaluation grade is based on these ratings. In addition to giving
> each team member a numerical score, the students are requested to include a
> paragraph on each person, describing the individual's contribution to the
> team.
>
> This is the dilemma:
>
> In order to obtain truthful assessments of team members' behaviors, I feel
> that the evaluations should remain confidential. I doubt students would say
> anything negative about their classmates if the evaluations were not
> confidential.
>
> However, given that the peer evaluations are a part of a student's grade, I
> also feel students should have the right to know how their final grade is
> determined. I do let students know their average score, based on how they
> were rated by the group, but I don't let them see the comments, or who gave
> them what rating.
>
> My question:
>
> How do other faculty handle peer evaluations in their classrooms?
>
> Denise Bane
> Assistant Professor of Management
> Baruch College, The City University of New York
>
Denise-Bane@worldnet.att.net
--
Bill Ferris
Professor of Management
Western New England College
Springfield, MA 01119
Phone: (413) 782-1629
Fax: (413) 796-2068
E-Mail:
bferris@wnec.edu