Discussion: View Thread

Expand all | Collapse all

evaluation of teaching effectiveness

  • 1.  evaluation of teaching effectiveness

    Posted 10-17-2001 03:44
    Wonder if some of you can point me in a useful direction related to this
    concern:
    I'm serving on a university committee studying and recommending a process
    for assessing teaching effectiveness. I've done some research on this and
    identified four or five institutions here in the USA that seem to have
    examined "best practices" elsewhere in revising the content and process
    of their own existing teaching evaluations (student perceptions and other
    sources; summative and formative). There are probably articles that I've
    missed (and web pages from institutions that have recently established
    perhaps innovative approaches to assessing teaching effectiveness). If
    you've run across anything interesting recently on this topic (that can
    create a lot of debate and controversy within a university), I'd
    appreciate your indicating a source that I could check and read. Thanks.
    --- Steve
    Steve Payne
    spayne@mail.gcsu.edu


  • 2.  evaluation of teaching effectiveness

    Posted 10-17-2001 08:01
    Hi Stephen - if its of any help to you

    I have found that the questionnaires designed specifically to the delivery
    of the single module's and of course end programme questionnaire to which I
    have described below

    All of which detail questions on the overall programme content which
    includes:
    * the delivery methods of the lecturer/trainer/assessor
    * elicits the relevant information on customer satisfaction
    * course contents and delivery.

    This information once collated together gives you information to be able to
    assess delivery and if the programme is working to meet the needs of
    different learning styles and a continual redesign which guarantees quality
    at the heart of training

    The formative assessment of the programme which includes a one to one review
    of progression on work based tasks etc set against the standards being
    assessed and includes the feedback to the candidates being accredited and
    shows the following areas.

    * Assessment methods utilised aids the progression of achievement of
    the individual
    * Tells how the individual achievement was evidenced
    * Helps individual learners to achieve at a slower pace rather than
    target the high flyers
    * Aids the summative assessment in accrediting the candidate with
    competence
    * Allows for appeals against the decision of the assessment
    * Records feedback of the assessment practice and assessor

    The relevant questionnaire is again designed for to elicit the information
    on personal effectiveness of the assessment methods/assessors/overall
    programme activities including work placements in the business environment's

    There are no pre set questionnaires for this but the assessor/lecturer
    /trainer is responsible for evaluating the whole of the practice and making
    the relevant changes to the programme delivery/programme outputs/ innovative
    approaches and of course evaluates the knowledge of the existing clients
    both internal and externally.

    You will find that the customers are very truthful in their comments in the
    questionnaires.
    It also brings out facts on behaviours and attitudes of those customers
    which have to be tackled within he context of the programme and of course
    the person who is delivering (the facilitator ) then has to include this in
    his/her delivery and manage this change in those behaviour's also.
    Regards IRIS







    -----Original Message-----
    From: Stephen Payne
    [SMTP:spayne@mail.gcsu.edu]
    Sent: Wednesday, October 17, 2001 8:44 AM
    To: MG-ED-DV@MAELSTROM.STJOHNS.EDU
    Subject: evaluation of teaching
    effectiveness

    Wonder if some of you can point me in a useful
    direction related to this
    concern:
    I'm serving on a university committee studying and
    recommending a process
    for assessing teaching effectiveness. I've done
    some research on this and
    identified four or five institutions here in the USA
    that seem to have
    examined "best practices" elsewhere in revising the
    content and process
    of their own existing teaching evaluations (student
    perceptions and other
    sources; summative and formative). There are
    probably articles that I've
    missed (and web pages from institutions that have
    recently established
    perhaps innovative approaches to assessing teaching
    effectiveness). If
    you've run across anything interesting recently on
    this topic (that can
    create a lot of debate and controversy within a
    university), I'd
    appreciate your indicating a source that I could
    check and read. Thanks.

    --- Steve
    Steve Payne
    spayne@mail.gcsu.edu

    ________________________________________________________________________
    Scottish Enterprise Network
    http://www.scottish-enterprise.com

    Please note that from 25 September 2001, the Scottish Enterprise
    operation currently located at 120 Bothwell Street, Glasgow
    will be operating from
    150 Broomielaw
    Atlantic Quay
    Glasgow
    G2 8LU.
    Tel: +44 (0) 141 248 2700.
    Fax: +44 (0)141 221 3217

    This message is sent in confidence for the addressee only.
    It may contain legally privileged information. The contents are not to
    be disclosed to anyone other than the addressee. Unauthorised recipients
    are requested to preserve this confidentiality and to advise the sender
    immediately of any error in transmission.


  • 3.  evaluation of teaching effectiveness

    Posted 10-17-2001 09:07
    There are a number of resources on the web among them the evaluation cookbook
    http://www.icbl.hw.ac.uk/ltdi/cookbook/

    While it may be useful to attach some healthwarnings to this approach it still
    provides practitioners with a worthwhile resource. It may be useful to also
    have a look at the wealth of literature that is out there, if you can try and
    get a hold of a paper by John Milton and Judith Lyons called "Evaluate to
    Improve Learning: the role of educational theory" from RMIT University
    Australia... Finally I always reference Aspinwall et als book "Educational
    Evaluation: a developmental approach (routledge) for its all round excellence
    but I don't know if it is in print any more.

    hope that helps



    Bruce Carter
    Telematics in Education Research Group
    Sheffield Hallam University
    01142253790


  • 4.  evaluation of teaching effectiveness

    Posted 10-17-2001 10:05
    Fairly high level 'effectiveness' assessment - see Baldrige criteria for
    Education, available on the NIST web site (maybe at http://www.itl.nist.gov).

    For specifics - what synapses in students' heads did you change - I'll bet
    you are on your own. the very word, 'effectiveness' implies an objective.
    different schools do not necessarily have the same objective. The closer you
    get toward operational definitions, the more differences you will find.

    I taught for some years at a private engineering oriented school, whose
    objective was to turn HS graduates into contributing engineers & adults. We
    were 85% 'efficient' inasmuch as that percentage obtained gainful career
    employment, while the rest went to grad school.

    Meanwhile, the flagship school in our state (UW- Madison) sought to prepare
    undergraduates, especially engineering students, for graduate school. they
    were 20% 'efficient' inasmuch as that group did go to graduate school. the
    byproduct sold very, very well, so few people were disappointed.

    My advice would be to define very carefully what your department and school
    wants to accomplish. The term 'customer' doesn't exactly fit a school,
    inasmuch as it can apply to at least 2 groups whose objectives may or may not
    overlap well. You are, nonetheless, changing something (synapses?) in ways
    that some people think they want. Someone pays you money to do that.

    Decide what you want to accomplish, and then you can figure out a way to
    measure how well you do it. then, and only then, can you successfully look
    around for another school that does some of the same thing well - a best
    practices example.

    Cheers,

    Jay

    Stephen Payne wrote:

    > Wonder if some of you can point me in a useful direction related to this
    > concern:
    > I'm serving on a university committee studying and recommending a process
    > for assessing teaching effectiveness. I've done some research on this and
    > identified four or five institutions here in the USA that seem to have
    > examined "best practices" elsewhere in revising the content and process
    > of their own existing teaching evaluations (student perceptions and other
    > sources; summative and formative). There are probably articles that I've
    > missed (and web pages from institutions that have recently established
    > perhaps innovative approaches to assessing teaching effectiveness). If
    > you've run across anything interesting recently on this topic (that can
    > create a lot of debate and controversy within a university), I'd
    > appreciate your indicating a source that I could check and read. Thanks.
    > --- Steve
    > Steve Payne
    > spayne@mail.gcsu.edu

    --
    Jay Warner
    Principal Scientist
    Warner Consulting, Inc.
    4444 North Green Bay Road
    Racine, WI 53404-1216
    USA

    Ph: (262) 634-9100
    FAX: (262) 681-1133
    email: quality@a2q.com
    web: http://www.a2q.com

    The A2Q Method (tm) -- What do you want to improve today?


  • 5.  evaluation of teaching effectiveness

    Posted 10-17-2001 12:57
    Check this out:

    http://www.idea.ksu.edu/

    We are probably going to adopt their instrument for student evaluations of faculty. It would be nice if you posted a summary to the list of sources that you found yourself or get as a result of your post. This is an everpresent and controversial issue.

    Scott

    >>> spayne@mail.gcsu.edu 10/17/01 02:44AM >>>
    Wonder if some of you can point me in a useful direction related to this
    concern:
    ...There are probably articles that I've missed (and web pages from institutions that have recently established perhaps innovative approaches to assessing teaching effectiveness). If you've run across anything interesting recently on this topic (that can create a lot of debate and controversy within a university), I'd appreciate your indicating a source that I could check and read. Thanks.
    --- Steve Steve Payne
    spayne@mail.gcsu.edu


  • 6.  evaluation of teaching effectiveness

    Posted 10-17-2001 14:28
    From: Bainkr@Northwestern.edu [mailto:Bainkr@Northwestern.edu]

    You might be interested in this approach to the evaluation of teaching:
    http://president.scfte.northwestern.edu/evalteaching.html

    --
    Ken Bain, Director
    Searle Center for Teaching Excellence
    Northwestern University
    627 Dartmouth Place
    Evanston, IL 60208-4181
    (847) 467-2338
    email: bainkr@nwu.edu
    http://president.scfte.nwu.edu
    For directions to the Center, see the maps on our Web site.


  • 7.  evaluation of teaching effectiveness

    Posted 10-17-2001 15:19
    We use the ETS's Field Test in Business. From my perspective, it is a good instrument to evaluate learning outcomes in business. It confirmed what we already expected to be our strong and weak subject areas. In addition, it quantified the gaps and benchmarked us against approximately 300 schools that use the instrument. As a school, we ranked in the 87 percentile. That's the kind of thing that the Dean, President, and I expect AACSB like to see.

    What I would like to know is there any nationally normed instrument that focuses on the teaching process?






    Frank Shipper, Ph.D.
    Professor of Management
    Perdue School of Business
    Salisbury University
    Salisbury, MD 21801
    Phone: (410) 543-6333
    FAX: (410) 546-6208
    E-mail: fmshipper@ssu.edu
    Home Page: http://faculty.salisbury.edu/~fmshippe/home/


  • 8.  evaluation of teaching effectiveness

    Posted 10-18-2001 03:25
    I've gone to the ets website and I can't find this test. How can I learn
    more about it?
    Mike Hanson
    Assistant Professor- Human Resources Department
    Course Leader, BBA Athens Campus Greece
    ESCEM School of Business and Management
    11 rue de l'ancienne comédie
    86000 Poitiers France
    mhanson@escem.fr
    Tel. (33) 549.60.58.34


    > -----Message d'origine-----
    > De: Frank Shipper [SMTP:FMSHIPPER@salisbury.edu]
    > Date: mercredi 17 octobre 2001 21:19
    > À: MG-ED-DV@MAELSTROM.STJOHNS.EDU
    > Objet: Re: evaluation of teaching effectiveness
    >
    > We use the ETS's Field Test in Business. From my perspective, it is a good
    > instrument to evaluate learning outcomes in business. It confirmed what we
    > already expected to be our strong and weak subject areas. In addition, it
    > quantified the gaps and benchmarked us against approximately 300 schools
    > that use the instrument. As a school, we ranked in the 87 percentile.
    > That's the kind of thing that the Dean, President, and I expect AACSB like
    > to see.
    >
    > What I would like to know is there any nationally normed instrument that
    > focuses on the teaching process?
    >
    >
    >
    >
    >
    >
    > Frank Shipper, Ph.D.
    > Professor of Management
    > Perdue School of Business
    > Salisbury University
    > Salisbury, MD 21801
    > Phone: (410) 543-6333
    > FAX: (410) 546-6208
    > E-mail: fmshipper@ssu.edu
    > Home Page: http://faculty.salisbury.edu/~fmshippe/home/


  • 9.  evaluation of teaching effectiveness

    Posted 10-18-2001 04:18
    The host specified in your URL could not be found.
    This error could have been caused by:

    Bad / misspelled URL
    Regards Iris

    -----Original Message-----
    From: Charles Wankel
    [SMTP:cxx@bellatlantic.net]
    Sent: Wednesday, October 17, 2001 7:28 PM
    To: MG-ED-DV@MAELSTROM.STJOHNS.EDU
    Subject: Re: evaluation of teaching
    effectiveness

    From: Bainkr@Northwestern.edu
    [mailto:Bainkr@Northwestern.edu]

    You might be interested in this approach to the
    evaluation of teaching:

    http://president.scfte.northwestern.edu/evalteaching.html

    --
    Ken Bain, Director
    Searle Center for Teaching Excellence
    Northwestern University
    627 Dartmouth Place
    Evanston, IL 60208-4181
    (847) 467-2338
    email: bainkr@nwu.edu
    http://president.scfte.nwu.edu
    For directions to the Center, see the maps on our
    Web site.

    ________________________________________________________________________
    Scottish Enterprise Network
    http://www.scottish-enterprise.com

    Please note that from 25 September 2001, the Scottish Enterprise
    operation currently located at 120 Bothwell Street, Glasgow
    will be operating from
    150 Broomielaw
    Atlantic Quay
    Glasgow
    G2 8LU.
    Tel: +44 (0) 141 248 2700.
    Fax: +44 (0)141 221 3217

    This message is sent in confidence for the addressee only.
    It may contain legally privileged information. The contents are not to
    be disclosed to anyone other than the addressee. Unauthorised recipients
    are requested to preserve this confidentiality and to advise the sender
    immediately of any error in transmission.


  • 10.  evaluation of teaching effectiveness

    Posted 10-18-2001 09:15
    Hmmmmmmmmmmmmm Iris,
    The url that Ken at Northwestern University sent works for me?
    Maybe their system was being maintained at the Euro-time that you tried
    to access it or something?
    Cybercollaborating,
    Charles Wankel
    Mg-ed-Dv List Director
    wankelc@stjohns.edu

    -----Original Message-----
    Behalf Of Iris Robertson, E, SE Glasgow


    The host specified in your URL could not be found.
    This error could have been caused by:

    Bad / misspelled URL
    Regards Iris

    -----Original Message-----

    From: Bainkr@Northwestern.edu
    [mailto:Bainkr@Northwestern.edu]

    You might be interested in this approach to the
    evaluation of teaching:
    http://president.scfte.northwestern.edu/evalteaching.html
    http://president.scfte.northwestern.edu/evalteaching.html

    --
    Ken Bain,
    Northwestern University


  • 11.  evaluation of teaching effectiveness

    Posted 10-18-2001 08:55
    ETS's general web site for Higher Education Assessment is http://www.ets.org/hea/index.html

    The web site for the pdf file for the Field Test in Business is
    ftp://ftp.ets.org/pub/corp/mftbus.pdf

    I hope that this helps.



    Frank Shipper, Ph.D.
    Professor of Management
    Perdue School of Business
    Salisbury University
    Salisbury, MD 21801
    Phone: (410) 543-6333
    FAX: (410) 546-6208
    E-mail: fmshipper@ssu.edu
    Home Page: http://faculty.salisbury.edu/~fmshippe/home/


    >>> mhanson@escem.fr 10/18/01 03:24AM >>>
    I've gone to the ets website and I can't find this test. How can I learn
    more about it?
    Mike Hanson
    Assistant Professor- Human Resources Department
    Course Leader, BBA Athens Campus Greece
    ESCEM School of Business and Management
    11 rue de l'ancienne comédie
    86000 Poitiers France
    mhanson@escem.fr
    Tel. (33) 549.60.58.34


  • 12.  evaluation of teaching effectiveness

    Posted 10-18-2001 09:34
    Hi - thanks its been happening quite a lot with some others
    Webb sites forwarded by email - could be the service provider is being
    maintained here in the U.K. - no problem don't worry - I shall try again
    later
    Regards Iris


    -----Original Message-----
    From: Charles Wankel
    [SMTP:cxx@bellatlantic.net]
    Sent: Thursday, October 18, 2001 2:15 PM
    To: MG-ED-DV@MAELSTROM.STJOHNS.EDU
    Subject: Re: evaluation of teaching
    effectiveness

    Hmmmmmmmmmmmmm Iris,
    The url that Ken at Northwestern University
    sent works for me?
    Maybe their system was being maintained at the
    Euro-time that you tried
    to access it or something?
    Cybercollaborating,
    Charles Wankel
    Mg-ed-Dv List Director
    wankelc@stjohns.edu

    -----Original Message-----
    Behalf Of Iris Robertson, E, SE Glasgow


    The host specified in your URL could
    not be found.
    This error could have been caused
    by:

    Bad / misspelled URL
    Regards Iris

    -----Original
    Message-----

    From:
    Bainkr@Northwestern.edu
    [mailto:Bainkr@Northwestern.edu]

    You might be interested in
    this approach to the
    evaluation of teaching:

    http://president.scfte.northwestern.edu/evalteaching.html

    http://president.scfte.northwestern.edu/evalteaching.html

    --
    Ken Bain,

    Northwestern University

    ________________________________________________________________________
    Scottish Enterprise Network
    http://www.scottish-enterprise.com

    Please note that from 25 September 2001, the Scottish Enterprise
    operation currently located at 120 Bothwell Street, Glasgow
    will be operating from
    150 Broomielaw
    Atlantic Quay
    Glasgow
    G2 8LU.
    Tel: +44 (0) 141 248 2700.
    Fax: +44 (0)141 221 3217

    This message is sent in confidence for the addressee only.
    It may contain legally privileged information. The contents are not to
    be disclosed to anyone other than the addressee. Unauthorised recipients
    are requested to preserve this confidentiality and to advise the sender
    immediately of any error in transmission.


  • 13.  evaluation of teaching effectiveness

    Posted 10-18-2001 10:01
    Iris

    I'm from Glasgow and am able to access thesite, hope this helps locate
    possible problems at your end

    Robert
    ----- Original Message -----
    From: "Iris Robertson, E, SE Glasgow" <Iris.Robertson@scotent.co.uk>
    To: <MG-ED-DV@MAELSTROM.STJOHNS.EDU>
    Sent: Thursday, October 18, 2001 2:33 PM
    Subject: Re: evaluation of teaching effectiveness


    > Hi - thanks its been happening quite a lot with some others
    > Webb sites forwarded by email - could be the service provider is being
    > maintained here in the U.K. - no problem don't worry - I shall try
    again
    > later
    > Regards Iris
    >
    >
    > -----Original Message-----
    > From: Charles Wankel
    > [SMTP:cxx@bellatlantic.net]
    > Sent: Thursday, October 18, 2001 2:15 PM
    > To: MG-ED-DV@MAELSTROM.STJOHNS.EDU
    > Subject: Re: evaluation of teaching
    > effectiveness
    >
    > Hmmmmmmmmmmmmm Iris,
    > The url that Ken at Northwestern University
    > sent works for me?
    > Maybe their system was being maintained at the
    > Euro-time that you tried
    > to access it or something?
    > Cybercollaborating,
    > Charles Wankel
    > Mg-ed-Dv List Director
    > wankelc@stjohns.edu
    >
    > -----Original Message-----
    > Behalf Of Iris Robertson, E, SE Glasgow
    >
    >
    > The host specified in your URL could
    > not be found.
    > This error could have been caused
    > by:
    >
    > Bad / misspelled URL
    > Regards Iris
    >
    > -----Original
    > Message-----
    >
    > From:
    > Bainkr@Northwestern.edu
    > [mailto:Bainkr@Northwestern.edu]
    >
    > You might be interested in
    > this approach to the
    > evaluation of teaching:
    >
    > http://president.scfte.northwestern.edu/evalteaching.html
    >
    > http://president.scfte.northwestern.edu/evalteaching.html
    >
    > --
    > Ken Bain,
    >
    > Northwestern University
    >
    > ________________________________________________________________________
    > Scottish Enterprise Network
    > http://www.scottish-enterprise.com
    >
    > Please note that from 25 September 2001, the Scottish Enterprise
    > operation currently located at 120 Bothwell Street, Glasgow
    > will be operating from
    > 150 Broomielaw
    > Atlantic Quay
    > Glasgow
    > G2 8LU.
    > Tel: +44 (0) 141 248 2700.
    > Fax: +44 (0)141 221 3217
    >
    > This message is sent in confidence for the addressee only.
    > It may contain legally privileged information. The contents are not to
    > be disclosed to anyone other than the addressee. Unauthorised recipients
    > are requested to preserve this confidentiality and to advise the sender
    > immediately of any error in transmission.


  • 14.  evaluation of teaching effectiveness

    Posted 10-18-2001 13:29
    From: Bainkr@Northwestern.edu [mailto:Bainkr@Northwestern.edu]

    Iris,

    Could also be caused by bad connections on your end. The URL is
    correct and can be reached. In fact, the traffic count suggest that it
    is getting substantial numbers of hits each day from around the world.

    --
    Ken Bain, Director
    Searle Center for Teaching Excellence
    Northwestern University
    627 Dartmouth Place
    Evanston, IL 60208-4181
    (847) 467-2338
    email: bainkr@nwu.edu
    http://president.scfte.nwu.edu


  • 15.  evaluation of teaching effectiveness

    Posted 10-19-2001 04:26
    Thanks Ken It could have been our server here also as maintenance was being
    done on one of our corporate systems being put in place - but again thanks
    for your kind feedback
    Regards iris

    -----Original Message-----
    From: Charles Wankel
    [SMTP:cxx@bellatlantic.net]
    Sent: Thursday, October 18, 2001 6:29 PM
    To: MG-ED-DV@MAELSTROM.STJOHNS.EDU
    Subject: Re: evaluation of teaching
    effectiveness

    From: Bainkr@Northwestern.edu
    [mailto:Bainkr@Northwestern.edu]

    Iris,

    Could also be caused by bad connections on
    your end. The URL is
    correct and can be reached. In fact, the traffic
    count suggest that it
    is getting substantial numbers of hits each day from
    around the world.

    --
    Ken Bain, Director
    Searle Center for Teaching Excellence
    Northwestern University
    627 Dartmouth Place
    Evanston, IL 60208-4181
    (847) 467-2338
    email: bainkr@nwu.edu
    http://president.scfte.nwu.edu

    ________________________________________________________________________
    Scottish Enterprise Network
    http://www.scottish-enterprise.com

    150 Broomielaw
    5 Atlantic Quay
    Glasgow
    G2 8LU.
    Tel: +44 (0) 141 248 2700.
    Fax: +44 (0)141 221 3217

    This message is sent in confidence for the addressee only.
    It may contain legally privileged information. The contents are not to
    be disclosed to anyone other than the addressee. Unauthorised recipients
    are requested to preserve this confidentiality and to advise the sender
    immediately of any error in transmission.