Re: Stats course geared towards Program Evaluation

Posted by Bruce Weaver on Mar 09, 2015; 12:00pm
URL: http://spssx-discussion.165.s1.nabble.com/Stats-course-geared-towards-Program-Evaluation-tp5728871p5728936.html

Hi Mike.  I had to wait until I was back on campus to get access to the article.  Based on a quick skim, I don't think that is the same story I remember hearing.  With any luck, Bozena will get a response from Dr. Tiberius, and all will be clarified.

Cheers,
Bruce

Mike Palij wrote

Bruce, take a look at the following:

Tiberius, R. G., Sackin, H. D., & Cappe, L. (1987).
A comparison of two methods for evaluating teaching.
Studies in Higher Education, 12(3), 287-297.

Especially pages 292-293 at the beginning of the
Discussion.  Does this describe what you remember?

-Mike Palij
New York University
[hidden email]

P.S. Found via google.scholar.com

----- Original Message -----
From: "Bruce Weaver" <[hidden email]>
To: <[hidden email]>
Sent: Friday, March 06, 2015 9:20 PM
Subject: Re: Stats course geared towards Program Evaluation


I contacted someone who I thought might know the source of that story.
I
copy his response below.  HTH.

-------------------------------------------------------------------

It was Richard Tiberius at Toronto. You've pretty well retold the story
accurately. I think he wrote it up, but a Pubmed search turned up
nothing. I
know he presented it in a few places.  Might still be able to reach him;
he's in Florida somewhere.

http://edo.med.miami.edu/contact-staff-fellows-advisory-council/subsect-staff/richard-g-tiberius




Zdaniuk, Bozena-3 wrote
> I am dying to know! It would be such a great example to use for
> advanced
> research courses...
> bozena
>
> -----Original Message-----
> From: SPSSX(r) Discussion [mailto:

> SPSSX-L@.UGA

> ] On Behalf Of Bruce Weaver
> Sent: March 6, 2015 3:30 PM
> To:

> SPSSX-L@.UGA

> Subject: Re: Stats course geared towards Program Evaluation
>
> In a slightly different (but I think related) vein, I once heard an
> education researcher talking about a study that involved some
> intervention
> to improve student performance in a particular course.  Somewhat
> surprisingly, the results showed no improvement in the target course.
> However, there was a substantial improvement in another course.  It
> was a
> situation where each course was populated by the same students.  So
> the
> researchers speculated that students were able to maintain their
> grades in
> the target course with less time and effort, and that they gave that
> extra
> time and effort to the other course, where it was apparently more
> important to them to improve their performance.  But if the
> researchers
> had not been paying attention to what was going on in the other
> non-target
> course(s), they might easily have concluded that the intervention was
> not
> effective.
>
> I can't remember who the researcher was.  But if anyone is dying to
> know,
> I can probably track it down.
>
> Cheers,
> Bruce
>
>
> Mike Palij wrote
>> Just one more addition to this thread, a cautionary tale.
>> Susan Reverby (a researcher best known for her work on the Tuskegee
>> syphilis nontreatment study; see:
>> http://books.google.com/books?hl=en&lr=&id=qm5X5gW7qNIC&oi=fnd&pg=PR7&
>> dq=%22susan+reverby%22+tuskegee&ots=b5Q3bpmUif&sig=GasL1Eq2uegPmHuaZD9
>> uCyNX1pM#v=onepage&q=%22susan%20reverby%22%20tuskegee&f=false
>> )
>> who is on another mailing list that I'm a member of, provided a link
>> to an analysis by HIV researcher Ida Susser of a program intervention
>> study that was published in the New England Journal of Medicine.  The
>> program was to promote preventive measures to stop the spread of the
>> HIV but, as implemented, appears to have failed to do so.  Susser
>> identifies some possible factors for why the intervention failed
>> which
>> highlights some of the problems the exist between the people
>> implementing a program and the recipients of the program.  Susser had
>> her analysis published on the Aljazeera America website (just a news
>> website, not a jihadi outlet) and it shows that when doing program
>> evaluation one cannot simply do statistical analysis but one also
>> should do an analysis of how the program was implemented.
>> NOTE: even if the program was implemented as planned, the plan that
>> was used may not have been the best approach to use, consequently, it
>> should not come as a surprise that there were negative results,
>> however, it failed because the wrong implementation was used not that
>> the implementation does not work.
>> Susser's article can be read here:
>> http://america.aljazeera.com/opinions/2015/3/blame-research-design-for
>> -failed-hiv-study.html#
>>
>> -Mike Palij
>> New York University
>
>> mp26@
>
>>
>>   ----- Original Message -----
>>   From: Dates, Brian
>>   To:
>
>> SPSSX-L@.UGA
>
>>
>>   Sent: Monday, March 02, 2015 10:19 AM
>>   Subject: Re: Stats course geared towards Program Evaluation
>>
>>
>>   Ryan,
>>
>>
>>
>>   The Evaluators’ Institute at George Washington University has a
>> full
>> cadre of courses for evaluators.  Here’s the current listing:
>>
>>
>>
>>   Analytic Approaches
>>
>>     a.. Applied Regression Analysis for Evaluators
>>     b.. Applied Statistics for Evaluators
>>     c.. Hierarchical Linear Modeling
>>     d.. Intermediate Cost-Benefit and Cost-Effectiveness Analysis
>>     e.. Intermediate Qualitative Analysis
>>     f.. Introduction to Cost-Benefit and Cost-Effectiveness Analysis
>>     g.. Needs Assessment
>>     h.. Practical Meta-Analysis: Summarizing Results Across Studies
>>     i.. Qualitative Data Analysis
>>   The link to the Evaluators’ Institute is:
>> http://tei.gwu.edu/course-listing-category
>>
>>
>>
>>   I’d also recommend the session by Stephanie Evergreen, Presenting
>> Data
>> Effectively: Practical Methods for Improving Evaluation Communication
>> .
>> She’s done amazing work with data visualization. We’ve had her at my
>> organization for a full day, and her stuff is really good.
>>
>>
>>
>>   Hope this all helps.
>>
>>
>>
>>   Brian
>>
>>
>>
>>   Brian Dates, M.A.
>>   Director of Evaluation and Research | Evaluation & Research |
>> Southwest Counseling Solutions
>>   Southwest Solutions
>>   1700 Waterman, Detroit, MI 48209
>>   313-841-8900 (x7442) office | 313-849-2702 fax
>>
>
>> bdates@
>
>>  | www.swsol.org
>>
>>
>>
>>   From: SPSSX(r) Discussion [mailto:
>
>> SPSSX-L@.UGA
>
>> ] On Behalf Of Ryan Black
>>   Sent: Monday, March 02, 2015 10:05 AM
>>   To:
>
>> SPSSX-L@.UGA
>
>>   Subject: Stats course geared towards Program Evaluation
>>
>>
>>
>>   OT:
>>
>>
>>
>>   Is anyone familiar a grad level stats course that is geared towards
>> program evaluation?
>>
>>
>>
>>   Thanks,
>>
>>
>>
>>   Ryan
>>
>>   ===================== To manage your subscription to SPSSX-L, send
>> a
>> message to
>
>> LISTSERV@.UGA
>
>>  (not to SPSSX-L), with no body text except the command. To leave the
>> list, send the command SIGNOFF SPSSX-L For a list of commands to
>> manage subscriptions, send the command INFO REFCARD
>>
>>   ===================== To manage your subscription to SPSSX-L, send
>> a
>> message to
>
>> LISTSERV@.UGA
>
>>  (not to SPSSX-L), with no body text except the command. To leave the
>> list, send the command SIGNOFF SPSSX-L For a list of commands to
>> manage subscriptions, send the command INFO REFCARD
>>
>> =====================
>> To manage your subscription to SPSSX-L, send a message to
>
>> LISTSERV@.UGA
>
>>  (not to SPSSX-L), with no body text except the command. To leave the
>> list, send the command SIGNOFF SPSSX-L For a list of commands to
>> manage subscriptions, send the command INFO REFCARD
>
>
>
>
>
> -----
> --
> Bruce Weaver

> bweaver@

> http://sites.google.com/a/lakeheadu.ca/bweaver/
>
> "When all else fails, RTFM."
>
> NOTE: My Hotmail account is not monitored regularly.
> To send me an e-mail, please use the address shown above.
>
> --
> View this message in context:
> http://spssx-discussion.1045642.n5.nabble.com/Stats-course-geared-towards-Program-Evaluation-tp5728871p5728909.html
> Sent from the SPSSX Discussion mailing list archive at Nabble.com.
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the command. To leave the
> list, send the command SIGNOFF SPSSX-L For a list of commands to
> manage
> subscriptions, send the command INFO REFCARD
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD





-----
--
Bruce Weaver
[hidden email]
http://sites.google.com/a/lakeheadu.ca/bweaver/

"When all else fails, RTFM."

NOTE: My Hotmail account is not monitored regularly.
To send me an e-mail, please use the address shown above.

--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/Stats-course-geared-towards-Program-Evaluation-tp5728871p5728911.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD