Term
| What are the 2 weaknesses associated with the one group pretest post test |
|
Definition
| potential selection bias and measurement bias |
|
|
Term
| What is internal validity defined as? |
|
Definition
|
|
Term
| What does internal validity measure? |
|
Definition
| the degree to which any measured change can be attributed to the program |
|
|
Term
| What is external validity defined as? |
|
Definition
|
|
Term
| What does generalizability refer to? |
|
Definition
| Can results be generalized to other populations |
|
|
Term
| What are the 2 non program related types of bias that interfere with internal validity? |
|
Definition
| maturation and historical bias |
|
|
Term
| What does maturation refer to? |
|
Definition
| natural changes in people due to passing time; differences in being wiser/stronger |
|
|
Term
ID:
Event that takes place between measurements that could influence participants |
|
Definition
|
|
Term
| What are the 4 program-related sources of bias that are somewhat controllable? |
|
Definition
| Attrition, Selection bias (self-selection and researcher selection) and measurement bias |
|
|
Term
| What are the 2 types of measurement bias? |
|
Definition
|
|
Term
| What do you have to do to demonstrate causality? |
|
Definition
| Increase internal validity |
|
|
Term
| What do you have to do to demonstrate causality? |
|
Definition
| Increase internal validity |
|
|
Term
| What 2 methods help increase internal validity? |
|
Definition
| randomization and using quasi-experimental designs |
|
|
Term
| How does randomization eliminate selection bias? |
|
Definition
| It has a control and experimental group |
|
|
Term
| What is another term for attrition? |
|
Definition
|
|
Term
| What is the definition for attrition? |
|
Definition
| drop out of a program before it is over |
|
|
Term
| How can attrition be prevented? |
|
Definition
| by touching base with people and showing that you care about their progress |
|
|
Term
| What is the issue with self-selection? |
|
Definition
| The ppl who volunteer to participate already care about the subject/program |
|
|
Term
| What is the concept behind measurement bias testing? |
|
Definition
| People get better at the test because they've seen it before |
|
|
Term
| What are the 3 things that must be demonstrated to determine causation? |
|
Definition
| time, relationship, and it has to be the only explanation |
|
|
Term
| Describe the concept of time in regards to demonstrating causality? |
|
Definition
| Cause comes before effect; temporal order |
|
|
Term
| Describe the time series design |
|
Definition
| one group; one interruption; multiple observations before and after (assume only interruption is program) |
|
|
Term
| What is the strength of the time series design? |
|
Definition
| useful in examining effects sof new health-related policy |
|
|
Term
| What 2 elements are missing from the control group interrupted time series design? |
|
Definition
| Missing C, E (comparison ad experimental) |
|
|
Term
ID:
plan est for data collection or hypothesis testing |
|
Definition
|
|
Term
| What do research designs attempt to address? |
|
Definition
|
|
Term
|
Definition
|
|
Term
|
Definition
|
|
Term
|
Definition
|
|
Term
|
Definition
| Comparison group; est through any method besides randomization |
|
|
Term
|
Definition
| Intervention applied to the experimental group |
|
|
Term
| What is a research design? |
|
Definition
| plan est for data collection of hypothesis testing |
|
|
Term
| What does a research design ATTEMPT to address? |
|
Definition
|
|
Term
| What are 3 ways of improving causality in designs? |
|
Definition
| groups (control/comparison), measurement (of outcome variables before and after), and minimizing threats to validity |
|
|
Term
| What are the 3 categorizations of eval design? |
|
Definition
| non-experimental, quasi-experimental, and experimental |
|
|
Term
| Describe a non-experimental eval design |
|
Definition
| 1 experimental group but no control or comparison group |
|
|
Term
ID:
includes experimental and comparison group made by methods other than randomization;Observe groups before and after X |
|
Definition
|
|
Term
ID:
includes random assignment of experimental and control group |
|
Definition
|
|
Term
ID:
What is the simplest form of outcome eval |
|
Definition
|
|
Term
| What are the weaknesses of the one shot case study? |
|
Definition
| Does not demonstrate change during/as result of program |
|
|
Term
| Describe the retrospective pretest eval design |
|
Definition
| Participants are asked to recall information before and after the intervention; Recall bias weakness |
|
|
Term
| What are the 3 types of non-experiemtnal eval designs |
|
Definition
| one shot case study; retrospective pretest, one group pretest-post test |
|
|
Term
|
Definition
| One group pretest post test |
|
|
Term
| What are the 2 weaknesses of the one group pretest post test eval? |
|
Definition
| potential selection bias and measurement bias issue |
|
|
Term
| Explain the measurement bias issue |
|
Definition
| the same measurement taken multiple times can lead to bias |
|
|
Term
| What is a cost-effectiveness eval? |
|
Definition
| Helps determine which eval option you should use based on cost |
|
|
Term
| What is the usefulness of the cost effectiveness eval? |
|
Definition
| Determines the rate of return on investment and tells funder what they can expect with the money they put in |
|
|
Term
| What key issues must be determined before conducting a cost-effectiveness eval? |
|
Definition
| Measurement validity and reliability; program fidelity; internal validity of results |
|
|
Term
| What are the 6 steps to making a cost effectiveness eval? |
|
Definition
| Define, cost, collect outcome data, compute program outcomes, conduct analysis and sensitivity |
|
|
Term
| What do you u define when making a cost-effectiveness eval? |
|
Definition
| program outcome indicator; told by goals and objectives |
|
|
Term
| What are the 4 categories of cost for a program? |
|
Definition
| total cost; variable vs fixed; recurring vs non-recurring; direct vs indirect |
|
|
Term
| What do you ask when determining if a cost is fixed or variable? |
|
Definition
| Does the cost change as a result of program activity? |
|
|
Term
| What is the difference between hard money and soft money |
|
Definition
| Hard money comes from the institution soft money comes from grants |
|
|
Term
| What does outcome data describe? |
|
Definition
| percentage of success (how many people reach the goal) |
|
|
Term
| What factors are considered when computing program outcomes |
|
Definition
| were objectives met, benefits, consequences,internal validity issues |
|
|
Term
| when do you consider program outcomes? |
|
Definition
|
|
Term
| the conduct analysis reveals what? |
|
Definition
| cost in relation to outcomes |
|
|
Term
| What is CEA and how is it calculated? |
|
Definition
| cost effectiveness analysis; total program cost/N or % of success |
|
|
Term
| which eval design has an increased dropout rate because it takes a long period of time? |
|
Definition
| control group interrupted time series design |
|
|
Term
| What is a strength of the non-equivalent comparison/control group and why? |
|
Definition
| inclusion of comparison/control group because it reduces maturation differences, historical bias, testing bias, and attrition |
|
|
Term
| What are the 4 threats to external validity? |
|
Definition
| social desirability, expectancy effect, hawthorne effect, placebo effect |
|
|
