Term
| at its most basic level program eval is |
|
Definition
| Applying common sense practice settings with organized efforts |
|
|
Term
| What is the "Big Picture" reason to eval a program? |
|
Definition
|
|
Term
| What is the business of health ed? |
|
Definition
| Changing behavior through health programs |
|
|
Term
| What two things occured as a result of the National Research Act? |
|
Definition
| IRB formation (Institutional Review Board) and the Belmont Report |
|
|
Term
| What are the 3 F's of program planning? |
|
Definition
| Flexibility, Fluidity, and Functionality |
|
|
Term
| What are the 5 factors common to all planning models? |
|
Definition
Assessment
goals and objectives
plan/develop
implementation
evaluation |
|
|
Term
| A need can't be defined without what? |
|
Definition
| social context of those involved |
|
|
Term
| How does assessing need practically help us? |
|
Definition
| resource allocation; program planning; program dev; program eval |
|
|
Term
| Describe the PRECEDE-PROCEED Model |
|
Definition
starts at the goal
genetics component was recently added |
|
|
Term
| Formative evals are mainly concerned with ____ |
|
Definition
|
|
Term
| What is the main purpose of formative eval? |
|
Definition
|
|
Term
| Formative Eval grounds intervention in ___ |
|
Definition
|
|
Term
| Process evals are concerned with ____ |
|
Definition
|
|
Term
| What is the purpose of process eval? |
|
Definition
| verify what the program is and whether it was delivered to the target audience |
|
|
Term
| Process eval is concerned with program ___ while formative eval is concerned with program ____ |
|
Definition
|
|
Term
| What are the 3 main goals of process eval? |
|
Definition
| program description, monitoring and quality assurance |
|
|
Term
ID:
Incorrectly rejecting the null hypothesis |
|
Definition
|
|
Term
ID:
failing to reject a null that should be rejected |
|
Definition
|
|
Term
ID:
the program assessed events that it was not intended to |
|
Definition
|
|
Term
| Which eval process is concerned with the context of program development? |
|
Definition
|
|
Term
ID:
determines if program failure is due to a poor program or poor implementation |
|
Definition
|
|
Term
| What are the 2 types of theories/models? |
|
Definition
| planning models and behavior change theories |
|
|
Term
| What is the concise definition of a theory? |
|
Definition
| systematic way of understanding events/situations |
|
|
Term
|
Definition
| use several theories to help understand a certain problem in a certain setting |
|
|
Term
|
Definition
| schematic way to portray relationships bet goals and outcomes |
|
|
Term
| a logic model represents a ___ ____ relationship |
|
Definition
|
|
Term
| standards can be set by what 5 things? |
|
Definition
Comparisons with other programs
Input from experts in the field
Available data sets / other studies
Published and unpublished literature
Economic evaluations |
|
|
Term
| What are the 4 elements of a measurable objective? |
|
Definition
| What; when; who; how much |
|
|
Term
| Qualitative researchers are interested in ___ |
|
Definition
|
|
Term
| Qualitative concentrates on ___ and ____ |
|
Definition
|
|
Term
| What is the primary instrument for data collection and analysis? |
|
Definition
|
|
Term
| What are the 2 interview methods? |
|
Definition
|
|
Term
| What is the core essence of validity? |
|
Definition
|
|
Term
| What are the 4 types of validity? |
|
Definition
| Face, Content, Criterion, construct |
|
|
Term
| what 2 types of validity are said to be subjective? |
|
Definition
|
|
Term
| What is the core essence of reliability? |
|
Definition
|
|
Term
| What are two examples of reliability? |
|
Definition
| internal consistency; test-retest |
|
|
Term
T/F:
Validity is more important that reliability |
|
Definition
| True;If instrument doesn’t measure what it’s supposed to then reliability is irrelevant |
|
|
Term
| What are the 3 categories of purpose for instrument design? |
|
Definition
|
|
Term
| What are the 2 test specifications for designing an instrument? |
|
Definition
| self-completion questionaire and mail surveys |
|
|
Term
| What are the 2 weaknesses associated with the one group pretest post test |
|
Definition
| potential selection bias and measurement bias |
|
|
Term
| What is internal validity defined as? |
|
Definition
|
|
Term
| What is external validity defined as? |
|
Definition
|
|
Term
ID:
Event that takes place between measurements that could influence participants |
|
Definition
|
|
Term
| What are the 2 types of measurement bias? |
|
Definition
|
|
Term
| What is the definition for attrition? |
|
Definition
| drop out of a program before it is over |
|
|
Term
| What is the concept behind measurement bias testing? |
|
Definition
| People get better at the test because they've seen it before |
|
|
Term
| What are the 3 things that must be demonstrated to determine causation? |
|
Definition
| time, relationship, and it has to be the only explanation |
|
|
Term
| Describe the time series design |
|
Definition
| one group; one interruption; multiple observations before and after (assume only interruption is program) |
|
|
Term
| What is the strength of the time series design? |
|
Definition
| useful in examining effects sof new health-related policy |
|
|
Term
ID:
plan est for data collection or hypothesis testing |
|
Definition
|
|
Term
| What do research designs attempt to address? |
|
Definition
|
|
Term
|
Definition
|
|
Term
|
Definition
| Comparison group; est through any method besides randomization |
|
|
Term
| What does a research design ATTEMPT to address? |
|
Definition
|
|
Term
| Describe a non-experimental eval design |
|
Definition
| 1 experimental group but no control or comparison group |
|
|
Term
ID:
includes experimental and comparison group made by methods other than randomization;Observe groups before and after X |
|
Definition
|
|
Term
ID:
includes random assignment of experimental and control group |
|
Definition
|
|
Term
ID:
What is the simplest form of outcome eval |
|
Definition
|
|
Term
|
Definition
| One group pretest post test |
|
|
Term
| What are the 2 weaknesses of the one group pretest post test eval? |
|
Definition
| potential selection bias and measurement bias issue |
|
|
Term
| What key issues must be determined before conducting a cost-effectiveness eval? |
|
Definition
| Measurement validity and reliability; program fidelity; internal validity of results |
|
|
Term
| What are the 6 steps to making a cost effectiveness eval? |
|
Definition
| Define, cost, collect outcome data, compute program outcomes, conduct analysis and sensitivity |
|
|
Term
| What factors are considered when computing program outcomes |
|
Definition
| were objectives met, benefits, consequences,internal validity issues |
|
|
Term
| What is CEA and how is it calculated? |
|
Definition
| cost effectiveness analysis; total program cost/N or % of success |
|
|
Term
| which eval design has an increased dropout rate because it takes a long period of time? |
|
Definition
| control group interrupted time series design |
|
|
Term
| What is a strength of the non-equivalent comparison/control group and why? |
|
Definition
| inclusion of comparison/control group because it reduces maturation differences, historical bias, testing bias, and attrition |
|
|
Term
| What are the 4 threats to external validity? |
|
Definition
| social desirability, expectancy effect, hawthorne effect, placebo effect |
|
|
Term
T/F:
Community based needs assessment is defined as seeking to influence a community as a whole |
|
Definition
|
|
Term
| What is the correct order of steps when considering the framework for designing eval instruments? |
|
Definition
| purpose, test specifications, pool of items, Dilman's state of pretesting, final form of instrument |
|
|
Term
| Formative evals are primarily concerned with _______ while on the other hand process evals are primarily concerned with ____ |
|
Definition
| feasibility; delivery of services |
|
|
Term
| A ____ can provide a general explanation of why people act or do not act to maintain and/or promote their health |
|
Definition
|
|
Term
| State all the steps in a needs assessment and why assessing need is vital for a program |
|
Definition
Understand purpose, level of assessment, budget and resources, time allotted
ID specific info needed
Det whether info already exist or can be obtained with current resources
Design methodology
Collect and analyze data
Prepare the report
Disseminate results
Gives measure against which program implementation and outcome will be compared |
|
|
Term
| What is not present in a measurable objective? |
|
Definition
|
|
Term
| What is the formula for CEA and its meaning? |
|
Definition
| total cost/success (# or %); Cost effectiveness analysis |
|
|
Term
| T/F: a process eval is concerned with feasibility |
|
Definition
|
|
Term
| What 3 concepts must be related to demonstrate causality? |
|
Definition
| time (cause before effect) relationships ( more cause=more effect), only explanation |
|
|
Term
| What type of eval is concerned with feasibility? |
|
Definition
|
|
Term
| What type of validity is not a subjective opinion? |
|
Definition
|
|
Term
| 4. What are the 3 major components of informed consent and when is consent considered voluntary? |
|
Definition
| Informative comprehension voluntary involvement |
|
|
Term
| What are the different types of needs assessments? |
|
Definition
| Normative, perceived, relative, expressed |
|
|
Term
| What is the purpose of a program veal? |
|
Definition
| To determine worth or merit and to change behavior |
|
|
Term
T/F:
The program planning process is driven by the program's goals and objectives |
|
Definition
| False; driven by needs assessment |
|
|
Term
| Which theory component fits the following description: concepts developed for use in a particular theory |
|
Definition
|
|
Term
| List the 6 stages of the Transtheoretical Model in the order they occur |
|
Definition
| Pre-contemplation Pre Action Maintenance termination |
|
|
Term
| Names the 3 ethical principles of the Belmont report |
|
Definition
| Respect for persons, beneficience, justice |
|
|
