Term
| Action research (is an answer) |
|
Definition
| It is research that answers practical questions for more immediate solutions) that focusses on solving practitioners local problems. Most common in education. |
|
|
Term
| Can something be valid but not reliable? |
|
Definition
|
|
Term
| Can something be reliable but not valid? |
|
Definition
|
|
Term
| If you increase the number of items on the exam does it increase the reliability? |
|
Definition
|
|
Term
| If two variables are moving in the same direction, they are said to have... |
|
Definition
|
|
Term
| Sources of researchable problems can be derived from... |
|
Definition
| experience, practice and theory |
|
|
Term
| Confirmatory research is characteristic of... |
|
Definition
| a top down approach (hypothesis, experiment, decision to accept or reject). it uses the deductive method and is characteristic of quantitative research. |
|
|
Term
| What is a mediating or intervening variable? |
|
Definition
| A variable that comes in between other variables, helps to delineate the process through which variable affect one another. (i.e. amount of studying (IV) leads to input and organization of knowledge in long-term memory (mediating variable) which affects test grades (DV).) |
|
|
Term
| A researcher studies and develops a model. She believes that parent involvement has an impact on the motivation to do school work thus in her model higher ___which in turn leads to higher test scores. In the example motivation is what kind of variable? |
|
Definition
|
|
Term
| principles of validity and reliability |
|
Definition
| Validity - the accuracy of the inferences, interpretations, or actions made on the basis of test scores Reliability - the consistency or stability of test scores. |
|
|
Term
| Qualitative research is synonymous with |
|
Definition
- bottom up
- the inductive method
- theory generation approach
- logic of discovery
|
|
|
Term
| Quantitative research is synonymous with |
|
Definition
- top down
- the deductive method
- the traditional theory testing approach
- logic of justification
|
|
|
Term
| Differentiate between experimental, correlational and descriptive studies. |
|
Definition
| Experimental involves manipulation, randomization and controlling something. Correlational research is a form of non-experimental research in which the primary independent variable of interest is a quantitative variable and there is no manipulation. (i.e. SAT scores to GPA). Descriptive studies are studies that attempt to describe the characteristics of a phenomenon (i.e. observation or polls) |
|
|
Term
| What is the makeup of a journal article? |
|
Definition
- title page
- abstract
- introduction
- method --participants --design --procedures
- results
- discussion
- references
|
|
|
Term
|
Definition
Deception is misleading or withholding information from the research participant. Deception is allowed when:
there is minimal risk to participants, participants can or will be debriefed, and it is nor possible to do the study without it. |
|
|
Term
| What makes a good quantitative research question? |
|
Definition
| A question that asks about a relationship that exists between two or more variables (ex. What is the relationship between parent education and student success?) |
|
|
Term
| What makes a good qualitative research question? |
|
Definition
| A question about a process, issue or phenomenon to be explored. It is general, open-ended and overarching. (ex. How does the social context of a school influence pre-service teachers beliefs about the principal?) |
|
|
Term
| What are the characteristics of of experimental research? |
|
Definition
- manipulation
- randomization
- controlling something
|
|
|
Term
| Interpret correlation coefficients. |
|
Definition
| A correlation coefficient is a numerical index of the strength and direction of the relationship between two variables. Strength is no relative to positive or negative. It is more concerned about strength. It can be between -1 and 1, with zero being the weakest. The further away from zero the stronger the relationship. (-.5 is the same "strength" as .5) |
|
|
Term
| How to determine correlation coefficients. |
|
Definition
| A correlation coefficient is a numerical index of the strength and direction of the relationship between two variables. If both variable move in the same direction they are positive. If they move in opposite ways they are negative. |
|
|
Term
| How are research questions developed? |
|
Definition
| It is an extension of the purpose of the study in that it specifies exactly the questions that the researcher will attempt to answer. |
|
|
Term
| What is the nature of science? |
|
Definition
| Science includes any systematic or carefully done actions that are carried out to answer research questions or meet other needs of a developing research domain. Science does not accept face value and taken for granted knowledge. We do not find scientific proof, but rather scientific evidence. (The Principle of Evidence) It is dynamic (not static) Science is a never ending process that includes rational thinking, reliance on empirical observation, constant peer evaluation, critique and - very important - active creativity and attempts at discovery |
|
|
Term
| reasons to review the literature |
|
Definition
| 1. Tell you whether the problem you have identified has already be researched. 2. Give you ideas as to how to proceed and design the study. (And hypotheses too!) 3. Point out methodological problems specific to research questions. 4. Can identify appropriate data collection instruments |
|
|
Term
|
Definition
- variables must be related
- proper time order must be established
- the relationship between variables must not be due to some confounding or third extraneous variable
|
|
|
Term
|
Definition
| research aimed at generating fundamental knowledge and theoretical understanding abut basic human and other natural processes |
|
|
Term
|
Definition
| a form of qualitative research that is focussed on providing a detailed account of one or more cases. |
|
|
Term
| A categorical variable is... |
|
Definition
| a variable that is made up of different types or categories of a phenomenon. (ex. the variable of gender is made up of categories - male and female.) |
|
|
Term
| confounding / extraneous variables are... |
|
Definition
| bad, variables that researcher did not account for! |
|
|
Term
|
Definition
| the process of drawing a conclusion that is necessarily true if the premies are true. Make sure premises are true, use valid argument forms, be careful in making assumptions and drawing conclusions. |
|
|
Term
| two types of quantitative research |
|
Definition
| experimental and non-experimental |
|
|
Term
|
Definition
| the extent to which the study results can be generalized to and across populations of persons, settings, times, outcomes, and treatment variations. |
|
|
Term
|
Definition
| descriptive studies are studies that attempt to describe the characteristics of a phenomenon (i.e. observation or polls) |
|
|
Term
|
Definition
| the ability to make statements about a population based on sample data. |
|
|
Term
|
Definition
| research about people places and events in the past |
|
|
Term
|
Definition
| the process of drawing a conclusion that is probably true. It uses probabilistic reasoning. An issue with this is that things that happened in the past may not happen in the future. |
|
|
Term
|
Definition
| the ability to infer that a a causal relationship exists between two variables. |
|
|
Term
| a moderating variables is... |
|
Definition
| fine. It is a variable that delineates how a relationship of interest changes under different conditions or circumstances. (ex. perhaps the relationship between studying (IV) and test grades (DV) changes according to different levels od use of a drug such as ritalin (moderator)) |
|
|
Term
|
Definition
| a type of qualitative research in which the researcher attempts to understand how one or more individuals experience a phenomenon (ie how kids experience stress) |
|
|
Term
| A quantitative variable is... |
|
Definition
| a variable that varies in degree or amount of a phenomenon. (ex. the variable annual income varies from zero income to a very high income level) |
|
|
Term
|
Definition
| a procedure that makes assignments to conditions on the basis of chance and in this way maximizes the probability that the comparison groups will be equated on all extraneous variables. Randomly assigning a set of people to different groups. |
|
|
Term
|
Definition
| the consistency or stability of test scores. |
|
|
Term
|
Definition
| a method of social research in which there are two kinds of variables. The independent variable is manipulated by the experimenter, and the dependent variable is measured. The signifying characteristic of a true experiment is that it randomly allocates the subjects in order to neutralize the potential for experimenter bias. |
|
|
Term
|
Definition
| the accuracy of the inferences interpretations, or actions made on the basis of test scores |
|
|
Term
| Experimental research is... |
|
Definition
| research in which the researcher MANIPULATES (an intervention studied by a researcher) the independent variable and is interested in showing cause and affect. |
|
|
Term
| Other descriptors or characteristics of Qualitative research... |
|
Definition
- Words-rich narrative
- generally exploratory Research
- key instrument are flexible small, purposive samples
- Focus is on understanding specific-context dependent
- Discovery, Meaning Process oriented
|
|
|
Term
| Other descriptors or characteristics of quantitative research... |
|
Definition
- Numbers-statistical analysis
- Generally confirmatory
- Researcher: outside – ideally, no influence
- High degree of control
- Ideal-large random sample
- Focus on generalizing to larger population
- Test relationships between variables, causation
- Outcome oriented
|
|
|
Term
|
Definition
| All arrows will be in one location but not hit the bulls-eye:[image] |
|
|
Term
|
Definition
arrows scattered all over:
[image]
|
|
|
Term
|
Definition
arrows all hitting the bulls-eye area:
[image]
|
|
|
Term
| Types of qualitative research: |
|
Definition
- phenomenology
- ethnography
- case study
- grounded theory research
- historical
|
|
|
Term
| Qualitizing and Quantitzing: |
|
Definition
| Qualitizing is converting quantitative data into qualitative data. Quantitizing isconverting qualitative data into quantitative data. Neither are encouraged, especially qualitizing. |
|
|
Term
| Quasi-experimental design: |
|
Definition
| an experimental research design that does not provide for full control of potential confounding variables primarily because it does not randomly assign participants to comparison groups. Sometimes it is just nt possible to randomly assign. Dr, J. says when you are lacking any one of the three criterion. If it is lacking 2 or more it s considered non-experimental. |
|
|
Term
|
Definition
| an alteration in performance that occurs in people as a result of being aware of participating in a study |
|
|
Term
|
Definition
| a measure of the consistency of scores over time |
|
|
Term
|
Definition
| the extent to which the study results can be generalized across time |
|
|
Term
| Random Sampling or selection |
|
Definition
| randomly selecting a group of people from a population |
|
|
Term
|
Definition
| the ability to generalize the study results to individuals who were not included in the study |
|
|
Term
|
Definition
| making the argument that because A preceded B, A must have caused B. making conclusions or assumptions after the fact. |
|
|
Term
|
Definition
| A researcher spends extended time with the group as an insider and tells members they are being studied. |
|
|
Term
|
Definition
| researcher spends limited about of time observing group members and tells members they are being studied |
|
|
Term
| **One-group pretest-posttest design is... |
|
Definition
| a research design in which a treatment condition is administered to one group of participants after pretesting, but before posttesting on the dependent variable |
|
|
Term
|
Definition
| equating the comparison groups on one or more variables that are correlated with the dependent variable |
|
|
Term
|
Definition
| any physical or mental change that occurs over time in a participant and affects the participant’s performance on the dependent variable |
|
|
Term
| Interscorer reliability is |
|
Definition
| consistency among different scorers |
|
|
Term
|
Definition
| a qualitative approach to generating and developing a theory from the data that the researcher collects; a general methodology for developing theory that is grounded in data systematically gathered and analyzed |
|
|
Term
|
Definition
| identifying so completely with the group being studied that you can no longer remain objective |
|
|
Term
| Investigator Triangulation |
|
Definition
| the use of multiple investigators in collecting and interpreting the data |
|
|
Term
|
Definition
| the use of multiple research methods |
|
|
Term
|
Definition
| the use of multiple theories and perspectives to help interpret and explain the data |
|
|
Term
|
Definition
| the use of multiple data sources |
|
|
Term
| **Presence or absence technique |
|
Definition
| manipulating the independent variable by presenting one group the treatment condition and withholding it from the other group |
|
|
Term
|
Definition
| the ability to generalize the study results across settings |
|
|
Term
| Disproportional stratified sampling |
|
Definition
| type of stratified sampling in which the sample proportions are made to be different from the population proportions on the stratification variable |
|
|
Term
|
Definition
| the study of the cultural past of a group of people |
|
|
Term
|
Definition
| judging people from a different culture according to the standards of your own culture |
|
|
Term
|
Definition
| a system of shared beliefs, values, practices, perspectives, folk knowledge, language, norms, rituals, and material objects and artifacts that the members of a group use in understanding their world and in relating to others |
|
|
Term
|
Definition
| administering the experimental treatment conditions to all comparison groups, but in a different order |
|
|
Term
|
Definition
| people who are available, volunteer, or can be easily recruited are included in the sample |
|
|
Term
|
Definition
| — researcher becomes member of group being studied and does not tell members they are being studied |
|
|
Term
|
Definition
| researcher observes as an outsider and does not tell the people they are being observed |
|
|
Term
|
Definition
| loss of people who do not complete the experiment |
|
|
Term
|
Definition
| manipulating the independent variable by giving the various comparison groups different amounts of the independent variable |
|
|
Term
|
Definition
| data are collected at a single point in time |
|
|
Term
|
Definition
| data are collected at multiple time points and comparisons are made across time |
|
|
Term
|
Definition
| the group that does not receive the experimental treatment condition |
|
|
Term
|
Definition
| dividing the population into mutually exclusive groups and then selecting a random sample from each group |
|
|
Term
|
Definition
| a procedure that makes assignments to conditions on the basis of chance and in this way maximizes the probability that the comparison groups will be equated on all extraneous variables |
|
|
Term
|
Definition
| randomly selecting a group of people from a population |
|
|
Term
|
Definition
| a scale of measurement that uses symbols, such as words or numbers, to label, classify, or identify people or objects |
|
|
Term
|
Definition
| a rank-order scale of measurement |
|
|
Term
|
Definition
| a scale of measurement that has equal intervals of distances between adjacent numbers |
|
|
Term
|
Definition
| a scale of measurement that has a true zero point as well as the characteristics of the nominal (labeling), ordinal (rank ordering), and interval (equal distance) scales |
|
|
Term
|
Definition
| Nominal Ordinal Interval Ratio |
|
|
Term
| AN answer on the test will be |
|
Definition
|
|
Term
| assume psychological constructs are |
|
Definition
|
|
Term
| principles of validity reliability |
|
Definition
| reliability - does your measurement yield consistent results? Consistency or stability of test scores |
|
|
Term
| Inter-rater OR Inter-observer reliability |
|
Definition
| the degree of agreement or consistency between two or more scorers, judges, or raters |
|
|
Term
|
Definition
| a measure of the consistency of scores over time |
|
|
Term
|
Definition
| are the two most important psychometric properties to consider in using a test or assessment procedure. Reliability refers to the consistency or stability of the test scores, and validity refers to the accuracy of the inferences or interpretations you make from the test scores. |
|
|
Term
| equivalent forms reliability |
|
Definition
| — the consistency of a group of individuals’ scores on two equivalent forms of a test measuring the same thing |
|
|
Term
|
Definition
| a measure of the consistency of the scores obtained from two equivalent halves of the same test One problem of split-half procedure is that different results can be obtained from different ways of subdividing the test. |
|
|
Term
| Content-related evidence — |
|
Definition
| validity evidence based on a judgment of the degree to which the items, tasks, or questions on a test adequately represent the construct domain of interest. |
|
|
Term
| Criterion-related validity evidence |
|
Definition
| validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance |
|
|
Term
| Concurrent validity evidence |
|
Definition
| validity evidence based on the relationship between test scores and criterion scores obtained at the same time |
|
|
Term
| Predictive validity evidence |
|
Definition
| validity evidence based on the relationship between test scores collected at one point in time and criterion scores occurring at a later time |
|
|
Term
|
Definition
| validity evidence based on the relationship between the focal test scores and independent measures of the same construct |
|
|
Term
|
Definition
| — evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs |
|
|
Term
|
Definition
| the specific group for which the test publisher or researcher provides evidence for test validity and reliability |
|
|
Term
|
Definition
| a test-taking method in which the participants check or rate the degree to which various characteristics are descriptive of themselves |
|
|
Term
| methods of data collection |
|
Definition
| each had + and -...none are perfect |
|
|
Term
|
Definition
| Tests Questionnaires Interviews Focus groups Observation Existing or Secondary data |
|
|
Term
|
Definition
| (i.e., includes standardized tests that usually include information on reliability, validity, and norms; tests constructed by researchers for specific purposes, skills tests, etc). |
|
|
Term
|
Definition
◦Can measure many characteristics of people.
◦Often standardized.
◦Allows comparability of common measures across research populations.
◦Strong psychometric properties (validity).
◦Can be administered to groups.
◦Response rate is high for group administered tests.
◦Ease of data analysis because of quantitative nature of data.
|
|
|
Term
|
Definition
| Can be expensive if test must be purchased. Reactive effects such as social desirability can occur. Test may not be appropriate for a local or unique population. Open-ended questions and probing not available. Tests are sometimes biased against certain groups of people. Missing data. |
|
|
Term
| strength and weaknesses of 3 types |
|
Definition
|
|
Term
| when to use quasi experimental studies |
|
Definition
| when random assignment is not feasible, ethical, o affordable. also when population size is very small |
|
|
Term
|
Definition
| is the most important technique that can be used to control confounding variables because it has the ability to control for both known and unknown confounding extraneous variables. Random assignment makes the groups similar on all variables at the start of the experiment. If random assignment is successful, the groups will be mirror images of each other. |
|
|
Term
|
Definition
| used to control for sequencing effects (like order and carryover). This technique is only relevant for a design in which the participants receive more than one treatment condition (e.g., repeated measures design). Latin Square* |
|
|
Term
|
Definition
| Science includes any systematic or carefully done actions that are carried out to answer research questions or meet other needs of a developing research domain |
|
|
Term
| assumptions about the nature of science |
|
Definition
| nature is orderly we can know nature all phenomena have natural causes nothing is elf evident or assumed to be true knowledge is empirical and superior |
|
|
Term
| Descriptive nonexperimental research |
|
Definition
| is used to provide a picture of the status or characteristics of a situation or phenomenon (e.g., what kind of personality do teachers tend to have based on the Myers-Briggs test?). |
|
|
Term
| Predictive nonexperimental research |
|
Definition
| is used to predict the future status of one or more dependent variables (e.g., What variables predict who will drop out of high school?). |
|
|
Term
| Explanatory nonexperimental research |
|
Definition
| h is used to explain how and why a phenomenon operates as it does. Interest is in cause-and-effect relationships. |
|
|
Term
| language is most important in |
|
Definition
|
|
Term
|
Definition
|
|
Term
| random selection and random assignment |
|
Definition
| page 240 - random selection is another word for random sampling and is the random selection of people form a population. Is like pulling names form a hat. Random assignment is taking a set of people and randomly assigning them to groups in the experiment. |
|
|
Term
|
Definition
|
|
Term
| Analysis of covariance (ANCOVA) |
|
Definition
| a statistical method that can be used to statistically equate groups that differ on a pretest or some other variable; a statistical method that used to examine the relationship between one categorical independent variable and one quantitative dependent variable controlling for one or more extraneous variables |
|
|
Term
| One group post test design |
|
Definition
| a research design in which a treatment condition is administered to one group of participants after pretesting, but before posttesting on the dependent variable |
|
|
Term
|
Definition
| any event, other than a planned treatment event, that occurs between the pretest and posttest measurement of the dependent variable and influences the post measurement of the dependent variable |
|
|
Term
|
Definition
| any physical or mental change that occurs over time in a participant and affects the participant’s performance on the dependent variable |
|
|
Term
|
Definition
| any change that occurs in the way the dependent variable is measured. |
|
|
Term
| threats to internal validity |
|
Definition
| (greatest in one group post test design) ambiguous temporal precedence testing instrumentation regression artifact (really more of a expectation) differential selection differential attrition history maturation |
|
|
Term
| Threats to external validity |
|
Definition
population validity
ecological validity
temporal validity
treatment variation validity
outcome validity |
|
|
Term
|
Definition
| the researcher specifies the characteristics of the population of interest and locates individuals with those characteristics |
|
|
Term
|
Definition
| occurs when an event occurring between the pretest and posttest differentially affects the different comparison groups |
|
|
Term
| Selection-instrumentation effect |
|
Definition
| may exist if the nature of the dependent variable or the way it is measured varies across the nonequivalent groups |
|
|
Term
| Selection-maturation effect |
|
Definition
| occurs when different comparison groups experience a different rate of change on a maturation variable |
|
|
Term
| Selection-regression effect |
|
Definition
| may exist if the two groups are from different populations such as the experimental treatment group being from a population of individuals with low reading scores and the comparison group being from a population of individuals with high reading scores |
|
|
Term
|
Definition
| biasing effects that can occur when each participant must participate in each experimental treatment condition |
|
|
Term
|
Definition
| the variable on which the population is divided |
|
|
Term
|
Definition
| manipulating the independent variable by varying the type of variable presented to the different comparison groups |
|
|
Term
| stratified random sampling is |
|
Definition
when a group is divided up into exclusive groups (men v. women) where sex would be the stratification variable
stratified sampling may be proportionate or disproportionate
|
|
|
