Term
| State the purpose of the testing program |
|
Definition
| Assess the trainee's achievement of learning objectives |
|
|
Term
| State the roles and responsibilities of the following for an effective testing program: 1. NETC (big Navy) 2. NETC N7 (big Navy) 3. Learning center CO (big Navy) 4. Learning center director of training (IOWA) 5. Learning center LSO (IOWA) 6. CCMM (IOWA) 7. Curriculum developer (IOWA) 8. Learning site CO/OIC (school house) 9. Learning site testing officer (school house) 10. Course supervisor (school house) 11. Participating activity (school house) |
|
Definition
| 1. Policy and guidance 2. Oversight of policy and guidance 3. Serves as CCA 4. Ensures testing programs are conducted 5. Guidance to curriculum development and testing/ Approve KTAGS & PTAGS 6. Approves test design / Maintains master test banks 7. Designs and develops testing plan 8. Implements testing plan (TTD department head) 9. Test admin,Oversees grading and maintain test banks (DIVO) 10. Ensures, monitors, validates admin and test item analysis (Chief) 11. Provides feedback (students) |
|
|
Term
| State the primary course source data for creating test items |
|
Definition
| JDAT, OCCSTD's, CTTL, PPP table and a COI |
|
|
Term
| List usable course source data to be used when the primary course source data is not available or has not been created |
|
Definition
| Combination of OCCSTD's, STTL, PPP table and COI |
|
|
Term
Define the following tests:
1. Formal
2. Informal |
|
Definition
1. Graded for final grade
2. Does not count toward final grade |
|
|
Term
Define 3 levels of proficiency levels of:
1. Skill
2. Knowledge |
|
Definition
1. Imitation, repetition, habit
2. Knowledge/comprehension, application/analysis, synthesis/evaluation |
|
|
Term
| 5 categories of performance and knowledge tests? |
|
Definition
Pretest
Progress
Comprehensive test
Oral test
Quiz |
|
|
Term
| Discuss the process of a piloting test |
|
Definition
1. SME revises it
2. CCMM forwards to LSO for approval
3. Test trainee's that are in the end stages
4. Survey training test results using test item analysis |
|
|
Term
Describe the use of each test instrument as they relate to knowledge and performance tests:
1. Job sheet
2. Problem sheet
3. Assignment sheet
4. Multiple choice
5. True/False
6. Matching
7. Completion
8. Labeling
9. Essay
10. Case study
11. Validation of test instruments |
|
Definition
1. Step by step performance
2. presents problems to use decision making
3. Direct study or homework efforts of trainee
4. Most versatile of all knowledge test formats
5. Only 2 answers
6. 2 lists of connected words
7. Trainees give the missing info from memory
8. Names on pictures, diagrams or drawings
9. Written response
10. Complex issues and comprehensive understanding of material is required
11. Content must be validated |
|
|
Term
| What are the 2 types of testing materials used in training? |
|
Definition
1. Criterion - referenced test (assesses if skill is met)
2. Norm-referenced - estimates skill/ knowledge level |
|
|
Term
| Discuss test failure policies and associated grading criteria within your learning environment |
|
Definition
1. Re-train, re-test
2. If passed, highest score is 80% |
|
|
Term
| Discuss during performance test design how the skill learning objectives critically is determined |
|
Definition
1. Using job sheets
2. Measures how useful to determine how critical (1=low, 2=moderate, 3=high) |
|
|
Term
| Discuss during knowledge test design how the knowledge LO critically is determined to perform a task |
|
Definition
|
|
Term
| Identify the 10 sections of a testing plan |
|
Definition
Course data
Course roles and responsibilities
Course waivers
Test development
Test admin
Course test and test types
Grading criteria
Remediation
Test and test item analysis
Documentation |
|
|
Term
| State the purpose of test and test item analysis |
|
Definition
| To determine statistical validity |
|
|
Term
| In a remediation program, discuss what the primary and secondary goals are |
|
Definition
1. Primary goal is to motivate
2. Secondary goal is to remove barriers to learning |
|
|
Term
Discuss the 3 methods of remediation available to instructors:
1. Targeted
2. Scalable
3. Interactive |
|
Definition
1. 1 on 1 with SME going over area of difficulty using test or lab
2. 1 on 1 with SME using total recall and using text, lab material, flashcards
3. 1 on 1 with SME using total recall and all available means of study material and using a minimum of 20 questions per each objective area with a total of 80% and complete practice exams |
|
|
Term
Define the following sections of a remediation program:
1. Re-test
2. Setback
3. Drop from training and activities
4. Counseling
5. ARB |
|
Definition
1. Student re-takes failed test either portion of difficulty or entire test
2. Failed test 2 times - decision should be made on the degree of difficulty the trainee had
3. Every effort was exhausted - academic drop, non-academic drop, disenrollment or discharge
4. "A" and "C" schools to review performance and personal problems
5. Last resort
- Average is below minimum passing grade
- Unable to achieve objective after all remediation
- Trainee performs objectives after all remediation
- Fails to achieve objectives after setback |
|
|
