Chapter 5 - Distinguishing and Constructing Various Paper and Pencil Test

The video introduces the continuation of the 'Assessment Learning One' lesson, focusing on Module 5: 'Distinguishing and Constructing Various Paper and Pencil Test'. It highlights a study showing that 13% of low grades are caused by faulty test questions, and attributes this to poor question construction, lack of course outline consultation, cost reduction efforts, and the absence of a Table of Specifications (TOS) before test creation. The speaker stresses that TOS should precede test construction. The main objective is to establish a clear understanding of TOS, explain its construction process, identify and distinguish different test types, and construct tests according to guidelines.

The Table of Specifications (TOS) is introduced as a blueprint or map guiding teachers in test construction. It ensures a balance between lower-level thinking skills (LOTS) and higher-order thinking skills (HOTS). Functions of TOS include identifying achievement domains, ensuring fair and representative questions, focusing on important areas, weighting content based on importance, and providing content validity. Benefits include building balanced tests, achieving reliability and validity, giving true weight to each lesson, boosting student confidence, and selecting a representative sample of content. The steps for constructing a TOS are detailed, including determining topics, time allocation, number of items, items per topic, and difficulty levels, along with item placement. Specific time allocations for various question types (true/false, multiple-choice, short answer, essay) are also provided.

The video provides detailed examples of calculating the number of test items and their percentages based on recitation days and total items. It demonstrates how to distribute items across different cognitive levels (knowledge, comprehension, application, analysis, synthesis, evaluation) according to Bloom's Taxonomy, both the original and revised versions. Emphasis is placed on ensuring vertical and horizontal sums of items are correct and accurately representing the percentage of test items from each topic. Placement of test items within different parts of an exam is also illustrated.

The discussion shifts to objective test types, starting with true/false items. These are binomial choice tests, presenting a declarative statement for students to determine if it's true or false. Advantages include ease of writing, quick scoring, objective scoring, and amenability to item analysis. Disadvantages include overestimating learning due to guessing, difficulty in differentiating effective from tricky items, tendency to test trivial facts, and encouraging rote memorization. Guidelines for constructing true/false questions are provided, such as avoiding hints, 'always'/'never' words, trick statements, double negatives, long sentences, and multiple ideas within one question. Statements should be clearly true or false, equal in length, and use simple grammar.

Completion and short answer items are explored, requiring students to fill in a short answer with their own words. Similarities include covering knowledge and comprehension, asking for recall, and answers ranging from keywords to phrases. Differences lie in whether the answer completes a sentence (completion) or answers a question (short answer), and the placement of the blank. Advantages include ease of construction, requiring active recall, quick answering, and providing diagnostic information. Disadvantages cover limited measurement of recall, issues with handwriting and spelling, unintended responses, and less objective scoring. Guidelines emphasize sufficient space for responses, equal blank lengths, and avoiding over-mutilated sentences or open-ended items that have multiple acceptable answers. The blank should be near the end of the sentence, and focus should be on significant items rather than trivial details.

Multiple choice tests are defined as assessments where students select the correct or best answer from a list of options. The components are the stem (question) and options, with incorrect options called distractors or foils. Advantages include versatility in measuring various cognitive levels, less administration time, objective scoring, minimizing irrelevant factors like handwriting, and amenability to item analysis for detecting weaknesses or ambiguities. Disadvantages include being time-consuming to construct plausible options, the 'multiple guess' scenario, limiting students to fixed options rather than generating their own ideas, potential for superficial questions, and dependence on reading and writing abilities. Guidelines for construction include grammatical consistency, reasonable distractors, matching items to objectives, consistent response lengths, and limiting 'all/none of the above' options. Common item problems like queuing, three-for-one split, impurity (apples and oranges), unparallel options, and implicit/outside knowledge are also discussed.

Matching type tests consist of two columns (premises and responses) to be matched by a specified attribute. They are a recognition, structured-response test, often considered a modified multiple-choice type where choices reduce as items are matched. Two classifications are presented: perfect match (open), where the number of premises equals responses, and imperfect match (closed), where premises are fewer than responses (encouraged). Advantages include objective scoring, ease of checking, allowing comparison of related ideas, minimizing impact of poor grammar/handwriting, and generally higher validity and reliability than essay tests due to more extensive sampling. Disadvantages involve difficulty in preparation, measuring only factual knowledge, encouraging rote memory, and allowing guessing. Guidelines for construction include using imperfect matches, placing an entire exercise on one page, randomizing correct answers, ordering responses logically or alphabetically, avoiding verbatim text, ensuring no keywords clue the answer, and preparing a scoring key.

Essay type tests require students to compose lengthy responses, often addressing higher-level cognitive processes like analysis, synthesis, evaluation, and creativity. A key feature is freedom of response. Uses include assessing recall, organization of ideas, written expression, understanding of subject matter, and factual knowledge. Examples of essay questions are provided for various cognitive tasks like comparing, relating cause and effect, justifying, summarizing, generalizing, classifying, inferring, applying, analyzing, evaluating, and creating. Two forms of essay tests are discussed: restricted (short, focused response, limiting both content and response scope) and extended (non-restricted, allowing students to select and organize information freely). Advantages of essay tests include fostering higher-order thinking, assessing complex learning outcomes, promoting problem-solving, improving writing skills, and encouraging creativity. Disadvantages include unreliable and time-consuming scoring, potential for subjective grading, and limited content coverage. Suggestions for construction include restricting use to specific learning outcomes, clear and precise questions, indicating time limits, avoiding optional questions, blind grading, and constructing questions aligned with learning standards. Scoring suggestions emphasize scoring by question rather than by student, disassociating student identity from responses, and pre-determining scoring criteria.

The video concludes with a reminder to consider scoring criteria before grading papers and acknowledges references and sources used for the presentation, including contributions from other educators.