Thursday, November 17, 2011

Chapter 8: Administering Assessment

Considerations Prior to Test Administration
·         Scheduling Test
·         Providing Information to Students
·         Academic Dishonesty
·         Physical Setting
·         Test Assembly
·         Answer Sheets
·         Supplies

Test Administration

·         Time: Tell students how long they have at the beginning of the test, and give them time announcements throughout the exam to help them budget their time more effectively.
While collecting papers, check that each student’s paper is filled out correctly: name on all pages of test paper, all sections of the test completed, and all parts of the test present. Make notes of any irregularities.
·         Administrator’s Role: It is recommended that the test administrator (usually the teacher) maintain a friendly but stern demeanor. Make it known to students that you will not tolerate cheating or misbehavior during the test.
·         Test Security: Remind students about the test conditions. Rules that you might want to institute include no talking, no cellphone calls or text messaging, and the correct procedure for asking a question. Before the test begins, remind students of the penalty for cheating.
·         Grading: The most common grade system is the letter grades A being the highest grade, then B, C, D, and F the lowest. Numerical grades are common, and they are usually expressed in percentage form. Often numerical percentages grades are translated into a letter grade. A third type of grading system is Pass/Fail. Some institutions uses a new type of grading for which students agree to complete agree to complete work at a certain standard for a set grade.

·         Grade Availability and Expectations: Inform students when their results will be available. In some situations, teachers are not allowed to release grades until the school administration approves them. If you work in the situation, make it clear you must abide by the rules and cannot disclose student grade.  Also inform students about your school’s policy on challenging grades or asking for a review of the test paper. Stress the importance of fairness and accountability.


Issues in Test Administration
Surprise Test/Pop Quizzes
A good program does not have surprises. It should be transparent to all involve. Surprise tests or pop quizzes have no place in an assessment program as students have no chance to prepare for them. Students should always know when they are going to be tested, what are they going to be tested on, and how they will be tested. Never administer test or quizzes as punishment or to discipline unruly students.
Latecomers
Students who arrive late for the test should not be allowed to take it. You should inform them of the date and time of the make – up exam if applicable and send them to the principal’s or college administrator’s office to wait out the exam. If you do not do this, the latecomer who is allowed to take the exam and who does poorly could complain that his or her tardiness affected the grade.
Incident Reports
A mechanism should be in place to record and report unusual behavior or events that occur during a test administration. Hang a “Test in Progress” sing on your door to prevent needless interruptions.
Accommodations Policy
Make sure you have an accommodations policy for students who have medical problems or are physically challenged.

The Advantages of Rubrics


What is a rubric?

A rubric is a scoring guide that seeks to evaluate a student`s performance based on the sum of all range of criteria rather than a single numerical score.
A rubric is an authentic assessment tool used to measure student’s work. Authentic assessment is used to evaluate students work by measuring the product according to real life criteria.
A rubric is a working guide for students and teachers, usually handed out before the assignment begins on order to get students to think about the criteria on which their work will be judge.
Why use rubrics?
Many experts believe that rubrics improve students’ end product and therefore increase learning. When teacher evaluate papers or projects, they know implicitly what makes a good final product and why. When students receive rubrics beforehand, they understand how they will be evaluate and can prepare accordingly. Developing a grid and making it available as a tool for students0 use will provide scaffolding necessary to improve the quality of their work and increase their knowledge.
There are many advantages to using rubrics:
·         Teachers can increase the quality of their direct instruction by providing focus, emphasis, and attention to particular details as a model for students.
·         Students have explicit guidelines regarding teachers’ expectations.
·         Students can use rubrics as a tool to develop their abilities.
·         Teachers can reuse rubrics for various activities.


Create an Original Rubric
Learning to create rubrics is like learning anything valuable. It takes an initial time investment. Once the task becomes second nature, it actually saves the time while creating a higher quality students product.  The following template will help you get started:
·         Determine the concepts to be taught. What are the essential learning objectives?
·         Choose the criteria to be evaluated. Name the evidence to be produced.
·         Developed grid. Plug in the concepts and criteria.
·         Share the rubric with students before they begin writing.
·         Evaluate the end product. Compare individual students` work with the rubric to determine whether they have mastered the content.

Analytic vs. Holistic Rubrics
Analytic rubrics identify and assess components of a finished product and holistic rubrics assess students work as a whole.
Which one is better?
Neither rubric is better than the other. Both have a place in authentic assessment, depending on the following:
·         Who is being taught? Because there is less detail to analyze in the holistic rubric, younger students may be able to integrate it into their schema better than the analytic rubric.
·         How many teachers are scoring the product? Different teachers have different ideas about what constitutes acceptable criteria.  The extra detail in the analytic rubric will help multiple grades emphasize the same criteria.
What is a weighted rubric?
It is an analytic rubric in which certain concepts are judged more heavily than others. If, in a creative writing assignment, a teacher stresses character development, he or she might consider weighing the characters part of the rubric more heavily than the plot or setting.

Chapter 7: Student Test Taking Strategies


In today's universities, grades are substantially determined by test results. So much importance is placed on students' test results that often just the word "test" makes students afraid. The best way for students to overcome this feeling of fear or nervousness is to prepare themselves with test-taking strategies. This process should begin during the first week of each semester and continue throughout the school year. The key to successful test taking lies in a student's ability to use time wisely and to develop practical study habits.
Actually, effective test-taking strategies are synonymous with effective learning strategies. This section is intended to provide suggestions for long-term successful learning techniques and test-taking strategies, not quick "tricks". There is nothing that can replace the development of good study skills.
The following steps will help students approach tests with confidence:

·         Make a semester study plan.
·         Come to class regularly.
·         Use good review techniques.
·         Organize pre-exam hours wisely.
·         Plan out how to take the exam.
·         Use strategies appropriate to the skill area.
·         Learn from each exam experience.

Make A Semester Study Plan
Students need to plan their study time for each week of their courses. They should make schedules for themselves and revise these schedules when necessary. These schedules should:

·         BE REALISTIC. Keep a balance between classes and studying. Block out space for study time, class time, family time and recreation time.

·         INCLUDE A STUDY PLACE. Finding a good place to study will help students get started; don't forget to have all the materials needed (i.e. pens, paper, textbooks, highlighter pens etc.).

·         INCLUDE A DAILY STUDY TIME. Students forget things almost at once after learning them, so they should immediately review materials learned in class. Students should go over the main points from each class and/or textbooks for a few minutes each night. Encourage students to do homework assignments during this time as a good way to remember important points made in class.
Attend Class Regularly
In order for language learning to take place, students need to come to class on a regular basis. It is not surprising to note that poor attendance correlates highly with poor test results.
Teachers need to point out early in the semester what constitutes legitimate reasons to be absent and stress the advantages of regular attendance.

Use Good Review Techniques
If students make a semester study plan and follow it, preparing for exams should really be a matter of reviewing materials. Research shows that the time spent reviewing should be no more than 15 minutes for weekly quizzes, 2 to 3 hours for a midterm exam, and 5 to 8 hours for a final exam.

When reviewing for a test, students should do the following:
·         PLAN REVIEW SESSIONS. Look at the course outline, notes and textbooks. What are the major topics? Make a list of them. How much time was spent on each of these topics in class? Did the teacher note that some topics were more important than others? If so, these should be emphasized in review sessions.
·         TAKE THE PRACTICE EXAM. By taking the practice exam students will have an idea of the tasks/activities that they will encounter on the real exam. They will also know the point allocation for each section. This information can help them plan their time wisely.
·         REVIEW WITH FRIENDS. Another way of studying for an exam is to create a "study group". By studying with friends there is the advantage of sharing information with others who are reviewing the same material. A study group, however, should not take the place of studying individually.

Organize Pre-Exam Hours Wisely
Students who have regularly reviewed course materials throughout the semester don't have to "cram" at the last minute. They can concentrate their efforts on particular areas of difficulty and conduct an overall review of the material to be tested.
Physical and mental fitness are important considerations for good test taking. These can be best achieved by making sure that the student has adequate rest and nutrition in the hours preceding the exam. A well-rested and well-fed student who has prepared thoroughly is likely to be calm and self-confident, two other important factors for successful test taking.
Some teachers have found it useful to encourage students in stress-reducing activities.

Strategize Your Exam Plan
An important factor in test taking is exam planning. Students should arrive early at the designated exam room and find a seat. All books and personal effects (with the exception of student ID cards and writing materials) should be left at the front of the room. Students should come prepared with several pens or pencils and an eraser.
As soon as the exams have been distributed and students have been told to start the exam, the student should write his/her name and ID number on all pages of the test paper.
If one section is given first, such as the listening portion of English exams, the student should focus attention on this section. With any section of the exam, the student is well-advised to do an overview of the questions, their values, and the tasks required. At this point, students should determine if the exam must be done in order (i.e. listening first) or if they can skip around between sections. The latter is not possible on some standardized exams where students must complete one section before moving on to the next.
An important consideration in effective test taking is time management. When exams are written, review time is usually factored into the overall exam design. Students should be encouraged to allocate their time proportional to the value of each exam section and to allow time to review their work. Teachers when proctoring can assist students with time management by alerting them to time remaining in the exam. Computer based tests (such as the new TOEFL) often show a countdown of the remaining time. Students should be made aware of this feature during the practice exams.
A recent research project investigating the reading skills of English students has yielded several disturbing findings. First, students frequently fail to read directions or read them superficially. Teachers can acquaint students with the requisite metalanguage of rubrics, and encourage them to emphasize the important points of the task. For example, teachers should point out that reading for main ideas requires very different strategies than scanning for specific information. Brainstorm with your students on the key terms found in rubrics.
Another finding in this project is the fact that students don't spend enough time on the reading and that they don't refer back to the text as often as they perhaps should. Again, when students are reading for specific detail, it is important that they refer back to the main text for each question.





Use Strategies Appropriate To The Skill Area

Teachers should train students in effective strategies for the various skill areas to be tested. Important activities (i.e. like note-taking for listening and writing tasks) should be demonstrated to students during classroom activities. Representative strategies for English skill areas will be modeled in today's workshop.

Learn From Each Exam Experience.
Each test should be a learning experience. Go over test results with students. Teachers should note specific students' strengths and weaknesses. The analyses that teachers receive right after computer-based exams provide teachers with invaluable information in a timely manner. Teachers should use this information to send students to student support services for remediation.
Each exam that the students take should help them do better on the next one.