Vistas de página en total

domingo, 9 de junio de 2013

PRINCIPLES OF LANGUAGE ASSESMENT

According with the reding of chapter #2 "Brown, H. D. Principles of languages assesment"  and the analysis of it, I could explore how these principles should and could be applied in formal tests and how some questions can help us to identify five main criteria at the moment of testing a test.
These principles are:
  • Practicality: It is not expensive, it is within appropriate time constraint, it isrelatively easy to administer and scoring/evaluation procedure that is specific and it is time-efficient.
  • Reliability: *"Consistency on assesment results" (Linn and Gronlund)                                                                                   *A test is reliably if: " You give the same test to the same student or matched students in two different occasions, the test should yield similar results." (Brown 2004)                                                                                      Some factors that might influence reliabilityof a test are:                                          * Students- Releated Reliability: The most common lerner related issue in reliability is caused by temporary illness, anxiety, fatigue, a bad day and other physical or phsychological factors.                                                            *Rater Reliability: It has two subdivisions (Inter-rater reliability: when two or more scores yield inconsistent scores of the same test. Some factor could be "lack of attention to scoring, inexperience, inattention") and (Intra-rater reliability: Scoring criteria, fatigue, bias toward particular "good" and "bad" students or simple carelessness)                              *Test Administration Reliability: It can be caused by administration facators. E.g: noisy from outside, photocopying variation, room condition, even condition of desks and chair.                                                                    *Test Reliability:
  • Validity: "Measuring what should be measured"                                      *Content-Related Evidence: If a test examples the subject matter about which conclusions are to be drawn.                                                                       If a test requires the test taker to perform the behavior that is being measured.                                                                                                    *Criterion-Related Evidence: Is used to demostrate the accuracy of a measure or precedure by comparing in with another measure or procedure which has been demostrated to be valid.                                                              *Construct-Related Evidence: How well performance on the assesment can be interpreted as meaningful measure of some characteristics or quality.                                                                                                         *Consequential Validity: How well use of assesment results accomplishes purposes and avoids unintended effect.                                          *Face Validity: It refers  to the degree to which a test looks right, and appears to measure the knowledge or ability it claims to measure, based  on the subjective judgment of the examinees who take it, the administrative personnel who decide on its use, and other psychometrically unsophisticated observers (Mousavi, 2002, p. 244). 
  • Authenticity: In a test, authencity may be present in the following ways: * Te language in the test is as natural as posible.                                            * Items are contextualized  rather than isolated.                                                  * Topics are meaningful: (relevant, interesting) for the learner.                          * Some thematic organization to items is provided, suchs as through a story line or episode.                                                                                    * Task represent, or closely approximate, real-world taks.
  • Washback: Any language test or piece of assessment must have positive washback, by which I mean that the effect of the test on the teaching must be beneficial. This should be held in mind by the test constructors; it is only too easy to construct a test which leads, for example, to candidates learning material by heart or achieving high marks by simply applying test-taking skills rather than genuine language skills.
As a conlusion, testing and assessment occupy a big part of teachers' time and, maybe partly because of this, there is currently great interest in validity issues, washback and in the ethics of testing. More and more tests now have a pre-testing element built in to their construction and, in addition, there is a lot of research into the construction, marking and validation of 'subjective tests'.

2 comentarios:

  1. Lorena, I really appreciate your endeavour for summarizing this topic. I found it interesting and I think this task you did will work for my understanding. Thank you for making this reading digestable and it's a good idea you have done a C-map since our brains decode and memorize information when it is interconected and synthetized.

    As for the principles, there are some innacurate practices on testing. Tests are unpractical when they cost a lot en masse as ECAES and the national teaching contest exam. ICFES may not be reliable if students are not prepared to take exams, it's not matter of mesuring knowledge but exam-taking skills. ECAES exam is usually a mess, it does not mesure what should be measured, what we did not study; it has no validity. Those tests are the most descontextualized examinations, so they lack authenticity. Finally, those State Exams trigger a great impact in people's education and might cause a negative washback effect... students could get frustrated or are meant to give up studying.

    ResponderEliminar
  2. I have a personal idea of standarized tests: they are just a waste of paper and time. There is not point on mesure an average or poor education in terms of quality as public education in Colombia is. I am affraid that if the goverment is sure of providing quality education, it would not be necessary to test it. On the other hand we have the money issue, for me all those standarized tests are a matter of business. It is shocking for me that even teachers-to-be have to take an standarized test, paid on their own, to apply for a job, which in fact anybody, not just graduated teachers, could take.

    ResponderEliminar