Developing tests for academic listening & speaking

By Erlyn Baack - ITESM, Campus Queretaro, Mexico

A teacher asked about "Listening/Speaking exams to assess low intermediate students if they are ready for high intermediate level and then high intermediate students if they are ready for advanced level of ESL. Putting an emphasis on better academic preparation, in Listening we stress listening to lectures and note-taking, and in Speaking, we stress academic vocabulary, grammar correctness, and presentation techniques. We consider (1) exam content, (2) testing efficiency considering the number of students, (3) a rubric for Listening/Speaking, (4) involvement of outside instructors to make testing more objective.

The teacher asked a whole series of interrelated questions involving testing of 40 low intermediate and 80 high intermediate students, and while the questions were specifically about "Listening/Speaking exams, the emphasis is much broader including listening and note-taking and academic vocabulary, grammar correctness, and presentation techniques.

Those questions, therefore, are all-encompassing questions that must be asked early on in the semester or even before the semester begins.

Teachers at both levels and the school administration should ask themselves (1) What do we want the students at each level to know (or be able to do) when they finish the level, (2) how are we going to teach it, and (3) how are we going to test it? Essentially, therefore, teachers at both levels should be (or should have been) addressing these questions in their lesson plans and classroom activities since the beginning of the semester. If daily or weekly classroom activities are designed for students to achieve the successes desired by the time of the final exam, their probability of success is high.

It would seem to me that listening to lectures and note-taking would be the easiest to teach and test although it takes collaboration among teachers and administrators on setting it up. For a simple classroom activity, I would recommend going to a website like Living on Earth at http://loe.org , download some MP3 files of radio stories, play them for the class while they take notes, and then test using ten multiple choice questions, for example. (Parenthetically, it is EASY to get written permission from LOE to use their MP3s in this manner, even including putting their files on CDs for the reserve in the library or for free distribution.) After the quiz (or before in some instances) students at both levels should have the opportunity to discuss the stories because they are interesting, sometimes polemic, and they can generate a lot of discussion. The last radio show is at consisting of seven stories ranging from three minutes to 17 minutes, and finally, an additional benefit is that the text is always available to these MP3 stories as well.

Regarding testing, to be fair, academic vocabulary and grammar correctness can be taken from materials (like Living on Earth) that students have already been exposed to. The text can be used for that, and at the levels Inna Braginsky is asking about, students can always benefit from focused attention toward S-V agreement, pronouns, modals, simple, compound, and complex sentences, adjective clauses, parallel structure, etc. It is up to the teachers and administrators to address the most obvious weaknesses at each level and focus on a few specifics students can study, so when they take their multiple choice texts on these things, they can succeed. (No apologies for multiple choice tests here! ;-) )

The hardest part is the speaking exam because it requires an enormous amount of consensus among TRAINED teachers.

First, teachers must agree on a series of possible questions or topics which may be announced beforehand or not, their preference. I think to be reliable the topic should come from topics students have already been exposed to, much like the Living on Earth topics suggested above (a dozen topics would not be too many for students to prepare for). After students are given three or four minutes to present a (1) SUMMARY or an (2) ARGUMENT for something or a (3) RATIONALE against something (for examples), teachers should ask a pertinent follow-up question or two, and both teachers/administrators and students should at least feel that the speech topic was fair; it was a topic the student was at least exposed to and had the chance to study.

Then, teachers should assess the speaking abilities of the students (both the prepared and extemporaneous parts), and ideally they will have worked together long enough with the parts of their rubric to arrive at a consensus independently. If four teachers, for example, assign the student a four of six points on an aspect of his speaking performance, they should be very proud of that!

I didn't address bringing a bunch of non-ESL-trained teachers into the mix, but their opinions count! Spaces both formal and informal should be available for "mainstream" teachers to explain the "greatest weaknesses" of the ESL students, but I wouldn't invite them to exams.