Technology in testing: the present and the future.

Technology in testing: the present and the future by Alderson, C. (2000).

This paper covers the uses of computers in testing.  It is a bit dated as it makes extensive reference to CD ROM.  These days downloads off the Internet would probably be used.  It is common these days to have computers sans DVD.  External optical drives do have their uses, far more so than built in optical drives.  Optical drives are prone to falling out of alignment so they are easily damaged.  So it makes sense to have external drives where possible as this makes a computer lighter as well.

A monumental disadvantage of CBT (Computer Based Tests) is there are some students who lack computer skills and aptitude, indeed some people have a very negative attitude to computers.  I have seen somebody type with one finger, that could make test taking really problematic.  This kind of problem will be greatly reduced with time.  As a decade has passed since this paper was written this sort of phobia is less likely to be a problem.

The paper cites a disadvantage that speaking cannot be assessed, this was before Windows 7 was launched.  It has a facility to teach a computer to recognize speech.  I have not had a chance to fully evaluate it yet.

There are distinct advantages of CBT.  Certain items such as Multiple Choice (MC) can be marked by the computer, so instant feedback is possible.  This is not possible with pencil and paper tests.  Some people (myself for instance) have appalling handwriting, this is not relevant with CBT.   It is not necessary to coordinate hundreds of test takers into entering an examination hall.  Students can take the test at a time of their choosing.  It can be done from wherever there is a viable Internet connection.  The mention of “diskettes” does suggest that this paper is somewhat dated.  These days much software is downloaded via the Internet.  Hence tests can be up to date.

Computer adaptive testing is where the computer estimates the student’s abilities, and presents the next item to suit the student for example freerice.com .  This particular programme gives the correct answer if a student fails to answer correctly and submits the failed item again to see if the student remembers the right answer.

An entirely incidental feature of this programme is that when the programme is used a donation of rice is made. The programme claims to improve the users abilities more information on this can be found in the Free Rice FAQ.

Some students do find a test intimidating, more so if it is taken in a large examination room with many others.  CBT do away with this, so they are far more user friendly (But not to Luddites).

In listening tests students are able to adjust the volume of the headphones.  Naturally this would be a problem for deaf students.  I had a deaf student who needed to lip read (In Cantonese and English !).

CBT is clearly most suitable for low stakes assessments.  There is the chance that some people will cheat in computer based tests, however the only person they will delude will be themselves.

DIALANG was and still is used for low level testing in 14 European languages.  This was experimental and at the time used major innovations.  The author mentioned the limitations of DIALANG in assessing students’ productive language abilities, however computers and technology have progressed greatly in the last decade so this may have been resolved now. It has been suggested that this is not particularly suitable for the younger learners.

When this paper was written computers would not have been as numerous as they are today.  CBT does enable more frequent testing of students with a reduced workload for the teacher. Students and teachers are more computer literate and technology has advanced considerably.  Moore’s law still holds true (and will probably hold true for at least another decade), consequently it can be expected that CBT will become more commonplace and more versatile. Smart phones are like mini computers, so students could test themselves when in transit. Perhaps the challenge is to make the test appear like a game, this would give a much broader appeal to an assessment.