Test Quality

EPLIS is considered a high-stakes test, since its results inform decisions regarding the licensing of professionals who work in the Brazilian Airspace Control System (SISCEAB). Such decisions have a direct impact on the lives of these professionals, as well as on the air traffic management and safety in the country. Therefore, it is extremely important that aviation English tests such as EPLIS comply with the quality standards established by ICAO and the International Language Assessment Association (ILTA).

In order to ensure that EPLIS results provide adequate, reliable, and fair information about the test takers' ability to use English in aeronautical communications, the process of developing test tasks and items comprises a series of steps, in which each step needs to be satisfactorily completed so that the next one can begin, thus providing a more efficient management of the quality of the examination. The diagram below includes the steps in the development of tasks/items, as well as a brief description of each one.

Development of EPLIS tasks/items

Since its implementation, EPLIS has been part of a continuous validation process, which intends to demonstrate that the inferences and uses made based on its results are consistent and appropriate, as well as to investigate whether the test is promoting positive effects. In 2009, EPLIS was appraised by a team of experts in language assessment, led by Prof. Dr. Matilde Virgínia Ricardi Scaramucci, a researcher with renowned knowledge in the area and with publications in several national and international journals. Again, in 2014, the test was assessed by ICAO's Aviation English Language Test Services (AELTS). Reports from these analyzes have guided improvements on EPLIS regarding its publicity, security, test item development, and rater training.

Members of the EPLIS development team also conduct validity studies and their findings have continuously contributed to the improvement of the test. Periodically, these results are discussed at conferences and seminars and published in journals and books in the field. On the Aeronautical English Study Group (GEIA) website, it is possible to access several published studies regarding EPLIS, the ICAO Proficiency Rating Scale, the ICAO Language Proficiency Requirements, aeronautical English training programs, among other topics.

Return