Questionnaire development
The SurveyLang Questionnaire development team is headed by Sanneke Schouwstra, at CITO.
There are four contextual Questionnaires which have been specifically designed for the European Survey on Language Competences. The first Questionnaire is the Student Questionnaire which is completed by the students who have also taken a language test. The second Questionnaire is for language teachers; the third for school principals and fourth for National Research Coordinators who will complete a country level Questionnaire.
The purpose of the Questionnaires
The European Commission has stated that the following is the key purpose of the overall Survey: "to facilitate a more productive comparison of language policies, and language teaching methods between Member States, with a view to identifying and sharing good practice" (Communication of the Commission on The European Indicator of Language Competence, 2005, p. 5). Additional European Council policy objectives include stimulating Member States to provide a sound basis for the life-long learning of foreign languages through teaching at least two foreign languages from an early age, promoting teacher training, and stimulating the creation of environments (both in school and at home) where different languages are heard and seen, where speakers of all languages feel welcome and language learning is encouraged.
The Questionnaires will help achieve and find out more information about these objectives by providing additional contextual information that will supplement the analysis of the Language Tests.
Content of the Questionnaires
Students will answer questions about themselves, their family, their home environment, their school environment, their foreign language lessons and learning experiences. In the second section of the questionnaire students will complete a short series of Can Do statements, self-assessing their ability in the foreign language tested.
The Questionnaires for teachers, Principals and National Research Coordinators will focus on those aspects of educational policies, language policies and language teaching methods that may vary among regions and countries. This will help to identify those areas of good practice within foreign language teaching.
Countries participating in the survey also have the opportunity to add five contextual questions relevant to their country to each of the four Questionnaires. This enables them to use the Survey to gain insight into aspects of language learning and education specific to their country, but perhaps not relevant to other Member States.
Design and development of the Questionnaire
The first phase of the development process involved the construction of a conceptual framework of policy issues. Another key task was to examine the different educational systems of the Member States, noting those areas where differences may affect the comparability of data across countries.
The second developmental phase involved writing the actual Questionnaire items and testing them in cognitive labs to ensure the questions functioned as intended and that the target age group understood the question wording.
Throughout both of these phases, extensive consultations and discussions were carried out with Member States and other stakeholders.
Currently countries are working with the English source version of the Questionnaires and translating and adapting them for use in their country. Rigorous quality procedures are in place for this translation process.
Following the Field Trial in February/March 2010, the Survey data will be closely analysed and any necessary amendments to the wording of questions incorporated into the version of the Questionnaire to be used for the Main Study in February/March 2011. The workability of questions across all countries and the workability of the translations will be scrutinised as part of this review.
After the Main Study has concluded, data from the Questionnaire will be analysed with data from the Language Tests to determine how these contextual factors might affect students’ language learning, both in the individual Member State and across all the participating countries.