Of complex assessment of English proficiency

METHODS OF ASSESSMENT OF LANGUAGE PROFICIENCY OF LEARNERS

 

As it was already noted in the Preface of the linguistic complex, the group of compilers worked out the scale of complex assessment of knowledge, skills and abilities the learner has to master. In the scale all tasks are divided into two blocks.

The first block is theoretical, and it involves lexical and grammar material which is given in the form of 20 closed tests for each level.

The first block of examination is theoretical, the examinee passes LGT according to the level of training answered 20 closed tests from 120 of Database. With the help of the table 1 it is possible to determine the level of theoretical knowledge of the learner. If the learner gets 50% and more (i.e. 10 correct answers) the examinee is allowed to pass the practical part of the exam.Time limit - 20 minutes.

Table 1

ASSESSMENT OF LEARNERS THEORETICAL KNOWLEDGE

ON LEXICAL GRAMMAR TEST

 

Grades	Score equivalent	% equivalent (marks)	Number of right answers
A	4.0	95-100	19-20 test assignments
A-	3.67		18 test assignments
B+	3.33		17 test assignments
B	3.0		16 test assignments
B-	2.67		15 test assignments
C+	2.33		14 test assignments
C	2.0		13 test assignments
C-	1.67		12 test assignments
D+	1.33		11 test assignments
D	1.0		10 test assignments
F		0-45	1-9 test assignments

The second block is the practical block which determines the level of practical language proficiency.

The exam on the second block consists of 30 exam cards, each card has tasks on 4 types of speech activity (TSA): listening, speaking, reading, and writing according to the learner’s level.

The practical part of examination lasts 40 minutes: listening – 7 minutes (time for preparation - 5 min.); speaking – 10 minutes (time for preparation -7 min.); reading – 9 minutes (time for preparation -5 min.); writing – 14 minutes (time for preparation -13 min.).

In the table № 2 (p.11) it is shown the content of the tasks on all TSA; time limit for preparation (30 minutes) and time for answer (10 minutes).

Thus, all combined exam materials are divided into two blocks: a) tasks which help to determine the depth of the knowledge of theoretical material; b) tasks which help to determine practical knowledge, skills and ability. Total mark T can be represented in general as:

T = X · P

where X – an absolute mark of theoretical knowledge on one of the five levels. It is shown in grades (A, B, C, D, F) (table 1).

P – a relative characteristics of practical language proficiency which is shown in marks (from 0 to 100 %).

The authors of ‘Universal criteria of complex assessment of language proficiency’ paid great attention to the level of practical language proficiency, which is estimated at the examination. The answer is evaluated in percentage (marks) from 0 to 100%, Beginner (1^st level) - 0-20%; Pre-Intermediate (2^nd level) –21-40%; Intermediate (3^rd level) –41-60%; Upper -Intermediate (4^th level) –61-80%; Advanced(5^th level) – 81-100%.

On the result of oral exam, the upper and lower thresholds are defined. The upper threshold is 19% - 20% for the 1^st level, 39% - 40% for the 2^nd level, 59% - 60% for the 3^rd level, 79% - 80% for the 4^th level. It allows the learner to transfer to the next level. The lower threshold for the 2^nd level is 21% - 29%; 41% - 49% for the 3^rd level; 61% - 69% for the 4^th level, 81% - 89% for the 5^th level. It means the learner has to retake the same level.

If the result of exam is from 10 - 18% (for the 1^st level); from 30 - 38% (for the 2^nd level); from 50 - 58% (for the 3^rd level); from 70 - 78% (for the 4^th level); from 90 - 98% (for the 5^th level) the learner will stay at the same level of training.

At all levels of the language course it is offered 2 tasks for listening, speaking and for reading 3 tasks, for writing – one task. All types of tasks should be fulfilled in exactly settled order. Tasks are not be missed or replaced.

To show the priority of one type of TSA above others, it was necessary to implement a differential key which was called ‘relevance index’ of TSA. According to the world research it was revealed that modern society spends 40% of time for listening, for speaking – 30%, for reading – 20%, for writing – 10%. It is obvious that the major TSA is listening, the ‘relevance index’ of it in our criteria made up 0.4. The second significant activity is speaking – 0.3. On the third place there is reading – 0.2, on the fourth – writing – 0.1. For simplification the procedure of calculation in ‘Universal criteria of a complex assessment of language proficiency’ there have already been presented calculated percentage taking into account the ‘relevance index’ of TSA.

Learners in KazGASA and KAU in the first semester of academic year are admitted to the 2^nd ‘Pre- Intermediate’ level on Kazakh and Russian course classes while in English class first-year students are admitted for the 1^st ‘Beginner’ level.

Note: a) in case of language insufficiency for the precisely level the learners have to take independently additional courses (within 7 weeks) to achieve necessary ‘admission’ level till the first midterm rating control.

b) for the language proficient (advanced level) learners the training is held individually in an advisory form during all time of study (the learner takes the tasks from the teacher and passes them once in two weeks).

Entrance test to define learners language level on linguistic disciplines is held on the basis of materials and worked out methods and criteria. For an academic period (semester) a learner has to raise the level of practical language proficiency to at least one level (from the 1^st to the 2^nd, from the 2^nd to the 3^rd; from the 3^rd to the 4^th; from the 4^th to the 5^th).

The sample of language proficiency assessment on the 3^rd level ‘Intermediate’

For example, the examinee chose the 3^rd level and answered 19 tasks out of 20 on theoretical block of correctly. He got A which corresponds to the assessment of his theoretical knowledge (table 1).

 

The examinee passes also 3^rd (Intermediate) level on practical block (table 2).

 

It took him 7 minutes for listening. According to the 1^st task the examinee listened to the text ‘Frederick’s restaurant’, filled up the table having answered 4 tasks correctly and got 12% from maximum 12% because he answered all tasks correctly. According to the 2nd task the examinee retold the main idea of the text in compliance with logical sequence, that is why he got 12% from maximum 12%. Total: 24%

For listening practice the examinee got 24% from maximum 24%.

It took him 10 minutes for speaking. According to the 1st task the examinee took part in discussion on ‘Money matters’, was able to prove his point of view and got 8% from maximum 8%. According to the 2nd task the examinee made a connected monologue about Kazakh national sport (6 sentences from 7) and got 10% from maximum 10% Total: 18%

For speaking practice the examinee got 18% from maximum 18%.

 

It took him 9 minutes for reading. The examinee read cursorily the text ‘Kazakh cuisine’ fluently with observance of all orthoepical rules, with correct intonation, verbal stress and got 3% from maximum 3%. According to the 1^st task the learner made a plan to the text and got 3% from maximum 3%. According to the 2^nd task the learner translated the 2^nd paragraph of the text and got 6% from maximum 6%. Total: 12%

For reading practice the examinee got 12% from maximum 12%.

 

It took him 14 minutes for writing. According to the writing task the examinee wrote an essay on the given topic, consisting of 60 words and got 5% from maximum 6% because there wasn’t any original presentation of the theme in his essay. Total: 5%

For writing practice the examinee got 5% from maximum 6%.

Thus, for the fulfilment of practical block the examinee got 59%.

 

Table 2