35 | STUDIES IN ENGLISH LANGUAGE AND EDUCATION, 3.
, 35-49, 2016
Problems With Section Two ITP TOEFL Test
P-ISSN 2355-2794
E-ISSN 2461-0275
Rizki Ananda* University of Syiah Kuala.
Banda Aceh.
INDONESIA Abstract This study was designed to investigate .
the difficulties faced by EFL university students with section two of the ITP, and .
whether part A or part B was more difficult for them and why.
A number of 26 students from two different universities.
Syiah Kuala University and the State Islamic University Ar-Raniry were the samples for the test.
The data was obtained from a multiple choice questionnaire test consisting of 46 questions, each with 4 answers to choose from.
The results showed that inversions .
%), subject-verb agreements .
%), adverb clause connectors .
%), passives .
%), reduced adjective clauses .
%), parallel structures .
%) and use of verbs .
%) were the most difficult questions for the students.
Furthermore, they felt that part B was more difficult than part A, as finding an error in a sentence was harder than completing a sentence from a multiple choice.
Furthermore, the length of questions in part A did not affect the amount of time the students spent to complete part A and did not cause them to panic.
Also, unfamiliar words in part A were not regarded as a problem by the Hence.
TOEFL teachers and trainers are highly encouraged to pay more attention to doing study exercises for the seven topics with the highest percentages above in part A and also to more practice for part B.
Keywords: ITP TOEFL, structure, written expression, questionnaire, multiple choice tests.
INTRODUCTION
Background The Test of English as a Foreign Language (TOEFL) is a test administered to measure the English proficiency of non-native speakers of English.
As Phillips .
1, x.
asserts that Authe TOEFL test is a test to measure the level of English ability of Corresponding author, email: rizki_ananda83@ymail.
https://doi.
org/10.
24815/siele.
Ananda.
Problems With Section Two ITP TOEFL Test | 36 non-native speakers of EnglishAy.
Likewise.
Abboud and Hussein .
contend that as a test of English as a foreign language.
TOEFL has become a standardized test used throughout the world to measure the English proficiency of non-native English The two statements above are congruent with Sulistyo .
who states that, for more than half a century.
TOEFL has been viewed as a standardized test widely employed all around the world in more than one hundred countries.
Furthermore.
TOEFL is used by many .
universities for their admission processes that must be fulfilled by prospective new foreign students (Pyle & Page, 2002.
Sharpe, 2.
relation to this.
Abboud and Hussein .
1, p.
further say.
Aumore than 5,000 colleges, universities, and licensing agencies in 90 countries accept the TOEFL scoresAy.
From the purposes mentioned above, it can be understood that mastery of TOEFL is very important because it enables learners to show that they have a good proficiency in English and opens a great deal of access to continue study abroad and also to continue studying in Indonesia.
In Indonesia.
TOEFL, particularly TOEFL ITP, is learnt by people to pursue the same purposes mentioned in the preceding paragraph.
Most students study TOEFL because some of the prestigious universities in Indonesia require them to obtain a high TOEFL score as a major requirement for admission.
Also, most of the universities in Indonesia urge their students, both undergraduate and graduate students, to have a fairly high score from ITP TOEFL for their graduation.
Besides, most, if not all, of the major companies in this country also request that their employees obtain a fairly high ITP TOEFL score for their promotion (Hambali, 2.
From these purposes, it can be understood that Learning ITP TOEFL is a must for students if they would like to continue their study at a prominent university and if they expect to earn a university Therefore, university students are expected to master the ITP TOEFL test to fulfill these purposes.
However, there is a big discrepancy between expectations and reality.
There are still many EFL students who fail to get good results in the ITP test.
Most of them agreed that one of their biggest hurdles is section two of the ITP test, which examines structure and written expression.
To this end, a study carried out by Hambali .
8, pp.
revealed that students still have many problems in answering section two of the ITP test.
Those problems included .
identifying verbs, .
identifying the correct word order of subject and verb in a noun clause, and .
identifying words with derivation and function.
Similarly, the findings by Abboud and Hussein .
confirmed that 52% of students said that the grammar questions were difficult.
This study also revealed that with part A, structure, 57% of test takers said that part A, structure, is harder that part B, written expression, whereas only 43% said that part B was more difficult than part A.
Moreover.
Wright and Sukur .
strongly affirm that one big common problem for students of the ITP test is section 2.
Structure and Written Expression.
hence, students often feel stressed with this part.
They also stated that problems with grammar were thought to prevent students from getting a high score in TOEFL which is one of the requirements for university admission either in Indonesia or in universities Similarly.
Mahmud .
in his study found that most of his respondents encountered serious problems in answering the structure and written expression section.
Based on the explanations above, the researcher was inspired to conduct research to find out the most difficult problems faced by EFL learners in the ITP TOEFL test.
was expected that this study can be both practical and theoretical contribution for EFL teachers and learners.
Practically, this study can help them find methods that they can 37 | STUDIES IN ENGLISH LANGUAGE AND EDUCATION, 3.
, 35-49, 2016 use to improve their ITP score.
As regards the theoretical contribution, this study is expected to enrich the theories of the problems faced by students in the structure and written expression part of the ITP test so that it can be used as a reference for further studies conducted by other researchers.
Research Questions This study was carried out to answer the following two research questions:
What are the difficulties faced by EFL university students in section 2 of the ITP Which part of section two in the ITP is considered more difficult by these students, part A or part B? Why? Research Objectives Based on the formulation of the two research questions above, it can be understood that the objectives of this study were to find out what kind of difficulties were faced by Acehnese EFL university students in the structure and written section of the ITP TOEFL test and to figure out which part of section two was more difficult for these EFL university students, part A or part B together with the reasons why these participants found one part more difficult than the other.
LITERATURE REVIEW
Brief History of TOEFL The Test of English as a Foreign Language .
TOEFL) is a test which is standardized to measure the English proficiency of non-native speakers of English.
This test was first started by an American Council for the testing of English as a foreign language in early 1962 (Sulistyo, 2.
Since its establishment.
TOEFL has developed several versions due to shifts in the views of the nature of language.
The first TOEFL was the Paper and Pencil Based TOEFL (PBT).
It was developed on the basis of the belief that language comprises two layers: the layer of form and that of meaning (Sulistyo, 2.
In this version of TOEFL, good mastery of English grammar was ultimately important.
It can be seen from the format of the test.
The PBT had three sub-sections: .
the listening section, .
the structure and written expression section, and .
the reading comprehension section.
Another two tests, commonly tested separately, were the Test of Written English (TWE) and the Test of Spoken English (TSE) (Sulistyo, 2.
In the listening section, there were three parts:
part A is the comprehension of fragmented sentences, part B is the comprehension of dialogues, and part C is the comprehension of texts larger than dialogs/monologs.
part A, accuracy of common grammatical points were tested (Sulistyo, 2.
In section two, structure and written expression, it was crystal clear that test takers must have an adequate knowledge of English grammar without which they would be sure to get a low score in this section.
From the explanation above, we can understand that the PBT still put great emphasis on the form of language.
Ananda.
Problems With Section Two ITP TOEFL Test | 38 However, a need to assess the test takersAo proficiency in using English communicatively found there were shortcomings in the PBT and the next version of TOEFL, the computer based TOEFL (CBT) was developed.
In the early part of its development, however, the CBT also still included sub-sections similar to the PBT:
listening, structure and written expression, and reading comprehension as well as TWE (Test of Written Englis.
and TSE (Test of Spoken Englis.
were both tested The major difference was that while the PBT was paper based, the CBT was computer based.
In the later development of the CBT, more emphasis on communication skills was prioritized.
It can be seen from the tested sections which include macro skills: listening, speaking, reading and writing.
In the most recent development of the CBT, the concept of language as a means of communication was viewed as highly important (TOEFL internet based test, 2007, as cited in Sulistyo.
The development of the CBT gave birth to the new version of TOEFL, so called internet based TOEFL (IBT) in 2005.
Linguistically, the rationale behind IBT and CBT is the same, namely to test the studentsAo ability to use language communicatively and The difference is that in the IBT academic settings and themes are more emphasized (Sulistyo, 2.
To summarise, the creation of the IBT has the purpose to assess the ability of the test takersAo to use English for speaking, orally.
Institutional Testing Program (ITP) Aside from the three versions of TOEFL elaborated above, there is one other version called ITP, which has become the focus of this study.
Basically.
ITP includes the same sub-tests as does the PBT explained above, but in the ITP, there are no TWE and TSE.
In line with this.
Sharpe .
reckons that ITP and PBT are quite similar in terms of their length, format, and level of difficulty.
In ITP there are three sections: listening, structure and written expression, and reading comprehension.
The following subheadings deal with the explanation of these three sections.
However.
The examples of conversations, dialogue, reading passages, and questions are not given here so to have a clear look at what all these look like go to Pyle and Page .
Philip .
TOEFL ITP assessment series .
1 Section One: Listening Section The purpose of the listening section is to assess the ability to comprehend spoken English (Pyle & Page, 2.
There are three parts to the listening section: Part A, with short dialogues containing 30 questions.
Part B with longer dialogues consisting of 8 questions, and part C, a lecture with 12 questions.
In all parts of these sections, the conversations and dialogues are not played a second time so that test takers need to listen to the recordings very carefully and attentively.
Then, they choose one out of four possible answers for each of the 50 questions.
The time allotted for the listening section is 30 to 35 minutes (Pyle & Page, 2.
2 Section Two: Structure and Written Expression The structure and written expression section was developed to test the ability to identify appropriate language for standard written English (TOEFL ITP assessment 39 | STUDIES IN ENGLISH LANGUAGE AND EDUCATION, 3.
, 35-49, 2016 series, 2.
This section entails two parts: Part A.
Structure, and Part B.
Written Expressions.
In Part A, there are 15 incomplete sentences.
beneath each sentence are four words or phrases, marked (A), (B), (C), and (D).
Test takers are to choose the one word or phrase that most perfectly completes the sentence.
On the answer sheet, find the number of the question and fill in the corresponding blank space with the letter for the answer they have chosen (Pyle & Page, 2.
Subsequently follows Part B, which is the written expressions, with 25 questions which each having four underlined words or phrases.
The four underlined parts of the sentence are marked (A), (B), (C), and (D).
Test takers are to choose the one underlined word.
or phrase that must be changed so that the sentence will be correct.
This section usually lasts for 25 minutes.
3 Section Three: Reading Comprehension The last section is reading comprehension whose purpose is to measure the ability to read and comprehend short passages which uses the same topics and styles as most universities and colleges (TOEFL ITP assessment series, 2.
There are usually four to five long passages, each of which commonly has about eight to twelve questions.
Test takers are asked to answer these questions which are usually related to main ideas of the whole passage, vocabulary, detailed information, inferences and reference items.
The time given for this section is 50 minutes.
Previous Related Studies It is true that the ITP TOEFL test is still a serious challenge for students as scientifically proven by previous studies (Mahmud, 2014.
Hambali, 2.
In his study.
Mahmud .
employed semi-structured interviews and classroom observations to investigate the problems faced by students in the TOEFL tests and the nature of their Not surprisingly, he found that the students confessed that the TOEFL test was very difficult for them to pass due to a low level of basic skills, less practice, less motivation, and individual differences amongst students such as age and family status.
Another study was carried out by Hambali .
Through participant observations at the Graduate School at Sriwijaya University during the TOEFL preparation class held in their language laboratory, he found that many students had problems in TOEFL, such as with identifying verbs, identifying the correct word order of subject and verb in a noun clause, and identifying words with derivations and their He further went on to say that the hardest problems mainly occurred in section two of the ITP TOEFL test.
METHODOLOGY
Research Design 1 Scope of Study This study focused only on investigating the problems that students had in section two of the ITP TOEFL, dealing with structure and written expression and the reasons why the students found one of the parts in section two of the ITP TOEFL .
art A or part R.
Ananda.
Problems With Section Two ITP TOEFL Test | 40 B) to be more difficult than the other.
as a result, problems with listening and reading comprehension were not considered.
The location of this research study was in the English language Department at Syiah Kuala University.
2 The Theoretical Framework The theoretical framework for this study was based on the grammar topics commonly tested in ITP TOEFL taken from Phillips .
as presented above.
The topics with high frequency of errors were categorized as the most serious problems faced by English learners in section two of the ITP TOEFL.
3 The Choice of Respondents In a bid to ensure the validity of the data, the samples chosen were 26 English students from Syiah Kuala University and from the National Islamic University ArRaniry who had taken the actual TOEFL test so that they could give reasons, based on their experiences, why they considered one part of section two in the ITP TOEFL test to be harder than the other part.
To choose the sample, the researcher employed a random sampling procedure in which the students were chosen randomly.
The reason for choosing this procedure was that by using random sampling, the result can be generalized for the entire population (Creswell, 2.
Research Instrument and Data Collection 1 Test The test items in this study were adopted from Phillips .
with some The writer used several ways to collect the data for the study.
First, the researcher gave a test to the participants consisting of the topics most often tested in the actual TOEFL test in the form of multiple choice questions like the TOEFL tests.
The test included 23 topics as presented above, each with two questions .
he test is set out in Appendix .
Therefore, the total number of questions was 46 questions that had to be answered within 50 minutes.
This test was used to answer the first question of this 2 Questionnaire The questionnaire was designed based on the findings of Abboud and Hussein .
with modifications to suit the study objectives.
It had six questions pertaining to the reasons why each student found one of the parts in section two of the ITP TOEFL test .
art A or part B) to be more difficult than the other.
Accordingly, this questionnaire provided answers for the second question of this study.
Data Analysis The data were analyzed through several stages.
For the first instrument, the test, the researcher began by checking the answers given by the students.
After that, he 41 | STUDIES IN ENGLISH LANGUAGE AND EDUCATION, 3.
, 35-49, 2016 classified the correct and incorrect answers.
Next, he counted the percentage of errors in each topic by using a formula given by Sudijono .
P = f x 100% In which:
P = percentage of errors in each topic f = the number of wrong answers in each topic N = total number of all wrong answers The topics with the highest percentage of errors became the most serious problems for the students.
In addition, the data analysis for the questionnaire was conducted by classifying the proportions of the samples choosing AuyesAy and those choosing AunoAy for each item to ease the researcher in analysing and interpreting the data (Aridah, 2.
DATA ANALYSIS AND RESULTS
Analysis of the Test The results from the data analysis are shown in Figure 1 below.
Figure 1.
Seven topics with the highest frequency of errors.
As shown in Figure 1, there were seven topics that had the highest percentage of The higher the percentage of errors that a topic has, the harder it is for students.
The first topic with the highest percentage was AuinversionAy amounting to 12%, followed by Ausubject-verb agreementAy .
%).
In addition, the topic Auadverb clause connectorsAy .
%) was the topic with the third highest percentage of errors, whereas.
AupassiveAy is the fourth topic with 6% of the total errors.
Meanwhile, the other three topics were Aureduced adjective clausesAy.
Auparallel structuresAy, and Auuse of verbAy or Aumisuse of verbsAy, each of which received 5%, respectively.
Ananda.
Problems With Section Two ITP TOEFL Test | 42 Questionnaire Results Table 1 shows the results from the questionnaire.
Table 1.
Questionnaire results.
No.
Statements For me, part A is more difficult than part B.
Part B is easier than part A because finding an error is easier than completing the Part A is more difficult than part B for me because it consists of long sentences so that it takes time to read and answer it.
Part A is more difficult than part B because I feel lazy to read long sentences.
Part A is harder than part B because its sentences contain a lot of unfamiliar words for me.
I quite often panic when I see long sentences in Part A.
Yes From the results of the questionnaire in Table 1, when the samples were asked if part A or part B is more difficult, there were 12 samples answering AuyesAy and 14 AunoAy.
It can clearly be interpreted that part A is not more difficult than part B and thus, part B is more difficult than part A.
In addition, question 2 revealed that more samples .
answered AunoAy if part B is easier because finding an error is easier than completing the From this response, we can understand that finding an error in sentences is harder than just completing sentences, hence part B is harder.
It was also found that the number of samples choosing AuyesAy and that of samples answering AunoAy is similar when asked whether part A is more difficult because it consists of long sentences so that it takes time to read and answer it.
It can be seen that for some samples, the length of the questions makes Part A more difficult than part B because they would spend much time reading it, whereas for the others, the length of questions in part A is not a matter.
Pertaining to question 5, most of the samples .
answered AunoAy that part A is more difficult than part B because they feel lazy to read long sentences.
This response revealed, too, that the length of sentences did not affect the attitude toward part A, making it no harder than part B in section two of the ITP TOEFL.
Moreover, there were more samples .
answering AunoAy than those choosing AuyesAy when asked question 6 regarding whether part A is harder than part B because its sentences contain a lot of unfamiliar words for them.
It can be understood that the familiarity of words was not a source of difficulty to answer part A.
Finally, question 6 showed that most of the samples .
chose AunoAy when asked whether they quite often panic when they see long sentences like in Part A.
Thus, we can understand that the lengthy sentences in part A did not make the samples panic and lose their concentration to finish part A.
DISCUSSION