Many students are concerned about the potential large-scale change of PTE questions while few others unfortunately faced unexplained sudden decline in their scores. Like mysteries, these are the questions which nobody can give a definitely answer. However, the mystery unwittingly points toward the obvious feature of PTE – Machine Learning, a form of Artificial Intelligence (AI).
What is Machine Learning? In the simplest form, it is when computers apply statistical learning technique to automatically identify patterns in data. These techniques then can be used to make highly accurate predictions.
Now, you probably wonder why is Machine Learning related to PTE? Well, unlike other English tests, PTE is a computer based English test and its definitive feature is the Automated Scoring System. This scoring system is very consistent, very fast (excepted for those occasional hiccups when your score isn’t available for weeks) and arguably superior than conventional methods due to its complex algorithms and most importantly, its all-powerful Machine Learning behind the scene that drives the entire process. In other words, by taking Machine Learning into consideration we could rationalize our findings and debunk the mystery.
OK, so what does Machine Learning have to do with PTE questions?
PTE score guide uses Item Response Theory (IRT), in layman’s term – for a question that is difficult then it should carry higher score weight. What this means is that item difficulties are in place for each PTE question and item difficulty level is assigned dynamically by the system via Machine Learning. This explains in some cases when some test takers think they screwed up their exam because it’s very challenging yet their score report showed improvement, and vice versa.
What it means to the overall experience for test takers?
It can be beneficial, the reason is very straightforward. Every new question introduced in PTE exam is a question that starts with minimal amount of statistical data. Pearson constantly collects new data to train its AI to improve its scoring system. Its ability at assessing responses for each new question improves as more and more data are being collected for the said question. In short, the bigger sample there is, the more accurate computer is at scoring. But, at the same time, releasing new questions pose risks because it can jeopardize the consistency of the scoring system due to low amount of statistical data.
A logical approach would be releasing new questions slowly to reduce the “damage”. By adopting this approach, it implies that those questions you have seen around during your exam will stay there for a long while (minimum 1 year), good news for most test takers!
To sum up, the release of new questions is most likely in small increments as it takes time to get enough data for Machine Learning to be effective. If your score suffered a sudden plunge in any particular section, maybe it’s because the Machine Learning is still “learning”. And for those who are undecided on switching to PTE because they are worried about the question pool or format change? Relax, it’s NEVER BEEN BETTER TIME to make that switch.
To obtain more information about PTE exam preparation, please check out PTE Study Package.
I’ve heard rumors that PTE is actually replacing the “computer” with actual artificial intelligence sometime this September 2018. This, in turn, meaning that it can scan your response and check for the underlying meaning. If this is true, we can not memorise a general format and apply it to everything anymore since it will detect that we’re not making sense or not being accurate with the meaning and just adding keywords into it. Can someone confirm if this is true? I’m having doubts that because the government (Australia in my case) might have seen the statistics of test takers conjugating in PTE and getting 79+ more frequent than IELTS and OET counterparts.
Computerized marking process performed by PTE is a form of Artificial Intelligence. Although there will definitely be some form of incremental improvement over the current system (could be improving the accuracy and consistency), it’s extremely unlikely to see an overhaul of the current “working” system unless there are unfix-able flaws.
You have said it yourself, it’s a rumor. There have always been ridiculous rumors of PTE, and we strongly feel that all of these rumors have brought nothing other than stirring chaos, confusion and above all, panic attacks within the PTE community. In 2017, many students have expressed their concern over a major overhaul of PTE question format which turned to be a laughable rumor.