Sunday, October 31, 2021

One Question – Five Answers

Earlier this week I saw a tweet from Jo Morgan about a broken question that appeared in an end-of-topic test produced by an exam board for KS4 pupils.

Clearly, that's not helpful in a test, because it might confuse students, particularly if two friends answer it in different ways and get different, but reasonable answers!

It is, though, a great task to use with A-level students who need to revise the sine rule and cosine rule.

Here is the original question (taken from Jo's tweet):

Yr 12 could be asked about the problem with the original question, or could be told that not only has too much information been provided, but that it is not internally consistent (which is what leads to the problem with different answers being produced/possible).

They could then be told to ignore one piece of information each time and to work out the answer each time.  The neat thing about this is that a different strategy is required each time.  Here are the six things I could think of to remove:

  • Version 1:  Remove the 19cm
  • Version 2:  Remove the right angle
  • Version 3:  Remove the 35°
  • Version 4:  Remove the 10cm
  • Version 5:  Remove the x and the 2x
  • Version 6:  Remove the need for ADC to be a straight line

To my surprise, two of these gave the same answer for angle y.  Can they predict which two? 

Then: which two pieces of information can be removed, still leaving a question that can be answered?

This is available as a worksheet (with all eight versions shown with diagrams).  I suspect the second page is the only one that is necessary for the students to have.

Here is the final diagram, with two of the original pieces of information removed.  (It is still possible to calculate y.)

Version 7:  Remove the 10cm and the 19cm







Saturday, October 02, 2021

Another day, another Ofqual consultation

Another day, another Ofqual consultation, this time about the way Ofqual propose teachers should collect evidence to support the awarding of TAGs, should they be needed, in 2022.  It would be easy to ignore this one, figuring that the important guidelines about exams in the summer of 2022 have been published now (with detail of topics to follow in February).

The proposals in this new consultation will affect all students in Yr 11 and Yr 13, and their teachers, regardless of whether exams go ahead as planned or not.  For this reason, please respond.

The first thing to note is that these proposals appear to be there as a fall-back option, in case exams have to be cancelled for future public health reasons.  They are not in place to mitigate any unfairness caused by previous school closures, or the greater amount of schooling missed in different parts of the country, or the disparity in access to remote teaching and/or ICT, etc. 

Could exams have taken place last summer?  Yes – they could.  Exam halls are usually big, well-ventilated spaces and students are automatically socially distanced there anyway.  Given the huge desire (from Ofqual, DfE, etc) to return over the next two years to a grading system that is similar to 2019, it seems vastly unlikely that exams will be cancelled this academic year.  So whatever is included in this consultation is extremely unlikely to be implemented.  It must, therefore, be proportionate and should not detract from what students would otherwise be doing, or cause additional work for teachers.

Here are some of the key features that are being proposed:

b.         [...] A sensible pattern could be to plan to assess students once in each of the second half of the autumn term, the spring term, and the first half of the summer term.

c.         When carrying out assessments that could be used towards TAGs, centres should assess students in ways that are as useful as possible for students expecting to take exams next summer by creating assessment opportunities that replicate, in full or part, exam board papers (past papers could be used, in full or part, where appropriate). Such assessments will also help to inform teaching and learning.

e.         Each assessment should only cover subject content that students have been taught at the time of the assessment and not include questions on topics they are yet to study. The range of planned assessments should mean that students are prepared to be assessed on the full range of content they will have been taught.

Ordinarily, schools would carry out mock exams with Yr 13 and Yr 11 students.  In many schools/colleges these happen in the late autumn (Nov/Dec) and in the early spring (Feb/Mar is common).  It would fit well with the timetable suggested in the guidance for these mock exams to be used as evidence for TAGs.

There are several problems with this.  The proposed guidance continues:

l.          Teachers should mark the work and carry out any internal standardisation of the marking, in line with exam board guidance where appropriate. Students should be provided with feedback, which could include marks or comments, but teachers must not determine a TAG unless exams are cancelled nor tell their students what their TAG might be.

This needs more clarity.  Marks can be given to the students but not TAGs.  What about mock exam grades?  The students need these mock exam grades to inform their understanding of the level they are working at.  Their teachers, particularly in Yr 13, will use the mocks to produce predicted grades for university applications.  More guidance about how we can communicate these to students without "telling them their TAG" is necessary.  It would clearly be ridiculous to give mock exams and then separate TAG-exams!

f.          Centres may wish to aim for a total assessment time that does not significantly exceed the total exam time for the specification.

g.         Students should be told before they take the assessment that their performance in the assessment would be used to inform their TAG if exams were cancelled to ensure they have time to prepare. They should be told the aspects of the content the assessment will cover, but not the specific questions.

h.         Students in the same centre cohort should be assessed using the same approach where possible and all the assessments taken should be used to determine the TAG (not just those in which students performed best). The centre will make the final judgement about what is to be used and will need to document the rationale for any instances where consistent evidence is not used for a whole class or cohort.

The suggestion is that we have three high-stakes exams to be taken during the academic year (one late autumn, one in spring, one in early summer).  If TAGs become necessary then these will all count, and there is no opportunity to pick the best result for each student from a range of data. 

This means students will need to treat these more seriously than they do normal mock exams, where often the first Yr 13 mock exam acts as a wake-up call to focus more, etc.  They will need to revise thoroughly as they would for a final exam, because it could end up counting as their final exam.  This means we will need to give full revision time and full exam preparation practice for these exams as if they were the real thing (because they might end up being just that), which will detract from teaching time and will give the students additional stress.  The final piece of evidence will be collected in the summer term, but in order for this whole process to be worth doing, exams themselves won’t be able to take place in, erm, the summer term.

Essentially, the proposals consist of the worst aspects of the old modular exams (the vast amounts of lost teaching time in preparing students to take them) without the benefits (the opportunity to resit them).

The really frustrating thing with the consultation is that it asks whether these suggested arrangements are better than those for summer 2021.  What the consultation ignores is the vast amount of additional work and worry that this will require, for something that can only possibly be used if schools close suddenly, just before the exams are due to take place. 

The consultation closes on 13 October, so please fill it in soon!

https://www.gov.uk/government/consultations/contingency-arrangements-gcse-as-a-level-project-and-aea/contingency-arrangements-gcse-as-a-level-project-and-aea

 

Tuesday, September 07, 2021

Preparation for AQA Core Maths 2021 Preliminary Materials

Many of the Core Maths qualifications involve preliminary material that students need to gain familiarity with before the exam.  In a non-Covid year, lots of teachers think about these materials, consider what their students need to know and create potential questions for them to answer.  

The summer 2021 exam papers are being used by a small number of students who will be doing the (inaccurately named) resit option in October.  A group of us (Tom, Chloe, Sue, Jane, Zoe and Mark) explored the AQA materials and gathered some ideas.

Paper 1 Preliminary materials

Points to ensure the students understand

  • The reduction of the personal allowance is new here.
  • This reduction is only challenging for people who earn between £100,000 and £125,000.  Below that amount the personal allowance applies in full, while above that there is no allowance at all.
  • Students should note the figures that are here and use them; they are different from those that were in use in previous years.

Possible questions:

  1. Choose salary amounts that fall into the lowest rate only, that cross into the middle band and that cross £100,000.  Calculate the amount of tax paid each time.
  2. See the image about lorry drivers.  If you and your partner both earn £53,000 per year, how much tax do you pay?  What if one member of the family earns £106,000 per year?  How much tax would they pay?

 



Points to ensure the students understand:
  • There is no ‘allowance’ to be subtracted before working out the NI that is due (but there is a zero-rated band).
  • You start paying NI before you start paying income tax.
  • Income tax is progressive, in that the more you earn, the higher the percentage rate becomes, whereas higher earners pay a lower percentage on their highest earnings in NI.
  • National Insurance is paid on your original salary (don’t subtract the tax first!).
  • Student Loan repayment is also done on your original salary (the ‘gross income’).
  • There are three separate things going on with Student Loans:
    • You pay 9% of your income, regardless of how much you owe.
    • There are two different thresholds at which you start paying, depending on when you started university.
    • Interest is added to the amount you owe: using the figures that are given, this is 5.4%.

Possible questions:

1) Kadir is a senior foreign exchange broker and earns £120 000 per annum.

He has paid off his student loans.

a)       What is his personal allowance for income tax?

b)      Calculate his net monthly pay.


2) Beyza is a real estate lawyer.

She graduated in 2005 and now earns £65 000 as a Senior Counsel.

a)       Calculate her monthly student loan repayment.

b)      How much money does she have left per week after paying her tax, NI and student loan?


3) You owe £29,000 on your student loan.  At the end of a year you need to add on the interest and then make a payment of 9% of your salary (assuming it is over the threshold).  If you earn £40,000 per year, how much will you still owe on your student loan after three years?


Points to ensure the students understand:

  • The plot sizes include the garden, and are given for a 4-bed house (presumably it will be smaller for a house with fewer bedrooms).
  • 1 hectare is equivalent to the area of a square of side 100 metres. 

Possible questions:

This information could be used as the starting point for an extended project.  For example, students could be given a number of houses to plan for and could be asked to create a map of the new estate (perhaps on a hectare of land).  (This could be extended to include building costs and prices of houses.)

  1. Estimate the scale of the given photograph.
  2. In the middle of the photograph there is a park.  Estimate the area of the park, clearly stating all your assumptions.
  3. Estimate how many houses could reasonably be built on 1 hectare of land.


 Paper 2 Preliminary Materials

There is a lot of material here about the same topic.  It is broken down here.

Yellow: How much plastic waste in 2010 and in 2014 ?

Blue: How much came from households?  What might have produced the rest of the plastic waste?

Pink: What is/isn’t included?  What is a “waste stream”?  What does “packaging” refer to?

Green: What is the difference between the government estimates and the WWF estimates?  Why might they be different?  How might these estimates have been reached?

Yellow: 9% (of the plastic waste “which was sent to treatment”) is 53,400 tonnes.  How much plastic waste does this mean there is altogether?  What is the problem here?

Blue: Calculate the amount that is recycled and landfilled using the WWF figures.

Possible questions:

1)      What is the life-cycle of a bottle of soft drink?

2)      Estimate how many kg of plastic each person in the UK is responsible for each year (using the WWF figures).

3)      A newspaper article says that the WWF calculation for the plastic waste generated in 2014 was 4 times as much as the government-estimated amount. Use the figures in the briefing to determine whether this is true.

There are lots of issues with this graph! (Some of these overlap with the questions below.

  • ‘EU28’ is presumably the value for all EU countries (including, at the time, the UK).  This could have been highlighted to show it encompasses the whole EU.
  • The scale is difficult to read and to apply to countries further up the list.
  • The size of the country is surely relevant.  Malta has a population of under 0.5 million, so is less of a concern than France, which is now the second biggest country in the EU (pop: 67 million).
  • It doesn’t mention whether each country produces the same amount of waste per person (just the percentage of that which is produced which is then recycled).
  • What does “recycling/recovery” actually mean?

Possible questions

  1. What might be misleading about the graph?
  2. Suggest two ways the graph could be improved

 

Possible questions

  • Using the graph, estimate the amounts of plastic waste exported to China/Hong Kong in 2017 and 2018. Calculate the % fall in the amount.
  • A newspaper article suggests that the plastic waste that is exported for recycling does not actually get recycled and may end up as landfill overseas or polluting the oceans. Using the graph on page 4 and the UK government estimates on page 2, work out a new estimate for the proportion of the UK’s plastic waste that was actually recycled in 2016.

Other links

Here are some other links that might be of use:

https://www.youtube.com/watch?v=B_PAK4aMQ14  Chap on Question Time talking about tax

https://www.bbc.co.uk/news/uk-57139474  News story about recycling

https://commonslibrary.parliament.uk/research-briefings/cbp-8515/  Updated version of this information.  What has changed?


Final thought

I got lots out of talking to others about this.  I would encourage all teachers of Core Maths to take the opportunity to talk to colleagues about the preliminary material ... and then to blog about their ideas!



Thursday, March 18, 2021

If you're going to do this damn silly thing, don't do it in this damn silly way

In Yes, Minister (a vastly less sweary antecedent of The Thick of It) the senior civil servant Sir Humphrey tells the Minister: “If you're going to do this damn silly thing, don't do it in this damn silly way”.

This is relevant because of the news that the assessment resources that are due to be released around Easter won’t just be sent to schools, or made available only via secure websites, but will be published openly for everyone to access.  Everyone.  That’s teachers, students, parents, tutors.  Everyone.

Here I explain why I think this is a bad idea.

Exam papers have never been wholly secure.  There has always been the chance that an exam cupboard will be broken into, that a parcel will be mis-delivered, that a paper will be photographed before it should have been opened. One year a maths exam was replaced at short notice by an alternative version.  Very occasionally a primary school head teacher has been found guilty of malpractice for instructing pupils to ‘look again’ at wrong answers.  These situations were thankfully few and far between.

Back when the TES forum was the main social media used by teachers, every summer teachers would post reminders to others not to discuss the content of exam papers on the day of release, even after the exam had finished in this country, because those same papers might be sat at different times around the world. 

This summer the exam boards have been instructed to produce assessment materials, including questions, mark schemes, model answers and grade boundaries.  It is not clear to me (at the time of writing) whether it is just the questions that will be published, or whether the other materials will be available to students as well.

According to TES: An Ofqual spokesperson said: "We asked in our joint consultation with the DfE: “To what extent do you agree or disagree that exam boards should publish all of their papers shortly before the assessments in order to manage the risk of some students being advantaged through papers being leaked?.  66 per cent of respondents either agreed or strongly agreed with this proposal”

This question is flawed.  In my response to the consultation (one out of 100,000 that they received), I complained that the question was unclear.  If ‘publish’ meant ‘made available to schools’ and if the emphasis was on ‘shortly’, then this was sensible.  If ‘publish’ meant the damn silly thing they are now proposing to do (making it available to the whole world), then it wasn’t sensible.  How can Ofqual tell in which way the other 99,999 respondents interpreted the question?

The problems with releasing the questions to Uncle Tom Cobley and all:

·         Model answers will appear on The Student Room, older students, parents and others will record perfect versions of the questions and these will be available on YouTube.

·         Students who have a private tutor, or an older sibling who is studying that subject at a higher level, or whose parents are able to help will receive disproportionate levels of support.

·         Students will focus on learning these questions to the exclusion of learning anything related to their subjects.

But surely it is better to have transparency rather than to know that the first few students to sit the questions will then tell their friends in other schools and that it will advantage them?  Well no it won’t.  Earlier I mentioned the appeal not to reveal questions that was posted on the TES forum each year.  This year, students could be asked not to share questions, education-related websites could remove posts that refer to exam questions, etc.  The big thing is that it would be much harder for students to learn answers, because their friends would have sat only a small subset of the questions, it would be difficult to collate a complete set of questions, and each school is likely to use a different set of questions (albeit with overlap between them).  If they are all published to everyone and are all fully available then it will be much easier to learn the answers.

And the worst thing?  It will be in the interests of the school to use these flawed materials.

I am so pleased not to be a Head of Department and not to be in the situation of having to make a decision about which assessment questions to use.  If I were to choose to use questions I have selected, taken from different past papers, from different exam boards, over a number of years, then I could be fairly sure the questions will be unfamiliar to all of the students. 

If I wanted my students to get the grades they need for university, or to achieve extremely highly at GCSE, I would use these flawed papers, knowing that they would give me inflated scores that the officially-provided grade boundaries would translate into high grades.  I would then have evidence to demonstrate that the students deserve the highly suspect grades they would be receiving.

Where would this leave me and my personal integrity?  The second course of action isn’t cheating, isn’t bending the rules, but rather is using the materials that have specifically been provided by the exam boards, on the instructions of Ofqual.  Were I _not_ to use these I would disadvantage my students, would create more work for me and my department, all the while knowing that in other schools and colleges the students are using these freely-available papers.  This leads to another ‘what if’.  If I were a parent or student then I would be keen to know why my friends from other schools are being assessed using questions that are in the public domain, while my school had decided not to do this.

Surely I’m overselling this?  Surely it won’t happen?  Anecdotes suggest it will.  I have seen Yr 11s submit fantastic past papers, only to discover after a disastrous mock exam that the student had been assisted on a regular basis by their brother.  A memorable A-level student completed the past paper he had been set for homework by copying out the mark scheme, including the instructions to the examiners such as the symbols to say that answers could be rounded off, and giving alternative methods and answers.  I know of schools where the students do several papers as part of their mock exams and where they now give papers from different years because of the occasion where students used Google after paper 1 to find out the year of the paper and then downloaded and learned the answers to paper 2 from the same year, leading to a massive increase in the results for paper 2.  These are all genuine examples of the lengths pupils have gone to in practice papers and mock exams.  Ofqual will be publishing the _actual questions_ that students will be assessed on.  Clearly many students will learn/practise them.

And, even if you aren’t convinced by this, the DfE acknowledges that it will happen.  According to Schoolsweek:

Rebekah Edgar, the DfE’s deputy director for 2021 Qualifications, said the materials would also be published openly after Easter so “students and others can access them”.

She added that the publication was being delayed until after Easter “to try and avoid students sort of cramming with them over the holidays which we didn’t think was a healthy thing we wanted to encourage”.

I suggest they will still be cramming, but will need to pace themselves and catch up on sleep over Easter to allow them to do when the papers are published.

I accept that this system is going to be used in the summer: it’s too late to come up with anything different now. Maybe it’s not too late to change this decision about who the papers will be released to.  So I say to Ofqual, the DfE, and anyone else who will listen: “If you're going to do this damn silly thing, don't do it in this damn silly way”.

Notes:

https://www.tes.com/news/gcses-2021-car-crash-plan-share-test-materials

https://schoolsweek.co.uk/2021-assessment-materials-to-be-published-online-after-easter-dfe-confirms/

https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/964599/6747-2_response_analysis_-_GQ_consultation_on_awarding_grades_in_2021.pdf  See Q26.

 

 

 

Sunday, February 21, 2021

Just because I _can_ calculate something doesn’t mean I _should_

Like many other maths teachers, I was taken with the article in the Liverpool Echo with the headline:

I was invited for a covid vaccine because the NHS thought I was 6cm tall

A journalist for the Echo was surprised to be sent an appointment for a vaccine, despite being in his 30s without any major health concerns.  On asking why he received this invitation he was told that his height had been mistakenly entered as 6.2cm, which gave him a Body Mass Index of 28,000.  Given that a BMI of >40 is considered to be ‘morbidly obese’, this obviously put him at major risk!

As a Core Maths teacher, I was particularly excited, because this course (with UCAS points equivalent to an AS-level, aimed at sixth formers who aren’t studying A-level maths) includes a requirement for students to be able to analyse real uses of mathematics.  I wrote this up, intending to post it as part of my series of ‘Questions Inspired By A News Story’.  We can work out the mass of the journalist (and then his real BMI) because we are given the putative BMI and the height it was based on.  We can also work out that a 6-foot person with this BMI would weigh 94 tonnes!

I haven’t posted it because I feel a little uneasy.

  • It’s personal: I would be encouraging the students to work out the weight of the journalist.
  • BMI is a flawed measure.
  • I worry my students will calculate their own BMI (even if I don’t want them to). This is problematic if there are students who want to be right on the bottom end of ‘healthy weight’ or who make errors in their calculations and suddenly think they are obese, etc.
  • BMI is a population measure, and not an individual one, so we can’t interpret it for certain for each individual.

How might Core Maths teachers use this?

I think it is worth using as a cautionary tale about checking your inputs and your answers.  (Clearly it’s nonsense to have 6.2cm as a height, and clearly 28,000 BMI wouldn’t be feasible as an answer.) 

Aside from this, though, I don’t plan to use it to carry out other calculations with this in class, even though I can.

 

Sunday, January 17, 2021

Why the 2021 Exams Consultation is flawed

 [The red text is quoted directly from the Consultation on how GCSE, AS and A level grades should be awarded in summer 2021 produced by Ofqual.]

Here we are again.  In spring and summer 2020 we spent time preparing for and implementing the system that was created in the place of exams.  Without training or support, teachers were required to rank students in each subject.  This was difficult and time-consuming.  It only worked as well as it did because in many schools teaching wasn’t being done in the usual way and in the second half of the summer term exam leave would have been in place for Yr 11 and Yr 13 students anyway, so many teachers had gained-time they could use to develop the rank order and the CAGs.

So – to this year, and a new system to get to grips with.

Not only is the system itself going to be different.  The consultation tells us Grades would only change, in this process, as a result of human intervention.  This is code for “no algorithms will be used in the making of these exam results”.

Unfortunately, everything else is different too.  Now schools are required to have full teaching in place (having been explicitly threatened over this by the Secretary of State).  Then we are likely to have exam year groups in school for longer because instead of pupils sitting externally-marked exams in early June, teachers will mark the exams that are sat in early June and will use this, along with other evidence, to create a grade for their students.  Next, To help teachers make objective decisions we propose that exam boards should provide guidance and training.  Hold on: at a time when workload is greater than it ever has been, when there will be less gained-time in the summer term, on top of this teachers will need to undergo training to do something we have never done before.

The exam boards haven’t yet written that training (the system hasn’t yet been decided on) – for something where the deadline for teachers to submit the grades is 5 months away!  5 months: to finish the consultation, to publish the response, to create a system, to write training, to roll the training out to teachers, for teachers to deploy it with the students and to gather data and to put that together to create the final grade.  Really?

Last summer a system was put in place at short notice.  How did that one turn out?

System-wide change is hard.  It’s not easy to get it right at all, it’s hard to get it right first time and it’s even harder to get it right first time at speed.  Add to which the idea that it’s not just a new system for, say, providing vaccines, where it doesn’t particularly matter if 70-year-olds in one part of the country are inoculated a few weeks before those in a different area.  For the students’ exam results we need to ensure this is fair across every school in the country.  During a pandemic.  With teachers who have even less time than usual.

I am not objecting to making changes to assessment; if the government wants to do things differently and properly consider the implications, to have trials of alternative methods, etc, then that is fine … for exams in 2024 at the earliest.  My objection is the speed with which this will need to be done: the clock is ticking.  By the time the consultation closes there will be 4 ½ months before results need to be submitted.  My objection is to the additional pressure this will put on teachers, heads of department and senior leaders, especially head teachers.  My objection is that students will be anxious, unsure of what they need to do, upset and, ultimately, not served well by a rushed system.

What to do instead?  Don’t cancel exams.  It’s that easy. 

There are legitimate concerns about equity and access to education for every student.  In this scenario we could allow for special consideration, take note of who hasn’t had access to wifi, computers, give additional credit to those whose schools were closed earlier, who had to self-isolate, etc.  The huge resources that will be put into creating a new system for use this summer, could instead be diverted to provide support for pupils who need it.

Everything in the consultation revolves around exams being cancelled and in trying to make that work.  By ignoring whether that cancellation is the right decision we are being asked to comment on the wrong thing.

The consultation itself isn’t going to give sensible results.  How many people will answer the consultation without reading the full documentation?  Lots. 

Question: 1. To what extent do you agree or disagree that the grades awarded to students in 2021 should reflect the standard at which they are performing?

Surely no-one can disagree with this?  It’s makes sense, doesn’t it? 

If you read the consultation text you see that this is being contrasted with the system from 2020 where students were awarded the grade their teachers thought they would have got.  The question should include this information.

What does the standard at which they are performing mean?  Well, later the consultation says: Teachers should assess students on the areas of content they have covered and can demonstrate their ability, while ensuring sufficient breadth of content coverage so as not to limit progression.

It appears that they are not expecting students to cover the whole of the curriculum in a subject, but that they will be assessed on the parts they have studied.  How much is sufficient breadth of content coverage?  That doesn’t seem clear.

In the absence of exams, our view is that teachers, once provided with the necessary guidance and training, are best placed to assess the evidence of the standard at which their student is performing.

Exams don’t have to be ‘absent’.  No, they really don’t.  And while teachers _do_ know their pupils well and do know how well they are performing, they don’t know “the standard”, because we don’t standardise things.  Not across schools.  Not any more.

(We used to, but someone decided that national curriculum levels of attainment that were the same across the whole of England should be abolished and that it made far more sense for every school to reinvent the wheel.  Now we have a fragmentary system that means we can’t compare across schools.)

Now I will go through sections of the consultation.

2 What the grades will mean

Remember: the intention is that students will be assessed on the parts of the content they have studied.  Qualification grades indicate what a person who holds the qualification knows, understands and can do, and to what standard.  This won’t happen if each student is graded only on part of the course.

For qualification grades to be meaningful, a person who holds a qualification with a higher grade must have shown that their knowledge, understanding or skills are at a higher standard than a person who holds a qualification with a lower grade.  This won’t work if different students have been assessed in different ways.

We do not believe that teachers should be asked to decide the grade a student might have achieved had the pandemic not occurred. That would put them in an impossible position, as they would be required to imagine a situation that had not happened. It would also mean that those who use the grades would not know whether the grade indicated what a student knew, understood or could do or, rather, what they might have known, understood or could have done, had things been different.

The teachers who worked so hard in summer 2020 to create CAGs, and the students who received results in 2020 will be delighted to hear this! 

Teachers should assess students on the areas of content they have covered and can demonstrate their ability, while ensuring sufficient breadth of content coverage so as not to limit progression.

Rather than asking each school to create their own, different system for doing this, perhaps we could have a national method?  Such as an exam?

3 When teachers should assess the standard at which students are performing

Here are some of the questions in this section:

Question 2. To what extent do you agree or disagree that the alternative approach to awarding grades in summer 2021 should seek to encourage students to continue to engage with their education for the remainder of the academic year?

This assumes there should be an ‘alternative approach’.  There shouldn’t.  The consultation should be asking about whether exams can take place and how, not assuming that they can’t.

How many people are likely to say “no” to the idea that students should continue their education during this academic year?  What will you learn from the answer to this one?

Question 3. When would you prefer that teachers make their final assessment of their students’ performance?

I would prefer that teachers _didn’t_ make the final assessment.

For these reasons, we propose that teachers should make final assessments of the standard of their students’ performance during late May and early June. If the assessments were undertaken earlier, perhaps in April, then students would unnecessarily miss out on more of their education. If they were assessed later, perhaps in July, this would delay the release of results, as there would be insufficient time for teachers to assess their students and for the necessary internal and external quality assurance measures to be taken. This could in turn delay students’ progression at the start of the next academic year.

We have no way of knowing how long the quality assurance process will take, so we have to take Ofqual at their word on this.  This is therefore an unanswerable question – it is clearly daft to have them too early or too late.  Again: what will be learned from this question?

4. To what extent do you agree or disagree that teachers should be able to use evidence of the standard of a student’s performance from throughout their course?

“Should be able to use”.  But how? 

This feels like an obviously fair thing to do.  “If my student has some good evidence from earlier in the course then I should be able to use it” seems reasonable.  But how do we ensure a level playing field?  If mock exams happened in December for Yr 11 in some schools but were planned for January in others then this doesn’t give everyone the same opportunity. 

You might say that I am just answering the question here, but it’s more than that: we don’t have the detail to know how this will be done – so any answers will be meaningless.

4 How teachers should determine the grades they submit to exam boards

We propose that teachers should only take evidence-based decisions about the grade they recommend their students be issued. A breadth of evidence should inform a teacher’s assessment of their student’s deserved grade.

This is where the training for teachers comes in.  The training that will need to be devised and delivered by exam boards from scratch and done and dusted in only a few months.

If this is ever going to happen it should be brought in with a lead-in time of several years: enough time for teachers properly to understand what it looks like and what sorts of things will count.  Enough time for students to get used to working in ways that will showcase their abilities fairly.  Tacking this on in a hurry now means it will be hugely uneven. 

Who will it harm the most?  The already-disadvantaged.  If it’s the case that exams have been cancelled because disadvantaged pupils will suffer … well we need to put things in place to support them, not spend vast amounts of time and energy creating a new system that will still disadvantage them.

Having said that exams would be cancelled, the next part says: 4.1 The use of exam board papers

I challenge anyone to read that without smiling.  Exams have been cancelled, but instead students will sit ‘exam board papers’!

We propose that teachers should assess their students objectively. To support them we propose the exam boards could provide guidance and training, along with papers which teachers could use to assess their students. The exam boards might work jointly on the guidance and training where appropriate. The consultation seeks views on the role of these papers in informing a teacher’s assessment of a student’s grade. Provision of papers by exam boards would support consistency within and between schools and colleges.

As would exams.  As would exams.  As would actual exams!

The teacher, through the marking of the papers, could consider the evidence of the student’s work and use that to inform their assessment of the grade deserved. The exam boards could also sample teachers’ marking as part of the external quality assurance arrangements and to seek to ensure this was comparable across different types of school and college, wherever students are studying.

What?  So presumably a higher mark in the paper would suggest, I don’t know, a higher grade in the subject?  To ensure real consistency, why not get external people to mark them.  They could be trained to do this and could mark lots of papers.  We could call them “examiners” and they could be paid for doing it.  And we would have returned to the system of having actual exams.

The use of exam board papers could also help with appeals. We propose that the exam boards should use in their papers, questions that are similar in style and format to those in normal exam papers.

Read that again.  The questions will be similar in style and format to those in normal exam papers.  So they are exam papers then.

This means that the sorts of questions used will be familiar to students, who typically use past papers to help them prepare for their exams.

Like exams then.

The exam boards might use a combination of questions from past papers and new questions to develop their papers.

No no no no no.  Not past paper questions. Don’t even suggest this.  Just don’t.  All teachers are familiar with the student who gets 90% on a mock exam but subsequently gets 30% in the real thing, because they had done the past paper with a tutor, or an older sibling, or had found the answers on The Student Room, etc, before the mock.  In this scenario those students who happen to have done a particular past paper (as a mock exam or a practice paper) will be advantaged.  That’s not right.

The nature of the papers set by the exam boards will need to be appropriate for the subject. Students must be given opportunities to show what they can do. For example, a student who was working towards a high grade in GCSE mathematics must be given the opportunity to show they could perform to a standard associated with that grade. Similarly, a student who is working at a lower grade standard must have access to material which reflects that fact.

Um – exam papers generally try to do this. 

We propose that the set of papers provided by the exam boards should cover a reasonable proportion of the content and that teachers should also have some choice of the topics on which their students could answer questions. The set of papers could allow teachers the ability to choose from a set of shorter papers, based on topics, to allow teachers options to take account of content that has not been fully taught due to the disruption.

We need more information about what this means.  Will the teachers be given a list of topics that are covered in each question and told to select from those (“I’ll have a Pythagoras, a simultaneous equations and a ratio question, please”), or will they see the actual questions (“That’s a hard Pythagoras question – I think I prefer this one instead”)? 

It is important to note that the exam boards don’t know for certain how easy or hard students will find each question they set.  This is shown by the way grade boundaries are usually determined only _after_ the papers have been marked and data collated as to how each question performed.  In the maths world, a few years ago one of the exam boards tried to be helpful and gave estimated grade boundaries for a specimen paper for which they had no data.  After lots of concerned TES Forum posts from very anxious teachers they withdrew the boundaries – and haven’t issued such things since.  Given that the experts don’t find this easy to do, how can we expect teachers to sort out appropriate grade boundaries, particularly given that the data about how hard candidates find each question won’t be collected by exam boards this year?

If the topics covered by the teacher’s assessment are too narrow, students will have less opportunity to show the standard to which they can perform. They would also not have demonstrated the breadth of knowledge they hold, which risks halting their ability to progress successfully with further study. We are seeking feedback on the minimum breadth of subject content a teacher must assess a student on. This makes it appear as if the consultation is going to ask “how much” content must be assessed.  It doesn’t.  The closest to this is Q12: To what extent do you agree or disagree that teachers should be required to assess (either by use of the exam board papers or via other evidence) a certain minimum proportion of the overall subject content, for each subject?  This seems to me to be asking whether a minimum proportion should be tested, not what that minimum should be.

The exact approach would have to be tailored for each subject with details confirmed by the exam boards following this consultation. We propose that the exam boards should provide guidance on how teachers should take account of other evidence of the standard at which the student was working and of factors that might have affected their performance in the papers. In all cases we propose that teachers should record the evidence on which they base their decision for each student. This will be essential if students choose to appeal. It will also be needed by the exam boards for quality assurance arrangements.

_If_ other evidence is going to be used then it should be recorded.  How do we ensure this is done fairly?  How do we ensure every student has the opportunity to provide additional information?  How do we ensure this is manageable for teachers?  Teachers won’t want their students to be disadvantaged, but if a teacher currently has one exam class they will have a vastly different workload in this process from one that has several exam classes.  Those who teach in a sixth form college, for example, are likely to have around half of their students requiring grading and additional information.  And remember, this is an unfamiliar process that will require training, will require the marking of exam papers and is to be done without additional time being made available.

4.3 Other performance evidence

We propose that teachers should be able to take other evidence of a student’s performance into account when deciding on the grade to be submitted to the exam board. If teachers do not use the exam board set papers, or even where they do, they should use additional ways to assess students and to gather evidence of the standard at which their students are performing. The exam boards would provide guidance on how they could do this.   Gathering more evidence.  In what time-frame?  There won’t be time for exam boards to decide what is required/permitted, for them to prepare the training, to train teachers and then for teachers to tell students what they could do to impact this, so it can only be things that exist already, which will advantage those who already happen to have done the things that are deemed to be appropriate.

We propose that where teachers devise their own assessment materials, they should be comparable in demand to the papers provided by the exam boards.

Why would anyone do this?  Why would anyone want this to happen?  There is so much evidence to show that writing exam papers is hard.  It is reasonable for teachers to write end-of-topic tests, and to create formative tests that will show which children can answer questions on a particular topic.  But writing real, proper exam papers is hard.  It’s done by highly trained and experienced professionals.  And even they (as Twitter shows every now and then) occasionally get it wrong. 

Writing a single question without flaws is hard.  Creating an exam paper that provides a good mix of questions and difficulties is a different level.  Teachers just aren’t used to doing this.  Plus there’s the chance that pupils will get used to the style of questions their teacher poses … and will therefore answer a ‘home-made’ paper better.  Plus the teachers will know the questions that their students are going to get which doesn’t seem ideal.  Why would this be worth doing?  Only if teachers in a school were convinced it would benefit their students (perhaps, legitimately, by allowing the students to demonstrate better what they can do).  So if this is an advantage to the students, which teachers and schools will have the capacity/skills/experience to make it happen?  And who will suffer as a result?

Any assessment must allow students to demonstrate the standard at which they can perform. We propose that any teacher devised assessments used to support the final assessment should be used at the same time as the exam board papers would be taken, to avoid any students being unfairly advantaged or disadvantaged by the timing of when they are assessed.

A legitimate use of teacher-devised papers seems to me to be to allow for additional information to be gathered ahead of the exam period, to go alongside the exam papers created by the boards.  But that isn’t being permitted.

Teacher devised assessments should be supported by mark schemes, in order to support consistent marking within a school or college and any appeals. We propose that the exam boards should provide guidance for each subject on the relative use of different forms of performance evidence.  The exam boards now need to train people in how to write and use exam papers.  In ~4 months.  Good luck with that.

we propose that, in the majority of circumstances, greater weight should be given to evidence of a student’s performance that is closer to the time of the final assessment.

Does this mean that greater weight is given to topics that were studied closer to the end of Yr 11, or that greater weight is given to examining that happens closer to the end of Yr 11?  If the latter, then the easiest way to do this is to have exams.

We are also aware that it may be more difficult to draw on wider evidence for students whose education has been most disrupted and ask you bear this in mind when answering the questions here and in the equality impact assessment section.

Question 20.To what extent do you agree or disagree that a breadth of evidence should inform teachers’ judgements?

I know that this will be tempting for lots of people.  There are those who believe other evidence ought to be part of assessing final grades, alongside exams.  While I think it is reasonable to hold this position, I worry that some will see that supporting this question will help to usher that in.  At the risk of repetition: there isn’t time to put this in place properly this year, it will be applied unevenly, and the pupils who will be disadvantaged by this will be students who already face disadvantage.  Please don’t support this question just because you are ideologically in favour of it: the practicalities mean it will be a nightmare this year.

5 The assessment period

If schools and colleges use exam-board-provided papers or create their own, we propose they should be used by teachers within a set period of time. If students who are completing the papers do so at different times there is a risk that students taking the papers later in the window might be at an advantage, particularly if the content of the papers is leaked.

I love the optimistic use of “if” here.  I would replace it with “when the content of the papers is leaked”.  In a normal year, the day after a maths paper is sat there are videos showing worked answers on YouTube and threads about it on The Student Room.  This means schools can’t use those papers as mock exams the following year and is a source of frustration for many.  Of course the same thing will happen here.

This risk could be reduced by: (a) the exam boards creating a menu of papers from which teachers would choose. The papers could be deliberately published shortly before the assessment window opened, although students would not know which one(s) they would be required to complete

By “published” does it mean that they would be made openly available to everyone, including students?  Those with access to additional teaching, private tutoring, etc, will be able to go through these.  And they will appear as worked answers on social media.  Or does it mean that schools will only be able to see the papers (which will still be kept away from students) a short while before choosing the questions they want their students to answer?  That will lead to a mad scramble just before the exams.  What if the teachers decide the questions aren’t appropriate for their students at that late date?  Do they then begin to write their own paper?

(b) all students completing the papers for a particular subject within a certain time frame—and we are seeking views on how long that should be It is important to consider what would happen if the course of the pandemic is such that papers cannot safely be sat within a school or college (see the next section). Following this consultation, the exam boards will seek views from schools and colleges on the dates between which the papers for each subject can be used by teachers. We propose that, in the interests of fairness and consistency, students assessed with and without the use of the exam board papers should be assessed as late as possible in the academic year.

If there is an assessment window, what is the benefit to schools of having their students do the exam early in that window?  Some will want to defer them as late as possible to allow for more lessons to take place.  And it will be extremely difficult to police leaks of papers and who might have seen them. 

We shouldn’t forget that students will be taking their usual subjects.  For Yr 11 that might be 9 or 10 subjects.  If there is only one exam in each subject these still needs to be spread out and still requires an exam timetable to be created (add that to the list of things for every school to do separately: create an exam timetable) except instead of having the usual 6-week-long exam-board produced timetable, it all needs to happen in a shorter timeframe.  More exams in each subject would make this more challenging to do, fewer would make the results less reliable.

7 Supporting teachers

Question: 31.To what extent do you agree or disagree that the exam boards should provide support and information to schools and colleges to help them meet the assessment requirements?

Will anyone disagree with this?

9 External quality assurance

We propose that the exam boards should quality assure the approach taken by each school and college and that the exam boards should work together, where appropriate, to make sure their approaches are both consistent and do not impose unnecessary burden on schools and colleges.

_All_ of this is an unnecessary burden on schools and colleges that is being caused by the decision to cancel exams.

We propose that the exam boards should engage with every school or college to consider the approach it is taking.  Will this be on a subject basis or a centre basis?  If the former, will exam boards have enough capacity to do this?  If the latter, does that mean the exact same approach will have to be taken across every subject?

All schools and colleges, regardless of cohort size, geography, demographic or centre type could be subject to further checks. We would also expect the exam boards to target some of their quality assurance activities. They might, for example, spend more time with a new school or college verifying that compliant processes are in place,

This process is a brand new one.  No-one has done it before.  _All_ schools and colleges will be ‘new’ to doing this. 

10 How students could appeal their grade

We propose that the appeal should be considered by a competent person appointed by the school or college, who had not been involved with the original assessment – this could be another teacher in the school or college or a teacher from another school or college.

This is a very odd way of doing things.  The person considering an appeal will be chosen by the school, and could even be a colleague of the teacher who made the original judgement. 

an appeal to the exam board would be on the grounds that the school or college had not acted in line with the exam board’s procedural requirements, either when assessing the standard at which the student was performing or when considering the student’s appeal. A student could not appeal to the exam board on the basis that either the teacher assessment or the appeal decision was not a reasonable exercise of academic judgment where the correct procedure had been followed.

How will students know that the procedural requirements haven’t been followed?  Presumably this will require every school to publish detail of what they have done and what evidence they have used?  Is that a sensible use of time?

To relieve pressure on the appeals process, we are seeking views on whether results day(s) in 2021 should be brought forward as this could be of benefit to students, schools and colleges and further and higher education providers. Students should only be issued with their result once external quality assurance by the exam boards has been completed. If there is an appetite for results to be brought forward we will consider the interaction between the timing of students receiving their results and the results becoming formal for the purpose of university admissions, working with the further and higher education sector to ensure no delay to existing admissions timelines. We propose that the exam boards should publish information for use by schools and colleges on how to deal with appeals.

Does this mean appeals would happen during the summer holiday?  Would teachers need to be on-hand to respond during that time?

11 Private candidates

We want to build into the approach opportunities for private candidates (for example students studying independently, and home educated students) to be awarded grades in summer 2021.

The proposals give four suggestions, of which the third is:

(c) for the exam boards to run normal exams for private candidates to take in the summer of 2021 – appropriate venues would need to be provided.

This suggests that exams haven’t been “cancelled” then.  The only thing that would be different here from having _all_ students sitting exams is the number of students who are involved.  If it’s deemed fair for us to consider in this consultation that private candidates might sit exams, surely it’s fair for us to be asked whether _everyone_ should be allowed to sit exams?  Question 58 says:

58.If the preferred option for private candidates is an exam series, should any other students be permitted to enter to also sit an exam?

Yes!  All of them!

Impact on schools and colleges

We expect there would be one-off, direct costs and administrative burdens to schools and colleges associated with the following activities: • familiarisation with information and guidance from exam boards on teacher assessment and submitted grades • communication and training from senior leaders to teaching staff on teacher assessment and submitted grades • marking and quality assurance of teacher assessments and submitted grades • amendments to centre systems to enable the required information to be gathered and submitted to exam boards in a format specified by them • managing high volumes of enquiries from candidates and parents • managing potentially high volumes of appeals

Of these, which will fall on teaching staff and senior leaders in school?  Most of them.  And even if exams officers make amendments to centre systems and are the first contact for enquiries from candidates and parents, teaching staff will need to learn how to use the centre system, will need to enter data they didn’t used to have to input (because exams were marked externally) and will need to respond to at least some of the queries.

But it’s OK, because there are things schools won’t need to do that will balance this out:

Schools and colleges will be delivering the alternative arrangements in place of, and not in addition to, the usual range of activity required to deliver summer exams in their centre including, for example, secure handling of exam papers and scripts, invigilation of exams and dealing with any cases of possible malpractice and maladministration arising in usual exam delivery.

Let’s look at these in turn:

secure handling of exam papers and scripts

This will still need to happen to maintain integrity.  This is a task that wasn’t carried out by senior leaders and teachers but by exams officers.

invigilation of exams

Teachers aren’t allowed to invigilate exams; external people are paid to do this in a normal year.  In fact, who will be doing that this year, when the exam papers are sat in school?  There will _have_ to be invigilation happening in any case.

dealing with any cases of possible malpractice and maladministration arising in usual exam delivery

This will also still need to be done (and would have been carried out by the exams officers and not by teachers in any case).

So this section lays out the vast extra work that teachers and senior leaders will have, countered by things that are either a mirage, or which would have been done by non-teaching members of staff anyway.

We acknowledge that the burden of delivering the revised arrangements could be greater and more challenging for both exam boards and centres where staff availability is affected by the coronavirus (COVID-19) and centres are closed for normal teaching.

This one hadn’t occurred to me.  If there is a short timescale for exam board papers to opened and for decisions to be made as to which parts to use, if teachers are unwell then that will mess things up.  Normal exams could be invigilated as usual, with perhaps the need to recruit more invigilators if there is illness within the group, because no specialist subject knowledge or knowledge of the students is required to carry out the invigilation process.

We also acknowledge the exceptional impact of the coronavirus (COVID-19) pandemic on the workload of teachers and their colleagues.

I am pleased to see this written down, but these proposals suggest it has then been entirely ignored.  Teachers and senior leaders are being asked to do an intolerably large number of additional duties.

Impact on students

Students taking the relevant qualifications are directly affected by the proposed arrangements. We are focused on making sure they are not disadvantaged and that disruption to their planned progression is minimised.

It is right that students should not be disadvantaged and should not be disrupted.  Unfortunately these proposals don’t achieve this goal as well as exams would.  We should be asked for our thoughts on ordinary exams as well.

Summary:

What has been suggested here is vastly less good than having exams and tweaking how those are organised and managed. 

Here are the downsides of these proposals:

·         Huge extra workload for teachers and senior leaders with the need to:

o   Write/choose exam questions

o   Justify the choices

o   Be trained in how to assess students by non-exam means

o   Set and mark the exam questions

o   Decide on the grade for each student

·         Teachers will need to do all of this with a period of about 4 months, while teaching full-time and remotely, in a pandemic.

·         Anxiety amongst students who have been preparing for one system and who will now have to change to something new, something that neither they nor their teachers have experience of.

·         The fact that exam boards and teachers will have to do all of this at speed.

·         Disadvantaged pupils are likely to be more disadvantaged.

·         Despite best efforts, it won’t be moderated in a fair way across schools; there will be huge differences in the questions that are used, in the way additional evidence is taken into account.  It won’t be fair and it won’t be seen to be fair.

·         Exam questions will be leaked, they will make it into the public domain, and this will give some students an unfair advantage.

·         There is chance in play here: if students happened to do a mock exam in December then that might be usable, but cancelled January mocks are not.

How can we deal with these problems?

This answer to this is boring and predictable: having exams as usual will deal with every single issue listed above.

Here are the downsides of having exams as usual?

1.       In different schools the teaching provision during lockdown has been different and not all of the syllabus can be covered in full.

2.       Disadvantaged students are likely to have suffered disproportionately (perhaps because of a lack of access to wifi, IT equipment, a place to work, equipment for art, etc).

3.       Schools might not be able to be open on a particular date in June for students to come in to sit their exams, or certain students might be having to self-isolate at the time of an exam.

How can we deal with these problems?

It is reasonable to say that if I am disagreeing with one set of proposals I should come up with an alternative, so here are some comments on those problems caused by having exams as usual:

1&2) Additional resource needs to be put in place in schools that have been more disadvantaged by lockdowns and for students who have been more affected.  If Yr 11 and Yr 13 have been affected in some schools more than others, then so will Yr 10, and Yr 7, and Yr 5, etc.  Changing the entire exam system for this one year won’t help those other year groups and doesn’t deal with the underlying issue.  Special consideration could be applied by exam boards, with schools asked to say which students are likely to have been disadvantaged, either because of access to equipment or by additional periods of self-isolation.

3) This might be the case for the new system that is proposed, and the solution for that can be used for ordinary exams.

It seems far more sensible to tweak the usual exams rather than throwing them out (and replacing them with different exams).  These tweaks could be different in each subject.  For example, in GCSE maths there are currently 3 exam papers, all of which examine the majority of the curriculum. Removing one paper would not be a major issue and would save on exam-time (although it wouldn’t sort out lack of coverage of the curriculum).  If there are distinct topic areas within exams (this might be more likely at A-level) then it could be feasible for students to choose say 2 out of the 3 topics to answer questions on.  Alternatively, in all examined subjects the topic for each question could be made explicit and schools could declare in advance which topics have been covered in their school, with those that aren’t being ignored for those students (with a minimum requirement in place).  I think my preferred suggestion would be for exam papers to be set as usual and for the lowest-performing 20% of questions to be ignored for each student, so it won’t matter that they have only covered 80% of the content of the exam. 

Is this perfect?  No.  Is it better than the proposed system?  Yes!  And will take vastly less time, energy and resource to put in place: time, energy and resource that could be diverted to the students who need it most.

A plea

I have strong views on this.  If you do too, then please take part in the consultation (whether you agree with me or not!).  I will be using the ‘any other comments’ questions to say how much I disagree with the approach being taken.

Please read the full consultation document first and then reply to the consultation.  The link for both of these is here: https://www.gov.uk/government/consultations/consultation-on-how-gcse-as-and-a-level-grades-should-be-awarded-in-summer-2021

The deadline is Friday 29 January 2021 .