Saturday, March 18, 2023

EQE: 17 Mar 2023 - Pre-Exam - no copy (sorry), but my comments

ItC => no ticket for you!
Friday was the e-EQE Pre-Exam (Part 1: 0930-1040 CET - 70 mins, part 2: 1100-1210 CET - 70 mins, part 3: 1330-1440 CET - 70 mins and part 4: 15000 - 1610 CET - 70 mins). Unfortunately, I was not able to get a copy of the questions, so I cannot share them. The EPO normally makes good copies available in the compendium in the week after the EQE.

  • I am keeping my fingers crossed for all 2023 candidates 🤞🤞🤞. 
  • If you had any issues with any exam that affected you efficiency, or it was not inline with your expectations, please file a complaint.  Formally, complaints must be formally filed no later than midnight on the day of the exam you are complaining about. Even if you have miss the formal deadline, submit all complaints that could affect your marking or performance as quickly as possible to helpdesk@eqe.org. 
  • You can also give a reason why you were not able to submit immediately after the exam, such as tiredness or needing to prepare for the next exam. Also realise that by filing a complaint, you keep your options open regarding an appeal. The first thing that is checked by the Disciplinary Board is whether you complained promptly after the exam. You are also creating a record while it is fresh in your mind. Even if it is something that you might feel is your fault, remember that the conditions under which you are taking the exam have been 100% determined by the EQE organisation and that you have no choice but to do it that way. Any issue that you may have is directly caused by these conditions.

  • Some tips for the e-mails from case law:
    • turn on the automatic read receipt confirmation
    • ask them to confirm receipt
    • ask them also to confirm that the email has been forwarded to the Examination Board
    • explain why you were not able to submit the complaint on the same day of the exam
    • keep bugging them until you get the confirmations.
  • My suggestions to candidates after the eEQE
    • Celebrate - you survived the third eEQE 🥇
    • Put your TAB and WINKEY caps back 😀
    • Manually uninstall Lockdown Browser: in Windows, it is found in the start menu under Respondus
    • Be suspicious of any emails mentioning WISEflow or Lockdown Browser or Respondus. if you get any emails about "updates" of the Lockdown Browser, do not click on them. Only update through WISEflow.
    • Preferably unplug all the extra cameras and microphones. Or at least cover the cameras when not in use.
    • Take a couple of days off and celebrate 😉
    • Don't read blog posts about model answers. They are usually made by EQE nerds who made the exams under relaxed conditions. They could still be wrong. Even if it is a perfect answer, no-one knows where all the marks will be awarded. 
    • The marking sheets are only finalised after the exam following discussions within the committees about what to accept and what not. For example, if there was an issue almost no-one dealt with, they usually compensate by awarding marks for something else that most people got. The exams usually have built-in fail-safes, so if you miss something, you will not lose marks everywhere. 
  • I heard some very disturbing news that candidates were not allowed late entry to the flows under any conditions. It was suggested that the Instructions To Candidates (ItC) have been amended on that point. In the version of Dec 2022 on the EPO website (why has these Instructions not been published in the OJEPO before the exam?):
    • I. General  
      • 2. Candidates must enter the online examination environment as stipulated in point IV below at the official start time
      • 4. Candidates who enter the online examination environment after the official start time of a particular examination paper or paper part may not make up the lost time at the end. 
      • 5. Candidates will not be allowed to enter the online examination environment more than 15 minutes after the official start of each examination part (flow).
    • IV. Preparation and start of the examination
      • 8. After completing the above steps, candidates must immediately launch the lockdown browser. The lockdown browser launch procedure should be run at the start of the examination but must be completed no later than 15 minutes after the examination start time. Otherwise, candidates will not be able to enter the flow and sit the respective paper or part thereof.
  • Note that in the last version that was actually published in the OJEPO before EQE 2023 (OJ 2022, A20), these sections read:
    • I. General
      • 4. Candidates who fail to log on to the FLOWlock browser by the official start time of a particular examination paper or part of a paper may not make up the lost time at the end unless, in exceptional cases, the invigilators decide otherwise.
    • IV. Preparation and start of the examination
      • 8. After completing the above steps, candidates must immediately launch the FLOWlock browser. The FLOWlock browser launch procedure must be completed no later than 15 minutes after the examination start time. Otherwise, candidates will not be able to sit the EQE.
  • It is not clear to me from either version that this is a hard deadline which cannot be overruled in certain circumstances. Candidates can only take this exam 1x per year - if they are casually denied entry, their careers can be jeopardised and they can be severely demoralized.
  • In at least one case, the candidate contacted the invigilators who stated that late entry was not allowed because they had printed out the materials and could have passed them on to someone else. So, the candidate was prima facie accused of cheating without any evidence or chance to defend themselves, and not allowed into the flow at all. 
    • It reminds me of the infamous Munich ticket machines pictured above that randomly don't accept credit cards, bank notes over 20 Euros, coins etc, and guide you through endless menus only to reset if you take too long to choose. No ticket for you!
  • This absolute exclusion cannot be true - the normal procedure should be that the candidate is allowed to do the the exam and the "suspicious" situation is reported to the Examination Board. 
  • It is clear in ItC IV. Misconduct (OJ 2022, A20) only the Examination Board is allowed to take a decision regarding cheating, not the Secretariat:
    • 3. Suspicious events during the examination pointing to potential cheating, e.g. suspicious looks in a particular direction, that are detected during the retrospective review of the video and audio recordings can be punished by the Examination Board under Rules 19 and 20 IPREE. The Examination Board may do so even after the examinations have been marked and the results published. 
    • 4. Other breaches of the instructions may also lead to consequences for candidates and may attract further consequences under Rules 19 and 20 IPREE.

Thursday, March 16, 2023

EQE: 16 Mar 2023 - C Exam - no copy (sorry) and my comments

Thursday was the e-EQE C Exam (C-1: 0930-1230 CET - 180 mins and C-2: 1315-1615 CET - 180 mins). Sorry, I do not have a copy available (I was not a benchmarker), but please post any comments you have. The EPO normally makes official copies of the exams available in the compendium in the week after the EQE.
  • I heard from many people that the subject matter was very mechanical.
  • There were also a lot of complaints about the amount that you needed to read in C-1 before you could answer. Most people seemed to have needed 2 hours before they could start answering.
  • In the afternoon, the experiences seem to have been reversed, with plenty of time available. But, according to the exam rules, it is not allowed to answer any of the morning questions in the afternoon.
  • A common feeling is that the exam timing should have been C-1: 4 hrs and C-2 hrs.
  • Having to read so much in C-1 is a severe disadvantage to non-native speakers.
  • I also don't understand why the C exam is not split evenly into 2 parts, either as 2 mini cases or two sets of associated claims with different prior art. The committee has had 2 years to do this - the WISEflow restrictions are still the same as in 2021. There is no excuse for this. Again, there will be many "fit-to-practice" candidates having to retake the C-exam in 2024.
  • I have heard a rumor that candidates who seem to improve their understanding of the case during the afternoon are suspected of cheating by discussing part 1 with someone else. There is also an innocent explanation - candidates are so overwhelmed in C-1 that they start reading as soon as they have printed out C-2. Or some of them reread C-1 in the lunch break. This is not forbidden by the rules - it is just a risk because they do not know how relevant the C-1 information will be in C-2. But for 2021, 2022, and 2023 it has been very relevant. There is a very simple way to fix this - split the exam properly!
  • And again, it seems that all the discussions about changing the exam syllabus are also completely pointless because the committees will just make the exams that they want to. I have now changed my opinion to be in favour of the multiple-choice only option originally proposed by the EPO.
  • It is unacceptable that good, well-prepared candidates are now spending several years trying to pass these 4 exams due to the unpredictable technical problems and due to the unexpected exam contents. 
  • And non-native speakers continue to be punished. They do not expect any favours, but they should be treated fairly and they should able to adequately prepare based on previous exams.

Tuesday, March 14, 2023

EQE: 14 Mar 2023 - B Exam - no copy (sorry) and my comments

Tuesday was the e-EQE B Exam (0930-1300 CET - 210 mins). Sorry, I do not have a copy available (I was not a benchmarker), but please post any comments you have. The EPO normally makes official copies of the exams available in the compendium in the week after the EQE.

I heard from many people that it was a lot of subject-matter to get through, similar to the old exams where you had to figure out the amendments yourself. If you need too much time to decide on your amendments on B, it becomes very difficult to pass because most of the marks are for argumentation (support, novelty, inventive step).
  • The problems in B are made worse by the difficulties in WISEflow of comparing on-screen claims as filed with the description as filed, and comparing on--screen amendments with the claims/application as filed.
  • And the problems in current B exams are made even worse by the very high time pressure. When the PE was introduced, the B-exam was reduced in 2013 by 30 minutes by providing a claim set from the client. This can only save time if it is almost exactly the direction to go in. The standard advice from tutors used to be (in 2013 - 2019) was not to think too much and just follow this direction, clearing up clarity and extension issues, and writing out the argumentation.
  • Since 2021, the B committee has gone back (unannounced) to the old-style (< 2013) of B-exam, requiring a more thorough interpretation often deviating from the clients proposal, but without giving the 30 minutes back. So, more technical understanding is needed to figure out the amendments, but you have no time to think, and definitely no time to correct your answer. You have one-shot to pass.
The basic principle of A and B as negative mark exams is a fundamentally flawed principle, which can lead to an enhanced loss of marks. The Disciplinary Board has also commented on this. You start with 100 marks, and lose marks for every mistake. That means that they have to anticipate all expected mistakes during exam drafting, and either added additional comments in the exam to point you away from them, or provide a route to keep getting marks after making mistakes. Unfortunately, with the combined technology exams, it is even more difficult to predict what 1000 candidates will do. What you are often missing with an unexpected solution are similar features in the prior art for the novelty & inventive step defence, and you are often missing a clear technical effect associated with your distinguishing features.
  • Because of the time pressure, there is no time to rewrite your answer or to change your mind. The only guidance you have is that if you find the supporting words / phrases for amendments, and you have a technical effect, then you are probably on the right path. 

Saturday, March 11, 2023

EQE: 9 Mar 2023 - A Exam - no copy (sorry) and my comments

Updated 14 Mar 2023
Thursday was the e-EQE A Exam (0930-1330 CET - 240 mins). Sorry, I do not have a copy available (I was not a benchmarker), but please post any comments you have. The EPO normally makes official copies of the exams available in the compendium in the week after the EQE. 

  • I heard from many people that it was very electromechanical, similar to the old exams when there were separate EM and CH exams.
  • There is a clear trend emerging of alternating exams with either very CH cases and solutions or very EM cases and solutions. This pattern seems to be in both A and B, but offset to each other. It does not seem as if they are able to make the combined technologies approach work properly.
  • De facto, we seem to have moved from a system pre 2017 where EM/CH specialties were tested each year to the current system where EM/CH specialities are only tested every 2 years.  It would be interesting to see how many candidates are now only passing A and B after 2 years. Unfortunately, the publicly available detailed statistics per candidate (anonomised) have been suppressed during the last few years, so it is not possible for any third party to evaluate this.
  • Maybe they could announce in advance whether it will be an EM or CH flavour - that could save candidates from a lot of frustration.
  • They either need to provide an exam that all competences really can pass or provide better guidance about how to prepare. I still believe that it is a better to have more generic AB exams, but we maybe have to admit that the current EQE system just cannot deliver it.
  • It also means that it is pointless discussing theoretical changes to the exam syllabus if they will just produce basically the same exams in different pieces with different names.
The basic principle of A and B as negative mark exams is a fundamentally flawed principle, which can lead to an enhanced loss of marks. The Disciplinary Board has also commented on this. You start with 100 marks, and lose marks for every mistake. That means that they have to anticipate all expected mistakes during exam drafting, and either added additional comments in the exam to point you away from them, or provide a route to keep getting marks after making mistakes. Unfortunately, with the combined technology exams, it is even more difficult to predict what 1000 candidates will do. What you are often missing with an unexpected solution are similar features in the prior art for the novelty & inventive step defence, and you are often missing a clear technical effect associated with your distinguishing features.
  • Because of the time pressure, there is no time to rewrite your answer or to change your mind. The only guidance you have is that if you find the supporting words / phrases for claims features, and you have a technical effect for your distinguishing features, then you are probably on the right path. 

Wednesday, December 7, 2022

Internet Resources & Calendars during EPAC 2022 & EQE 2023

During the exams, only LIMITED ONLINE ACCESS will be available. So, you will need to print references and CALENDARS yourself before the exam. WISEflow allows access via the Permitted Internet Resources menu to EPO Legal Texts (En / Ge / Fr) and PCT APPLICANT’s Guide (En / Fr) only.

We have made a set of Exam Calendars available, including the closing days from the EPO, as well as some guidance about using them and calculating time limits.

See IP.appify Blog post for more details.

Friday, October 28, 2022

Who can afford an in-person EQE ?

By DALL·E, OpenAI
The EPO makes Adminstrative Council documents public to increase transparency. Unfortunately, they do not have older documents. I have made CA/139/08 available here because it provides important background for the many changes made to the EQE during the last years. 

There are a lot of people arguing that we should go back to the in-person exam. But that can only happen if some organisation is willing to organise it and/or pay for the organisation. The EPC is silent about who should bear the costs for the EQE, so it has been a struggle between the EPO and the epi / national offices as the EQE has grown from tens of candidates candidates to a couple of thousand. The system is very dependent on the many people who kindly sacrifice their free time organising / making / marking exams. 

For example, the figures in 2007 were:
"All in all, the cost of the 2007 examination came to EUR 7 167 000.
Of this, EUR 2 681 000 (estimate based on EPO cost levels) was contributed through the working time of professional representatives made available free of charge and EUR 108 000 (estimate based on EPO cost levels) through kind support from national patent offices in the form of premises and staff.
Receipts from fees amounted to EUR 652 000.
The remaining costs totalling EUR 4 378 000 were borne by the EPO."

This was the main reason to introduce the Pre-exam - with the increasing number of resitters in the system, the EPO calculated that their costs would rise to 8 500 000 in 2018

Whether you want it or not, the EQE will change. I have no idea what the current online exams cost, but it must be a lot less than in-person, so it will stay online.
Longer exams do not work online, and there are many countries that have health and safety rules which oppose having to be present for 90 minutes without a bathroom break. So, they have to move to shorter exams.
Also, it is getting harder to find enough volunteers, so they have to move to exams that are less time-intensive to make and less time-intensive to mark. 

Thursday, September 22, 2022

September 2022: PCT.App update is now live!

The only digital PCT reference that is future-proof, self-customisable, & self-printable. In English & German. Paper books and an EPC version are also available.

We have just completed our major update of PCT.App for the legal changes in July & August. Most of the changes relate to sequence listings, which is now much more integrated into PCT. We have also changed some core structures to improve the layout and to distribute legal provisions in a more logical way.

In the self-editable online version of our PCT commentary, all changes of the update are rolled-out automatically, while personal user annotations from before the update are retained and can be exported into a customized printable PDF offline version. As usual, we further published this September 2022 edition as standalone softcover books in English or German with same content. 

See the post on the IP.Appify blog for more details.

Thursday, September 1, 2022

New e-EQE has major improvements

A cyberpunk illustration of a successful ecstatic student with laptop and books
By DALL·E, OpenAI
The EPO and epi recently published their extensive proposals for the new e-EQE, including mock exams to get a better feel for the changes.

It will be a major improvement for candidates, but it will also depend on how the modules will be made.

IP.appify Blog: New e-EQE has major improvements

Monday, July 11, 2022

e-EQE2022: Main Exam - what to do after a pass or a fail

15-07-2022: added comments about translation errors.
14-07-22 - added note about split exams compensation.
13-07-22 - added "fit to practice" check during marking.

A big congratulations to all who passed at least at one exam. None of the exams are easy, and if you are unlucky, it is easy to miss something crucial or to misread a sentence.

The result totals and statistics are available here. The pass rate for B is higher than last year, and D is relatively high compared to previous years (not including D 2021 because of the global compensation for technical issues). 

Unfortunately, (since 2021) anonymized individual results are no longer made available, so we cannot calculate statistics or see the mark distributions per exam. Joeri Beetz has a nice website with extensive statistics for the older exams. We were told last year that this omission was due to a lack of capacity.

2021 "Pass rates" - candidates with 45 points or higher:

  • Nr of candidates: Main Exam = 2780, A = 1905, B = 2005, C = 1852, D = 2003
  • A  = 79%, B = 65%, C = 57%, D = 92% 
  • Passed last exam in 2021: 1093 (= 53 % of all ME candidates)

2022 "Pass rates" - candidates with 45 points or higher:

  • Nr of candidates: Main Exam = 1918, A = 886, B = 1158, C = 1400, D = 704
  • A  = 73%, B = 84%, C = 61%, D = 71% 
  • Passed last exam in 2022: 885 (= 46 % of all ME candidates)

The Examiners Reports for each exam are also available here. Unfortunately, the marking sheets are missing (they were included in 2021 and previous years). These are the same as each candidate receives, with a rough division of  available marks. I don't know why they are not included this year.

For each exam, the Examination Committees have selected Candidates' Answers in English, French and German who scored quite highly with an exam answer close to their desired solution. These are unedited, so they can contain mistakes. Unfortunately, the marking sheets for these candidates are still missing (they were also missing in 2021). These marking sheets were very useful for candidates trying to understand where they missed marks. We were told last year that this omission was due to a lack of capacity. 

Still to be published is the Survey report, summarising the answers provided immediately after the exam. It will appear here, at the bottom of the page. Hopefully, it will be back to it's pre-2020 extensive format. In 2021, it was merely a PR folder - we were told last year that this was due to a lack of capacity. 

In October (usually in week 42), there will be a meeting of Tutor's and the Examination Committees to directly discuss the exams of 2022, and to look ahead to EQE 2023. No definite date for the meeting is yet available. In 2021, it was online - no word yet if it will be back to an in-person gathering.

If you passed your last exam, double congratulations 🥇and welcome to the post-EQE world 💪. 

  • For attorneys, request entry onto the list of representatives. 
  • If you are a national of a non-EPC state and you wish to be on the list, you need to request an exemption under Art. 134(7). This involves extra administration - see the FAQ's. Preston Richard has made a template letter that you can use.
  • Relax and look forward to developing other aspects of your career.
  • Even though the epi has no formal requirement for permanent education, commit to keeping up your knowledge. You still need up-to-date knowledge to provide optimal services to your clients, especially of changes in EPO procedure:
    • Subscribe to a blog that regularly discusses case law and legal changes, like the IP.appify blog
    • Go through the yearly changes to the EPO guidelines and follow G decisions
    • Use your legal knowledge more in your daily work (see if a colleague needs help with an office action or opposition, give a presentation to your office, check whether your office procedures meet "all due care", teach subjects to trainees, write a legal article).
    • Attend or follow the EPO's education sessions related to Applying for a Patent, to Law and Practice, or for Patent Attorneys
    • Become a tutor, or volunteer for an Examination Committee
    • If you have added digital notes to EPC.app and PCT.app, they will be updated automatically each year.
Click on READ MORE > > for possible actions after a fail