Sunday, April 18, 2021

e-EQE – epi discussion paper - comments

The epi recently published their discussion paper on proposed changes to the EQE from 2024. See below for some comments, following on from my earlier comments on the future of the EQE. 

My conclusions: 
  • Some good ideas, like allowing an earlier start of learning, but I miss any proposals to improve the organisation. 
  • I miss a proposal for permanent education - the EQE tests whether a small number of representatives are fit to practice at that moment. 
  • I hear more and more candidates choosing to follow a law degree instead of the EQE because of the unpredictability of passing. Having everything modular will help prevent this getting larger.
    • But we also need a clear syllabus for each part, transparent marking and a proper way to address the concerns of the average non-native speakers.
  • Infringement has to be added - it is an essential part of being a patent attorney.
My comments:

1. Is the current EQE adequately testing the “fit to practice” criterion? - p.1
  • Some Exam Papers are ... jigsaw puzzles ... rather than testing real skills ...
    • It is not a problem if questions are designed to have one answer - the legal questions are set up like this. Having small puzzles that fit together, like the current Pre-Exam - claim analysis and D2 does mean that you can feel when you are on the right path.
    • However, the general advice to pass currently is to not think too much and give the answer in the Guidelines because alternatives are almost never accepted, even if properly argued. Perhaps that way that the questions are structured needs to be clarified - instead of asking, is it novel/inventive/extension etc, you can ask whether the EPO will object (the Guidelines answer) - candidates should know what will happen during proceedings.
    • The biggest current "puzzle" is the C exam - it is completely out of control (not just this year). There are too many different documents and the pieces you need are not always in the most likely places. Way too long, too many documents, with a ridiculous amount of detail require for argumentation. 
    • The B exam is now going the same way. 
  • All papers should start with 0 marks, and award marks for correct parts. A and B suffer the most because they are negatively marked - you start with 100 marks, but lose marks for each deviation from the expected answer. The problem is that by misreading or misunderstanding a couple of things, you end up running out of materials to use. There is a randomness to passing - if you are on the same wavelength, you pass. If not, you fail. But if you retake it a year later, then you can pass without preparing any differently.
  • Marking of the practical papers should always consider whether a mistake would be correctable in real-life 
      • Why should you be afraid for A of submitting a non-novel claim or non-inventive claim? As the argumentation supplied tends to be brief for A (as it reflects the brief argumentation typically included in a patent application), you should not lose so many marks if a dependent claim is what they wanted. There should be no marks lost for extending a feature beyond the scope of the client's letter, for example.
      • For B, where argumentation is required, the reasoning can be judged better for possibly having a non-novel or non-inventive claim. There should be no marks lost for not abandoning scope based on an instruction by the client if you think it is patentable (and argue this). 
      • Why is matching EVERY feature and correctly defining closest prior art in C such an issue? For an opposition, the main thing is to attack all the claims, get all the documents in, and argue the non-trivial aspects of the feature matching and inventive step. You would not write an opposition like that.
  • Methodology courses - p.1, p.2
    • I may be a little biased ;-), but I am not sure why it is a goal to get rid of these. Most of the methodology courses are based on reverse engineering and save candidates a lot of time that they can use for actually practicing papers. I don't think these will disappear, even with a more modular exam and shorter pieces. 
    • These are currently "needed" because the exams are much too long (so very difficult to do in the time available, especially for non-native speakers), there is no official info about what is to be tested, how the papers should be made, or how they should be marked. The Examiners' Reports are not easy to read and deliberately leave out a lot of details on alternatives that were accepted, or the exact marking. Even if candidates file an appeal, they will never see the details of their marking to see where they lost marks. 
    • If there are tricks that is being taught to pass with little preparation, obviously this should be prevented. But I don't consider pointing out where marks are awarded and how to score those marks as a trick - all marks count equally to the scoring, and candidates should always focus on their strengths and understand what is required. I don't see weak candidates passing just through methodology - more that there are a lot of well-prepared candidates who fail because they do not know how to show their working properly within the time available. Hardly anyone ever gets about 80 marks for certain exams.
    • I agree that it should not be necessary to follow such a course to pass. The committees and boards can influence this already => a clear syllabus that they stick to, openness about the marking and what is expected, using similar formats and styles each year, announcing new subjects to be tested or changes to the marking in advance, publishing several alternatives that were accepted, allowed appealing candidates to see exactly where they lost marks etc.
  • Practical training
    • This varies greatly, depending on where you work and the opportunities available - there should be more guidance on what you should be doing and some help with this. 
    • I agree that that it is better to prepare earlier and not make exam participation dependent on a fixed number of years - for example, a lack of drafting and amendment experience can be compensated by doing more old exams to learn the skills needed. You need the knowledge as early as possible.
  • Suggestion - allow qualified attorneys, lawyers, employees, formalities officers etc. to also sit the modules (without overwriting their scores) to allow them to stay up to date in a structured way. This could already be done for the Pre-Exam (no consequence - they just get marks separately for legal and claim analysis).
CLICK BELOW FOR MORE COMMENTS

Sunday, April 11, 2021

Answering D1 Exam 2021 with EPC.App & PCT.App

While doing the D Exam as an official benchmarker, I kept track of how I used the EPC.App and PCT.App references to answer questions. I did this to check usability and completeness. Below are notes on how and where I found the main legal issues, so there are spoilers. The D Exam can be downloaded from the EPO Compendium. See also an earlier post with more about D Exam technical issues
I have not included my answers - these were made under exact exam conditions, so there are plenty of mistakes. I have concentrated on D1 use as you need to find things quickly. My main conclusions:
  • Both books contained the legal info needed, and allowed it to be found quickly. Exception was Situation B of Q.5 - although this is unlikely to be asked again for many years, it can be important for real life. R.26.3ter is included in PCT.App, but we need to cross-reference that in other sections.
  • The fastest way to search in EPC.App and PCT.App is to use the Detailed Contents. Based on your knowledge and the point in the procedure, you should be able to quickly see the most relevant provisions.
  • The fastest way to answer PCT questions is to look for an overview of the procedure at the beginning of many sections.
  • It is sometimes quicker to search directly in the Guidelines / Applicants Guides as not everything can be neatly sorted under the structure of a legal reference book.

The set of references I used was:
  • EPC.App (IP.Appify) => EPC and Euro-PCT legal provisions, case law (Nov 20 - standard version from Amazon with the editor's annotations)
  • Indexed EPO-EPC Guidelines (Fireball Patents) => EPC implementation by EPO, case law (1 Nov 19)
  • National Law and Validation (Fireball Patents) => National Law tables (implementation by EPC states) and validation agreements (31 Oct 20)
  • EPO as a PCT Authority (Fireball Patents) => Euro-PCT and EPO's PCT implementation (31 Oct 20)
  • PCT.App (IP.Appify) => PCT and priority part of Paris Convention legal provisions (Sep 20 -  standard from Amazon, but printed with color mark-up made using Print on Demand option)
  • Complete PCT Applicant's Guide (Fireball Patents) => PCT implementation by all offices (1 Sep 20)
  • PCT References - Part 1 & 2 (Fireball Patents) => Most relevant PCT annexes (implementation by PCT states) and overviews (31 Oct 20)

To find things quickly:
  • During study, you need to learn what each book contains and where/how to find it. For example:
    • EPC.App is arranged according to Articles in numerical order, together with the relevant Rules. It has a Detailed Contents with the Articles, Rules and other contents like G-Decisions - this is the best tool to quickly scan through the contents if you are not sure where to look. There are also an Index of Legal Provisions to directly find specific Rules, and an Index of Decisions to directly find G, J , R, T & W case law. In general, the Articles and Rules of the EPC are arranged in chronological order as an application proceeds from filing to grant.
    • EPO-EPC Guidelines are arranged in approximately chronological Parts as an application proceeds from filing to grant. Substantive issues, such as amendment and patentability, are arranged per subject. The Detailed Table of Contents is the best tool to quickly scan through the contents. In most other cases, you will be following a specific chapter or section link from another reference, such as OJEPO or EPC.App
    • PCT.App is arranged according subjects in approximately chronological order, mirroring the structure of the WIPO Introduction to International and National Phases. It has a Detailed Contents with the Articles, Rules and other contents like Admin Instructions - this is the best tool to quickly scan through the contents if you are not sure where to look. There are also an Index of Legal Provisions to directly find specific Article and Rules. In general, the Articles of the PCT are arranged in chronological order as an application proceeds from filing to Chapter I entry, and from examination to Chapter II entry.
    • PCT Applicants' Guides (Introduction to International and National Phases) are arranged in approximately chronological order as an application proceeds from filing through search, publication, examination to national entry. The Detailed Table of Contents is the best tool to quickly scan through the contents. In some cases, you will be following a specific chapter or section link from another reference, such as PCT Newsletter or PCT.App.
  • To decide on which reference to use during the exam, determine: 
    • EPC, PCT or Euro-PCT?
    • More likely to be found under legal provisions or implementation?
    • If more than one, which will be quickest to find?

My approach to D1
  • I copied each question completely into the answer sheet, and only used occasional highlighting (this can waste a lot of time and does not generate marks). I left it in my answer just to have a copy immediately after the exam.
    • CTRL-C and CTL-V (Win 10) were sufficient to properly copy/paste all D1 questions except Q.4 (needed to manually remove formatting and tidy up lines)
  • I use 3 minutes per mark as a rule of thumb to quickly calculate how much time to spend. Traditionally, the D Exam was 330 minutes (3.3 mins/mark). This year, an extra 30 mins was given to compensate for the format (3.6 mins/mark). It is normal to run out of time answering D1 questions.
  • There are no negative marks and no requirement to fully complete everything you start - you want to generate enough to get 55 marks or higher. Get the marks first for the things you know well - if necessary, skip a part of a question until the end.
  • There is no time to read all the questions first, so I read each question in order as if I am going to answer it completely. If the question seems likely to take a long time to answer (or I have no idea), I skip it and go back to it at the end.
    • it is very difficult under pressure to read, understand and apply something you read for the first time (or it seems like the first time)
    • even if you think know the issues or can find them, you don't want to waste too much time 
  • I identified EPC, PCT and/or Euro-PCT parts while reading
  • I copied the last part of the questions ("the explicit questions") as a rough framework for my answer to make sure I didn't forget anything.
  • I made a rough vertical timeline by copying phrases and putting them in chronological order (no need to make it nice - just understandable during the exam). I avoided editing by sticking close to the exact wording, although I did reduce some long sentences. E.g.: 
    • -- EP-A1 was filed in 2018  A in English - X and Y, and claims invention X only
    • --  A.94(3) issued by the EPO on 5 October 2020
    • -- received by applicant A on 8 October 2020
    • -- No response has been filed
    • -- January 2021, he filed a European divisional application EP-A2 based on EP-A1 in French. claiming and describing invention Y
  • For some issues I know well, I have an idea how to form the answer and select the argumentation to use. For others, it can be less clear how to proceed, so I just to start working on pieces (like calculating time limits) until a bigger picture emerges. In most cases, the overall answer to the question about whether something is possible or not is added at the end.
  • Main part of answer includes identifying the correct law (legal provisions, case law and/or implementation) by citation, applying it step-by-step to the facts given and any other facts you can derive, and giving a conclusion as an answer (yes/no/yes if.../no).
  • Be conscious of where you are in the procedure - certain conditions must have already been fulfilled (and thus are less relevant to discuss). Focus should be on the next few weeks and major actions required in the future. Assume that the case takes place on the day of the exam - here 2 Mar 2021. 
  • At the end, if time, I check whether there are still facts from question that I have not used - these may need to be included somehow. But I am always trying to get to the next question, and often decide not to address these if I have already answered the question asked.
CLICK BELOW TO SEE THE DETAILS PER QUESTION/PART

Saturday, April 10, 2021

Lessons learned from e-EQE and looking to the future

Updated 18 Apr 2021: see also my post commenting on the epi discussion paper.
Updated 12 Apr 2021.
"It is only when the tide goes out that you see who's been swimming naked"
I already posted these comments on LinkedIn - this post gives a little more background. There was an enormous effort behind the EQE scenes, and a lot of people working many extra hours, but this could not prevent cracks appearing. 
On reflection, I think a few long-standing EQE issues may have played a role in creating the problems:
  • No effective communication with most candidates. Email is fine for sending standard messages, but there is little chance to request additional information. It is not always clear whether candidates actually receive them and understand the intention behind the emails.  A lot of candidates are surprised by changes in exam formats as not everyone prepares using a tutor, or with other students to discuss things.  
  • Secrecy and little transparency about every aspect of the exam and organization. Seen particularly by candidates who fail - it is very difficult to figure out where marks were missed, why the official answer was preferred, what alternatives were available etc. But this year, it was promised that the exams had been adapted to take into account the new format, but it was refused to provide any details as this was related to the content of the exams.
  • Just enough volunteers to make and mark the exams. No one expects perfection -  limited resources means that not everything can be addressed. But it is a professional exam, so it should be possible with sufficient preparation to have a reasonable expectation of passing. There is a minimum level that should always be achieved.
  • Few real limits for each paper in what can be asked. A real problem for many candidates is the habit of regularly introducing new things not announced before or tested before. It is unheard of in any other professional exam not to have an official detailed syllabus of what you need to know, both for the legal parts and the practical subjects. The REE is too vague to be useful, so candidates prepare based on unofficial study guides (like CEIPI or EQE Guide for Preparation) and doing old exams. There is still no clear distinction between legal subjects tested at Pre-Exam level and Main Exam level.
    And it is ridiculous that every year candidates need to have 2000 pages from the WIPO in case a question is asked about a PCT state (in many years, the WIPO and National Law are not needed at all).
  • Few real limits for each paper in length and style. Since 2017, an extra 30 mins was added to each Main Exam so that non-native speakers have more time. But there is no clear way in which this is enforced, and it is clear that the time has been eaten up by the exams. 
  • No effective way to assist those with En/Fr/Ge as a 2nd language. Non-native speakers have a clear disadvantage. The patent attorney terminology manuals are very useful, but reading/typing exams can still be slower. And giving everyone an extra 30 mins has now lost its effect.
Normally, these are compensated by a lot of flexibility in the marking, and that will be repeated this year. So, anyone well-prepared who generated a reasonable answer has a good chance (as in all other years). But moving forward, some suggestions of possible improvements:
  • Make e-EQE improvements highly visible, so that candidates know what to expect (platform + content) and can properly prepare. 
  • Using the new possibilities, better define the content to be tested and make sure it is relevant to daily work. 
  • Have a proper official syllabus for each exam - articles and rules, sections of Guidelines, case law, OJEPO's. 
  • Limit detailed PCT questions outside Europe to IP5 countries, and provide resources electronically.
  • Remove overlap in testing and preparation (candidates & committees). For example:
    • Pre-Exam: limit to only only legal questions, covering procedural and substantive law. Drop Claims Analysis (covered extensively in A, B, C). Use a mix of multiple choice and "D1"-style questions to test D1 level of knowledge. This is main test of legal knowledge.
    • Allow ME: A and ME: B to be taken anytime - either with Pre-Exam or Main Exam. These are practically oriented, relating to skills which are being developed early (drafting and amendment).
    • ME: A can be cut in half => reduce subject matter, focus mainly on independent claims,  provide less prior art.
    • ME: B is ridiculous with client giving you claims. Go back to old format, cut in half => reduced subject matter, only include a few claims, provide less prior art.
    • ME: D - limit to current D2 (D1 is now in Pre-Exam). But also include some basic trademarks/designs and basic trade secrets. Test legal concepts, and not substantive patent law (or greatly simplified substantive law).
      Expand basic foreign knowledge (JP, US) to include CN, KR (IP5). Also define clearly what you need to know. Possibly also test something about those foreign national patent systems. Knowledge of DE, FR and UK systems would also be useful.
    • ME: C has much repetition in attacks. Cut in half => fewer claims, provide a lot fewer documents. There should also be a proper infringement part in EQE - it makes most sense to add it here as technical understanding is important.
Perhaps also look even wider, putting the EQE in a broader perspective. A lot of effort is put into only passing candidates who are fit to practice, but there are many other people who interact with the EPO at different levels:
  • Permanent education required for qualified attorneys. For most, a lot of the knowledge is lost within a few months of taking their last exam. I know there were some attempts in the past to introduce this, and I know that no system is perfect, but something must be better than nothing. This would also address the issue of the varying knowledge levels of grandfathers \ grandmothers.
  • European formalities officer qualification. These are the people who have the most up-to-date procedural knowledge in the offices, but the levels of knowledge vary wildly. 
  • European patent agent qualification. Similar to US, where a basic knowledge of procedural and substantive law needed for those interacting with the patent office. This would be useful for people who do not wish to become patent attorneys (yet), or work in a company's patent department, or work in a lawyer's office.

Friday, March 5, 2021

e-EQE - C 2021 (D/E): copy to try, last exam, few technical problems

Updated 7 Mar 21 with status picture. Updated 6 Mar 21 with extra comments on C. Updated 5 Mar 21 with WISEflow unavailable picture :-)
Today was the e-EQE C Exam. I have extracted the claims of the patent as granted and added them to the printable files. I have also put the claims at the end of each part to simulate exam conditions - DE versionEN version (sorry no FR), The official compendium versions will be available next week.

  • I have not made it yet, but check the Telegram groups for some discussions and comments. Today there were not a lot of discussions - most seem to be happy to have survived the first eEQE, and to start the weekend early. Some discussion about the length and complexity. See below for some comments on the problems.
  • No widespread technical issues πŸ‘πŸ‘πŸ‘

1. Thanks to the EQE organisation, and good luck with the marking
  • Thanks to all the invigilators, helpdesk staff, EQE secretariat members, and epi/EPO members who have been working tirelessly for the last few months to make it happen. Even under pretty stressful conditions (on both sides), the majority of candidates said that they felt listened to and helped πŸ‘πŸ‘πŸ‘. 
    • it seems that the general experience during the C exam that everything was running smoothly πŸ’ͺ.
  • And good luck to those involved in the marking - at least you will not have to struggle with poor handwriting any more πŸ˜‰, although there are a lot of spelling mistakes and copy/paste errors to puzzle over.

2. My suggestions to candidates after the eEQE
  • You survived the historic first eEQE πŸ₯‡
  • Put your TAB and WINKEY caps back πŸ˜€
  • Manually uninstall Lockdown Browser: in Win10, it is found in the start menu under Respondus
    • be suspicious of any emails mentioning WISEflow or Lockdown Browser
    • if you get any emails about "updates" of the Lockdown Browser, do not click on them
  • ... actual screenshot of WISEflow (5 Mar 21 2330) - EQE candidates got their revenge πŸ’£πŸ’£πŸ’£πŸ’£, or at least "broke" WISEflow
  • ... and the status page on Friday indicated that the last major incident was 3 days ago (Tues was also the "D1 incident")
  • Preferably unplug all the extra cameras and microphones. Or at least cover the cameras when not in use.
  • Take a couple of days off and celebrate as much as you can respecting your local lockdown rules πŸ˜‰
  • Don't read blog posts about model answers. They are usually made by EQE nerds who made the exams under relaxed conditions. They could still be wrong. Even if it is a perfect answer, no-one knows where all the marks will be awarded. 
  • The marking sheets are only finalised after the exam following discussions within the committees about what to accept and what not. For example, if there was an issue almost no-one dealt with, they usually compensate by awarding marks for something else that most people got. The exams also have built-in fail-safes, so if you miss something, you will not lose marks everywhere. 

3. Telegram chat groups

  • The main group has 285 members, for general issues and WISEflow + LockDown Browser + Zendesk issues. The (ABC+PE claims analysis) group has 159 members, the (D+PE legal) group has 131 members, and the summer study group for EQE 2022 preparation already has 81 members. Now also a EQE Marketplace if you want to sell or buy EQE materials.
    • Started for students to discuss with others, but completely open to any tutors from any organisation who want to just read or join the discussions. 
    • If you have just done an exam, only discuss the answers if you can really take it. For most people, it is better not to discuss - you can't change your answer, no-one knows what the marking will be for particular answers (Main Exam) and sometimes more than one Pre-Exam answer is accepted. 
    • Group rules: no discussions of ways to cheat, no exchanges of large sections of copyrighted materials (excerpts, annotated examples, WIPO/EPO docs etc. are allowed), no requesting or sharing of exam materials until after the scheduled end of the last part of that exam, no requesting or sharing of invigilator password.

4. WISEflow, before the exam, after the exam
  • At least one person noticed that the pdf of their D1-Part 1 and D2 answers was missing statements and even had a blank page. It is not clear how widespread it is, but it is advisable to check (while you remember) whether it is complete after the exam.
    • I have not seen any messages about problems after the A, B or C Exams
  • The copy of the answer from Part 1 was available very quickly in WISEflow πŸ‘. 

5. LockDown Browser

  • No widespread technical issues πŸ‘πŸ‘πŸ‘
  • Wednesday, after the widespread problems D1-Part 1, the Examination Board issued a very clear unambiguous commitment to ease candidates minds:
  • On the official e-EQE page, a message from Examination Board (3 Mar 21):
    • The Examination Board of the EQE is aware of a situation that affected paper D1.1. The Examination Board guarantees that the marking process will be conducted so that no candidate will be disadvantaged because of that.πŸ‘πŸ‘πŸ‘
  • Problems seen when handing-in answers at the end of D2 (quoted from Telegram chat)
    • No problems reported for C-1 and C-2.
  • Copy/paste from the C Exam did not retain the formatting at all, and CTRL-SHIFT-V or the remove formatting button removed line breaks and a lot of spaces between words.
    • copy/paste is a major advantage of an online exam. It is disappointing that this cannot be made to function properly

    6. Reporting complaints & problems to helpdesk@eqe.org
    • See here for post about Instructions to Candidates
      • ItC 11- email complaints regarding conduct as soon as possible, but no later than end of day of the exam. ItC 39 - email report on any disruptions during exam for which candidates are not responsible or which are beyond their control within 24 hrs of end of exam.
    • The EQE organisation is well aware of many issues, and general issues affecting large numbers of people will be taken into account during the marking. However, they may not be aware how a disruption or incident has affected an individual candidates performance. The idea of reporting is to give them a chance to consider whether to take it into account during the marking. They may also not realise how a positive thing for many (30 mins extension) could have a negative effect on an individual.
    • As an emails need to be sent very quickly, and most candidates are pretty tired after the exam, I worked with Preston Richard (Bardehle Pagenberg) to make a complaint template with some of the possible things you may wish to mention (we collected them from the blogs and chats). It may also reduce the number of emails from each candidate.
      • But don't just copy everything and send it - it must be personalised to explain your situation and experiences.
    CLICK BELOW FOR COMMENTS ON C (no spoilers) 

    e-EQE - B 2021 (D/E/F): copy to try yourself, very long exam, few technical problems

    😱Update 6 Mar 21: note added on formatting.
     Yesterday was the e-EQE B Exam. Sorry for the delay, but I was waiting for the compendium version. They are being put online the day after the exam πŸ‘. It is difficult to extract 13 non-printable pages, and there were complaints about the formatting, so I wanted to check. I have slightly amended them by putting the online only pages at the end to simulate exam conditions - DE version, EN version, FR version

    • I was dreading this exam as it was the worst to do online due to the large amount of unprintable pages, and the frequent need to compare parts of the exam. 
    • I have not made it yet, but check the Telegram groups for some discussions and comments. There were certainly a lot of discussion about the length and complexity yesterday. See below for some comments on the problems.
    • For any one who struggled and feels desperate, remember that the final marking (what is required, accepted, what is not accepted and any deductions) still has to be finalised. They fine tune everything based on how the paper was made by a large number of candidates. 
    • Answers posted on blogs are often made by 2-3 nerds who spend several hours doing it, and usually represents a theoretical answer. But it could be wrong, the number of marks to be awarded is unknown, and other solutions could be accepted.
    • No widespread technical issues πŸ‘πŸ‘πŸ‘

    1. Telegram chat groups

    • The main group has 284 members, for general issues and WISEflow + LockDown Browser + Zendesk issues. The (ABC+PE claims analysis) group has 154 members, the (D+PE legal) group has 130 members, and the summer study group for EQE 2022 preparation already has 79 members. Now also a EQE Marketplace if you want to sell or buy EQE materials.
      • Started for students to discuss with others, but completely open to any tutors from any organisation who want to just read or join the discussions. 
      • If you have just done an exam, only discuss the answers if you can really take it. For most people, it is better not to discuss - you can't change your answer, no-one knows what the marking will be for particular answers (Main Exam) and sometimes more than one Pre-Exam answer is accepted. 
      • Group rules: no discussions of ways to cheat, no exchanges of large sections of copyrighted materials (excerpts, annotated examples, WIPO/EPO docs etc. are allowed), no requesting or sharing of exam materials until after the scheduled end of the last part of that exam, no requesting or sharing of invigilator password.

    2. WISEflow, before the exam, after the exam
    • Some problems accessing exams for printing before the exam (the links do not appear), so some candidates could only read the pages online during the exam
      • Helpdesk answer: ".. participant’s computer has changed its external IP addresses from when they last refreshed the page in WISEflow (flow overview)". Refreshing only the flow page (where the download links are visible) is not enough.
      • Solution (1) from helpdesk: Reload (Refresh in browser or CTRL F5) of flow overview page in WISEflow
      • Solution (2) from participant (if (1) does not work): logout and back in to WISEflow
    • At least one person noticed that the pdf of their D1-Part 1 and D2 answers was missing statements and even had a blank page. It is not clear how widespread it is, but it is advisable to check (while you remember) whether it is complete after the exam.
      • I have not seen any messages about problems after the A or B Exams

    3. LockDown Browser

    • No widespread technical issues πŸ‘πŸ‘πŸ‘
    • A lot of individual issues with the Browser crashing. In spite of sometimes losing up to 20 mins, and requesting extra time, a number of people reported that the request was denied.
    • Wednesday, after the widespread problems D1-Part 1, the Examination Board issued a very clear unambiguous commitment to ease candidates minds:
    • On the official e-EQE page, a message from Examination Board (3 Mar 21):
      • The Examination Board of the EQE is aware of a situation that affected paper D1.1. The Examination Board guarantees that the marking process will be conducted so that no candidate will be disadvantaged because of that.πŸ‘πŸ‘πŸ‘
    • Problems seen when handing-in answers at the end of D2 (quoted from Telegram chat)
      • Could not submit because of "connection error". System message gets you nowhere as everything is greyed out. 
      • Told by Zendesk to refresh. They said it's a common issue. System overload as everyone submits at the same time (and the D-2 has a larger data volume). 
      • Also seen when handing-in A and B. So expected for C-1 and C-2.

      4. Reporting complaints & problems to helpdesk@eqe.org
      • See here for post about Instructions to Candidates
        • ItC 11- email complaints regarding conduct as soon as possible, but no later than end of day of the exam. ItC 39 - email report on any disruptions during exam for which candidates are not responsible or which are beyond their control within 24 hrs of end of exam.
      • The EQE organisation is well aware of many issues, and general issues affecting large numbers of people will be taken into account during the marking. However, they may not be aware how a disruption or incident has affected an individual candidates performance. The idea of reporting is to give them a chance to consider whether to take it into account during the marking. They may also not realise how a positive thing for many (30 mins extension) could have a negative effect on an individual.
      • As an emails need to be sent very quickly, and most candidates are pretty tired after the exam, I worked with Preston Richard (Bardehle Pagenberg) to make a complaint template with some of the possible things you may wish to mention (we collected them from the blogs and chats). It may also reduce the number of emails from each candidate.
        • But don't just copy everything and send it - it must be personalised to explain your situation and experiences.
      CLICK BELOW FOR MORE DETAILS ABOUT B (mild spoilers)

      Thursday, March 4, 2021

      e-EQE - A 2021 (EN & DE): copy to try yourself, few technical problems

      Yesterday was the e-EQE A Exam. If you want to try yourself, see here for complete copies with first the printable parts and the online only parts. The online parts have been extracted from answers, so they may not be perfect. The font is also quite small (would normally be 7 pages). A 2021 - complete (EN) and A 2021 - complete (DE). Sorry, I had no French answer to work with. The EPO normally makes official copies available in the compendium in the week after the EQE. 

      • I have not made the paper yet, but check the Telegram groups for some discussions and comments. There were certainly a lot of discussion about different answers yesterday.
      • No widespread technical issues πŸ‘πŸ‘πŸ‘

      1. Telegram chat groups

      • The main group has 265 members, for general issues and WISEflow + LockDown Browser + Zendesk issues. The (ABC+PE claims analysis) group has 135 members, the (D+PE legal) group has 124 members, and the summer study group for EQE 2022 preparation already has 71 members. Now also a EQE Marketplace if you want to sell or buy EQE materials.
        • Started for students to discuss with others, but completely open to any tutors from any organisation who want to just read or join the discussions. 
        • If you have just done an exam, only discuss the answers if you can really take it. For most people, it is better not to discuss - you can't change your answer, no-one knows what the marking will be for particular answers (Main Exam) and sometimes more than one Pre-Exam answer is accepted. 
        • Group rules: no discussions of ways to cheat, no exchanges of large sections of copyrighted materials (excerpts, annotated examples, WIPO/EPO docs etc. are allowed), no requesting or sharing of exam materials until after the scheduled end of the last part of that exam, no requesting or sharing of invigilator password.

      2. WISEflow, before the exam, after the exam
      • Some problems accessing papers for printing before the exam (the links do not appear), so some candidates could only read the pages online during the exam
        • Helpdesk answer: ".. participant’s computer has changed its external IP addresses from when they last refreshed the page in WISEflow (flow overview)". Refreshing only the flow page (where the download links are visible) is not enough.
        • Solution (1) from helpdesk: Reload (Refresh in browser or CTRL F5) of flow overview page in WISEflow
        • Solution (2) from participant (if (1) does not work): logout and back in to WISEflow
      • At least one person noticed that the pdf of their D1-Part 1 and D2 answers was missing statements and even had a blank page. It is not clear how widespread it is, but it is advisable to check (while you remember) whether it is complete after the exam.
        • I have not seen any messages about problems after the A Exam

      3. LockDown Browser (many comments posted under PE 2021 post and in Telegram chats)

      • No widespread technical issues πŸ‘πŸ‘πŸ‘
      • Yesterday, after the widespread problems D1-Part 1, the Examination Board issued a very clear unambiguous commitment to ease candidates minds:
      • On the official e-EQE page, a message from Examination Board (3 Mar 21):
        • The Examination Board of the EQE is aware of a situation that affected paper D1.1. The Examination Board guarantees that the marking process will be conducted so that no candidate will be disadvantaged because of that.πŸ‘πŸ‘πŸ‘
      • Problems seen when handing-in answers at the end of D2 (quoted from Telegram chat)
        • Could not submit because of "connection error". System message gets you nowhere as everything is greyed out. 
        • Told by Zendesk to refresh. They said it's a common issue. System overload as everyone submits at the same time (and the D-2 has a larger data volume). 
        • So be aware of this for A,B, C-1 and C-2

        4. Reporting complaints & problems to helpdesk@eqe.org
        • See here for post about Instructions to Candidates
          • ItC 11- email complaints regarding conduct as soon as possible, but no later than end of day of the exam. ItC 39 - email report on any disruptions during exam for which candidates are not responsible or which are beyond their control within 24 hrs of end of exam.
        • The EQE organisation is well aware of many issues, and general issues affecting large numbers of people will be taken into account during the marking. However, they may not be aware how a disruption or incident has affected an individual candidates performance. The idea of reporting is to give them a chance to consider whether to take it into account during the marking. They may also not realise how a positive thing for many (30 mins extension) could have a negative effect on an individual.
        • As an emails need to be sent very quickly, and most candidates are pretty tired after the exam, I worked with Preston Richard (Bardehle Pagenberg) to make a complaint template with some of the possible things you may wish to mention (we collected them from the blogs and chats). It may also reduce the number of emails from each candidate.
          • But don't just copy everything and send it - it must be personalised to explain your situation and experiences.

        Wednesday, March 3, 2021

        e-EQE - D 2021 (EN & DE): copy to try yourself, and many technical problems

        Updated: 3 Mar 21 after message from Exam Board
        Yesterday was the e-EQE D Exam (still called Paper D even though no paper is used any more πŸ˜‰. If you want to try yourself, see here for combined EN & DE copy. The text was extracted from peoples answers (sorry, no French). The EPO normally makes official copies available in the compendium in the week after the EQE. 

        • I made the exam at the same time as candidates as a bench marker. The Examination Committees have 5 external people per exam, and the answers are used for Committee discussions. They do not directly influence the marking, but allow group discussions on what should and should not be awarded marks
        • See below for more detail. I have not discussed the content of the exam, and avoided any spoilers, but I will try and respond to comments on this post or in the Telegram chat about particular questions. Also check the Telegram groups for discussions and comments

        1. Telegram chat groups

        • The main group has 255 members, for general issues and WISEflow + LockDown Browser + Zendesk issues. The (ABC+PE claims analysis) group has 114 members, the (D+PE legal) group has 116 members, and the summer study group for EQE 2022 preparation already has 67 members. Now also a EQE Marketplace if you want to sell or buy EQE materials.
          • Mainly for students to discuss with others, but also open to any tutors. 
          • If you have just done an exam, only discuss the answers if you can really take it. For most people, it is better not to discuss - you can't change your answer, no-one knows what the marking will be for particular answers (Main Exam) and sometimes more than one Pre-Exam answer is accepted. 
          • Group rules: no discussions of ways to cheat, no exchanges of large sections of copyrighted materials (excerpts, annotated examples, WIPO/EPO docs etc. are allowed), no requesting or sharing of exam materials until after the scheduled end of the last part of that exam, no requesting or sharing of invigilator password.

        2. WISEflow, before the exam, after the exam
        • Own answers were available 45 mins (could also have been earlier) after the scheduled end of the last part (as promised) πŸ‘
        • At least one person noticed that the pdf of their answer was missing pages. It is not clear how widespread it is, but it is advisable to check (while you remember) whether it is complete

        3. LockDown Browser (many comments posted under PE 2021 post and in Telegram chats)

        • After starting LockDown Browser for Part 1 at 0930, the assignment (exam) was only available in German. The selection menu at the top of the thumbnail was missing. So, it was only German in both the preview window and in separate tabs
          • I immediately refreshed the Browser, and the menu reappeared, so I only lost 3-4 minutes.
          • However, refresh did not work for everybody, or it only worked after 20 minutes, or they had to restart the Browser. Someone said that the Zendesk queue was 1100 people 😭
          • At 1020, a message popped up to say that everyone had been given an extra 10 minutes to compensate. My exam countdown clock did not change
          • At 1045 (15 minutes before the scheduled end), a second pop up saying that everyone had been given an extra 30 mins, but that the break was reduced from 30 mins to 20 mins, and Part 2 would start at 1150 instead of 1130. The D2 schedule in the afternoon did not change, so the break after Part 2 was reduced from 45 mins to 25 mins. 
          • I saw that my countdown clock had changed, but I handed-in at 1103 voluntarily because I was benchmarking
        • It is very positive that the EQE organisation were able to react so quickly to help those still working on the exam πŸ‘. However, there were still some issues:
          • not everybody's clocks were extended, so they were forced to hand-in at 1105 ( the scheduled end). Some got reactions from Zendesk that they would be compensated for any issues.
          • Extending a 90 minute session to 120 minutes without breaks was a problem for some
          • It is pretty stressful when the start times change because you need to be there on time to log-in
          • Some people reported the same problem in D1-2 (Part 2)
        • Update: On official e-EQE page, a message from Examination Board (3 Mar 21):
          • The Examination Board of the EQE is aware of a situation that affected paper D1.1. The Examination Board guarantees that the marking process will be conducted so that no candidate will be disadvantaged because of that.πŸ‘πŸ‘πŸ‘
        • Problems seen when handing-in answers at the end of D2 (quoted from Telegram chat)
          • Could not submit because of "connection error". System message gets you nowhere as everything is greyed out. 
          • Told by Zendesk to refresh. They said it's a common issue. System overload as everyone submits at the same time (and the D-2 has a larger data volume). 
          • So be aware of this for A,B, C-1 and C-2
        • Screen went white approx, 10mins before end of  Part 1 (quoted from Telegram chat, occurred during Pre-Exam)
          • Browser would not start for Part 2, so 10 mins late to get it to work. 
          • Froze again in the middle of part 2, and again 3 mins before the end of part 2, forced to reinstall lockdown browser each time
          • Both times answers had to be handed in afterwards as missed end time of exam.
          • Managed to get remote assistance from IT over lunch break πŸ‘. They removed loads of programs and checked IP addresses which fixed the issue.
          • Not sure what it was as didn’t happen in any of the mocks. Hope to have passed - it was very disruptive. 
        • Invigilators were very friendly and tried to help.πŸ‘

          4. Reporting complaints & problems to helpdesk@eqe.org
          • See here for post about Instructions to Candidates
            • ItC 11- email complaints regarding conduct as soon as possible, but no later than end of day of the exam. ItC 39 - email report on any disruptions during exam for which candidates are not responsible or which are beyond their control within 24 hrs of end of exam.
          • The EQE organisation is well aware of many issues, and general issues affecting large numbers of people will be taken into account during the marking. However, they may not be aware how a disruption or incident has affected an individual candidates performance. The idea of reporting is to give them a chance to consider whether to take it into account during the marking. They may also not realise how a positive thing for many (30 mins extension) could have a negative effect on an individual.
          • As an emails need to be sent very quickly, and most candidates are pretty tired after the exam, I worked with Preston Richard (Bardehle Pagenberg) to make a complaint template with some of the possible things you may wish to mention (we collected them from the blogs and chats). It may also reduce the number of emails from each candidate.
            • But don't just copy everything and send it - it must be personalised to explain your situation and experiences.
          CLICK BELOW FOR MORE ABOUT D EXAM (no spoilers)

          Tuesday, March 2, 2021

          e-EQE - Pre-Exam 2021: copy to try yourself, and some technical problems

          Today was the e-EQE Pre-Exam. If you want to try yourself, see here for main copy with EN printable parts, and the printable parts in German and in French. Sorry - it is a bit of a mess, but the pages produced by LockDown Browser seem to be a little unpredictable. I also deleted the T/F answers, so you will not be influenced.
          The EPO normally makes good copies available in the compendium in the week after the EQE. 

          I have not made the paper yet, but check the Telegram groups for some discussions and comments

          • A number found it more difficult than exams of previous years
          • Having DE, EN, FR below each other is not so nice for reading, especially with claim sets and comparing with questions

          1. Telegram chat groups

          • The main group has 230 members, for general issues and WISEflow + LockDown Browser + Zendesk issues. The (ABC+PE claims analysis) group has 102 members, the (D+PE legal) group has 97 members, and the summer study group for EQE 2022 preparation already has 57 members.
            • Mainly for students to discuss with others, but also open to any tutors. 
            • If you have just done an exam, only discuss the answers if you can really take it. For most people, it is better not to discuss - you can't change your answer, no-one knows what the marking will be for particular answers (Main Exam) and sometimes more than one Pre-Exam answer is accepted. 
            • Group rules: no discussions of ways to cheat, no exchanges of large sections of copyrighted materials (excerpts, annotated examples, WIPO/EPO docs etc. are allowed), no requesting or sharing of exam materials until after the scheduled end of the last part of that exam, no requesting or sharing of invigilator password.

          2. WISEflow, before the exam, after the exam
          • Prior art documents were available 20 minutes before (as promised) πŸ‘
          • Own answers were available about 20 minutes after the scheduled end of the last part (as promised) πŸ‘

          3. Technical problems (Several reports of webcam issues)

          • a) Screen partially black due to failure in starting LockDown Browser. Problem seen in Mock1, reported to helpdesk, moved to cable connection instead of WiFi which seemed to help.
            • Contacted the invigilators and managed to enter Browser again using invigilator password after 20 min or so
          • b) Laptop with external monitor and external webcam. All worked fine in the Mocks. Before Pre-Exam, entry photo was no problem. But during exam, contacted by Zendesk and told that his webcam only took black photos. Candidate deactivated laptop camera in device manager, but didn’t help and he got contacted again. Not sure how it was solved
            • it seems likely that LockDown Browser later defaults back to camera selected automatically default in screen to take entry photo
            • some suggested disabling internal webcam in software if you have this setup
            • one tried unplugging USB plug of webcam and this helped

          • c) Laptop with Win 10, external monitor and external webcam, laptop lid closed during exam, all screen savers, lock screens, energy saving modes etc turned off, privacy settings adjusted accordingly and webcam given full access to apps, including desktop apps. During system tests in Wiseflow, Mocks 2 & 3, no apparent problems, 
            • During Pre-Exam, entry photo successful. In Part 2, contacted via zendesk, and told that cam not working correctly. Could not solve issue, allowed to carry on. 30 mins before Part 3, in contact with technical expert => disabled integrated webcam of my laptop, did Part 3 without interruption. In part 4, contacted again as camera sending black photos, i.e. the same problem as before. It seems as if laptop and external webcam is a known problem. => opened lid, but no change. Allowed to complete Part 4.
            • All invigilators very friendly and tried to help.πŸ‘ Still it cost a lot of nerves and time.

          4. Invigilation

          • Many positive reports that contact was made quickly πŸ‘
          • However sometimes delay (15 mins) when there was a technical issue, or when getting the invigilator password 
          • For refreshing Zendesk chat every 30 minutes, one candidate indicated that a refresh option will be visible on the chat when it can be done

          Wednesday, February 24, 2021

          e-EQE Mock3 - Experience & Tips

          https://wiseflow.zendesk.com/hc/en-gb/articles/360018952959-Facial-Recognition-automated-proctoring-fact-sheet-
          © UNIwise
          On 23 Feb Mock3 was held as an extra test mainly for your setup: 
          • 0930-1300 CET ME (B only - not a new paper, but Mock2)
          • 1530-1640 CET - PE (one flow - not a new paper, but Mock1, Mock2)
          Mock3 was your last chance to test under close-to-exam conditions. Different to Mock2, was the availability of an increased number of invigilators to help with problems and some monitoring of candidates (this picture is old - it is missing the audio/voice monitoring). See below for my comments on things that seemed new, and notes from the many messages I got before, during and after.

          1. Resources (check regularly for updates):

          2. Telegram group(s)
          • During and after Mock3, members of the main group exchanged tips, discussed problems in close-to-real time and helped each other. This is a very good way to beta-test software.
          • The main group has 210 members, so the conversations were getting a little chaotic. Ignacio has now added 3 more: a summer study group for EQE 2022 preparation, an (ABC+PE claims analysis) group and a (D+PE legal) group. The main group will be more for general issues, and WISEflow + LockDown Browser + Zendesk issues.
            • Mainly for students to discuss with others, but also open to any tutors. Group rules: no discussions of ways to cheat, no exchanges of large sections of copyrighted materials (excerpts, annotated examples, WIPO/EPO docs etc. are allowed)

          3. Hardware / software
          • Some problems may be due to using a company computer where you don't have full admin rights. For example, blocked urls, a missing chat window in Zendesk, changing IP addresses, automatic virus scans, screensavers that cannot be disabled, updates that cannot be disabled.  
            • If you cannot solve the problems, you may have to switch to a personal laptop or PC, and either log on to the company guest network, and/or do the exam from a different location.
          • During Mock3, many candidates had problems with the camera turning off after some time during the exam (entry image and initial testing by LockDown Browser were all done successfully). It is not clear why this happens. The LockDown Browser does not generate an error or warning. It should be detected by the invigilators dashboard - if they have time and it lasts too long, they should contact you to find out.
          • If you notice the camera is off (e.g. LED turns off), report it as soon as possible in Zendesk chat (you likely will not know how long it has been off). 
          • Solution (ME): Refresh Browser (Click on browser "refresh" icon top-left). If this does not work, you may need to exit the LockDown Browser.
          • Solution (PE): For Pre-Exam, LockDown Browser works differently - you will need to enter flow AND invigilator password after a refresh before you can continue. So, you need to wait for instructions from Zendesk if you do not have the invigilator password to refresh.  If this does not work, you may need to exit the LockDown Browser.
          4. Invigilation
          • Some confusion about the AI monitoring. Surprisingly, the AI does not automatically generate warnings if you move your face out of view or speak. Your camera and microphone are sampled, and the invigilators have a dashboard (see picture above) with the real time status. For example, the degree of facial recognition is monitored. If one of them is "zero" or "low" (e.g. if you move too much), you should go to the top of the list, and they may contact you. But it depends on how busy they are. 
          • When you hear the "bip" sound, you click on the Zendesk chat tab - there are no pop up messages.
          • Not being contacted does not mean that everything you did was acceptable.
          • After the exam, this data is combined with other inputs to generate a profile. All data collected is used afterwards to determine whether suspicious behaviour is suspected. The AI will generate a list of possible suspicious behaviour, which will be further analysed by people. It is the people who make the decisions.
          • Some confusion about Zendesk. You must start Zendesk chat immediately (via External Resources) after starting Lockdown Browser. It must remain activated for the whole exam.
          • However, if Lockdown Browser crashes, you can open a normal browser (Chrome etc) window, go to epo.zendesk.com and login instead. Once you restart Lockdown Browser, you need to activate the Zendesk chat again.
          • More invigilators were available compared to Mock2, and some people chatted with them. They also attempted to solve hardware/software problems with others. People asking for the invigilator password had to typically wait 20 - 30 mins. 
            • during the exam, there will be more invigilators available
            • after 30 mins, any active chat automatically timed-out
          • You can email a transcript of your Zendesk chat (before end of exam and before time-out) by clicking on three dots on bottom right and entering your email address. It gives you a full timestamped history. 
            • But if you or the invigilator leave the chat, then the next contact will create a new transcript which has to be requested separately
          CLICK BELOW FOR MORE

          Saturday, February 20, 2021

          e-EQE: Code of Conduct and creating your own evidence

          Updated 26 Feb 21
          Updated 23 Feb 21 after Mock 3
          Updated 21 Feb with comment on software under ItC 14 and ItC 32.
          Fri 19 Feb, EPO published the updated Instructions to Candidates (OJEPO Feb 21), and a related Code of Conduct (19 Feb 21) on the official EQE page. All candidates need to read the latest version

          • ItC 43 is an End User Agreement where you implicitly confirm agreement by taking an exam
          • It seems likely that you will need to explicitly accept them as well before the exam (like the UK PEB exams)
          • Also read the Data Protection Statement (v2 - undated), on the same page so you know who is retaining what data, and your right to access, rectify, erase and receive your personal data, as well as restrict its processing or object to the same. Reference is made to the EPO Guidelines for Protection of Personal Data (Apr 19) which is on the Data protection & privacy page. 
            • In general, personal data is deleted max. 30 months (2.5 years) after exam, or after appeal. 
            • Chat content is retained for 120 days (4 months), facial images, audio and biometric data deleted after 6 months, but if suspected misconduct or appeal, EPO will make a copy and retain for max. 30 months (2.5 years).
          General comments
          • Disclaimer: these are my general impressions, and will not cover all individual cases. I am not a lawyer, and this is not legal advice. If you are worried, then talk to your mentor or contact helpdesk@eqe.org
          • The intention of these rules is to provide a framework to sanction anyone who seriously breaches the rules or tries to cheat. 
          • If you do your best to comply with the spirit and letter of all the regulations and instructions, there should be no problems.
            • But different to in-person exams, potentially suspicious behaviour will be flagged by AI software. All the audio / visual / computer / network / keyboard / mouse inputs from each candidate are analysed after the exam (ItC 36, 37) and compared to other candidates (approx. 1000 for PE and approx. 2400 for some main exams). Decisions are not taken solely on these flags - the flags and the data collected will always be reviewed by the responsible EPO/epi members and they will contact you first. They also have your answers, how you answered, the speed and order of answering, and Zendesk chat interactions for analysis and comparison.
            • And different to in-person exams, if you accidentally breach an instruction, you may not be warned. The invigilators can see real-time some of the data, but they will mainly be using video and audio (ItC 25), and mostly occupied with major issues and emergencies (which includes being unable to do the exam because the Browser is locked). So, if you are not contacted by an invigilator, that does not mean that no issues were detected by the system. 
          Measures you can take to create evidence 
          • You can expect that the rules will be interpreted in good faith, but the evidence being used is based on the data collection and AI. By complying with all the rules, you are the only witness. 
          • You will forget a lot of details because of the stress, and it may be several week before you are contacted. So, put yourself in the best position to support being unfairly flagged. 
          • But don't go crazy - these are just all tips I could find. At least do something - any evidence is better than none. And hope you don't need it.
          • Comply with the spirit and letter of all the regulations and instructions, before during and after the exam. Even if you think them trivial. 
          • Report any issues or conflicts with regulations BEFORE the exam, prepare alternative solutions, and test your system as much as possible.
          • Keep your mentor updated on all the problems, and make sure they know the exact circumstances you are taking the exam. Preferably, they should also see it, either in person or by video chat. If the mentor agrees, record the video chat with a time and GPS stamp. Or with photos with time and GPS stamp.
          • Before each exam, before you put your phone away, make a video with time and GPS stamp of the room, desk and computer. Include your point-of-view as you will take the exam, 360 degrees around, up and down. Under the desk, on top of the desk. Behind the monitor. Explain what everything is, and how they comply with the requirements. Mention anything you removed to comply with the requirements. Also include the ID you will be using. If there are glass walls and windows, show that they are covered. Show where the doors are, and what is on the other side. Pictures are also possible, but a video is stronger. If possible, include a witness or get someone else to film you. It should only take 5 - 10 minutes.
          • Put your phone out of the room (you don't want it to accidentally ring). Preferably, give your phone to someone else to keep during the whole exam.
          • Don't record video and/or audio during the exam as this itself is a breach of the rules.
          • During the exam, if something happens that could be flagged, report it in the invigilator chat and make a note on paper so you don't forget. If you interact with an invigilator, note the name on paper.
            • Tip from candidate: you can email a transcript of your Zendesk chat (before end of exam) by clicking on three dots on bottom right and entering your email address. It gives you a full timestamped history. But if you or the invigilator leave the chat, then the next contact will create a new transcript which has to be requested separately.
          • AFTER the exam, report any issues that happened during the exam as soon as possible. 
          • If have made notes on paper or annotated printed pages, store them safely and scan them in. 
          • Store the unedited videos, photos and files somewhere safe. 
          • Optionally, you may want to timestamp the files using a third party. Use the same facilities to create proof as for copyright, trade secrets and rights of continued use against patent infringement: 
            • Create a SHA-2 hash fingerprint yourself using truetimestamp.org. They have their own register of certificates (free)
            • WIPO Proof - store the files yourself unaltered, no file size limit, create and register a digital fingerprint, store the fingerprint yourself (20 CHF) 
            • i-DEPOT - upload up to 100MB of one or more files (any format), create and register a certified pdf, BMM retains it for 5 years, you can download a copy (EUR 40)
          • DON'T send the helpdesk all your videos and files.
          • If something did happen, consider requesting a copy of the data they collected as described above (although it can take up to 3 months)
          • If you are accused of suspicious behaviour, don't just send all your videos and files and hope for the best. Talk to a colleague or mentor. You will need to respond seriously, offering to supply selected parts of the evidence. Handle it like receiving a "cease and desist" letter.
          CLICK BELOW FOR MORE (comments on Instructions and Code of Conduct)