e-EQE 2021 update - 12 Feb 21 - Mock3 announced

© Matt

Update 16 Feb 21 - Mock 3 part updated. Last chance to test. At least test briefly on 23 Feb, even if you have not yet had any problems

Update 14 Feb 21 - AI monitoring part during exam amended. During exam, a lot is recorded and invigilators will have access. After exam, AI analysis will be done to flag problems, but people will review.

Update Feb 21 with a couple of things from Zsofia Pintz's LI post.

On 11 Feb 21,560 people followed an EPO/epi public webinar updating us on e-EQE. Panelists answered questions supplied in advance. There were a lot of unanswered questions in chat. Announced Mock3 for 23 Feb 21 as an extra test for your setup (see below). Pass on this info to all candidates you know.

Panelists: Xavier Seuba (EPO: Director Patent Academy and EQE),  Christoph Machwirth (EPO Head of EQE Secretariat), Simone Fausti (EPO Project Manager e-EQE), Tiem Reijns (epi Project Team e-EQE), Julia Gwilt (epi Chair of Professional Education Committee), Jens Horstmannshoff (EPO Project Team e-EQE). 

Thanks to the panelists for taking the time to do this. Hopefully, it will be online soon. I asked for the 28 Jan 21 session to be put online as well: these sessions really answer a lot of questions. Indented are my notes for things that seemed new or were emphasised, so check the official documents and my other posts.

General points

On 10 Feb 21, Ignacio Lobato Holtmann created a Telegram group for fast exchange of eEQE info. He also proposes forming using it study groups for the next EQEs. For a lot of people this is a more natural way of sharing info - they are answering each others questions and swapping tips. It is like a mini unofficial helpdesk. At the moment, there are 90 members, it is completely open, so members can also invite other candidates. So if you need help, join.

• I am happy to have been selected again to do Paper D as an external bench marker. So I will also have to prepare my room, keyboard etc. and do the exam on 2 Mar 21 under the same exam conditions. 
• 5 people are selected for each exam - the answers are used for discussions around marking. The answers do not determine marking levels in any way - they simply want answers scoring approx. 50 marks which they can discuss as a group about where to award marks or not. 

• Read latest versions of official docs on official EPO e-EQE page and FAQ page in preparation for Mock3 and exam. Read in detail before testing and again before the exam (updated regularly)
• a lot of questions are already answered here
• they are working to combine everything in one guide (now available on e-EQE page)
• 50% of candidates have still not tried the system. If you know somebody, please pass it on. Mock1 flows are available and there will be a Mock3 on 23 Feb 21. Mock 1 exams were made by the Examination Committees.
• Real risk that you fail because something trivial like a camera does not work or your desk is facing the wrong way. It is your responsibility. 
• If you "hand-in" an exam, flow is completed and you cannot start it again. So if you want to try again, don't hand-in for Mock1 or Mock3
• Mock2 was intended to test everything with a big load, so flows are no longer available.

1. Location for exam

• Make sure no windows, bookshelves, paintings, or light sources behind you.
• Can confuse AI invigilation. If it is a problem, cover them with paper.
• They can ask you to scan your room before you start with the camera to check everything
• My suggestion: discussions on possible "suspicious behavior" may happen much later after the exam. I advise to video (or pictures) your room/desk/monitor before the exam, with date & gps location stamp. If something strange happens during the exam, type it in the chat. After the exam, if it was serious, let them know by email to helpdesk@eqe.org.
• No glass walls or doors
• Earlier, they said that you can cover glass walls and doors from the inside. Just sticking paper over them was suggested. You should close blinds and curtains. You make sure that no-one can see your screen or communicate with you.
• Realise that for the whole exam, you have to sit at your desk in front of the camera. So if you have them covered and your desk is away from them, it should not be a problem.
• No other electronic devices permitted unless explicitly allowed by Examination Secretariat in advance
• You cannot have a 2nd computer or phone close by in case you have problems. 
• Better to put outside the room
• If you do have a second screen next to your first one but disconnected, you should move it way, well out of reach of your desk, and with the screen side not visible
• Other computers may be in the room but must be switched off and out of reach
• If the other computer has screens, disconnect them and move them away
• Medical issues: you should have mentioned these issues and electronic apparatus when registering as they apply during a regular in-person exam. It is now too late to register and request special treatment
• My experience: they consider reasonable requests, but no guarantees. Explain why you did not mention on registration. Don't request things you can live without. Be prepared to provide a letter from a doctor.
• You cannot get up to get books from book shelves. You must remain sitting in front of camera for whole exam. Normal movement is fine, but head has to stay in camera range and with the camera capturing your ears as much as possible.
• There was a discussion about whether books on the floor is allowed. Don't risk facial recognition issues - have all your books on your table or side tables if possible. Make sure you can grab them without moving your head out of range
• Question asked about taking exam from US or though VPN. In principle, no restrictions, but you may get delays and connection may be less reliable. VPN should be avoided as it slows the connection down and might block Lockdown Browser.

CLICK BELOW FOR MORE (Invigilation section updated)

2. Hardware / software

• Wireless keyboard and mouse
• not yet in FAQs , but are allowed as an exception to the wireless devices ban (from a reliable source)
• If you had technical issues during Mock2, check known Wiseflow technical issues, particularly troubleshooting and webcam troubleshooting
• If you had issues with 2,3,4 finger gestures crashing Browser, on a touchpad, use an external mouse
• Local copies: normally no local copy made on your system
• You are given the option to save if the internet goes out
Continue working if internet fails - avoid rebooting
• this part seems to work pretty well in the Browser. It warns you and it will keep trying to reconnect. It will also give give you chance to save a local copy 
• Hotspots - need to be set up so network is switched automatically. They have tried it with their phones. You will not be allowed to grab your phone to turn it on during the exam.
• Someone had problems downloading the papers because the server addresses were blocked by their company network. Solution proposed was an unlimited network connection on day of the exam.
• My suggestion: ask about a guest network. Most companies have them, and they are designed not to have access to the company internal network.

4. Invigilation

• During exam, keystrokes, mouse movements, audio and images of your face are regularly sampled and stored. People will make the decisions about suspicious behaviour, not AI.
• Avoid being flagged later by keeping face and ears within camera view and being quiet.
• My research from other websites using Respondus: The image/audio etc data is stored, together with your interaction with exam (progress, start time, time handed in) and monitoring of internet and relevant hardware/software errors or reboots. 
• This is used to create a profile, which is automatically analysed after the exam to determine the degree of suspicious behaviour. 
• If you score highly, then people will review the incidents after the exam, look through all the data in detail, contact you and take any final decision.
• Suggestion: if something happened, type in the invigilator window what happened to create a record. After the exam, if it was serious, send a report to the helpdesk@eqe.org explaining what happened.
• During exam: if someone or something accidentally opens door, they will be lenient. Important is to immediately get rid of them.
• Suggestion: type in the invigilator window what happened to create a record. After the exam, if it was serious, send a report to the helpdesk@eqe.org explaining what happened.
• My research from other websites using Respondus: during exam, invigilators will have access to at least some of the data being stored. If they see something unusual, such as moving your head out of range a lot, turning your face away from camera a lot, or sounds, they can contact you. 
• I have also seen reports that the Browser may automatically generate a warning if something is suspicious is detected, but it is unclear whether this will be used during eEQE. Don't assume that if you dont see a warning, you are okay. The data is analyzed in much more detail later. Avoid being flagged later by keeping face and ears within camera view and being quiet.
• If they do not contact you during the exam, that does not mean that you will not be contacted later once the full data set is analyzed. Avoid being flagged later by keeping face and ears within camera view and being quiet.
• No unscheduled breaks to leave the room during PE parts (4x 70 mins) and D1 parts (2x 90 mins). This to be sure that you have no contact with others to discuss the exam. If you leave room, you must first hand in your exam. Also cannot leave room or move out of camera view within first 30 mins of exam, even if you hand-in paper early.
• My research from other websites using Respondus: by leaving the frame, your face is no longer recognised (or missing for so many frames) and this will be flagged to an invigilator. They may contact you.
• I have also seen reports that the Browser may automatically generate a warning if something is suspicious is detected, but it is unclear whether this will be used during eEQE. Avoid being flagged later by keeping face and ears within camera view and being quiet.
• During D2, A, B and C parts, you may leave the room to take short unscheduled breaks. Only possible after 30 mins passed from official exam start time. Inform invigilator via chat function:  “I take an unscheduled break” and “I’m back from the unscheduled break
• My research from other websites using Respondus: by leaving the frame, your face is no longer recognised (or missing for so many frames) and this will be flagged to an invigilator. They may contact you. 
• Also if you make noises, it is not a problem. But you cannot read out the questions aloud. "Thinking aloud" may be overlooked by the invigilator
• I am not sure what thinking aloud is, but I guess it is muttering or whispering, with the occasional swear words (WTF) and sighs. Hopefully, this part can be tried during Mock3.

5. WISEflow and just before exam

• Printing was too short. You will get 20min  now
• Very welcome. Print from WISEflow from the regular browser before starting the Lockdown Browser. Make sure you have all the pages before starting Lockdown Browser.
• You can already print the calendars for EQE2021 on EQE notices page
• Mock1, Mock2, Mock3: For the flows, once you hand in a answer they are Closed and cannot be reopened. So if you want to play with the system again for that exam, you need to leave without handing in.
• Make sure you hand in your answer during the real exam. There is no facility to do it in WISEFlow, so if you do not submit it, it will not be marked
• There is a "Hand in blank" button in WISEflow  - don't use this. This hands in empty pages.

6. Lockdown Browser

• See here for my unofficial guide to avoiding crashes. and ways of getting out of browser. Also explains one way that worked on my computer to change networks
• Better to wait to see if original network is restored. You can carry on working.
• Invigilator password: will be available only in real emergencies. It will not be provided beforehand
• Needed to start late or exit browser after a crash or after an "illegal" act
• Even if you have it, you are going to lose time, so make sure you take steps you can before exam to prevent issues
• Explain why you need it
• Alt-Tab twice kicks you out: they are looking at this. Try and stick to CTRL-C, CTRL-V and CTRL-SHIFT-V - these will be the safest
• If tripped, you will need invigilator password, have to rest, costing you 5-10mins, and causing stress
• Browser is a 3rd party product. Assume that this will not be improved and take action to avoid pressing. 
• Like Matt (photo above), if you have a USB keyboard, you may be able to take of either the TAB or ALT cap. TAB is probably the one you don't really need. Laptop key caps cannot be removed!!!!!
• Note that TAB / SHIFT-TAB can be used to change bullet indent positions. So you will only have one indent available. But that is enough fro the exam - dont try and make the formatting too nice. Use "-", "=", or space if you want to show a difference.
• Or put a sticker on it so feels different. Or slide a thin piece of card, like a business card, under the edge. TAB seems to be the easiest to block as it is a wide key
• William Salinger has invented a less destructive way using a plastic tab, particular for laptop keyboards.
• I recommend also disabling WINKEY in the same way
• Online reference docs: only EPO domain. No WIPO access. Still allowed to use any books you want.
• EPO website has 2 versions of EPC Guidelines and EPO-PCT Guidelines. So when you search, you may end up in the draft version (which goes into force on 1 Mar 21). But that is not a problem. Answers based on the 1 Mar 21 Guidelines will also be accepted.
• they are being very flexible on the versions of legal texts used this year
• Copy/paste was not optimal in Mock2. The files were not produced like a real exam. Exam committee has taken more care, so it should be better
• CTRL-SHIFT-V copies without formatting. Does not work on MAC - but there is an I icon on the right in the Browser toolbar which allows formatting to be removed after pasting.
• There will be no way to hand in the exam from WISEflow. You have to do it in the Browser.
• So if it crashes, you will need the invigilator password to start the exam "late" and start the Browser. 
• In the tests that I ran, everything was retained in the answer, even after several reboots.
• Also if it looks like things are missing, go to the REVISIONS overview in the Browser, showing the time and number of words.

6. Mock3 = 23 Feb 21 0930-1300 CET ME (B only), 1530-1640 CET - PE (one flow).

• Mock3 is your last chance to test - this will be closest simulation of the real exam - if everything works, you can relax about the IT part 😊.
• Purely for you to test your hardware and software setup - EPO will test entry pictures, Zendesk, invigilation. Not a full exam, and not a new exam. Purely for you to login and test. Please don't ask helpdesk about the invitation. You will get it.
• Even if you had no problems before, the system may have changed slightly. You may you have new hardware/software as well. 
• No need to do the exams - at least login on time, do the ID checks, start the Browser on time, try typing for 5-10 mins, move your head around like you normally do looking at your notes.
• Try sending a message on Zendesk that you are taking an unscheduled break. Note that many do not have a chat window - test this in Mock3
• I thought they mentioned that AI part of the invigilation will be tested, but I am not sure. Try moving as you would when you will be taking the exams. However, most of the analysis is done later - if your actions do not generate an error or an invigilator contacting you, that does not mean it will not be flagged later as possible suspicious behaviour (see above).

7. My suggestions: after finishing all your EQE exams

• Put your TAB and WINKEY caps back :-)
• Manually uninstall Lockdown Browser: in Win10, it is found in the start menu under Respondus
• Be suspicious of any emails mentioning WISEflow or Lockdown Browser
• If you get any emails about "updates" of the Lockdown Browser, do not click on them
• the only official version is available after logging in to WISEflow
• Preferably unplug all the extra cameras and microphones. Or at least cover the cameras when not in use. When LockDown Browser is opened, it continously captures images and sounds.

• Take a couple of days off and celebrate as much as you can respecting your local lockdown rules ;-)
• Don't read blog posts about model answers. They are usually made by EQE nerds who made the exams under relaxed conditions. They could still be wrong. Even if it is a perfect answer, no-one knows where all the marks will be awarded. 
• The marking sheets are only finalised after the exam following discussions within the committees about what to accept and what not. For example, if there was an issue almost no-one dealt with, they usually compensate by awarding marks for something else that most people got. The exams also have built-in fail-safes, so if you miss something, you will not lose marks everywhere.