Skip to main content
Home
Podcast Facebook Twitter LinkedIn YouTube RSSRSS Newsletter
  • DE
  • EN

Search form

Between Margin Notes and Exam Clinic: video-assessment of legal exams

Sven Störmann
Sven Störmann, 27.8.2019

In the guest article, Sven Störmann, Project Manager E-Learning at the Centre for Legal Learning (ZJL), and Jonathan Schramm, personal consultant to the management (both Bucerius Law School, Hamburg), explain the advantages of individual feedback through video-assessment as an alternative to conventional exam correction using the example of exam preparation in law studies.

This article was automatically translated using DeepL Translator. Please excuse any errors.

A better view through video evaluation?A better view through video evaluation? Photo: [https://unsplash.com/photos/Vrv_nZHaFTc timJ]

Exam preparation in law studies

Students who choose law as their subject of study end up writing the written exams: six exams, five hours each, and a correspondingly high level of stress with 52.5% of the overall grade being achieved as a result of the results.

To ensure that students are optimally prepared for this "all or nothing" examination situation at the end of their studies, most students opt for targeted preparation for this examination format at the end of the regular period of study - i.e. after all requirements for registering for the state compulsory subject examination have been met.

There are different procedures. The options range from preparation on one's own initiative, to internal university preparation courses ("Uni-Rep"), to commercial revision courses, which, by the way, have existed since the end of the 18th century because the faculties refused to teach the new Prussian Land Law at that time.

Since the first state compulsory subject examination plays by its own rules and, in addition to legal specialist knowledge, examines in particular time management, fast handwritten (sic!) writing as well as typical examination wording and argumentation, it makes sense in any case to write such five-hour examinations regularly under examination conditions in preparation for the examinations.

Scrabble in lawIs it still possible to write by hand? Or by laying stones? Photo: [https://unsplash.com/photos/xcVW_sFp4jQ Melinda Gimpel]

All faculties now offer an exam practice course for this purpose. 

At Bucerius Law School, students write an "ExÜ" every Friday from 8:30 a.m. to 1:30 p.m., which they receive back in corrected form approximately 10 days later. Up to now, the correction classically consisted of marginal notes and a final vote including grading. At the same time, the Center for Legal Learning (ZJL) at Bucerius Law School has been successfully offering exam clinics for many years. Students can contact the staff of the ZJL and discuss their exam in detail in a personal conversation.

Conventional corrections naturally mean considerably less effort for all involved compared to examination clinics, but do not achieve by far the same degree of individualisation and depth of content as examination clinics and are naturally also subject to fluctuations in quality.

In addition to the content comparison with the solution sketch, to which classical corrections are often limited, the retreat clinic also offers an analysis of the methodology and "retreat tactics". It should also be borne in mind that the request for an examination clinic definitely requires the overcoming of a certain inhibition threshold - students must first recognise that support is helpful or necessary for them in the current situation and then overcome the unfortunately often existing inhibition to accept this offer. Both previous formats for the post-processing of practice exams thus have advantages in each case, but also disadvantages inherent in the format.

There is a gap between the very good, but complex examination clinic and the less motivating and helpful classical correction, which means much less effort for students and correctors.

The gap - didactic considerations

We were therefore looking for a solution that would close the gap between conventional correction and the closed-door clinic - one that was more individual, better in content and lower in threshold than marginal notes and a short vote, but which on the other hand did not require as much effort as a classic closed-door clinic.

The main reason for the wish for more individual and better feedback was to motivate the students to deal more intensively with the practice exam and subsequently to increase their learning success. The discussion should not be limited to reading the received grade alone. Exercises are time-consuming, so that it makes sense to optimise the learning success of the time invested for the students as much as possible.

So how can the resource advantages of a conventional correction be combined with the quality and motivation of an individual feedback within the framework of the examination clinic? Classic automation is difficult to implement because of the flow text to be corrected. Other examination formats cannot be considered for the state examination because of their training character. 

Since April 2018, Bucerius Law School has been using a new mode for correcting exam practice exams to solve this problem. Instead of a conventional correction with marginal notes and a final vote, students receive a video file. The video file shows the screen recording of the proofreader as he or she goes through the candidate's scanned exam. So the students are "live" while their exam is corrected and discussed. The necessary hardware and software is provided by the university.

The concept of video correction, developed and tested by Sven Störmann, project manager for e-learning at the Centre for Legal Learning (ZJL), together with Dr. Olivia Czerny, Sylvan Gebhard and Victor Thonke, now makes it possible to deal more individually with the strengths and weaknesses of case processing, and is intended to motivate students when correcting to point out less core legal optimisation possibilities and to strengthen their feeling for written exam tactics. Students will be able to look through the glasses of the proofreader. On the part of the correctors, there is the greatest possible flexibility: A written examination can be read through and corrected in sections or in one piece, changes to the correction are possible and the oral discussion can be supplemented by comments, underlining or other visualisations if required. In our experience, the fact that discussions are always held orally lowers the inhibitions of correctors to give informal tips and hints or to point out possibilities for deepening and repeating.

At the same time, the candidate's screen recording allows him or her to know "where" in the exam he or she is at any time and motivates him or her to discuss the content of his or her own paper, since it is not easy to open the last page with the grade.

Last but not least, the digitisation of exam corrections also solves a very practical problem: especially in cities like Hamburg, universities compete with a large number of attractive employers for the best graduates. A largely location-independent process makes it possible to recruit proofreaders who do not live in Hamburg or the surrounding area.

Video-assessment of legal exams: implementation

The project implemented at Bucerius Law School has of course not reinvented the correction of exams, but has only screwed it into existing and moving positions due to digitisation, drawing on experience already gained in other subjects. It was also explicitly desired to implement the project "gebootstrapped", i.e. with existing means and initially without major development or implementation effort. In this way, a prototype could be developed quickly and feedback could be obtained from those involved. In addition, not all practice exams are always corrected in this way, but only a share of 10 to 20 percent for testing purposes.

Lawyers filmVideo correction in Law. Photo: [https://unsplash.com/photos/4qGbMEZb56c Thomas William] Currently the correction of exam practice exams in the context of video correction proceeds as follows:

  1. Depending on the video corrections received so far, an algorithm determines who receives a video correction and who receives a conventional correction.
  2. After the exams have been handed in by the students, the corresponding exam edits are scanned manually and stored in the cloud memory.
  3. The exam is then released to the proofreader via the cloud memory.
  4. The subsequent correction takes place in "real time" along the editing process as described above.
  5. Students receive the correction by e-mail link for downloading as a video file via the cloud memory.

The following video shows an example of what such a correction looks like.

Outlook and further steps

The systematic evaluation of the new correction mode is still pending. So far, however, students have made active use of the opportunity to give individual feedback on the concept. This is almost always positive and very constructive, so that the mode has developed and will continue to develop along the wishes of the students.

An uncertain future?The digital future of legal teaching? Photo: [https://unsplash.com/photos/X2CxUXFqKcM Chris Brignola]

According to student feedback to date, it is clear that video correction should completely replace conventional correction in the medium term. It offers students a convenient and efficient way to receive individual feedback without the considerable logistical effort of an exam clinic.

In the next step, the processes are to be further automated so that, at best, scanning, provision for correction and subsequent distribution to the students are fully automated. By transcribing the spoken correction, the correction could be searchable despite the spoken word.

Another development with potential effects on exam preparation practice exams is the digitisation of state exams. If these were to be written digitally in the future, the practice exams would also be written digitally, so that the scanning step would automatically be omitted.

It remains to be seen how the examination requirements will change. In any case, video corrections currently offer proofreaders more flexibility and make the dragging around of stacks of paper obsolete. Students benefit from more individualised proofreading, to which they have low-threshold access, and are motivated to actually deal with it.

The fact that over 90 % of all feedback to date has favoured this new correction mode over conventional corrections shows us that there can (and should) still be innovation even in a system that has basically been in existence for over 230 years.

  • Philipp Kürten's blog
  • Printer-friendly version

Add new comment

(If you're a human, don't change the following field)

Your first name.

(If you're a human, don't change the following field)

Your first name.

(If you're a human, don't change the following field)

Your first name.

Switch to plain text editor

More information about text formats

Simple HTML

  • Adds captions, from the title attribute, to images with one of the following classes: image-left image-right standalone-image
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <code> <ul> <ol> <li> <dl> <dt> <dd> <h2> <h3> <h4> <table> <th> <tr> <td> <span> <p> <br> <hr>
  • Lines and paragraphs break automatically.
  • Web page addresses and e-mail addresses turn into links automatically.
  • You may use [view:name=display=args] tags to display views.

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Image CAPTCHA

Enter the characters shown in the image.

Sven Störmann
Sven Störmann

Sven Störmann is project manager for e-learning at the Centre for Legal Learning (ZJL) of the Bucerius Law School in Hamburg. He studied law in Hamburg and London. Since 2015, he has been responsible at Bucerius Law School for the development of e-learning capacities and, in this context, deals with innovation in legal education and legal technology.

Additional authors:
Jonathan Schramm
Jonathan Schramm

Jonathan Schramm is personal advisor to the management of Bucerius Law School in Hamburg. He studied law in Hamburg and San Francisco and spent four years as an active student representative at Bucerius Law School and as a student member of its Academic Senate. As an alumnus of the university, he himself benefited from the project "Video Correction" during his own exam preparation.

Partners:

Stifterverband CHE Centre for Higher Education German Rectors' Conference

Project Sponsor:

Federal Ministry of Education and Research
Contact | Imprint | Privacy policy

Wir erneuern unsere Website und brauchen Ihren Input!

Das Hochschulforum Digitalisierung möchte Ihre Ideen in die Gestaltung der Website einbeziehen. Dafür bitten wir Sie herzlich, an unserer Umfrage teilzunehmen.
Als Dankeschön können Sie einen von drei Hoodies vom Hochschulforum Digitalisierung gewinnen.

Hinweis: Die Umfrage wird über Google Formulare durchgeführt. Durch Klicken auf den Button werden Sie zum Google Formular weitergeleitet.

Search form

  • Innovation Hub
    • Der Innovation Hub
    • HFDvisions
    • Zukunftsfähige Lernräume
    • Studentische Zukunfts-AG #DigitalChangeMaker
    • AG Digital Accessibility
  • University:Future Festival
    • University:Future Festival 2023
    • Let's Talk:Campus
  • About
    • About us
    • Stakeholder Dialogue
    • Project Partners
    • Team

    • Activities of the Stifterverband
    • Activities of the Centrum für Hochschulentwicklung (CHE)
  • Network & Strategy
    • Network for Higher Education Teaching

    • Current Activities
    • HFDnet
    • SummerSchools
    • HFDcert

    • Retrospective
    • Community Working Groups
    • Online Qualifizierungsspecial
    • Netzwerktreffen 2019
    • HFDcon

    • Strategies for Higher Education in the Digital Age
    • Peer-to-peer strategy consulting
  • Students' Perspectives
    • #DigitalChangeMaker
    • Hackathon
    • Podcasting the digital turn
  • Call for Experts
  • Participate
    • How to get involved
    • Call for Experts
    • Working Groups
  • International Activities
    • Conferences & Festivals

    • Bologna Digital
    • Reinforcing European Higher Education

    • International Exchange
    • Delegation Visit to Asia
  • Publications
  • Media
    • Blog-Guidelines

  • Corona - Tools Collection
  • Corona - Special Rates for digital Tools