Difference between revisions of "Digitaal toetsen"

From Cncz
Jump to: navigation, search
([Voor- en nadelen][Advantages and disadvantages])
([Voor- en nadelen][Advantages and disadvantages])
Line 35: Line 35:
 
## Antwoorden op open vragen worden ingetypt i.p.v. geschreven en zijn daardoor veel beter leesbaar.
 
## Antwoorden op open vragen worden ingetypt i.p.v. geschreven en zijn daardoor veel beter leesbaar.
 
## Multiple choice vragen kunnen automatisch worden beoordeeld.
 
## Multiple choice vragen kunnen automatisch worden beoordeeld.
# Naar mate de database met toetsvragen groeit, wordt het eenvoudiger voor docenten om toetsen samen te stellen.
+
# Naarmate de database met toetsvragen groeit, wordt het eenvoudiger voor docenten om toetsen samen te stellen.
 
# Voor de meeste studenten is typen en klikken handiger dan schrijven.
 
# Voor de meeste studenten is typen en klikken handiger dan schrijven.
# Voor Informatica cursussen, vooral op het gebied van programmeren, is de mogelijkheid om code te typen en verbeteren een enorme verbetering t.o.v. het schrijven van code op papier.
+
# Voor Informatica-cursussen, vooral op het gebied van programmeren, is de mogelijkheid om code te typen en verbeteren een enorme verbetering t.o.v. het schrijven van code op papier.
 
# De cursus-enquete (Alice) is geïntegreerd aan het einde van de digitale toets, waardoor de response op de enquête enorm is gestegen.
 
# De cursus-enquete (Alice) is geïntegreerd aan het einde van de digitale toets, waardoor de response op de enquête enorm is gestegen.
 
[/nl]
 
[/nl]
Line 45: Line 45:
 
## Answers to open questions are typed in, solving the poor handwriting problem.
 
## Answers to open questions are typed in, solving the poor handwriting problem.
 
## Automatic grading of multiple-choice questions is possible.
 
## Automatic grading of multiple-choice questions is possible.
# As the database of exam questions grows it becomes easier for lecturers to create tests.
+
# As the database of exam questions grows, it becomes easier for lecturers to create tests.
 
# For most students typing and/or clicking is much easier than writing.
 
# For most students typing and/or clicking is much easier than writing.
 
# For courses in Computing Science, especially computer programming, the possibility to type and modify code instead of writing code on paper is a major improvement.
 
# For courses in Computing Science, especially computer programming, the possibility to type and modify code instead of writing code on paper is a major improvement.
Line 55: Line 55:
 
Er zijn ook nadelen:
 
Er zijn ook nadelen:
 
# Digitaal toetsen introduceert nieuwe fraude-risico's. Het kan lastig zijn om deze allemaal uit te sluiten.
 
# Digitaal toetsen introduceert nieuwe fraude-risico's. Het kan lastig zijn om deze allemaal uit te sluiten.
# Digitaal toetsen legt beslag op de beschikbare PC's voor studenten.  Dit probleem neemt toe naarmate het digitaal toetsen toeneemt.
+
# Digitaal toetsen legt beslag op de beschikbare PC's voor studenten.  Dit probleem neemt toe naarmate het digitaal toetsen toeneemt. De RU heeft daarom in 2017 meer dan 600 Chromebooks aangeschaft voor het afnemen van toetsen in o.a. en sporthal in het Gymnasion.
# Mede in verband met het vorige punt kan het nodig zijn om digitale toetsen in de avonduren te roosteren. Dit is momenteel een probleem omdat IT ondersteuning buiten kantooruren niet geregeld is.
 
 
# De PC's in de computerruimtes zijn niet beschermd tegen stroomuitval. Bij een langdurige uitval kan een digitaal tentamen niet doorgaan.
 
# De PC's in de computerruimtes zijn niet beschermd tegen stroomuitval. Bij een langdurige uitval kan een digitaal tentamen niet doorgaan.
# Op dit moment is het niet mogelijk om te werken met wiskundige of chemische formules, reactievergelijkingen, diagrammen, of welke andere vorm van input anders dan gewone tekst.
+
# Op dit moment is het niet eenvoudig mogelijk om te werken met wiskundige of chemische formules, reactievergelijkingen, diagrammen, of welke andere vorm van input anders dan gewone tekst.
 
[/nl]
 
[/nl]
 
[en]
 
[en]
 
There are also disadvantages:
 
There are also disadvantages:
 
# Digital testing introduces new cheating risks. It may be difficult to eliminate all of them.
 
# Digital testing introduces new cheating risks. It may be difficult to eliminate all of them.
# Digital testing places a burden on the available PCs for students. This problem increases as the use of digital testing grows.  
+
# Digital testing places a burden on the available PCs for students. This problem increases as the use of digital testing grows. That's why Radoud University purchased more than 600 Chromebooks to be used for digital tests in e.g. a sports hall in the Gymnasium.
# It may be necessary to schedule digital tests in the evening due to the previous issue. Currently this is not possible because IT support cannot be guaranteed outside office hours.
 
 
# The PCs in the computer labs are not shielded from a major power outage. If this happens the exam can only be cancelled.
 
# The PCs in the computer labs are not shielded from a major power outage. If this happens the exam can only be cancelled.
# The current solution can not be used for exam questions where the answer requires the use of mathematical or chemical formulae, reaction equations, diagrams, in general any substantial amount of free format “drawing” by the student.
+
# The current solution can not easily be used for exam questions where the answer requires the use of mathematical or chemical formulae, reaction equations, diagrams, in general any substantial amount of free format “drawing” by the student.
 
[/en]
 
[/en]
  

Revision as of 15:26, 22 June 2018

Digital testing environment

We offer a digital testing environment, based on the open source product TAO Testing, that can be used for both summative and formative testing. This testing environment supports only a limited number of question types. In June 2018, a successful digital test was performed with a Windows application (a modern computer program development environment) that ran in a tab of the exam browser and was delivered through Amazon Appstream 2.0. With this, many limits of TAO Testing can be crircumvented.

In TAO itself, there is no support for entering mathematical or chemical formulae in answers, although formulae can be used in questions. Entering computer source code is possible in a free text field, but not in a manner which resembles the computer program development environments people are used to nowadays. So, in general, questions which require free text or multiple choice answers are currently supported in TAO iself. Images can be used in questions and it is possible to let the student make and upload a drawing (using a basic tool available on the desktop such as Windows Paint) as (part of) their answer.

The environment consists of four parts, all of which are web-based.

  1. A “database” environment in which lecturers can create and manage their own collection of exam questions and answers.
  2. An “authoring” environment in which lecturers can create exams from questions from the database.
  3. A “testing” (exam) environment in which tests can be performed. The tests take place on the computer lab PCs managed by C&CZ in a so called Secure Exam Browser environment.
  4. A “grading” environment in which the answers that were handed in can be reviewed and graded.

At this moment all four parts of the environment exist and are operational.

Advantages and disadvantages

The advantages of digital testing are many.

  1. Correcting/grading, especially for large numbers of participants, can be done much faster.
    1. Answers to open questions are typed in, solving the poor handwriting problem.
    2. Automatic grading of multiple-choice questions is possible.
  2. As the database of exam questions grows, it becomes easier for lecturers to create tests.
  3. For most students typing and/or clicking is much easier than writing.
  4. For courses in Computing Science, especially computer programming, the possibility to type and modify code instead of writing code on paper is a major improvement.
  5. Functionality as offered by Versatest (digital microscopy) is only possible in a digital environment (but it has not yet been integrated in TAO Testing).
  6. We have integrated the course survey (Alice) at the end of the digital test which has led to a vast increase of the survey response percentage.

There are also disadvantages:

  1. Digital testing introduces new cheating risks. It may be difficult to eliminate all of them.
  2. Digital testing places a burden on the available PCs for students. This problem increases as the use of digital testing grows. That's why Radoud University purchased more than 600 Chromebooks to be used for digital tests in e.g. a sports hall in the Gymnasium.
  3. The PCs in the computer labs are not shielded from a major power outage. If this happens the exam can only be cancelled.
  4. The current solution can not easily be used for exam questions where the answer requires the use of mathematical or chemical formulae, reaction equations, diagrams, in general any substantial amount of free format “drawing” by the student.