examgen

examgen is an exam generator for the LaTeX document class exam. It is written using literate programming through NOWEB. The program code is Python 3 and the documentation is LaTeX.

Installation

There are two options for "installing" this utility. Either go to releases, download the code and put it in your PATH. Otherwise you can follow the build instructions below.

Building

To build the executable file you need NOWEB, there is a package on most systems. For the documented source code you also need a LaTeX distribution, e.g. TeXLive. There are TeXLive packages for most systems. Finally, to run the program you need Python 3. These should also be available on most systems.

Once you have the dependencies. Make sure to first clone the submodules:

git submodule update --init

Then you can build the documentation PDF by

make examgen.pdf

To get the executable code run

make examgen

then run ./examgen -h to get the usage. (You can also run make examgen.py is you prefer to have the .py file-name extension.) Finally, if you'd like to have the examgen command available somewhere in your $PATH, then

sudo make install

will put examgen in /usr/local/bin.

In summary:

$ git clone https://github.com/dbosk/examgen.git
$ cd examgen
$ git submodule update --init
$ make examgen.pdf examgen
$ sudo make install

Example usage

To generate the exams I have an exam directory for the course, in this
directory I have a Makefile which says something along the lines of:

.PHONY: 2016
2016: exam-160603.pdf exam-160822.pdf exam-161024.pdf

exam-161024.pdf: exam-161024.tex q-161024.tex
exam-160822.pdf: exam-160822.tex q-160822.tex
exam-160603.pdf: exam-160603.tex q-160603.tex

%.pdf: %.tex
	latexmk -pdf $<

MODULE_QUESTION_DBs+=	 ../modules/crypto/questions.tex
MODULE_QUESTION_DBs+=	 ../modules/crypto/slides.tex
EXAM_TAGS+=	           AnalyseNeededCryptoProperties
EXAM_TAGS+=	           DesignSystemsWithCryptoProperties

# Until you cover the desired intended learning outcomes ...

q-160603.tex q-160822.tex q-161024.tex: ${MODULE_QUESTION_DBs}
	examgen -NCEi -d ${MODULE_QUESTION_DBs} -t ${EXAM_TAGS} > $@

Each exam-<date>.tex file \inputs the corresponding q-<date>.tex in the question section.

With the above Makefile, whenever it's time to submit the exams for the 2016 instance of the course, I just run the command make 2016 in that directory. That will create questions for each exam. (I can create the individual sets of questions by running make q-<date>.tex.)

What actually happens when I run that command is the following:

• The exam generator will try to find questions in the files MODULE_QUESTION_DBs whose tags are subsets of the required tags specified in EXAM_TAGS. The exam needs enough questions to cover the required tags (the -C option) --- but no tags which are not in the required tags (the -E option). To avoid excessively many questions on the exam, we require that each question adds coverage of a non-covered required tag (the -N option).

• The -i parameter enables the interactive (or inspirational) mode. This opens each qualifying question in the user's favourite editor, set by the EDITOR environment variable. This allows you to use the exam generator to generate questions for inspiration: you use the questions as starting points when creating new ones. But if a question truly is the perfect question you can always use the question without any modification.

• The way the questions are tagged is as follows. Each question is tagged with the intended learning outcomes (ILOs) it covers --- which is what we examine in a course! The ILOs in the course syllabus represent the least a student should be able to do to pass the course. So we need ILOs for the higher grades too to be able to grade an exam A-F. In the example above: AnalyseNeededCryptoProperties for E and DesignSystemsWithCryptoProperties for A.

For a more automated and systematic way of using examgen, see the chapter on exam.mk in the documentation of the makefiles.