In Australia most theses are examined through blind peer review. Other countries have different ways of doing examination, but in every system judgment of any PhD is the job of a small group of experts. This is an assessment process unlike any other in academe and it pays to make yourself familiar with it.
You’ll be pleased to know that people have spent time studying how examiners read a thesis and what sort of document they expect you to deliver. The seminal paper is “It’s a PhD, not a Nobel Prize: how experience examiners assess research theses” (2002) by Gerry Mullins and Margaret Kiley. I consider this paper required reading for every research student, regardless of their location or discipline. There’s a lot I could say about this paper. In fact I have been talking about this paper for about 5 years in one of my On Track Workshops “What do examiners really want?”, where I spend two hours examining it in detail (there’s sessions coming up next week for students at RMIT – check your email!).
As you can imagine this is one of our more popular sessions, but I must admit I’m beginning to feel like one of those aged rock stars. Although the audience expects it, I don’t want to sing a straight version of my hit wonder from the 1980s. I want to sing songs from my new album. So here I turn around my normal presentation of the paper. If Mullins and Kiley are right about how examiners examine – what are 5 things you could do if you really wanted to fail (or at least be asked to do major revisions)?
1. Don’t talk to your supervisor about who you think should examine your thesis
I am located in the School of Graduate Research, who manage the examination process, so I get to read a lot of examiner reports and see the occasional complaint go by. Far and away the most common complaint is that the examiner didn’t understand what the student was trying to do. Usually this means there’s some kind of disagreement about method and how the student has handled (or not) validity, reliability and so on.
You don’t have to know exactly who the examiners are, but you do need to know if the supervisor is thinking about the right kinds of people. There aren’t too many academics who are truly broadminded. It’s best if you have someone who will be sympathetic to your methodology.
Sometimes supervisors take the confidential nature of the examination process seriously and may brush off your attempts to have a conversation about what sort of people they have in mind. However most universities, including ours, include an option for you to send a list of people who would not be appropriate. In my opinion every student should send a list of inappropriate people to their supervisor – if only for the record.
Just in case ok? Humour me.
2. Send your thesis to someone who has never examined a thesis before
Mullins and Kiley found that even more than methodological orientation, the amount of experience the examiner has matters. This probably makes sense to those of you who teach. Young teachers tend to have high expectations because they haven’t had time to see the full range of student abilities out there. The longer you teach, the more forgiving you become because for every new student you encounter, you have probably seen another who was worse. Some people can be nervous about sending their thesis to the world’s expert in *blah*, but they are exactly the sort of people you should be aiming for.
3. Write your introduction first
One of the most interesting and useful observations Mullins and Kiley made is that most examiners don’t read your thesis like it’s a novel – starting at the beginning and reading through to the end. Shocked? I was the first time I read this, but then I reflected on the last academic book which I read from start to finish… and I couldn’t think of one. Academic texts are dense, difficult, cumbersome beings at the best of times and a thesis is even worse.
Most examiners read the abstract, introduction and the conclusion to see what the work is about and then look in the references, so you should write these last – or rather rewrite them at the end. Any questions you raise in the introduction should be answered in the conclusion. If these parts act as righteous ‘bookends’ the examiner will form a better impression of you as a scholar – and is likely to be more forgiving of you if you slip up a bit in the middle parts.
4. Write a bad literature review
Oh boy. Where do I start? There are so many ways to write a bad literature review that it deserves a few posts on its own. The literature review is the nice party frock of your thesis. If the examiner sees that you have chosen the right frock for the occasion they are more likely to want to have a drink with you. It goes without saying your frock should be freshly ironed and have no stains on it – even better if it matches your handbag and shoes.
The kind of dress you think is appropriate is up to you, but I think you can’t go wrong with a little black dress (LBD). In thesis land the LBD is a simple, but competent run through of the major authors with a thread of an argument running through the whole. The argument should be connected to why you are bothering to do the study. It’s up to you of course, you can be more daring, but I would stop short of trying to be Lady Gaga.
5. Don’t let anyone else do your copy editing
Mullins and Kiley note that across all disciplines examiners report being put off by ‘sloppiness’. Yep – typos, missed footnotes, badly formatted bibliographies and so on. Those of you writing in a different language don’t need to fret too much, there’s evidence to suggest that examiners accommodate idiosyncratic grammar more than plain mess. I’m not sure how much it costs to get a copy editor – but most universities will allow you to employ one under certain guidelines. If not, do a lot of favours for a grammar enabled friend and ask them to perform the duty for you. It’s hard to see the mistakes in your own work on the 700th read
I’d be happy to have a discussion in the comments section about fears and questions relating to examiners and examination – and a special shout out to all the RMIT students due to submit at the end of March!
*Update: Later Mr Thesis Whisperer found another 3 mistakes in this copy, other than intentionally missing full stop. That’s why I made him read my masters thesis 🙂
Related posts