Straw men, academic artisans and instruments of torture

If the title of this post sounds like the title of a Bruegel painting that is because sometimes I feel like I am living inside a Bruegel painting. Reading a comment posted in response to an article in the Times Higher Education caused this unpleasant feeling to repeat on me, even while enjoying my Christmas break.

The article by Chris Havergal was reporting on a new study by Angela Brew, David Boud, Karin Crawford and Lisa Lucas, Absent research: academic artisans in the research university. The study suggests that academics who are not necessarily high performing researchers nevertheless play an important role in the functioning of the university.

I had never thought of academics who devote a lot of time and energy to what one might call academic citizenship as artisans but that is a good label for them. People who recognise talent, skill, passion and commitment in others and who use their skill, experience and wisdom to labour, nurture, shape, carve, create....not a functional work of art but something far more extraordinary: people working together towards a shared goal.

The academic trinity of research, teaching and service fails to capture the artisanal trait. The dominant discourse privileges individual research excellence but, it seems to me, marginalises the art, craft, creativity and teamwork required to foster productive academic environments.

So, it was with a heavy heart that I read the only comment posted in response to the article:

This is straw manism ... this all seems like an exercise in making non-research 'academics' feel better about themselves. 

The full comment is here and you can decide for yourself about the merits of their argument. Here are my reflections:

But, what I found really disturbing was that I could almost hear the closing words from this comment echoed closer to home:

This is the game we're in, we need to play it (counting publications); Stop whinging, start publishing; If you're not likely to make at least a B in the next PBRF round your job could be at risk ... 

There is no shortage of research which describes, evaluates and contests the impact of national research performance assessments (e.g. PBRF in NZ, ERA in Australia, REF in the UK). The problem is not that there is not enough research. The problem is that in practice, the detail seems to be largely ignored by the institutions who claim to prize research. Funny that.

Personally, I think some form of accounting for institutional effectiveness is important. The humble taxpayer funds our work and deserves reassurance that their hard earned cash is not gurgling down the toilet. So, I have far less issue with the external measures per se than I do with internal measures of individual performance and gaming that have spawned as a result. Assessment, including research performance assessment, can have unintended consequences. Professor Jonathon Boston's comments relating to the design of PBRF reported in McGilvray, 2014 are apposite:

"We simply failed to fully realize the implications of the Privacy Act and Official Information Act,” ... “If I had known we would end up with a regime in which individuals had their scores reported to them, and that other people could potentially know what they were, I would not have supported it. 

Where university departments operate as largely independent fiefdoms the ground is fertile for manipulation. All performance indicators are not equal, decisions about what to count are subjective and within departmental and institutional cloisters, these decisions are almost impossible to contest. Furthermore, it is far from easy to gather data relating to academics' experiences of research performance management. Comments made by Edgar and Geare, 2013 regarding the ticklish business of collecting data for their study into factors affecting research performance at NZ universities are telling in this regard.

In the hands of thoughtful, even-handed and artisanal Heads of Department there may be little to fear from internal performance measures. In the hands of bumbling but well-meaning or distant and distracted HoDs, there could be cause for concern. In the hands of self-serving, manage-up and boot-down career-climbers, alarms should sound: through a solitary interpretive act, something as simple as a publication count can be transformed into an instrument of torture.

The only outcomes of torture are fear, defensiveness, toxicity and despair. On every level, institutional, departmental and individual, this serves no one well.

So, good on Brew et al. for their study. I hope that it does get noticed and I really hope that it informs thoughtful and critical action. Blindly counting publications is the road to hell.

The Blind Leading the Blind by Pieter Bruegel the Elder, 1568

(Note: Clover made herself scarce at the mention of Bruegel. Stories involving goats during Bruegel's time seldom ended well. I tried to explain that depictions of medieval goat owners were far from flattering either but Clover was already well beyond the reach of reason and had fled to the far paddock.)