30 December 2010

On the "decline effect" again

The link is to a post by Michael White, as a commentary on the Jona Lehrer piece to which I referred in my previous post. It argues with Lehrer's spin, but for my purpose serves to underline the difference between what passes for research in education, and in science.

28 December 2010

On not trusting "the research"

The new Dean is energetic and enthusiastic and keen to raise the research profile of the Faculty, and has been trying to get me involved in bidding for EU funding for research in post-school education. I don't think I shall rise to the bait--I am after all now retired, and I have never been one for large-scale research projects.

However, the process, together with  my post of about two weeks ago about published research and the comment on it from a volunteer on one of the All Results Journals has set me thinking about the practicalities of doing research and the how they impact on the results and quite conceivably on the value of it all. I'm not talking about methodology as such, here, but the story of how research actually comes to be done in universities and beyond, and how we get to know about it and use it. I'm sure it varies according to discipline and institutional setting, of course, but some features are fairly common.

26 December 2010

16 December 2010

On making learning more difficult by making it easier...

Who writes curricula, or rather syllabi?

In further (rather than higher) education, on the whole they are not written by people who have studied on the kinds of course they are designing. The course designers are, probably, graduates who have progressed to their present positions via quite a different route from that followed by the students who will take their course.

(I'm sure there are counter-examples, of course, and I can remember that when I started in FE teaching 40-odd years ago, there were respected vocational teachers in the college who had come up "through the ranks", as it were, and were actively involved in designing ordinary and higher national certificates and diplomas in shorthand and typing, in office practice, and other vocational areas. They represented the community of practice in the Lave and Wenger sense, even if they were located in a college. But the process has become more professionalised since then, and the practitioners' voice is fainter, with the exception of some of the National Vocational Qualifications.)
And of course the writers are older and experienced (and quite probably experienced teachers in the area).

What these factors mean is that designers have a totally different perspective on the content from that of the learners. That is not surprising, but it appears to have some less obvious consequences.

Let us also throw into the mix the pressure on the awarding bodies (for whom the designers work) to create courses on which "learners" (i.e. students) can "achieve" (i.e. pass); colleges get a bonus for students who pass.

I have undertaken several teaching observations recently on such courses, and on the whole they have not been very good. At one level that is only to be expected; the teachers I observed have only just come to the end of the first term of a two-year part-time course and in these cases they have little experience under their belts.

But that is not the whole story. In one case the teacher thoughtfully provided me with some of the course documentation including photocopies of pages from the "official" textbook which she was using as a handout.

(Not best practice, but with a heavy timetable and no time to develop her own resources, understandable.) So I could see that she was following the required Scheme of Work almost to the letter. The handout declared authoritatively that there are four theories of such-and-such (well, it all depends... and two of the theories were simply variations on a third, but there was no acknowledgement of that), and the teacher was supposed to "get through" these at the rate of ten minutes each, and to test that they had been "learned" (whatever that means in this context). Being fair to her, again, she was not very familiar with the area she was teaching, and so she had to stick largely to what the book told her*. She offered few examples, because she was not confident they would be "correct".

And I could tell that some of the information on the handout was misleading and even simply wrong.

The students, rather sadly, were bored but compliant. They "researched" allocated topics (Googled them), and paraphrased what they found and the relevant paragraph from the handout, and two of them gave short presentations by the time the session ended. They spoke when spoken to, but volunteered nothing. They exhibited a weary familiarity with yet more half-understood gobbets of information they were supposed to "learn", without a clue as to why.

The teacher and I had our post-observation discussion. I checked on the academic/vocational level of the programme (3; the next level below first-year undergraduate level). She agreed it was dumbed-down to near meaninglessness, because that is seen as the way to get the students to "achieve".

As I drove back I realised how many times before I had been to such a class. I wrote about one in 1999.

It's to be hoped that with more experience, and a little (well, a lot of) reading round the subject, and confidence from her training, this teacher will like so many others get to lighten up a little and her proficiency will lead to more learning. But it's difficult when she is constrained by the limitations of the curriculum.

What appears to have happened is that in order to ensure that the students pass (and thereby ensure that this particular awarding body continues to be used by the college in this vocational area) the content has to be made as easy or simple as possible. Einstein is frequently paraphrased as saying “Everything should be made as simple as possible, but no simpler.” Courses like this appear to have violated that threshold. In an attempt to reduce the "learning" to discrete gobbets of information, they have ignored the context and the connections between those items, so that learning one provides no assistance with the next one.

(A few weeks ago, one student offered a micro-teaching session on an introduction to Chinese calligraphy; it was principally a practical session but of course provoked many questions from group members, some about the difference between a logographic and an alphabetic system of writing. C. pointed out that every character in a logographic system has to be learned from scratch; while some are composites, the link between the elements is not mediated by phonemes in the same way as in an alphabetic system. So one character offers little as a clue to another; it's the same issue. And learning three or four thousand separate characters is a formidable task!)
After another session I compared the content with a bowl of beads. They can be mixed up any way you like. Pick one out (teach it) and it has no implications for the rest. There is no system of knowledge. It cannot be other than inert. But thread the beads together, and picking one up will bring others with it... Context and connection are not optional extras.

In trying to make things simpler, this curriculum made them a whole lot harder.

The designers seem to have forgotten, at their distance from the students, what it is like to study this stuff. The teachers (we hope) and the designers have an overview of the field. They know where everything fits in so it makes sense. The students on the other hand are just thrown one thing after another in a seemingly arbitrary fashion. They are like puzzlers trying to make sense of the jigsaw without the picture on the box.

Surface learning and at best the unistructural level of the SOLO taxonomy is as good as it can possibly get. There is a special challenge in “Everything should be made as simple as possible, but no simpler.”


* One little-remarked feature of vocational programmes is that of course they include some necessary background material which may be based on academic areas of study which may not be the teacher's own area--physiology, sociology, even physics, for example. Since each of these specialist topics may not feature very much, it falls to the main teacher to be a jack-of-all-trades teaching all of them even when her or his knowledge is shaky. (Yes, a great opportunity for e-learning indeed, but not much used.)

15 December 2010

On the vagaries of published research

I've just come across the linked article (via ALD). It is questioning the consensual view that peer review is the most effective way of ensuring the quality of research published in academic journals. (Peer review is the process through which a submitted article is sent by the editor to two or three established scholars/researchers in the field, for comment. The comments are made anonymously, and may result in rejection of the article, requests for amendments or even acceptance without amendments.) The article refers specifically to medical research, but the process applies to all kinds of research and scholarship.

It so happens that I recently had a very interesting discussion with a student who was wondering what she could do with the interesting phenomenon of a totally zero response rate to a questionnaire, which led us to thinking about the publication process and the biases it may well (we don't really know and don't even know how to find out) introduce into what we think we know from out reading of what is published.

I also came across this blog post, which is interesting because of its rarity: it refers to a published article on ‘The Unsuccessful Self-Treatment of A Case of Writers' Block’ (my emphasis, and it is not entirely serious). It is of course very unusual to publish an experiment which did not work--most researchers will self-censor and decide not to submit. At a simple level, there is no telling how much futile duplication of effort takes place simply because it is not publicised that something does not work.

And it is plausible to argue that the tendency of the publishing system to "privilege" positive results leads to a higher probability of Type 1 or "false positive" errors being published (see here for a discussion of this issue in relation to assessment procedures).

...and of course the corresponding neglect of negative results (both true and false). These do creep in, to be fair, via attempted replication and literature reviews, but you have to be pretty dedicated to find them. Perhaps there's a case for a wikibullsh*t.org site?

That might account in some measure for much of the egregious rubbish which pollutes the educational literature as touched on here, but the relative paucity of proper critical evaluation of fads and fashions.

Of course, the other variable which makes a difference is enthusiasm, that's a magic ingredient which transforms dross into gold. Apparently. But sometimes the effect is strong enough to withstand even the rigours of (such self-serving) publication practices. It's just not strong enough to stand up to replication by anyone other than a true believer...

08 December 2010

On the "uncanny valley" effect in learning...

Just occasionally one of those paradoxical situations occurs in teaching where a frankly poor situation pays off in spades in terms of learning.

The other evening was such a situation. We were on the last session of micro-teaching (that is where students teach something to the rest of the group for twenty minutes and the group and the tutor then provide feedback on it). In our set-up the students choose their own topics. Someone has to go last, and on this occasion it was G. It so happened that most of the topics he would have chosen had been taken, so he took commendably took a chance with something he was not sufficiently familiar with to be comfortable. And despite his best efforts he fell into a heffalump trap...

He chose to teach the principles of "positive reinforcement" as promulgated by Aubrey Daniels, a proponent of  "performance management". The minor problem was that he could not address the issue properly in twenty minutes.

The major one was that he did not check out levels of prior knowledge in advance. Had he done so, he would have found that at least five of the other ten members of the class thought that they knew quite a lot about positive reinforcement, because their education in other disciplines had involved at least some exposure to the principles of behavioural theories in psychology.

The problem is that despite using very similar terminology and there being a substantial overlap of ideas, Daniels' branded and corporate-focused angle on reinforcement is not quite the same as the classic behaviourist tradition (making no judgements--I'm not a behaviourist and this was the first time I'd ever heard of Daniels).

Trying to provide a framework for the subsequent review, I was reminded of the "uncanny valley" phenomenon:
  • See here for the general principle, and
  • here if you have hours to waste for examples (although I think they expand/dilute the idea too much)
(This has cropped up previously on this blog under a different guise.)

Expressed simplistically, it comes out as "Tiny differences are more difficult to handle than gross ones".

We have no problem processing obvious differences between objects, categories, ideas. But it gets more difficult when the differences are subtle and may not even be real. That requires serious attention and concentration... "I'd like to take these colour samples outside to compare them in daylight..." "I need to hear that again..." "Does Daniels mean the same thing as Skinner when he refers to 'reinforcement'? I'm not sure..."

If the problem is up-front, then at least we can argue about it, bitter though such arguments may be (in inverse proportion to their importance in the real world, of course, as here).

But if it is not acknowledged, for whatever reason, there is a real problem. Such was the case in the session the other night, when those in the role of "student" were confused, asking themselves; "Am I just being stupid? Have I been misunderstanding this all along?" or "This guy has got it all wrong. But he is supposed to be the teacher and I want to be constructive--how do I confront the point without undermining him?" And that is without going into the possibility of any personal investment in prior beliefs...

I'm doing my DIY carpentry. I've drilled a 4mm hole, but it is out of alignment by 2mm. Much more difficult to correct that than one which is 10mm out.

I'm driving down a rutted road; I need to steer a fraction to the right. I could do a right-angle turn, but I can't make that fine adjustment. The circumstances conspire against it...

I'm going beyond my exemplar here, but perhaps I'm discovering what many people --particularly perhaps in the coaching field-- have known (and probably written about) for centuries. 

And a great deal of teaching at advanced levels is about precisely this level of detailed adjustment. It calls for great open-ness on the part of the learner, and deep conviction on the part of the teacher that this "trivial" point is worth getting right (which may well lead to the traditional accusation of "arrogance", of course).

29 November 2010

On not networking...

I'm now on Facebook! By mistake. It all got out of hand, and I have been deluged with messages, some from people I have never heard of who want to be my "friend", and others from people I really respect and like who are--if not offended--at least bemused.

I'm backtracking fast! But presumably there is some point to all this social networking stuff. How come I don't get it? Apart from being a socially inept introvert, that is? I've sent a variant of the following post to everyone I believe might have been affected...
My apologies to everyone who has received gratuitous and importunate messages from Facebook in my name.  I did not expect that those of you who steer clear of it--as I did until I followed up a link onto the slippery slope--would be approached to sign up.

I joined in the first place to investigate whether it was a viable alternative to the clunky Virtual Learning Environment used by the university (particularly for those of our students in community education programmes who do not have access to such portals). The team discussed it and decided that it was not secure enough, so dropped it.

In a moment of madness last night--prompted in part by nagging emails from Facebook about some people I know trying to reach me (FB knows where I live, of course) I revisited the site. I was invited, I thought, just to check who, on my address lists in gmail, etc. was already on the site. I was naive and didn't understand how it worked; it asks for an inch and takes a mile.

So far, the only reason I can see not to "deactivate" (apparently there is no way to delete completely) my account is that it would be rude to those of you who are making good use of it. I'll keep it open for a week or so, in case someone wants to persuade me otherwise.

A few people have noted that they can't "friend" me. I must have had the good sense to disable that option when I first signed up.

In the meantime I have battened down the privacy settings to their tightest. There is some marginal convenience in being able to send the same messages to all one's "friends" at once of course, but all email packages offer the same facility. But why on earth I would want "friends of friends" to know anything about me by default, I can't imagine. And if I want something completely public it goes on the blog.

On the other hand, you are of course entitled to conclude that I'm a miserable luddite curmudgeon and you are better off without me. That's fine; there's no need to tell me, because that is the default position... :-)

27 November 2010

On the Socratic method

I came across this quotation while marking over the summer:
“...the Socratic approach where you do not need to tell students anything, just ask them the right questions so that they will find out for themselves...”  (Reece and Walker, 2006: 118)
At least the referencing was punctilious. I must be missing something, I thought, because the quotation is a gross distortion of the "Socratic method" (if indeed there is such a thing).

And then I thought--I'm pretty sure this student has not read Plato*, because otherwise s/he would not have had to refer to one of the standard textbooks to explain what the "method" is.

But (I merely raise the question--the answer may be a clear "yes!" [in the original Greek]) have R and W (standing simply as proxies for many other writers in the field) actually read any Plato?

19 November 2010

On toxic training

Has teacher training become part of the problem rather than the solution? I'm speaking of the Higher (HE) and general Post-Compulsory Education (PCE) sector here.

As so often, I'm prompted by events and discussions which seem to be pointing in a general direction.

First--perhaps trivial, but perhaps symptomatic. Two MA students, whose dissertations I was supervising, confessed that they weren't interested in what mark they got, they just needed to pass. One teaches in PCE, the other at a university. They explained they were very busy, and so they had to be careful with how they invested their time, but that they needed the post-graduate award for career purposes. It is hard to think of a more cynically strategic approach to study--and this from people engaged in teaching beginning professionals. (They got their wishes, but only just.)

Second--Sean posted about his experience on his own MA course, on this occasion drawing attention to his fellow course members' lack of inclination to do any work outside class, resulting in ill-informed discussions and a general sense of futility. (Earlier, though, he commented on similar reluctance to work beyond the session in the very different setting of a WEA class on navigation--I may get round to that in another post...) He asks,
"Has the education system now bent so far backwards to accommodate strategic learners that even people who presumably must once have been interested in getting to grips with the thing they were studying now do the bare minimum? Or is this (as I hear it may be) how most PGCEs are now, rewarding conformity, strategic learning, and technical compliance, rather than any deeper understanding?"
Both, I think.

Third--(and slightly tangential, I confess)... Graham Gibbs' short but magisterial report on educational achievement in HE appeared in August and I blogged about his presentation based on it it here. Among his observations (p.24) is:
"High levels of detail in course specifications, of learning outcomes and assessment criteria, in response in part to QAA codes of practice, allow students to identify what they ought to pay attention to, but also what they can safely ignore. A recent study has found that in such courses students may narrow their focus to attention to the specified assessed components at the expense of everything else (Gibbs and Dunbar-Goddet, 2007). Students have become highly strategic in their use of time and a diary study has found students to progressively abandon studying anything that is not assessed as they work their way through three years of their degree (Innis and Shaw, 1997).

I learned at the age of about seven that it is possible to have too much of a good thing. (I was visiting neighbours on my own, and for the first time I was allowed to have as much sugar in my tea as I wanted. I put in four heaped teaspoonsful, and it was revolting!) The same goes for designing teaching, as for any other complex activity. Complex interactions between ingredients/variables do not seem to have occurred to the powers that be...

(Is there anywhere in LLUK standards or Ofsted criteria or similar bumf, a call for less of anything? Have they never heard of the art that conceals art?)

There is a perfect storm conspiring to distract us all in the direction of surface --or at best strategic-- learning, to attention to the signifier rather than the signified.


Perhaps it will all change next week...

References

Atherton J S (2010) Doceo; Values, Effort and QA [On-line] UK: Available: http://www.doceo.co.uk/tools/values_qa.htm  Accessed: 19 November 2010

Gibbs G (2010) Dimensions of Quality  York: Higher Education Academy [On-line] available: http://www.heacademy.ac.uk/assets/York/documents/ourwork/evidence_informed_practice/Dimensions_of_Quality.pdf  Accessed: 19 November 2010

Gibbs G and Dunbar-Goddet H (2007) The effects of programme assessment environments on student
learning.
York: Higher Education Academy

Innis K and Shaw M (1997) "How do students spend their time?" Quality Assurance in Education 5 (2), pp. 85–89.

16 November 2010

On unintended consequences down the line...

 (Actually this post has been held back for several weeks to anonymise it for readers who may also be my students; some details have been changed for the same reason.)

I've put it off for several days, but I've finally commented on a complicated (second) draft submission from a student.  It's complicated because although she is British by birth, English is her second language. She is a graduate (in fine arts) but her written expression is nowhere near graduate level. And when my colleague pointed out that problem to her, on her first module assessment, she protested that no-one had ever picked her up on it all the way through university, probably because of her ethnicity (and perhaps because literacy was not much assessed in fine arts, and even dyslexia is becoming "normalised"--not necessarily a bad thing of course...).

But now she is teaching English to Speakers of Other Languages (ESOL)! She has been seriously let down by PC sensibilities, and she won't pass the course if she can't catch up, and if she doesn't pass she can't carry on working... She's clearly trying very hard, but I'm not sure she has the background knowledge to make full use of my feedback, and there's a limit to how much assistance it is fair for me to give...

So. Do I provide feedback as I would to anyone else? Do I make allowances for her linguistic heritages? Or is that simply patronising and indeed colonialist? Or do we arrange specialist support for her? Or do I disregard her claimed (but so far unassessed) dyslexia as worthy of support, but not her heritage? ....

Do I apply the same pass criteria as I would to anyone else? I have to answer "Yes", to that. The obligation to guarantee minimum standards for the sake of the students and even the employers must outweigh others. But clearly her teachers at school and university have colluded in the past to avoid confronting problems. Moreover, the exam boards must have done the same, because her grades were sufficient for her to get to university.

(This bit is current) On Saturday we had one of our Study Days. The theme on this occasion was "Race and Gender, Inclusivity and Diversity"; and the speaker quoted from the report of the Victoria Climbie inquiry (Laming, 2003),
“It may be that assumptions made about Victoria and her situation diverted caring people from noting and acting upon signs of neglect or ill treatment”
More telling, however, in the present context:
"It was the belief of two senior staff managers from Haringey that some staff had difficulty in reading practice guidance because of problems with literacy. (Laming, 2003, para. 1.60)
I've commented on this tragic case in relation to the ultimate cruelty of "kindness" here. (For some reason, the transcript of the Climbie Inquiry to which I refer is no longer on-line.)

14 November 2010

On performance

I have to confess that music is not a big part of my life. I am puzzled by people who go around with their ears plugged by pre-digested musical pap, isolated (and thus insulated) from the rest of the world. I can't help feeling that negates the point of music. Surely it's a beautiful (or at least organised) noise which enhances what life offers, rather than masks it.

I've just been watching a programme on Neil Diamond. Insofar as I have ever been a fan of a performer (as opposed to a composer ... leaving aside Frank, Bing, Ella, Peggy, Louis, Benny, Cleo ... OK, the argument breaks down) I quite like his work.

His repertoire is limited, mostly to his own compositions. I have great respect for that, and I'm not going to make any snarky remarks to detract from what he does.

But I am wondering about what it is like to perform the same material over and over again, for years. I see the listings of concerts and stand-up gigs, and hear the tales about "life on the road", but behind all that is the sheer grind of doing the same stuff over and over again. I and my colleagues are lucky; we may have to repeat a lecture two or three times within a week, but usually it doesn't then come round again for a year.

Perhaps it is because we are so privileged that we perpetuate this fiction about "reflective practice"?  That is merely an indulgence for people who are lucky enough to get to do something different every day, rather than variations on a basic theme--however sophisticated, skilful and state-of-the-art. The more specialised become the realities of practice--in personal injury litigation, or prostate surgery--the more routinised they become, (and the more they "belong" to a team or community of practice than an individual) and the less relevant  it becomes to reflect on them.

01 November 2010

On "self-theories", "mind-sets", popularisation and framing

I want to add to the website some stuff on mindsets, self-theories, and the like, so I have of course gone back to primary sources, and I have just finished (re-) reading Dweck (2000) (the whole thing, just to be sure. But the critics are right: it's a hologram. The whole is contained in each chapter--possibly in each page).

It's now ten years old, so I sought out something more recent, but nonetheless accessible (i.e. not paywalled academic articles). Dweck produced a popular version in 2006 called Mindset so today I did something for which there is still no real substitute. I went to a serious bookshop and found it on the shelf, with a view to spending my own money on buying it (although as Susi reminded me, I would claim it against tax).

Oh dear. I'd read the reviews on Amazon of course (increasingly it's due diligence for reading list recommendations) across the board. And the one-stars were right. Half an hour in the bookshop (Heffers is the kind of bookshop where you can spend half an hour with one book--as long as you don't crack the spine) re-framed my reading.

One regretful reviewer had suggested that the publishers would have pushed for a popular version without formal referencing and attribution and the usual academic apparatus. Perhaps so. Like one of the reviewers, I found the book in the "Self-Help" bay rather than the "Psychology A-Z" bay.

And generally, as an avid consumer of "popular science" books which enable me to develop an appreciation of areas which I lack the background to enagage with in their raw form, I would have no problem with this--indeed, I would welcome it.

But in this case... Stripped of its scholarly accretions, it amounted to nothing more than:
If you regard attributes--however positively rated--as fixed and given, you are stuck and tend to give up when faced with difficulties; see them as malleable, provisional, and any assessment as merely "where you are now", and you will face set-backs as challenges...
That is banal as a bit of folk-wisdom. But if it has research-based support it may be important...

So?
  • I'm confused about how to deal with this stuff. I say that because it is rarely said, and readers of this blog--if any there be--need to know that it is OK to be confused. "Negative capability" rules, OK?

  • Dweck's book comes with an effusive endorsement on the cover from Robert Sternberg --premier league psychologist-- but who happened to be a colleague of Dweck.

  • I confess I have not done a detailed count, but I guess that at least 20% of the 15 pages of references include her as an author. (Not always lead author, and the convention is of course that the supervisor is included as an author when the work is done by grad. students...)

  • But I didn't find any dissenting voices or arguments, even when I went on line to look for them. That can mean at least (but not only) two things
    .
    • First that the argument is unassailable--academe (particularly in the softer areas of scholarship) doesn't do that. Dispute is the fuel which keeps it going, for better or worse. Or of course

    • That no-one can be bothered to test it with a view to refuting it. It's either trivial or untestable (or no funding body will stump up the funds)

    • Or of course that the work has been done but no-one will publish it...
So I am interested in the uncritical acceptance which seems to have greeted this work. Such reviews as I have found have only commented on the lack of detail in the synoptic book, the unexamined assumptions about the extension of research from young children to pretty well everyone, and the less well-evidenced (and admittedly more tentative) claims about applicability to other areas of personality.

I suspect that it fits with the Zeitgeist, and particularly with a US tradition of self-help which has contributed to the "positive psychology" movement over the past ten years or so; Dweck does not appear in Barbara Ehrenreich's entertaining but devastating Smile or Die; how positive thinking fooled America and the world (2009) but she might very well have done so. After all, Dweck's analysis shares the individualism and neglect for external factors which characterises so much of what Ehrenreich castigates.

    30 October 2010

    On credibility

    One of the perils of being in the business of teaching teachers is that your credibility is on the line whenever you "perform"; if you don't show that you can actually walk the walk, no-one is going to listen to you talk the talk.

    In one of my sessions on the post-compulsory education course earlier this year, one of the (mature--as are they all) students was a little late. This was a sanctioned irregularity, but it meant that when he came in, it was to a class in quite heated and I suppose rather unruly debate. People were arguing across the classroom, there were three different conversations going on at the same time, and they were cutting across each other. It was all "on task", though, and it was not difficult to restore order and carry on with the class. Afterwards, the late student came up to me and said he thought that the behaviour in the class was inappropriate and disrespectful, and he could not possibly have taught in such chaos. He said it with reference to the class, but it was clear that it was just as much about me, and my apparent inability to control their behaviour, with the sub-text of, "if you let that kind of behaviour occur in your own class, how do you have any right to tell us how to control our classes?"

    Quite right, too. Up to a point; he teaches teenagers, and there was no way in which I would have been prepared to allow anarchy in such a group. And we had earlier discussed the issue of teaching styles appropriate to different groups of students, in the course of which I had drawn attention to the need for a different approach on this course from that which would be needed with their own students. Nevertheless, I had in his view failed to model the skills of classroom management which  the course would in time assess him on, and in that sense he was right.

    With all classes, credibility is critical. I'm acutely aware of that, in that I spent twenty years teaching under false pretences. I taught social workers, and I was neither an experienced nor qualified social worker (but I did have quite good academic credentials, and in those days that counted more with appointment panels than proper experience; I didn't fake anything).

    After a while, of course, I could have faked it. For the latter ten years of my involvement, a staple of our Centre's menu of courses was ASW (now AMHP) training under the Mental Health Act 1983*. After years of listening to experienced social workers telling the stories of their practice, I would certainly have fooled any lay-person, almost all non-specialist social workers and a good proportion of the real McCoy...

    * The actual terms don't matter; the point is that they were about the use of legal powers to detain people with mental disorders. And for the record, out of the five of us who taught most of those courses, two were experienced ASWs, one was a legal specialist, the fourth a mental health specialist, and I was the charlatan!


    In practice, I was up-front about my lack of experience. Not only did it preserve me from gaffs which would have severely undermined my (and indeed our) credibility, but it could also be used to subvert the agenda of resentment among many long-established Mental Welfare Officers who--by statute--had to be retrained. Sub-text; "I'm not here to tell you how to do your job (because I'm not an expert on that), just to work out how it has changed in a new legal context..."

    However! I was reminded of all this, which re-surfaces at the start of each academic year as you consider how to establish--as quickly and easily as possible--the most appropriate relationship with each new class. (Incidentally, you can't get it right. It's not your fault. It's a feature of the system.) And I remembered...

    In the dim and distant past (at the latest 1972) I was an assistant lecturer grade A (which for some reason was even lower down the pecking order than grade B) in "Liberal Studies" (a weirdly idealistic educational initiative of the late '60s onwards in the UK to 'liberalise' technical education by teaching students anything they did not want to know about...) (Sorry about all the parentheses, by the way).

    Liberal Studies was a statutory requirement of vocational courses, but course managers rightly regarded these sessions as superfluous and pointless and so they competed to schedule them for the least desirable teaching slots. Such as 7-9 pm at the end of a full day-release programme. And Friday afternoons, of course...

    So it was that I acquired a class of about 20 electrical technicians from 6.30 to 8 on a Thursday evening. They were there because, and only because, if they did not appear on the register they would be reported to their employers. They in their turn couldn't care less, but hey! Any excuse to dock wages is good for the bottom line, right?

    The class was not assessed, other than by attendance, so there was no incentive for students to engage with what I was teaching. So baiting me was the most entertaining way of passing the time...

    "Psychology of Personality" was one of my standard packages for such circumstances. Most people are interested in themselves, after all. So we started with the Maudsley/Eysenck Personality Inventory. I used to use it in the first session with minimal introduction, get the students to score it, and then wait for my cue. That was the "What's it all mean, then?" question. (I make no claims for this as a scheme of work. It was a means of survival, that's all. I might be more sophisticated nowadays... or maybe not...)

    This time it wasn't enough. In the view of a vociferous minority of the group, administering someone else's questionnaire did nothing for my credibility. One of them challenged me; "If you're a psychologist--prove it! Psychoanalyse me!".

    [Note: this is not a verbatim quote, although given that the incident is almost 40 years old, I have not had to delete any expletives---but he did use the word "psychoanalyse", which would probably not be in the vocabulary of his contemporary counterparts. Whether of course he had any idea of what it meant, I know not. I attach no significance to this; I am merely trying to establish his terms. And I'm not a psychologist.]

    I was on the spot, so I rose to the challenge. (I should have risen above it, but that is easier said than done, even with more experience than I then had...) I burbled banalities worthy of a tabloid astrologer, about "liking to be liked" and "feeling misunderstood sometimes", and he seemed to be listening. But I realised I had to take a risk and be more specific. I thought of the way he had taken the lead in challenging me, and wondered whether his emotional investment suggested he felt a little threatened. So I suggested that he had a problem with anger (nowadays we would talk about "anger management").

    I thought I had blown it. He denied it (angrily). But then his mates laughed and joined in--"Too true!", "You've nailed him", "Spot on!", and in the face of the onslaught he conceded that occasionally he got a little carried away.

    And my credibility soared. I had passed the test! And I survived. (We did not do evaluations any more sophisticated than that in those days...)

    How perspicacious was I? Not very. I didn't become aware of how it worked until twenty-odd years later, listening to Radio 4 while driving the Northampton ring-road (strange how locations stick in the mind...) I was, unknown to myself, making use of the Forer (or Barnum) effect, which does indeed underpin newspaper horoscopes.

    The only value I added lay in my guess about anger issues, which required little more than observation and basic inference. "And that has made all the difference."

    29 October 2010

    On the acceptability of originality, criticality and context.

    I came to university with a history--at least in my mind; probably no-one else ever noticed. I failed O level English Literature (now GCSE, and apparently almost impossible actually to fail). I passed on a re-sit. But as far as I can reconstruct, given that the whole assessment process was inaccessible to scrutiny in 1960, I rose to the challenge of some question about Wordsworth (whom I hated at that time with a passion worthy of himself) by referring to Aldous Huxley's speculations* about the neurological or even pharmaceutical roots of Wordsworth's vision;
    There was a time when meadow, grove, and stream,
    The earth, and every common sight,
    To me did seem
    Apparell'd in celestial light,
    Ode on Intimations of Immortality from Recollections of Early Childhood ll.1-4

    Fifty years on, I think the marker was probably right! Chris Woodhead (a marmite figure if ever there was one!) has periodically made the point in his columns that schools are not about encouraging originality--pupils do not know enough at that age to make useful original contributions to anything; and even Diana Laurillard  argues that in science in particular, school and undergraduate study can be no more than an initiation into what is already known. (I think she concedes that an undergraduate final dissertation may perhaps occasionally have a touch of originality.) But of course by the time one embarks on a doctorate, the rubics will require "an original contribution to knowledge".

    I've just caught up with two of Jim Hamlyn's recent posts; here and here.** The pedantry of the marker is mind-boggling, of course, but for me Jim's experience also poses the question of why he or she should find Jim's independent-mindedness so objectionable (even perhaps threatening) as to put in the considerable effort
    required to nit-pick so obsessively. After all, this is a post-graduate course, and Jim's own discipline (art) is one which values and encourages creativity and originality and (critically) critical thinking, as this post of his demonstrates, so he can be trusted to have a handle on those values and attributes.

    So where does the energy come from to set out so comprehensively to miss the point and to inhibit learning? After all, the marker could just have let things ride, and the outcome would almost certainly have been better on all fronts. I suspect that it has something to do with "the notion that the less meaningful a belief, the greater the passion and dogmatism with which it is held. This was observed by Swift (the war between the Big-Endians and the Little-Endians in Gulliver's Travels, 1726, ch. IV) so it's not exactly original, and of course as in that story, it is religious disputes which spring to mind as the most obvious examples." I'm quoting myself here, from another post on 3 March 09.

    That also fits with points I made at about the same time about referencing, and the other day about the "fetishization of citation". All these "technical" issues are no more than proxies for valuable knowledge which works--and you know you are in trouble when the proxies are elevated above the substance, or you stop seeing the wood for the trees.

    Returning to Graham Gibbs' keynote; one of his opening slides was a quotation (I didn't make a note from whom) to the effect that "there are just a few factors which make a difference in teaching, and we know what they are." He explicitly denied that was the case, although of course such a contention is the foundation of teaching development programmes; it is an article of faith which tutors on such programmes must believe, otherwise they would not be able to carry on "delivering" them.

    I admit that I am having something of a crisis of faith. Gibbs' account of the variability of student experience and the importance of context, and even Hattie's acceptance that "everything works" (in some measure) (2009: 1) accord much more closely with my experience than practically anything in the teacher education literature. Also at the conference, Ray Land recycled to great effect a lecture from a few years ago when he stood in for a keynote speaker who got stuck in France; he took us on a tour of the changing context of education and students' lives, and concluded that current models of the university were being superceded.

    When teacher educators start behaving like Jim's (and Sean's) examples, and many others, we have to conclude that the implicit deficiency model is flawed, because we do not have the authority to which we pretend. So perhaps it is time to see the lecturer as the expert in teaching in his or her context as well as a subject expert, and the role of the teacher educator as no more than a consultant to the practitioner.

    In practice I think that is what I have been doing for years... Of course, it screws up conventional approaches to assessment, but that's OK.

    *  Huxley A The Doors of Perception and Heaven and Hell, Harper; various editions 1954-2004
    ** Of course I'm well aware that I'm accepting Jim's account as legitimate, and the whole story--but I have no reason not to, and this is the start of a meditation rather than an adjudication.

    27 October 2010

    On the "fetishization of citation"

    Thursday's keynote at ISSoTL10 was by Jude Carroll, whom I met for the first time face-to-face after scores of email exchanges. She is best known for her work on dealing with plagiarism, of course, but in this case she was addressing issues around a transcultural approach to curriculum issues.

    I was delighted to hear her inveigh against the "fetishization of citation". I've also touched on this issue here. Jude went so far as to say that this obsession with "correct" referencing was a phenomenon of the last ten years, and implied that it was symptomatic of a crisis of confidence on the part of academics in their own authority in a post-modern world. It's not so much an issue in the STEM* world, where there are real, objective and positivistic criteria for judging ideas. Like, "does it work?" If it does, who invented it is a matter for the historians and the (patent) lawyers.

    Moreover, it is an approach which devalues the contribution and opinion of the student herself. Jude's piece suggested to me (she may well have said something like this, but I don't want to put words in her mouth), in the context of the internationalisation of the curriculum, an inability to handle the different ways in which prior knowledge is or may be dealt with by students of different backgrounds and from different disciplines.

    She played with the manner in which direct quotations from other scholars had been used in presentations within this very conference.

    Which set me thinking about the concurrent sessions I attended, and the ways in which such scholarly material had been incorporated and used. I caricature slightly when I say there was in a number of them a ritual obeisance to the literature, as part of what was frequently explicitly identified as a "literature review" section (many papers followed the traditional pattern of a published research paper or dissertation). Nothing wrong with that, except that in Perkins' term, the knowledge was often "inert". Not much was done with it. It was introduced in order to confer academic respectability on the session and then--with some notable exceptions, of course--it just lay there...

    I think I detect that this is becoming ever more common, possibly because of search engines; it is so easy, with basic search skills, to go straight to an article in a peer-reviewed journal which bears in some measure on your subject. It will probably be a contribution to a discussion, in your own discipline, and very up-to-date. And it will probably say very little of interest, or ever have been heard of by anyone else. Your session may be the only citation it will ever get!

    I actually made a note of several promising leads, and since getting back I have followed up some of them, to my disappointment.

    I would have been much more interested in people making use of some "golden oldies" (my preferred strategy because I was always too lazy and too easily bored, and too busy, to keep up with new stuff unless someone used it or recommended it); or illuminating their arguments from parallels outside the immediate confines of their own disciplines.

    In a "soft" discipline like "education", it is all too easy to build foundations merely on successive bundles of reeds, rather than rocks. But one may feel the need to be seen to be imitating academics in harder disciplines.



    * Science. Technology, Engineering and Mathematics.

    26 October 2010

    On reflection on reflection, again

    I have just written up the notes from the round-table discussion at the conference last week--click on the header to go to them.

    20 October 2010

    On the importance of context

    I'm at the ISSoTL conference in Liverpool. It got off to a great start with a plenary from Graham Gibbs. At the Washington conference in 2006, Graham piggy-backed an intervention on Diana Laurillard's plenary, to lambast the conference for academic and theoretical ignorance and sloppiness, asserting that 75% of the papers he had attended would not have made the cut for the Improving Student Learning Symposium which he had founded in the 'nineties.

    This year the ISL symposium and the ISSoTL conference are effectively one and the same, and so (and in deference too to the shake-up he had given the SoTL community) Graham got to offer the opening plenary.

    Which he did in exemplary fashion. First, he is a superb lecturer. Understated and unflashy, he lets the material speak for itself and steps aside so as not to muffle it. PowerPoint yes--very plain text-based slides which did not draw attention to themselves but to their content, black-and-white but for the key bits in red. Funny bits but no jokes. Sadly no questions because apparently he is now hard of hearing, but all brought in with precision timing of which the (BBC Radio 4) Today programme would have been proud.

    So much for the process--what about the content? It was billed as being a reflection on 35 years of experience in pedagogic research, but it was rather more specific than that. It was about the importance of context for making sense of what we think we know about teaching.

    Having been engaged in what amounts to a meta-analysis of research on teaching and learning in HE, Graham became interested in material which does not fit the general message. Simply, if research indicates on the whole a 0.4 correlation between, say, student participation in class and student achievement, the picture is far more complex than simply asserting that is quite a good correlation and so we ought to be encouraging more participation. The other side of the coin is a 0.6 absence of correlation, which is stronger. But of course the 0.4 figure is attributable to the choice of apparently straightforward variables to correlate, whereas the 0.6 is attributable to a whole host of amorphous variables which did not correlate. So you can't draw any conclusions, can you?

    Well, yes, pointed out Graham. You can draw some conclusions about the ways in which the researchers approached their task, and how they sought likely variables to explore, in accordance with what they expected to find. And of course how they only sought to publish the expected and positive results, and how peer-reviewers might regard negative and inconclusive or ambiguous results...

    So he investigated (some of) the anomalies, and was reminded of the significance of context, which meant that, for example, "student participation" might mean radically different things in different disciplines (a dance class in which a student did not actively participate--leave aside the injured student sitting in--would not be a "class" in a meaningful sense). A science lecture to a hundred or more students is not where you expect their active contribution--you would expect it in the follow-up seminar or problem class or hands-on lab class.
    He examined, drawing on the universities with which he has worked across the world, and many different disciplines, the role of academic and professional disciplines in creating different pedagogic cultures and structures. He examined traditions across different institutions and how these were entwined with and inseparable from even such matters as the layout of buildings and staff hiring policies. He explored the quality guidance and criteria laid down by many bodies for evaluating the excellence (or otherwise) of courses--and showed that some of the avowedly best institutions might meet none of them. He showed that in some cases staff engaged in "industrial deviance", violating university policies where they actively inhibited the provision of formative feedback to students. The result was the students appreciated this bending of the rules as evidence of the staff interest, and succeeded. But this department seemed to be bucking a trend in the research--because when the investigators visited the staff were reluctant to confess to such "illegal" good practice!

    He discussed the impact of organisational culture on the development of excellent practice; out of four kinds of such culture found in universities--collegial, corporate, bureaucratic and entrepreneurial, it was the first and the last which actually promoted excellence. The corporate and bureaucratic models were dead hands. So why has government and the quality movement (he did not mention the QAA, or Ofsted, by name) persevered in plugging precisely the least effective models?

    And in passing he mentioned the irrelevance of specifying learning outcomes and objectives for every session... (Teresa, if you read this before I reply personally, that is what I shall say).

    A masterful lecture, and sadly perhaps his last public address, he said. I do hope it appears, soon, in an accessible form.

    And just before I started on the second half of this post, I read Sean's latest and characteristically challenging post--perhaps Gibbs has some answers for him.

    P.S. -- Several people have commented that Gibbs has undermined everything he himself has stood for, for the past thirty years. I confess I am not sufficiently familiar with his canon to confirm that, but they may indeed be right. This holist, contextualised approach is contrary to the viewpoint of much research. It is idiographic rather than nomothetic, and scholars from humanistic traditions have been delighted to celebrate the claimed switch.

    ...and I have been reminded that he also claimed that increasingly detailed course specifications resulted in students learning less from the course. Counter-intuitive again, but the more detail is specified, the more students can target their study strategically in order to pass--and to pass well.  Which they will do with the minmum sufficient knowledge, never having had to engage with all that pesky background stuff which may help you understand but not directly to pass.

    14 October 2010

    On having no bearings...

    My partner would love to get an affirmative answer to the question, "Does my bum look big in this?" She is skinny, and she can't find jeans to fit. When she commissioned me to go shopping for jeans for her in the States a few years ago, the shop assistant insisted I must have got the wrong measurements--no adult was that size.

    However, she got wind via a friend, of a shop in St Albans (actually a menswear shop) which might well stock some to fit. She spoke to someone there on the 'phone and we drove down today, to find this little shop in a very elegant back-street. She had not mentioned prices on the 'phone, and I began to wonder when the guy found her several pairs to try on, and referred to them all by their labels--of which the only one I recognised was Versace. While she was trying them on, I browsed the shop and found a  nice cardigan--only £400. (You know you are getting old when "nice cardigan" is no longer an oxymoron.)
     
    Fortunately none of the jeans fitted quite well enough (although there were bargains--at only £220) for her to splash out on them. But what amazed me, naif as I am, was how much one has to pay nowadays to look tatty and cheap. (Not that everything in the shop was like that...)

    I wouldn't have picked that up as clearly in a womenswear shop--we went to a couple later and I realised I had absolutely no reference points for understanding "quality" in that area.

    And that is the point of the anecdote. Not that fashion is silly (or indeed obscene in its self-obsessed self-indulgence, although it is) or that prices are ridiculous. No, it is the disorientation which comes from having no point of reference, no sense of standards by which to judge--anything.

    I'm pretty sure that it is key to much marketing-oriented business to keep consumers on the back foot in this way, so they can provide a spurious "solution", such as a brand, to the intolerable abyss of disorientation. At least to the extent that they can be parted from a couple of hundred quid.

    Here links indirectly

    06 October 2010

    On doing it myself

    I was teaching from 4.30 to 6.30 this evening. Naturally (!) it was all supported with projected presentation material, so I had to set up my netbook and pipe output through the data projector. Half of the session was a micro-teaching exercise, which needed to be videoed so that the student could review his teaching and tell us about his evaluation next week. This was the first time I had used this equipment (my own, incidentally) in this room, so I needed to set up a backup system just in case... Sound is more of a problem than video.

    (The car park "automatic" exit barrier broke down as I arrived causing a substantial tail-back of people trying to leave, which in turn caused delays for those of us trying to enter and park--so I was 15 minutes behind my planned schedule to begin with...)

    So I was scuttling around the classroom, plugging in bits of kit. blessing my prescience in bringing an extension lead, setting up a tripod on a table at the back (and pleased that no-one commented on my climbing onto the table via a chair, as a violation of health and safety regulations...), attaching the backup camera to the window (yes--it's brilliant, see here, and this is not a paid endorsement) and then wrestling with getting my netbook to engage with the university wifi network... After the session, I spent ten minutes with next week's micro-teacher checking that the system could access streaming video.

    A student drifted in early and asked innocently, "Don't you have technicians to do that kind of thing?"

    Yes, we do. And I'm delighted to say that ours are very helpful and knowledgeable, and go out of their way to make things possible. But apart from the issues around their availability at these hours, I'd rather do it myself. Because;
    • many or even most of the students do not have access to instant technical support in their work-places. Modelling good practice is an interesting issue on this programme, but some aspects are clear. Being able to make the kit work is basic and applies to all settings, so I ought to be able to do it, too.
    • Technicians have to work to institutional policies. Dropbox is a brilliant tool, but here colleagues can't use it on their work machines because they do not have "administrator" privileges to instal it.
    • And if I have some idea of what is going on "under the bonnet/hood", it is more likely that I can fix it with least disruption to the class.

    25 September 2010

    On celebrating punctuation

    For some reason I missed International Talk Like a Pirate Day (19 September) but there's a slightly more serious celebration today, albeit U.S.-based (is that punctuated correctly?). (Where should the question mark go? Was that final full stop necessary?) It's national Punctuation Day over there.

    Which reminds me of the Apostrophe Protection Society, too. What is moot, of course, is whether the apostrophe should be protected. German, after all, has a similar genitive construction and gets along without it.