Showing posts with label quality. Show all posts
Showing posts with label quality. Show all posts

17 June 2011

On learning by naming

To-day we have naming of parts. Yesterday,
We had daily cleaning. And to-morrow morning,
We shall have what to do after firing. But to-day,
To-day we have naming of parts. Japonica
Glistens like coral in all of the neighboring gardens,
          And to-day we have naming of parts.
Reed, Henry. "Naming of Parts." New Statesman and Nation 24, no. 598 (8 August 1942)

(Do read the rest of this very funny, but also cutting and sometimes beautiful, long poem about the absurdity of war, from the link above.)

I was reminded of this as I drove back from another teaching observation this morning, (the same circumstances as this earlier one). I'm happy to report that the student is making good progress, but she is still stuck with another hopeless course. The Wolf Report on vocational qualifications makes no bones that the quality of many of those qualifications is dubious, they are not fit for purpose, and effectively deceive young people into believing that they are going to lead somewhere. What I observed this morning clearly met those criteria. It was a Level 3 National Diploma in "Sports Development and Football"--a spurious concoction of a curriculum, even by vocational education standards, clearly not well understood by students or even the tutor. (To be fair, I must concede that today's lesson on planning activity sessions for children did have some practical merit--despite being enirely classroom-based.)

Its recurrent theme was matching up all activities with "the" four Benefits of Exercise. Not three, not five, not twenty-two, but four. It appeared that these were so doctrinally significant that they had to be taught dogmatically; they could not be discussed and discovered. And then they had to be written down and incorporated into the (written) assignment. (Without attribution--despite this being Level 3, which is just one level below first-year undergraduate level, the question, "Who says?" was never raised. No wonder freshers are thrown by their university experience...)

And there was no Japonica in a garden outside, but it came to me as I drove back that I had sat in on a session about naming of parts. At this level, it appears (on the basis of the previous observation and class discussions) that most of the learning is about attaching an approved label to a concept or experience. Rather like the magical belief in the potency of naming as a means of gaining power over an object, the assumption is that to name is to know, and that is all that is needful.

At least in Reed's case, the naming was clear labelling of concrete objects, even if one of them "you have not got"...
This is the lower sling swivel. And this
Is the upper sling swivel, whose use you will see,
When you are given your slings. And this is the piling swivel,
Which in your case you have not got. The branches
Hold in the gardens their silent, eloquent gestures,
          Which in our case we have not got.

03 March 2011

On technology and quality assurance

From a London Review of Books piece on Nicholas Carr's The Shallows:
There are two ways that computers might add to our wellbeing. First, they could do so indirectly, by increasing our ability to produce other goods and services. In this they have proved something of a disappointment. In the early 1970s, American businesses began to invest heavily in computer hardware and software, but for decades this enormous investment seemed to pay no dividends. As the economist Robert Solow put it in 1987, ‘You can see the computer age everywhere but in the productivity statistics.’[...] it wasn’t until the late 1990s that some of the productivity gains promised by the computer-driven ‘new economy’ began to show up – in the United States, at any rate. So far, Europe appears to have missed out on them.
The original IBM PC was launched in 1981. Deming formulated the principles of "Total Quality Management" in 1982. 

I previously wrote about "write-only" documents in the context of compliance and quality management here and here.

I wonder if there is a kind of Parkinson's Law about quality assurance, and one of the factors behind its explosion in the past twenty years is the availability of the technology to generate the verbiage on which it lives. Reinforced perhaps by spurious analogies between organisations and computers?

Would insistence on only original handwritten documents restore some sanity to the process?

06 July 2010

On validations and grading

I'm now quite an old hand on validations panels.

(New readers start here: it is standard practice in the UK that a new course, and indeed a substantially modified established course, is scrutinised by academic peers --colleagues within a school, within the university but from a different school, and beyond the university-- before it receives the university's imprimatur.)

I have taken part in two in the last couple of weeks. One was a complex master's programme with generic and named routes, and different but sometimes unexplored understandings of what constitutes M level work. And today's was a humble 60-credit certificate at NQF 5.

In both cases I have been really impressed by the quality of discussion. Something has changed for the better over the past few years (in my experience).

On the Master's programme we had a great and appropriately unresolved discussion about transformative learning and whether one can "require" it in assessment (among other things) [Yes, I will post on that in more detail as promised as soon as I know what I think...]

..and today we grappled with how to assess "reflection" and whether its proxy for assessment  could be graded. And I found myself arguing that it could be graded!

Thinking back over a dozen or so validations in which I have participated recently --some internally but more externally, at all levels from level 4 certificates to professional doctorates-- for once I have to concede that the system has got better. Not necessarily at the level of formal regulations--in practice one only hits those when really difficult technical issues obtrude-- but in both the quality and the culture of the debate.

I (and I'm not a lone voice, albeit a timorous one) have inveighed against (moaned about) the "compliance culture" stifling serious discussion of course content, structure and processes. But that seems to come principally from the accreditation bodies rather than academic institutions themselves.

I'm very pleased to find that within those institutions, "quality assurance" has moved on from covering institutional arses by ticking boxes, to a genuine enquiry into how learning can be promoted and the student experience enhanced.

I'll have to lie down--it has all been a bit of a shock!

21 June 2010

On the problem of self-limiting adequacy

I'm not sure whether or not it is true, but the story goes that Ofsted has declared that their Grade 3, "Satisfactory" is no longer satisfactory. Or perhaps it is (i.e. "satisfactory"), once again, given that the common inspection framework has "raised the bar". (I've looked up the urls for the links, but don't expect me actaully to read this stuff. I'm retired, remember?)

I hate to say it, but they may be right.

For Father's Day one of our sons gave me a premium, organic, long-matured, etc. rib of beef. I don't usually roast a joint on the bone, so I consulted Delia, naturally (in book form rather than online). Of course her advice was impeccable, and even Susi commented on the better flavour and texture than our usual supermarket joints. (This may prove to be expensive if we have also raised Susi's bar...)

For me, and indeed a generation of conscientious UK cooks (domestic cooks, rather than "chefs"; it's a very different discipline), Delia's books are the bible [that statement is grammatically "correct"].

Next to the guidance on roasting beef was, of course, a recipe for Yorkshire Pudding. (No, I am not going to post a link to a similar recipe.)

It was different from my usual one. That is of course fine; there is no canonical recipe for a traditional dish. And mine works very well, thank you. Most important, it is reliable. Sometimes a pudding comes out as a dome rather than a bowl for some unknown reason; but turn it upside down and it is like all the others.

I didn't try it. I know what I always get with my own recipe, so why risk it? If I were floundering; if my puddings came out like biscuits, I would go for it. And perhaps if I were cooking just for me, I might try it; but I am trying to produce a meal for Susi, too. (And the dog, but being diabetic, he couldn't have the pud in any case...)

So in Ofsted's insistence on "capacity to develop further" they may just be onto something. "Satisfactory" is not only not good enough, but inimical to further development. Discuss...

(Principally, Delia says you don't have to let the batter stand, but then she does add water as well as milk. I've always believed that standing the batter in the fridge until the last half-hour of roasting lets the liquid do something to the flour which helps with the rising process --because it is plain flour after all, and the egg is not whipped to retain air, souffle style. A proper scientist would not take any of this on the authority of the blessed Delia or even St Jamie, but rely on the experiments. OK, fund me!)

20 May 2010

On the effects of inspection

The professional education programmes at the university with which I maintain a tenuous association were Ofsteded last week. (PCE provision got 2 and 2, since you ask.)
(Ofsted=Office for Standards in Education. The militant wing of the Department for Education. Yes!  We now have a ministry which acknowledges "education" in its title; the Department for Curtains and Soft Furnishings is no more!
Incidentally, "to be Ofsteded" is a rare example of a deponent verb in English--one where the passive voice is the default. Inspectors don't say, "I ofsted, you ofsted...", they say, "I inspect," etc. Freire would say "to be Ofsteded" is the language of the oppressed...)
Given that we now have a new government which is making noises about rolling back the centralised micro-management regime of the last 13 years, and also that cuts mean that the regulatory body LLUK can no longer inspect us, I found myself thinking about whether the Quality Assurance approach actually works, and was reminded (as so often by an insightful question from a student) of work I had done on this 20 years ago, in the different context of social care.That suggested that the issue was not simple, but was comprehensible.

So I have re-visited that work and put it on the web here. Hope someone finds it useful.

18 February 2010

On norm-referenced grading

A fascinating insight into how a US professor grades forty essays, on a norm-referenced basis. (If you're not familiar with that term, have a look here, with a more opinionated piece here.) Apart from her initial remakrs about approaching the drafts like a copy-editor, I have no idea what actual criteria she is using to make her judgements.

I referred here to another columnist's approach to grading, which seems to be based on the amount of work a student submits rather than on its quality;
"...you made the deadlines -- which is what I expect from everyone -- and you handed in the assignments -- which is also what I expect. That level of work secures students a "C" because that's what we call "meeting the minimum requirements" and in no case would that snag anybody an automatic A."
I may grumble about subject benchmarks and the generally dead hand of the Quality Assurance Agency on higher education in the UK--and of course the system conspicuously fails to deliver the consistency it claims--but at least the insistence on criterion-referenced assessment does mean that students and colleagues should know more clearly where they stand than in what appears from a distance to be a highly arbitrary world across the pond.

08 August 2009

On "write-only" documents again

I did write about this earlier, on 16 October 06 to be precise, but it's worth a re-visit.

I met a couple of former colleagues in a bookshop this afternoon, and after a few moments of obligatory skirmishing about the intellectual street-cred of the items in one's basket. [Note; the sole copy of Slavoj Zizek's (sorry, can't be bothered with the accents) latest hardback has continued to sit there, face out, for at least six weeks...] Sorry, after those few ritual moments, we caught up on the state of play at the factory (aka university) and what happened to some course proposals we had been involved in validating.

One of them had participated in the validation of an earlier version of a course which I largely wrote and which of course never recruited or ran. I knew it was fairly unlikely it would ever see the light of day, so I sprinkled the documentation with "easter eggs" as programmers call them--hidden gems which are only revealed to the dedicated few who really dig into the program. Of course no-one ever noticed

I think she was a little taken aback that I could be so cavalier with the university's sacrosanct quality assurance procedures.

Yet another example (to set alongside the collected works of Slavoj Zizek) of documents whose sole virtue is their existence. Perhaps we could try simply pasting "lorem ispum..." into required forms and seeing if anyone ever notices...