29 September 2012

On a busman's holiday

I have delayed posting this for some time, because I don't want to point the finger at anyone, publicly. I debated whether or not to post it at all. As it stands it is merely opinionated commentary--a legitimate form of expression, but not one which can claim the interest of a reader. I am actually posting it to supplement my posting on a MOOC--where I have paraphrased and condensed some points, including events which happened after I wrote this version. Sorry--you didn't need to know that, did you?


I am on holiday; for once on a tour organised around a topic--the history of classical Greece. I won't go into more specifics for reasons which will become apparent.

On the whole it has been excellent. The site visits have been informative, and there is no substitute for going to the real locations. The organisation and the food have been almost exemplary. And the company of the other members of the party has been excellent.

Unfortunately the same cannot be said for the lecturer.

As I sat in the first lecture on the first morning, I berated myself for not having brought my trusty observation sheets with me. Had he been a student, I should not have been able to sign off on any item on my list. That is not in itself a problem (see here, for example), and indeed some of the things we are obliged to check would have been clearly inappropriate, such as "embedding functional skills". (It doesn't matter what that means.)

I note, re-reading the earlier post, that I commented then:
It was not about the tutor's technique... It was about "strategy", or really values.
And therein lies the difference. The lecturer started the session with the air of the whole thing being slightly beneath him--to think that it has come to this, to be hired by a package-tour company to lecture to a group of elderly people... There was evidence to support this, because he had clearly done very little preparation, despite--or perhaps because of--his apparent familiarity with the material. I say "apparent" because other members of the group who are more familiar with it than me have been more disparaging about his scholarship.

He did ask us who was in Greece for the first time. Otherwise he asked us no more questions. He said nothing about himself and his background, other than that this was the sixth time he had done this particular tour, and let slip references later to up to fifty years of visiting the eastern Mediterranean. He did decide not to undertake introductions, which was a fair call, probably; he obviously defined his role as an "expert" rather than a full-scale teacher. But it would have been interesting if he had shown just a small proportion of the interest in us which he clearly expected we would have in him. A show of hands on who were the old hands? On who spoke or read Greek? Considered themselves well-informed about the architecture, the history, the culture...? Five minutes would have sufficed.

He said he would get to know our names as time went on, and he did do that. (I could have said that he achieved this principally by counting us onto the bus, but that would be even snarkier than this account is already. Credit where credit is due!) But he missed out on so much information which could have been useful to a more confident and less arrogant person; there were people in the group with expertise from their professional backgrounds and travels who could have contributed fascinating material, which in practice was only shared with two or three others chatting over dinner.

Although I was not expecting and would not have wanted reams of paperwork, it would have been useful to have a list of titles of the lectures. However, it became apparent that in his view this was one long lecture which he would deliver in a series of chunks. Throughout the rest of the week, there was only the most token obeisance in the direction of a clear start and finish (except a sort of peroration in one talk given on the coach, but that was more about drama than structure).

He did supply a reading list; it was badly formatted and the bibliographical format was not standard. Who cares? Well, publishers and dates are quite useful. Perhaps more important, it had been corrected in long-hand and then copied without being re-typed. This clearly sends a message to the "class" that they are not worth serving properly; it amounts to an expression of contempt.

No visual aids. Well, he did have a carrier bag with some copies of picures from books, laminated, so he could hand them round. Given that all but the first of the talks were given on the coach, there might be something to be said for that, but the logistics of distribution and the number of copies, and their labelling, needs some thought. There was a single copy of each page to be shared sequentially among two dozen people, even if most of them were couples and would look at the page together.

He had prepared two pages on a flip-chart, though, showing a time-line. They were sloppily printed in marker pen, but they were big enough to read and he had covered them up with a blank sheet so they were not distracting until deliberately revealed.

So no presentation package, probably because of the setting of the talks, but also because I don't think he has the necessary skills to develop a slide-show. That might also account for the hand-written corrections on the book-list. Even so, the most important thing he could have achieved through a presentation, he could also have achieved for himself with a handful of 6x4 cards--a structure. But the consequence was that, together with a voice which sometimes descends into a mumble, and some irritating mannerisms, it was almost impossible to follow what he was talking about.

It is an egregious delusion that just because you know (or think you know) a lot about something, you can lecture about it. Even in an open-ended situation where the intention is to inform and perhaps entertain, where the group will not be assessed and they are free to take it or leave it at their discretion, where the language of "objectives" and "outcomes" is inappropriate--even then you need a structure. And when you are inclined to ramble on in a kind of drunkard's walk from one topic to another with little evidence of a theme, you definitely need a structure. I know because that is what I do, left to my own devices.

The simplest device of notes or a set of cards, each with only a key word or phrase on them demands some degree of planning. Cards are of course more flexible because you can re-order them, or take one out when you have answered a point in response to a question, earlier than planned...

So all this is very very basic. For most of the week I have been juggling hypotheses about what is going on. Is he merely incompetent? He is incompetent, but not merely so. His failings can be superficially rectified with advice, should he be inclined to accept it. But there is I think more to it than that; there's a fundamental self-absorption which suggests he hasn't got a clue about how other people respond to him and his work, and he doesn't care. (Apparently, nor does the company--I am led to believe that there has been critical feedback about him for years, but he is still employed.)

Beginning teachers are often very concerned about their own "performance" to the extent of not being able to pay attention to the students' performance; that's a natural stage which is soon overcome in most cases, and in any case their self-consciousness often makes them eager to seek and respond to feedback. For whatever reason, this guy is stuck...

But... all this does not extend to other aspects of his public role. Mingling with guests at social functions he is a little stiff and has to try hard to be charming. I empathise. I'm pretty inept at that, too: but then I don't set myself up to do a job which requires such skills. Tonight was a supposedly special dinner--characterised only by having to sit at long tables rather than self-selected small ones, and he was in "host" role. He was clearly not comfortable but he pulled it off quite well--better than I could have done, certainly. But his performance in making a simple vote of thanks for the organiser was largely about him and his next destination.

Something happens to this guy when he assumes the mantle of teacher or authority figure. What, why, how?

Thank goodness for local guides!

[There's no definitive answer, of course. But if you are tackling "the role of the teacher" on a post-school and adult education teacher training course, I think you might find this case-study stimulating.]

On the MOOC -- 3

This is one of a series of posts about participation in the free Massive Online Open Course [MOOC] on the History of the World since 1300 CE, from Princeton U via Coursera. Jonathan Rees, at More or Less Bunk, is also blogging his take on it. I'm sure he has more readers than me, so if you feel like commenting, please do there first--no objection of course to getting his leftovers!

I was going to talk about the forums this time, but an announcement tells us that they are still working on the "Global Dialogue", so I'll hold off that for a while.

This is getting harder work (and it is still only week 2). I started the first lecture of the week on Monday. I haven't been unusually busy this week but I didn't get to its third segment until Friday afternoon and its fourth on Saturday. It's not that the content is getting any more difficult, by any means. It's just that the prospect of another quarter-hour or so of Adelman's halting nasal sing-song drone is not exactly inviting. Nothing personal and not his fault, but putting him up as the presenter says interesting things about the course design.

We know that video lectures can be compelling stuff. TED talks are hugely popular, and perhaps the producers of this course have learned something from them in breaking the lectures up into chunks of under twenty minutes. But TED talks are rigorously rehearsed, with a professional director advising on expression, and pace, and visual aids... (Not to mention that presenters are presumably selected in part on the basis of their screen presence and articulacy, in the first place.)

Adelman has, in a sense, "rehearsed", in that he has delivered these lectures live, before. And to his credit he is not reading them from an autocue. But it doesn't appear that he has rehearsed specifically for this recording. And he is not in a lecture theatre with real live students around, just in a studio with his two assistants and a few technicians--and if he is in a studio, why is the assistants' sound hook-up so bad?  He may not realise it, but he is missing a whole world of feedback from his non-existent audience. Their posture, their expressions, their dozing disengagement, occasional blankness as they miss a point; the opportunity to focus on a particular student or two as barometers of engagement and interest--all that is missing, and a half-decent lecturer makes more use of that than she recognises. It is as if he were singing in an acoustically dead room, rather than in the shower... (I am giving him the benefit of the doubt here--his singing in the shower may well be as irredeemably dire as mine!)

There are two ways of re-couping that situation. Rehearsal and re-takes. They are basically the same thing--repeat performances until you get it right, either before the main performance or during it. When the main performance is a public event, retakes are difficult and so rehearsal is ever more important. But these are not public performances, and I have occasionally detected some continuity glitches in the lectures which suggest that there have been some retakes, but very few. (Lecture 3, segment 4 about 19:15m in)

This is not entirely straightforward. The faultless presentation becomes a "Spiel"--a slick salesman's patter which does not convince, and certainly lacks any sense of the thought and research and scholarship and debate which has gone into the considered and measured judgements of the lecture content. 
But... Academic presentation is not about the presenter, but the content. Sometimes the issue is about the academic superstar's "Look at ME!" obsession (I shall refrain from mentioning names...) This time it is certainly not that, but the way in which personal characteristics just obtrude into the presentation, unintentionally. Whichever way, we return to George Herbert, whom I quoted in the first post in this series--
A man that looks on glass,
On it may stay his eye,
Or, if he pleaseth, through it pass,
And then the heav'n espy.
The challenge for the presenter is to get out of the way so the student can engage as directly as possible with the content/

And that requires conscious and deliberate effort. And if it doesn't happen, it sends a message to the student. You ain't worth it. There are 70k students out there, we are told. The lecturing style of this course so far might pass muster for a couple of hundred students, live in a lecture theatre--where as I have argued, the situation is much richer than on-line. But for 70k students trying to engage with the material without the supporting ambience of a university, and a library... they need so much more. 

I am reminded of a post I wrote but never published from almost exactly a year ago, about an archaeology-themed holiday in Greece with a tour guide who was dire.
He rambled almost incoherently at inordinate length over the PA system on some very long coach rides (600 km on one day), his reading list was hand-written on top of typescript (and the citation was awful), his maps were badly photocopied from some school textbook, it appears... On the final evening, I took him aside and gave him some professional feedback (rising to the challenge of hints from some of the other participants*, and admittedly assisted by moderate wine consumption). I pointed out--much more gently than I would with my own students--that such an unprepared approach communicated effectively to the guests that this kind of job was really rather beneath him, and they weren't worth any greater effort.

It was when he admitted that the maps were not very good, but that he had not had time to get better ones, that I probably overstepped the mark. I reminded him that he had told us this was the sixth time he had done this tour. He rose, said he did not have to listen to any more of this, and walked off.
It's probably just me, with my background and professional interest, but I can't look beyond the presentation and "espy" the academic content. And I can't imagine--well, I can, actually--what it must be like to be a student on this course, where you are being assessed, and it is important that you complete it, and you find yourself approaching each lecture with foreboding... It's not that the experience is so bad, it's that it does not facilitate engagement with the subject-matter, it hinders it. Better not to have it at all.

The other point worthy of comment is the use--or lack of use--made of the assistants, who are brought in very very occasionally to answer questions about the images, with one or two word answers, as a cue for the lecturer to build on. Socratic questioning, it ain't. And the acoustics or sound-rigging make those answers barely audible. This is tokenism.

Sorry to have become so relentlessly negative.

* I do keep falling for this.

PS  Do take in  this post and comments from Historiann.

A useful selection of articles on MOOCs from the Chronicle of Higher Education

23 September 2012

Items to Share; 23 September

Education Focus
Other Business
  • Being Defensive Clever! But neither verifiable nor particularly useful... A lesson to all of us who (like me) occasionally fall for the idea that if you can diagram it, it's true!


21 September 2012

On the MOOC -- 2

This is one of a series of posts about participation in the free Massive Online Open Course [MOOC] on the History of the World since 1300 CE, from Princeton U via Coursera. Jonathan Rees, at More or Less Bunk, is also blogging his take on it. I'm sure he has more readers than me, so if you feel like commenting, please do there first--no objection of course to getting his leftovers!

I've now read the recommended material (admittedly in an earlier edition), and "attended" the second lecture.

One of the first issues to strike me (and indeed Jonathan) concerned signposting--ways of helping students to keep track of where they are in the overall argument. There was a lot of verbal signposting in this lecture.
  • "Gold" --we'll come on to that, later
  • "China's approach" --later
...but still no visual depiction.

I wonder why. Indeed, the visual component seems to be deliberately minimal. Now, I hold no truck with the egregiously spurious bulls**t about sensory learning styles. (I hope that is clear!) But I don't really understand why state-of-the-art producers of these courses--and for better or for worse the technical complexity is such that the designer/writer/presenter/producer roles can only be held by the same person with great difficulty--why they don't make elementary use of simple tools.

To be fair, we do get to see the illustrations as free-standing screen images, before the lecturer re-appears and they revert to background, but...
  • The quality is strangely low. We know from the copyright acknowledgement at the end of each segment that most images originate from the textbook, so perhaps we are simply being trailed with images to explore in more depth at our leisure. The images in the textbook, however, are no better. On screen, of course, the potential for zooming in and out on the maps is great, for example--and generalising for a moment, it's really easy and cheap with a package like Prezi. Using the tablet to circle and highlight battles in the expansion of the Ottoman empire is OK, but it could be so much better...
  • And the visual content is unimaginative. I floundered through the first lecture because the time-scale meant very little to me. As Adelman admits, 1300 CE is not an intuitive starting point. So--using a very broad brush--he dipped back into Asian history BCE and up to the high middle ages. That is fine; but it would have been even better with a visualised sub-title or otherwise accessible time-line.
But that poses another question for me; what is the academic level of this course?  It's a big problem for such a course, and I don't want to be critical for the sake of it, but;
  • How much background knowledge can one assume? I've just been watching Wartime Farm on TV. This episode included a reference to children from towns subject to aerial bombing being evacuated to the country, together with film clips, a recollection and some photos from a local person who was a child at the time, and an explanation of how it all worked*. I'm not old enough to remember it, but it was common knowledge in my childhood, and "it made me feel my age" to realise that it would be effectively ancient history to most of the audience, and did need to be spelt out, despite my generation muttering, "Yes, yes! We know all that! Who doesn't?"
  • This is by definition an open-access course, and that means that it will lose people for whom it is too demanding, and also those for whom it is too basic. Adelman promises it will speed up later--when it may well lose me because it expects too much--but for the moment it is frankly boringly slow. 
    • A commenter on the previous post has helpfully pointed out that it is possible to speed up the playback (available via the "keyboard shortcuts" menu at the bottom of the playback window).
  • But that poses another question. Video plays at its own pace. And it is linear (despite Adelman's references to later and earlier lectures). The experience, like that of the lecture hall, is common, although not necessarily shared, when the presentation is virtual. I know in this case that had I had a transcript of the lecture, I would have preferred to have skimmed that, rather than listen to the professor. Do we know what video is more suited to--in terms of level of learning, take a bow Mr Bloom--or discipline? That is a real question--I've just consulted my own library, and not found any answers beyond the thoughts of Laurillard (2001), which are of course way out of date--so all leads gratefully received.
    • Actually, it is possible to access a transcript, in the form of the text for the sub-titles, on the right-hand side of the panel for each lecture segment, but they are unformatted .txt files, and thus difficult to read. I note that there is an announcement about editing and translating those files, dated 20 September. That's brilliant--perhaps someone could edit and format them to reflect the relative importance of topics? (No, sorry, I have other things on!)
  • Somewhere, there was also a point made about the quizzes at the end of each segment, and the lack of guidance about when there was a single acceptable answer and when more than one item could/had to be selected (but I can't find it again). I am not a great fan of multiple-choice examinations of any form, and several posts on the "lectures" forum show their limitations. But I must admit that these have been carefully designed so they are not merely tests of recall, but do require one to think back over the arguments and the less-than-obvious distinctions made in the lectures. The distractors (the suggested wrong answers) are the key to good MCQs, and these are well pitched.
Next time, unless something gets in the way, I'll try to engage with the forums--they are very important, but daunting on a course as big as this...

Jonathan's take--and interesting comments--are here.

* if anyone is interested, the best introduction to that snippet of history is probably Jack Rosenthal's wonderful 1975 BBCtv play.

Laurillard D (2001) Re-thinking University Teaching (2nd edn.) London; Routledge

On the ultimate campaign ad!

Thanks to Jamie Frevele at Boing-Boing: "While I don't officially endorse Bridget Mary McCormack, who is running for a seat on the Michigan State Supreme Court, I do endorse the viewing of the campaign ad she's running for her non-partisan race. As the sister of actress Mary McCormack, who played security advisor Kate Harper on The West Wing, she was able too hook herself up with her very own reunion of the cast of Aaron Sorkin's presidential series..."



We don't have campaign ads in the UK (unless you count Nick Clegg saying "I'm sorry") but if we had to, I wish they were all like this. (But how did Bartlet get re-elected for a third term, and how did he oust Santos?)

20 September 2012

On the MOOC --1

This is one of a series of posts about participation in the free Massive Online Open Course [MOOC] on the History of the World since 1300 CE, from Princeton U via Coursera. Jonathan Rees, at More or Less Bunk, is also blogging his take on it. I'm sure he has more readers than me, so if you feel like commenting, please do there first--no objection of course to getting his leftovers!

Day 1. I am emphatically not planning to live-blog this whole thing, incidentally.

This post is not enthusiastic, and given my track record, I really don't want to become a professional whinger. But writing this, I realise an important distinction--one which I engaged with almost every day when I was assessing the practice of learner teachers--between the perspective of the observer and that of the participant. (Etic and Emic ...sorry!)

Most people who take the course will not give a damn about its design and implementation. They will quite rightly be interested only in what they can learn through it. That preposition is apposite. [I love it when I can be so precisely pompous!] As George Herbert put it:
A man that looks on glass,
On it may stay his eye,
Or, if he pleaseth, through it pass,
And then the heav'n espy.
I'm afraid that although I hope to espy the heaven, I cannot but stay my eye on the glass. And the glass is presumably the most refined, transparent, and distortion-free available.

I have indeed signed up for the course because I am quite interested in the subject, although it is worth noting that I have no extrinsic motivation at all (unless you count acquiring material for this blog).  The course carries no credit, which probably makes some difference to how it is experienced by its participants. But the majority of the 70,000 participants presumably could not care less about the features I shall comment on---until they pass a threshold beyond which they obtrude onto their learning experience.

My problem of course, as it is when I observe direct teaching, is to tell what matters and what does not.

I'm starting from the position that this is the best course its originators can design. It carries the Princeton brand--one of the most prestigious brands in US academe. It's far from an amateur (Khan academy in its early days?) production. I haven't seen a credits list, but I assume that it benefits from the input of very accomplished instructional designers, production staff and online developers.

The preface to the textbook (I wasn't prepared to pay £90 for the latest edition, and settled for £15 for the 2002 version--it arrived today) states:
"For an entire year we met to discuss [...] what global themes we wanted to stress. Only after intensive and sometimes contentious discussions were we able to decide on our over-arching framework, the chapter divisions[...]" (Tignor et al. 2002: xxv)
I'm assuming that a similar vigorous debate took place about the design of the MOOC (although probably not with the same team, and given the shift of focus, perhaps lacking some of the expertise?)

So what we are participating in is probably pretty well what was intended. I'm labouring this point not because I want to beat the authors around the head with what I see as their failures, but because I want to understand why they made the choices they did. This is the state of the art.

Pre-enrolment*

(* the single "l" is correct British spelling.)

I signed up easily, and the course details were accessible and adequate. I don't think the nature of the course contract was as clear as it could have been, in terms of probable time-commitment, assessment load, and so on.

In this case, as a free non-credit-bearing demo course, to emphasise such things could be overkill, and put off some prospective participants, but I noted some anxious questions on the forums---"I'm already juggling work and single motherhood, so I can't be sure I'll get the assignments in on time--can I still sign up?" (A paraphrase of several posts.)
    [Actually--off topic--that's not a problem for the course. The applicant has clearly not understood the nature of the contract. In this case, it is simply a gift. She can take whatever she wants, and there is no obligation in return.
    (Sweeping generalisation without evidence alert) We're not very good at gifts nowadays when they are so exploited commercially as portals to bait and switch deals. Even I feel a little "ungrateful" as I critique (not the same as criticise) this course. One shouldn't look a gift horse in the mouth.]
The confirmation and welcome emails were really helpful, because just as you need to know what room your course is in at college, we need to know precisely where to go (url) actually to start this course. Fortunately, online you can't be late for the first class. The introductory page is clear, welcoming, and instils confidence.

The bottom line.

It's based on video lectures. That's a very conservative approach, and I'm trying to weigh up the considerations which may have been taken into account in going down this route. But a little more detail would be appropriate for any of you who has not signed up for the course;
  • there is one lecturer (Jeremy Adelman)
  • these are not videos of live lectures (I think--there are some token gestures to the audience and a grad. assistant, but the setup is more studio than lecture theatre).
  • the lectures are broken up into 10-15 minutes segments, punctuated by "quizzes"--Adelman admits he does not like the term, but he has put out a rather good explanatory email about them, presumably in response to confusion about how many of the multiple-choice responses can be chosen. Even so, I am struck by the contrast between the pace of this presentation and that of "factual" TV, which covers material about five times as fast, although of course its aspiration is to entertain rather than educate (perhaps--bear in mind that some of the best factual programming on the BBC is supported by the Open University).
  • they are supported with minimal slides, at the rate of roughly one every three minutes. So far they are only maps and pictures--no bullet points, thank goodness. Of course, whether the absence of text-heavy slides reflects a principle about presentation, or a pragmatic acknowledgement that it's not a good idea for an international audience, (or both/neither) I don't know.
  • but--the segments are crude divisions, and there is no sign-posting of topics being addressed--other than verbally. Adelman makes an effort to re-visit his points and itemise them, but without any visual anchors. There is a handout to accompany the first lecture, but it consists solely of a list of names, locations and terms which may be unfamiliar--it gives no guidance on what to expect when.
  • this links, too, to my recognition after a while that I had no temptation to take any notes (partly a reflection of the speed of presentation--see below). One reason for taking notes in a live lecture (at least before they started to be recorded and placed on the VLE) was of course to capture this live one-off moment (at least, for the student!) This time, I knew I could re-visit any time and re-play a segment so perhaps I did not concentrate in the same way. The way in which I did concentrate, however, has swings and roundabouts. 
    • however, the absence of signposting would make it difficult for me to select a point in time to revisit the video for clarification. A continuing sub-title, or a crib-sheet handout showing at what point the lecture moves on to a different sub-topic would have facilitated such re-visiting.
  • a participant commenting on the forums thanks the lecturer for not going too fast--her first language is not English. I appreciate that, but the pace in the first lecture is turgid (Adelman promises it will accelerate shortly). That is not a critical comment aimed at the presentation, just something to bear in mind about lecturing in English to an international and multi-lingual audience.
  • Sub-titles are available, but the synch leaves something to be desired.
So what does that say about the strategy of the course? I can only make inferences, but I need more evidence...

Until later...


16 September 2012

Items to Share: 16 September

 A little thin on the ground this week--I've been working...

Education Focus
Other Business
  • The Perfectly Fried Egg (NYTimes)  Not only a load of pretentious foody bullsh**t, but up to slide five, it is the prose the rest of us have been speaking for centuries. 
And...

A History of the World since 1300 (Coursera): Just a reminder that the MOOC has started. I'd be interested to hear from anyone taking it.  

09 September 2012

On doing a MOOC

Fifteen years ago, I worked with some cutting-edge educational technologists to devise a module on "Resource-Based Learning"  for a Master's course which I directed. I rapidly found that even with small cohorts, the time required to tutor students and join in online discussions vastly exceeded my time allowance (even not counting the initial preparation time).

Ten years ago, a colleague and I launched an online Research Methods module for another Master's in Education, but I conducted mine as a blended course, using an early version of the "flipped classroom" approach as it is now known. Worked well, and was manageable for me, even allowing for a 110-mile round trip to get to the face-to-face sessions Perhaps now we would do it with Skype or similar technology.

And I worked with the UK Open University on developing re-usable interactice "assets" which could be incorporated into online practice-oriented courses in nursing and social care.

Around the same time, I wrote these pieces (here and here) on resource-based learning. I claim a certain  degree of prescience in them. And I've got a record as a designer, author and tutor...

But a few years later, I did an online course on online tutoring, as a student, and blogged it*.

I hated it.

I admired how it had been devised, and particularly the skill and patience of the tutors, dealing with obnoxious participants such as myself. No, to be fair, I was the only obnoxious participant. (The others were, I think, pre-disposed to enjoy/like/value/endorse it, because they [or--more likely--their institutions] had paid to participate. I got it free, as a part of my employment package; it seemed curmudgeonly to turn it down, but I did not approach it with high expectations.)

At the most basic level, all I can remember about it is resenting it. There was apparently some substantive content -- but most of it was about the management of online courses which frankly doesn't have much academic hinterland, and I won't mention the set text, because it was useless. So I'm a sceptic, even a cynic about online learning. Now...

Jonathan Rees (an historian) has long been a concerned observer of online courses on his More or Less Bunk blog. But with the advent of a free CoursEra Massive Open Online Course (MOOC) on World History since 1300 (AD/CE it appears, although it doesn't specify) he is signing up and planning to share his experience through the blog.

So--- Let's join in! OK, the projected time commitment may be a little onerous (but not obligatory), but there are no prerequisites and it is free.

Sign up here.

I shall particularly be interested in:
  • how much difference it makes that the course will be much more information-heavy than stuff I have done previously, and therefore probably more suited to online delivery.
  • the experience of participation and whether and how any sense of community and mutual support develops.
Incidentally, it probably makes more sense to post comments on his blog rather than this one--the bigger the community the better!



*  [1]   [2]   [3]   [4]   [5]   [6]   [X]

Items to Share; 9 September

Education Focus

Other Business

03 September 2012

On instrumental learning (pardon the digressive memoir)


I passed the local branch of a chain bookshop on Saturday, now featuring the "back to school" window display. Prominent was a "study guide" to To Kill a Mockingbird --presumably a set text again for some exam or another.

Harper Lee, author of To Kill a Mockingbird, is 86 and reclusive*. I wasn't surprised to see a "study guide" in the window, but it did set me thinking about what had been made of her wonderful story, whose very accessibility and gentle power has conspired to its reduction to a commodity--knowledge about it can be traded for exam credits, while the point is lost.

I'm not merely speculating here. Robert Westall was my art teacher at school. We became friends and remained so for thirty years until his death. (He was my son's godfather and I was privileged to be an executor of his will). As the link shows, he was a wonderful author of stories for children and young adults, acquiring many awards for works from his debut novel The Machine-Gunners in 1975 to posthumous publications. The Machine-Gunners was serialised on BBCtv in 1983 --and of course found its way to being a "set book" for 16+ examinations...

I don't remember when it was first set, or when the first cribs came out (for examples of current stuff go here and scroll until you get to the title--I make no comment at all on the quality of the resources offered. They are simply an accessible example of the kind of material on offer.) But I do remember discussing it with him.

I congratulated him. He'd really made it! And--since he was always something of a contrarian--I didn't really take it seriously when he said he wished it hadn't happened, and that perhaps he had a right to be consulted about it. (As far as I can remember, the first he found out about it was from his publisher or his agent, because they had been warned to increase print runs and approached about annotated editions. But then, most set authors are dead already, so...)

But his argument was persuasive. He did not want young people to see his work as "the kind of stuff they made you read at school." Once they saw it in that light, he would have lost them.

And of course he was right.

Yesterday I was in Waterstone's--the last remaining book-focused chain in the UK--and a woman approached me, holding two paperbacks, face out. "Excuse me," she said, "I'm a visiting author, and I wonder if you would be interested in these novels..." To my shame, I was rather brusque. (In the unlikely event that she reads this, I apologise. I can't identify her because Waterstone's website does not mention previous "events". Sorry!) "I don't read novels." I said.

And I don't. The last novel I read all the way through (as opposed to started and abandoned, of which there are dozens) was Ishiguro's "Never Let Me Go", which remains utterly haunting, but that was about 2006.

It was studying literature at university which did it for me, despite the quality of the courses and the teaching (memories and tributes here and here). I was fed up with reading literature instrumentally --for the sake of writing an essay or taking an exam or being able to escape humiliation in a seminar discussion.

Incidentally, in those days we took "Finals" at the end of three years. If we passed "Prelims" after our second term in the first year, there was no more summative assessment until then, when our degree classification was based entirely on --in my case-- thirteen three-hour unseen examinations over three weeks. And I tripped up. On the very last exam, I committed the silliest mistake. I did not read the instructions, and I only answered three questions instead of four... I only realised in the post-exam chatter, and I was devastated. I already had my rail ticket back home for that afternoon, so I went to the station bookstall to find something totally non-literary to take my mind off self-recrimination for my stupidity which robbed me of a first-class degree (as I later discovered). I picked up a pulp science-fiction paperback by someone I'd never heard of, called Isaac Asimov. This was 1966. Not a great stylist, and not strong on character, but the stories were amazing!

It was almost a decade before I went anywhere near mainstream literary fiction again.

In the early '70s, a friend let me in on a secret. Jane Austen is funny. How had I managed to read all her novels and volumes of critical appraisal of them, and write essays about them, and miss that fundamental point? I forgave her, as it were, but I couldn't extend the pardon.

I've since read a few recent mainstream novels, not totally contaminated by the academic stance/ frame/ discourse/ lens/ perspective or whatever bullsh*t term (I use the adjective advisedly following Frankfurt 2005) is current, but I can no longer recapture the innocent suspension of disbelief which is a prerequisite of sheer enjoyment. For a while I immersed myself in science fiction and fantasy, until the academic poison spread to "genre" fiction.

Why am I telling you all this? I hear you cry.

Because studying something instrumentally is quite different from immersing oneself in it expressively. Learning something in order to achieve something else is quite different from discovering that you have incidentally acquired enormous knowledge and skill --because you were just absorbed in something for its own sake.

And that has enormous implications for those of us who presume to specify what other people should learn.

(And just for the record, this is the 700th post on this blog.)



*  The website www.harperlee.com carries a disclaimer if you dig far enough; "Please note that harperlee.com is a private website, unaffiliated with Harper Lee or her representatives. Her reps cannot be reached through this site and we cannot forward messages to them."

    02 September 2012

    Items to Share; 2 September

    Education Focus
    Other Business

    31 August 2012

    On messy practice

    Formal science writing--what I call the "narrative of explanation"--presents a neat and tidy step-by-step process of introduction-methods-results-discussion grounded in a non-existent "scientific method" of observation-hypothesis-prediction-experiment followed in a linear fashion. (Shermer, 2012: 62)
    At the same time as reading this very interesting exploration of the neuroscience of belief, I am undertaking the annual penance of reading textbooks for courses whose reading lists need to be up-dated. Most of them are dire.But of course this time I have been reading them against the background of how P and I are planning to tackle some of the same material, and that has made their assumptions stand out.

    They do not count as "science writing", of course, but they present a similar idealised and unproblematic account of teaching, which bears only the most tenuous resemblance to reality. This came to mind again the other day when a former student wrote to recommend a website to me, and a planning model. (The ADDIE Analysis/ Design/ Development/ Implementation/ Evaluation model from Don Clark.) I had actually written about this before here, arguing that although it might be a good formal representation of the process, I don't know anyone in the real world who operates in such a way. Apart, that is, from my correspondent (and his colleagues) in the military--although he, too, maintains that the instructional designers just pretend to do it that way to placate their managers. And as he has often quoted to me, "No plan survives contact with the enemy" (von Moltke) --or perhaps with the students. At least it ought not to.

    It can of course be argued that the textbooks are just presenting a simplified model, because that it what everyone begins with, and then they modify it in the light of experience. That is fair enough, but I am coming to the conclusion that the writers seem to believe what they write. In a fine gesture of consistency, they are applying to their own writing practice the same kind of dumbed-down incremental view of learning as I seem to have been regularly castigating for a couple of years (here, for example).

    In the context of our book, I'm struck by the way in which the textbooks are focused, with the standard device, for example, of listing the applicable professional standards at the beginning of each chapter. So one (a 2001 dated but representative text which happens to be at hand) introduces a chapter on planning teaching with:
    "The ideas and advice in this chapter relate mainly to the following areas of skills and knowledge:
    • Introduction stage: skills B1a, B1c, B1, B2a..."
    (I'm not going to reference it--it's unfair!) It then goes on to consider items in short sections with an exercise and points to think about at the end of each. And to be fair it's all quite well done--better than I could do in this format. OK, that's what textbooks do, but...

    But... it all starts from the assumption that the authority of the standards is absolute, so if you can get a student to meet them, job done. That is of course rubbish. The standards are proxies and constructs, themselves the product of much wrangling and argument and horse-trading in smoke-free committee rooms. You don't have to be a relativistically oriented sociologist to see that--the very facts that they change when the job doesn't, that there are inconsistencies and contradictions within them, that they are aligned suspiciously and spuriously neatly with inspection framework, all testify to them existing at several removes from the job. It's no-one's "fault", it's just in the nature of the beast.

    And then there is the assumption that if you want to get from A to B, the most reliable route is a straight line. But as John Kay persuasively argues in a business context, the best approach is often an oblique one--especially when it is not clear that the apparent objective is the real one. You may be in the business of aiming at something else, knowing that the apparent objective will be a necessary side-effect. More examples from Kay in his book (2010), and more about that here.

    Indeed, as I seem to be arguing perpetually, most recently here, there is little or no evidence for many of the models and methods which are so dogmatically espoused and asserted by the educational establishment, or indeed that the obsessive process of digging up plants to see if they are growing can effectively do anything other than guarantee minimum standards. See here.

    Torrance et al (2005) comment with reference to the "learning and skills" sector that:
    Detailed tutor and assessor support, in the form of exam coaching and practice, drafting and redrafting of assignments, asking ‘leading questions’ during workplace observations, and identifying appropriate evidence to record in portfolios, is widespread throughout the sector and is effective in facilitating learner achievement and progression. (p.1)
    Yes, "learner achievement and progression", but that is not the same as actual learning. It merely testifies to the achievement of the dubious proxies of the educational system, as Ecclestone (2012) argues. (It's not new--the point was made brilliantly by Howard Becker, forty years ago--and of course re-invented by Lave and Wenger (1991), Wenger (1998) see here.)

    And as I have quoted before from Kay;
    For over ten years, I built and ran an economic consultancy business, and much of our revenue was derived from selling models to large corporate clients. One day, I asked myself a question: if these models were helpful, why did we not build similar models for our own decision making? The answer, I realised, was that our customers didn't really use these models for their decision making either. They used them internally or externally to justify decisions that they had already made.
    The issue is really about be able to embrace the messiness of practice--until we can do that we can't even recognise the meta-skills which are needed to be able to teach.

    As I noted in "Items to Share" a little while ago, this post on "Experienced teaching looks a lot like jazz" makes the point.


    Becker H (1972) "A School is a Lousy Place to Learn Anything in" American Behavioral Scientist September 1972 pp. 85-105. Reprinted in R G Burgess Howard Becker on Education Buckingham, Open University Press, 1995 (Public Library Location)*

    Ecclestone, K. (2012) ‘Instrumentalism and achievement: a socio-cultural understanding of tensions in vocational education’, in J Gardner (ed)  Assessment and Learning (2nd edition) London: Sage Publications 2012

    Note:  Hattie's meta-analysis, it has to be admitted, commends the effectiveness of "direct instruction", which is consistent both with the formal planning models and with SMART objectives and the like. I'm not denying that.

    * This public library tag is an ingenious facility I have just come across; click on it, enter your post-code, and it will tell you your nearest public library which holds a copy of the book.

    27 August 2012

    Items to Share: 26 August

    Education Focus
    • How Technology Can Help  Dan Meyers' exemplary account of how to use different levels of abstraction to teach maths (high school level, but generalisable) and how technology can facilitate the approach.
    Other Business
     

    25 August 2012

    On a possible book

    A friend and I are planning a book, probably an e-book which we can get out directly, and at a reasonable price. It will probably be aimed at the relatively new teacher in higher, adult, or post-compulsory education.

    For me this is an opportunity to collaborate with a colleague with whom I have worked closely for about fifteen years, and whose areas of interest are fairly complementary to mine, although we also overlap. What he is hoping to get out of it, however, I'm not sure!

    Clearly one of the important considerations has to do with the distinctiveness of the material and its arguments. When one does a proposal for a publisher, one of the standard questions is about how the proposed book compares with others on the market, and what it can offer which the others can't.

    There are of course now dozens of "text-books" about teaching in post-compulsory education, most of them clearly focused on the standards laid down by the various bodies with fingers in the pie. They are almost all deadly boring, of course. I only say "almost" because I haven't read them all, but I have not yet found one which conveys anything of the excitement and fun of teaching in this sector--although some of the more thoughtful and less didactic "para-textbooks" manage that. That is the kind of book we want to produce.

    So the strap-line could be, "what your Cert Ed/PGCE/DTTLS never taught you..."

    The working title is Teaching Off-road, which calls for some explanation. Driving (or cycling) in the UK is heavily oriented towards reliance on the systemic infrastructure including metaled roads, signs, traffic lights, and rules. Similarly, much teaching is merely about getting from A to B within the rules--and it is deadly boring. But... (you can fill in the rest)

    So we are planning to put it out initially as an e-book which we can revise in the light of comments; but your input to the planning would be much appreciated, and whatever makes it to the final version would of course earn at least a free copy as well as an acknowledgement. So do let us know what you would like to see addressed!

    24 August 2012

    On the return of shame-culture

    Two things. First:

    After a decade of fighting allegations of drug use and doping, Lance Armstrong has given up.
    World Anti-Doping Agency president John Fahey says Armstrong's decision to drop his fight against drug charges,[...] was an admission the allegations "had substance in them". (Source)
    That allegation only works by the rules of shame-culture, not those of guilt-culture, which apply in all reasonably advanced legal cultures. (I've outlined the distinction--which is not mine--here.)

    It is perfectly understandable that Armstrong, against whom nothing has been proved, has finally decided that there is no way he can win; he can't prove a negative, so he might as well not bother. It's not as if it matters any more.

    It is not possible to conceive of any evidence he could produce which would refute the allegations--that is the test of a shame-culture, whether in a class of students or a work setting or a political arena.

    Second:

    But the peculiar arrogance of the Anti-Doping Agency (there seem to be several outfits involved) is highlighted by their apparent belief that they can strip him of seven Tour de France titles. Just like that. As far as I am aware the USADA does not run the Tour de France. The contest operates under the auspices of the International Cycling Union (UCI), the world governing body--who have not yet pronounced on the matter.

    I know only what I have picked up from the general media--not even the sporting press--so I may have it all wrong. I'm not an advocate for Armstrong--but I am interested in the peculiar construction of  "authority" in the sporting arena. Whether it is the IoC, FIFA, or a range of lesser bodies--and leaving aside the issue of corruption, which is clearly entangled with the culture--there appears to be a pervading atavistic shame culture, which is tied up with their unaccountability.

    I first noticed this 40+ years ago in connection with a youth club I was associated with in Moss Side in Manchester. I remember a committee meeting at which we considered the implications of being fined--financially-- by the local amateur football league for not having fielded a team for a match, which put the very continuance of the club in jeopardy. I was sure they couldn't legally do that. My more experienced colleagues patiently explained to me that it made no difference; if you wanted to play football, you had to have other teams to play with, and that was arranged by the league, and so you had to play by their rules. In this case the league committee was merely bossy and a little unimaginative*, and there was no evidence of corruption, but it is easy how that might arise in such a context.

    Add loads of money, and create a toxic, unaccountable and powerful sub-culture, which is reflected in shame-culture in an institution, a community, a church**...


    *  And, as one of my colleagues observed at the time, what would one expect? These were working-class volunteers who were much more familiar with sticks than carrots, as opposed to us middle-class do-gooders who parachuted in to "help".

    As one local commented, not unkindly, when I moved on, "I know you meant well, coming to live here; but the essential difference was that you were here by choice and now you can move on by choice. We don't have that choice." But that's another story.

    **  ... or of course in the latter case, one which is powerful enough to over-ride the legitimacy of allegations.

    23 August 2012

    On the "decline" of exam achievements.

    Two Thursdays in August are guaranteed education headlines in the UK. The second Thursday is when the "A" level (18-year-old school leaving exam) results come out, and the third Thursday announces the results for the General Certificate of Secondary Education (the terminal or way-station exam for 16-year-olds). Cue great debate about whether rising achievement = declining standards. This year, for the first time since GCSEs were introduced in 1988, there has been a decline in the proportion of highest grades awarded (in both sets of exams). So--is this a cause for celebration or lamentation?

    I won't re-visit all the tired old arguments, although I was interested to note that an interviewee on BBC News 24, whose name I didn't catch but who is an experienced examiner, made very much the same points as I wrote about ten years ago on my "Heterodoxy" pages.

    P is currently tutoring on an on-line Master's programme for another university, and a few weeks ago the tutorial team had a meeting about assessment policy, which he told me about. (Disclaimer; I may not be representing him accurately, and I made no notes*)
    • He was--possibly naively!--surprised at the level of discussion. After all, all present were both academics and professionals in education from a School of Education. P could not detect any evidence that the discussion was informed by research, theory or scholarship.
    • Since assessment is one of his areas of special interest, he noted that the discussion concerned principally:
      • The assessment load, both for students and for staff How did it match with the demands of other courses? What kind of expectations did students have about feedback?
      • Ensuring maximum achievement. What kind of information and guidance did the students require to know exactly how to get a good grade? How detailed and transparent should the rubrics and marking scheme be, to ensure that they had no grounds for complaint?
    • These are good practical issues, and he didn't really want to contest their importance (although the rubrics which emerged later are so hand-holding that he [and I] regard them as not appropriate for Master's level study).
    • But he was struck by the hegemony of criterion-referencing. Norm-referencing was never mentioned, except by him, and he had the feeling that some of the group didn't know what he was talking about.
    Neither he nor I want to argue that norm-referencing would be an appropriate strategy for that course, but its apparent extinction is worthy of note. Simply, the distribution of marks/grades is as useful a guide as you are going to get as to whether the assessment criteria are pitched at the right level--there needs to be a constant conversation between criteria and curve.

    And despite my thoughts referred to earlier on the norm-referencing implicit in the national exam system, I believe that the achievement of the "best" is an important guide to setting assessment thresholds.

    After all, we have just had the Olympics, and the Paralympics are just around the corner. Such Games are the epitome of norm-referencing. No-one sets criteria to award a Gold to anyone who runs the 100m in less than 9.8s. Instead, the standards to be satisfied for entry to the Games are derived from the distribution of previous performances--and they continue to to rise. In the same way, (presumably--I really no nothing at all about this, but I am drawing on parallel experience and a little theory) in those sports--such as gymnastics or diving--which have to be scored by judges, the categories they use, their weighting and their criteria, are continually reviewed with reference to the bar-raising (itself an interesting metaphor) achievements of the past.

    Beyond sport, too: To refer merely to criteria for requisite performance is both to;
    • Potentially fail to do justice to work which is "off the scale" and can't be adequately represented within existing criteria. Game-changing stuff.** 
    • and more importantly--to arrogate to current authorities the right to specify, determine and ossify current "good practice" as the determinant of (inter alia) professional admission. History is full of examples (usually, to be fair, recounted with benefit of great hindsight--Semmelweiss, Tesla...)
    So?


    I've touched on this on the blog before:
    * Shame! You don't (well, I don't), when I'm having coffee with a colleague and friend. More along these lines coming up later. Watch this space!

    ** Kuhn, of course. But less contentiously I've just been reading Brooks M (2011) The Secret Anarchy of Science London; Profile Books which is full of great tales of the good seeing the best as the enemy.

    17 August 2012

    On writing with this new-fangled technology

    As I mentioned a few days ago, P and I have finally started on the book. It says something about my advanced age that the last book I had published came out in 1989. That was not exactly pre-computer, but it was close enough. I remember that I offered to send the publishers a word-processed manuscript* on file (I was up with the technology then!) but they declined, saying that it was more bother than it was worth. So I paid for the wife of a colleague to type up a fair copy from my MS onto several 5.25" floppies, and then imposed on a geeky clergyman friend to use his study and his BBC B computer (with 32k of RAM!) to edit them, and print them out.

    The alternative was for me, or someone employed by me, to re-type partial or complete drafts. At least this time I was able to buy a little program called "Grease" (the name is a reference to an incident in David Lodge's 1984 novel, "Small World") which generated the index automatically--it had cost me £200 for to have someone compile it for the previous book (more than a third of total earnings; I get more from photocopying levies than I ever earned from sales...).

    So despite writing innumerable structured documents and reports and reviews and webpages and blogs --I realise that I am now facing a blank wilderness, which I have to populate with ideas, with no boundaries or guides or constraints. No, that's not quite right. I don't have to populate it. It's what I want to do, but there is just too much choice about how to do it.  It's largely a function of the "freedom" to go back and cut and revise and insert, with the MS miraculously healing itself (and since I am careful about version control, the capacity to revert to a version of weeks ago in seconds.) Sartre talked about being "condemned to freedom"; I have a taste of what he meant.

    Of course I have been assembling resources--papers written for this and that, lecture notes, and so on. In one afternoon I found 57k words on an archive drive, all more or less relevant to the book, but some of it fifteen years old. And all author/date referenced--a convention we are not going to follow this time (I wrote about the reasons earlier, here).

    I'm still not clear whether to revise or to start from scratch, but in the meantime I have adopted what is probably the worst possible tactic--start at the beginning--recognising that the writing will all go through many more iterations than a paper-based process ever could. But will that make for a better product? On the evidence of student writing probably not. It's the constraints of paper which force so much greater attention to detail; sculpting in marble is different from moulding plasticine (Wallace and Gromit notwithstanding).

    Yes, I know. You make a maquette in clay, and then you create the real thing in the permanent form based on it. But with this technology there will never be a permanent form, because I can always go back, and revise and update; the material is infinitely malleable, and since we are planning to publish electronically, at least initially, it will indeed "never be finished, merely abandoned" (attr. Leonardo or E M Forster).


    * Even then a misnomer--"manuscript" means "handwritten", and of course mine was type-written.

    13 August 2012

    Items to Share: 13 August



    Education Focus
    • Seth's Blog » Blog Archive » Tyler Cowen’s Unusual Final Exam An interesting idea, if you have to have exams. For a history course on my undergraduate degree, taken by only four students, tutored in pairs, the tutor asked us to choose the topics of our essays ourselves (one of us would read out her or his essay each week for discussion). When we arrived at the exam, the questions on the paper were simply the titles of the essays we had devised and discussed. And on a course I worked on for many years, there were no assignments set by the tutors--they were, and are, negotiated with the students.
    Other Business