20 November 2012

On returning to the MOOC...

Sorry! This post arose because I ran out of words on the commenting facility of a discussion of a Massive Open Online Course (aka MOOC) which I left a while ago (see here)

Jonathan Rees has stuck with the MOOC longer than me, and he is now engaged in a discussion with the principal contributor Jeremy Adelman, who has effectively laid down the challenge, "OK, how would you do it better?" Jonathan opened the discussion to all and sundry, and I replied...

[Here is the lead-in] 

The first requirement is to get away from the economic model. The Dearing report on higher education in the UK, in the late '90s (sorry, I'm just responding on the hoof, so referencing takes a back seat) in an appendix, argues that simple lecturing requires 6 person-hours prep. for each hour of "delivery". "Resource-based learning" as it was then known, might require up to 100 person-hours of investment for each hour... And that  was about delivery of content...

So on-line learning should be prepared to spend about 15 times as much per hour as face to face. But the student numbers are a thousand times as great or more!

Whatever recent commentators such as Alex Tabarrok have argued--from an economic rather than educational perspective--the online model is impoverished--and especially if it relies on the "lecture" model.

(And incidentally, I'm sorry to say that the lectures on this MOOC were, at least until I dropped out, very poor. Not only were they poor on-line, they would also have been bad in the lecture theatre [although the sense of a live "performance" would have helped]. The visual accompaniments were frankly amateurish, and there was clearly no investment in professional advice in lecturing for distant delivery. This is not about spoon-feeding, but judicious enhancement. And--brutal bottom line--voice coaching for Jeremy.)

The "Global Dialogues" show something of the way forward.

(for reasons of technical ineptitude on my part, I'm publishing this incomplete stuff now, because it is getting late. I hope to finish it shortly)

(A week later...)

The second is implicit in the very pertinent comment added by Contingent Cassandra to the initial version of this post--it concerns the transparency of the medium. She concludes that:
The minute a lecture lands on a screen, students seem to become critics, and to use as their standard the highest-quality material they've seen. That's a tough standard to meet.
(I'm tempted to quote George Herbert again--but I've done that three times already.) The medium has become a message, if not the message. I suspect that only routine exposure to such a medium will overcome that issue, if indeed anything will.

And that prompts the third consideration, which is that simply porting a method (lecturing), which hasn't had much of a good press since alternatives became available and is far from the gold standard of teaching, suggests a certain lack of nerve on the part of the authors of the course, and, as I argued on 29 September a degree of laziness which sends a message: preparedness to re-configure the course,
...requires conscious and deliberate effort. And if it doesn't happen, it sends a message to the student. You ain't worth it.
More positively, there are ideas out there which could be used, although they would need some root-and-branch re-design. The most obvious are the Khan Academy (I note that the strap-line for their history listing is "The history of the world--eventually!") and RSA Animate. They are short (shorter than the MOOC's 15-minute segments), and use fairly basic animation to keep track of the arguments. Moreover, the preparation is necessarily a team enterprise (even if Khan did start out on his own) --the very act of discussing the integration and juxtaposition of channels of communication forces the team to make the most of the process. And that in its turn may promote the creation of more innovative models...

I'd better stop while I'm being uncharacteristically positive!

(But do follow Jonathan.)

19 November 2012

Items to Share: 18 November


15 November 2012

On finding one's own way


I've finally bought a tablet. It's not an Apple product; I admire their design, of course, but as a colleague remarked the other day, "I refuse to be dictated to about what I can and cannot buy to run on the machine." My first netbooks ran Linux--the ideological antithesis to the Jobs model (despite being the infrastructure of the MacOS)--and they were brilliant. Up to a point.

But the iPad famously comes without a manual--an act of typically Jobsian chutzpah--and it appears that its emulators feel obliged to demonstrate their intuitiveness in an equally minimal way. Indeed this story suggests that a machine might be the ultimate stimulus for discovery learning. (Caveat; it does originate from here--not that that is necessarily an issue.)

I'm less interested in the arguments and the one-upmanship (Stephen Potter, of course) than in the experience of learning by experience forced upon one by the lack of guidance.

But I did not have the advantage of ignorance. I came to the tablet with preconceptions about how it should work. For years, my PC use has been based on folders and files; files are tied to default applications (with some exceptions), so if I want to edit something, I find it in a file manager and click on it--it finds its default application--and there it is. Very rarely do I go the application first. Even when I want to create something from scratch, I am usually already using the application, so I just find whatever passes for File -> New File nowadays.

The File Manager on Android is so clunky as to be almost useless. That's OK; in this model of user interaction, it is "back office" stuff. It's routine business the user should not have to bother his pretty little head about.

It's all about Apps. I've carefully referred to "applications" so far for earlier interfaces, where they have been [more clearly] servants. They have now been promoted to maitre d' or gatekeeper status. "There's an app for that!" is the new mantra.

They have become easier to use, at the expense of flexibility. I have spent hours--yes, hours*--trying to work out how to do things I no longer need to be able to do. Or at least, someone has decided I no longer need to do them...
  • the proper url of a webpage appears fleetingly, and there is no way to copy it...
  • because the keyboard shortcuts (Ctrl+C etc.) don't work (I've searched for an app. to reinstate them--there isn't one. Come on, someone!) [Shift + > or < does highlight, but Ctrl+ anything just leaves the page, it appears. Granted, formatting can be done by poking a finger at the toolbar, but even Windows of umpteen earlier editions ago allowed several routes to the same result...]
  • there is no right-click menu.
(Note: I started writing this on the tablet--it's an Asus Transformer, with dedicated keyboard--but had to revert to the netbook, in order to manage some basic formatting. Like italicising this.)

OK--that's the grumpy stuff. What's the point?
  • I'm groping about in the dark. This is ultimate problem-based learning. But I don't even know what I need to know. 
    • So I pass through various procedures without noticing them because I don't know that they are important stepping stones to doing something I want to do. It's only when I realise, "I've been here before!" that I can start to chain them together.
    • They worked. Not necessarily very well, but they did work. And I remember them. So that's what I'll do again... (Yes, behavioral** theory can account for that.) It's a dead end***.
    • So how will I back-track to find an even better way?
  • I've complained principally on the basis that things don't work as I am used to. But what I am used to says more about me than about the quality of the UX (user experience).
  • The tablet interface is designed to facilitate consumption. Music, movies, news... and  elaboration (social networking) and conversation (ditto) or even modification (wikis) but not origination. I'd wager that few blogs are by default written on tablets, and even fewer stand-alone sites.
  • And that is what happens with learning purely from the bottom up... I'm really intrigued about Negroponte's experiment (referred to above) because if his subjects did indeed hack into the tablets and change the rules of the game by activating the cameras, they went beyond that stage. Without teachers. 
Next week I start teaching a unit on "curriculum"... I think I'll use this as a starting point. And of course Allen Tough's work. Except these are not on the curriculum...

* I would say "literally, hours", had "literally" not become devalued in current usage into its opposite--"apparently" or "virtually". Hey-ho--my baggage is showing again...

** I know there is a missing "u" there, but site statistics are potent reinforcers! 

*** Getting to "just about works"--survival level--and then getting stuck there, is a real problem. For many years--16 at the last count--I have obsessionally edited, written and up-dated a course handbook. I have used at least 70% of Word's capabilities (and some of its incapabilities), from elementary styles to labour-saving cross-references and table formats to definitive tables of contents and glossaries. All automatic. All automatically up-dating with every revision. See page x was always the correct x. It appears no-one else in the institution knows about these brilliant features--if I let anyone else touch the file it will come back broken... This year I had to pass it on. Disaster.

And strangely enough that disaster is the product of colleagues' learning from experience. That tends to be self-limiting. It needs not so much a teacher, as someone who can hold out a vision of something even better, to transcend the immediate answer and push on to the next level. (I'm amazed that I can draw such meta-lessons from Word, but so it goes.)

12 November 2012

Items to Share: 11 November

Education Focus 
Other Business


* the single "l" is correct British spelling, before anyone else complains!

04 November 2012

Items to Share: 4 November

Education Focus
Other Business

01 November 2012

On a master's class

... or at least, lecture. The lecture is the simplest--perhaps the crudest--form of "teaching", but it nonetheless has nuances...

A week or so ago, I got an email from an old friend and former colleague. He has forsaken mainstream academe to become a freelance lecturer, working nowadays across the world, but it so happened that this week he was speaking just a few miles away. Would I like to attend as his guest, and catch up over lunch afterwards?
    (I just googled his name, and his site came up second out of almost 9m hits. He must be doing something right, and I withdraw any silly remarks I made to him earlier about his site! It only goes to show the triumph of substance over style. 
    And I recalled the first time we met, when he was doing an informal staff-development session in the college library on the use of the Overhead Projector, about thirty years ago. I learned more in half an hour about reveals, overlays, layout, colour... than I could have believed possible. The technology has moved on, and he has kept up with it, but not for its own sake.)
We met briefly before he went on, and he asked me whether I had brought my (paper) notebook, because he wanted me to act as a "critical friend" and give him some feedback. Somehow, I'd rather expected that. But it's the first point which makes this worth blogging about.

J. has been lecturing for 30+ years. In his present incarnation, as it were, he has a standard repertoire of about a dozen talks, so goodness knows how many times he has delivered each of them (well, I shouldn't be surprised if he also keeps track...) And yet, as we talked afterwards, it became clear that they never stand still--much of our discussion was about what to put in and what to leave out, and how to get even better. More of that later (mini-point: he was of course very good at flagging points within the talk for later comment, creating a little sense of expectation, on which he of course duly delivered).

And yet he saw an opportunity to get some honest (and, dare I say it, professional) feedback--and took it. It takes confidence to do that. (Contrast with this incident.)

The context, of course, was a little different from my usual observations:
  • It is debatable whether he was teaching. The lecture was to a decorative and fine arts society;  the audience were certainly interested, and they may well have picked up some fascinating information along the way, but they were not primarily there to learn. After all, the programme of events for the society was never designed as a curriculum.
  • So, in terms of evaluation, using dear old Kirkpatrick, only level one [ Reaction - what participants thought and felt about the training (satisfaction; "smile sheets") ] really matters. Or does it? And how should it be construed? In other words, is this simply entertainment?
However, there were many useful practical points: I am confining myself to what I could observe and/or discuss. So although we talked about the perennially fraught issue of what to include and what to leave out, I'll just touch on that--it's a content rather than process issue.

As PhD Comics fortuitously put it the other day;

(The small text reads: "Where n = the number of academics in the room who think they know how to fix it, and 1 = the person who finally calls the A/V technician")

J brings his own equipment, and had it set up well in advance. He knows it thoroughly, and its capability to fill the screen in a large hall. It was just ironic that the chairwoman of the society's opening remarks included a vote of thanks to the couple who were just stepping down from arranging the audio-visual facilities, having done it for many years.

Not only did he set it up, he also had a rolling presentation--of quotations about wine--which he set running as the audience arrived. Some knew each other so there was some lively chatter, but there were quite a few singletons, who probably appreciated something to look at while waiting. The screen went blank for the notices about forthcoming events, and the introductory remarks.

Having been introduced, he took up his position at the side of the stage, where a boom microphone had been set up. As we discussed later, he prefers a lavalier radio mic. because it does not restrict you to one spot, sometimes it is simpler to adapt to the normal provision.

He did not launch into the talk at once. As the lights were being dimmed he requested that those at the rear of the hall be left on, lest their dimming encourage people to nod off. I've no idea whether this really happens or not, but it did--more importantly in my view--send a message, "I know what I'm doing; I'm an old hand; you can relax." 

He asked if everyone could hear, stepped up to the mic. and away from it, and back again. It was clear the amplification was not necessary, so that gave him a little more flexibility, although he kept it on. Later he told me that when he started doing these talks, he arranged several sessions with a voice coach to ensure he would not wear his voice out. The coach invoked John Wesley as testimony to the capacity of the unaided voice to reach thousands of people, even in the open air.

And then he told a self-deprecating and entertaining anecdote about his late mother's opinion of his ability as a public speaker, while the audience settled down to listen...and so to the lecture itself, marked by the first "slide". 
    I've gone on about this at some length because it was all about that "sending a message" to the audience, and it is (I generalise wildly) largely neglected in academe. Of course, as the link above suggests, you can't not send a message, but often--as academic staff of an accredited institution--we rely on its prestige, and even its branding, to send an institutional message to students so we think we don't have to bother. After all, our audience members are not lively nudging-elderly people who could readily choose to do many other things this Tuesday morning, and who generally trust the Society to book interesting and entertaining speakers, but who also know that they occasionally get deadly bores, and who need to be re-assured on each occasion... our students are signed up to a package of which we are a part, and are largely stuck with us. So we don't have to pay attention to these messages. So we don't. And they default to "It's not worth the bother." or worse, "You're not worth the bother." No--attention to these messages is not beneath us.
(The lecture was about the Shakers of North America. The link is not very informative, but the lecture itself is!)

As befits his subject, J's presentation package was simple*, even plain, but beautifully crafted. As Thomas Merton apparently said (or--being a Trappist monk--wrote), "The peculiar grace of a Shaker chair is due to the fact that an angel might come by and sit on it." But he would probably have adopted the same style for any of his presentations.

The slides mostly had plain blue backgrounds, with white sans-serif text. Sometimes, where relevant, a monochrome picture, appropriately faded, stood in for the background--that's an effective way of tying subordinate points into a common heading. No flashy transitions or animations, just occasional highlighting. (I did suggest that some of the highlighting on a map of settlement locations was too subtle and did not really do its job--but it is when you get to that kind of nit-picking that you are aware of the underlying quality!)

We had a slightly more committed difference about the wordiness of some of the text. J argues that while the visuals complement the lecture, they should be able to be read sensibly as free-standing text. For his predominantly elderly audience, perhaps compensating between visual and aural channels**, he may well be right. I'm more inclined to minimalism; the fewer words the better, each one a keyword for an idea. Coherent prose comes way down the field. (Indeed, switch the presentation package to Prezi, for example, and that is almost forced on you...)

Nevertheless, J never turned to look at the screen behind him (after all, the content was on his laptop before him) and when he showed a quotation on screen, he did not read it out loud. But he did keep quiet to allow the audience to read it. Again, I'm sure that works well with his constituency, and indeed his aspirations (Kirkpatrick levels 1 and perhaps 2). But I wouldn't want (as J wouldn't) to recommend it context-free. 

Most of the time the visuals ran in parallel with the lecture itself--I think I remember some counter-point juxtapositions, but subtly done. 

J did not announce his objectives at the start of the session--as I noted with interest, because when we first met many years ago he was very keen on making objectives clear. But of course the context was different--no-one was going to ask, "Why do we have to learn this?" or, "Will this be in the exam?" Even so, he was careful to sign-post each section of the lecture. It was billed as "The Shakers: Their Beliefs, Architecture and Artefacts", and so it was made clear how we were progressing through the material. The only part which was not signposted was the final few minutes in which J talked about being in touch (by email--they never eschewed technology) with one of the last three surviving Shakers, and told of the agony of some recent events among them. That touch of revealing a personal acquaintance framed the preceding material quite differently--and could not have been announced in advance. (I suspect, although I have not checked this out, that J makes an ad hoc judgement call about whether to include that, depending of course on time, but perhaps also on the "feel" of the audience...)

Just one other point to mention here. The whole lecture came in at 67 minutes, which was about what J. had expected. I began to notice a little fidgetiness in the audience at around 25 minutes: just time for a humorous but relevant diversion about the millennial laws of Shaker propriety, which lightened the mood for the transition to the examination of architecture and artefacts. There had, of course (of course?), been lighter moments and a few jokes earlier, but this was a couple of minutes' breathing space. I suspect that with a younger audience, J. would have gone for shorter units. (General background on lectures here.)
    Arising from our discussion I'm beginning to think of a model of trade-offs in constructing primarily informative sessions--but I'll come back to that in another post.

* "'tis the gift to be simple..." is the Shaker hymn which is a theme in Copland's Appalachian Spring suite, later well-known as the tune to the popular carol "Lord of the Dance" by Sydney Carter. Naturally J and I discussed the issue of the inclusion of music in the lecture; it's a trade-off, of course, and he does include it in his study days when he has more time. But music takes time to listen to, and the challenge is always to manage content in the available time.

** ...but nothing above should be construed as any kind of endorsement of the egregious bull***t about "sensory learning styles"--that is quite a different matter.

29 October 2012

Items to Share: 29 October

 Education Focus

Other Business

24 October 2012

On using a title

Years ago, I was asked for my name for some National Health Service form, by a receptionist whose first language was not English. After she struggled with the spelling of my surname, I just passed over a credit card so she could copy it. It showed my title as "Dr", and I lost my mini-campaign to be treated as normal by the NHS. Not that I am discriminated against in my thankfully so far limited contact with them, it is just that using my academic title confuses the system, wastes time as I have to explain I'm not a medic., and has medical staff "explaining" things to me in technical language which means nothing... All--admittedly rather desultory--efforts to get it changed have so far had no effect, despite assurances.

But I do remember one wise doctor on a course who greeted me with, "Are you one of us, or a proper one?" In the UK, strangely enough, the medical "Dr" is a courtesy title, because the MD is rare; most medics are "MB, BS" (or "MB, ChB"--two unclassified bachelor's degrees, in any case) and of course to the disconcertion of foreigners taken ill in the UK, surgeons are "Mr" or "Miss"*. By "proper one" he meant an academic doctorate, although of course there was no telling what its private connotations were ...

It came up again last week, in an out-patients' waiting room--and everyone looked up as I responded to the call for "Dr Atherton". I'm probably being hyper-sensitive and it's all trivial but I mention it because...

I've just been watching a Newsnight piece on the postponement of the badger cull. The two interviewees were a representative of the National Farmers' Union, and Dr Brian May speaking for "Team Badger". The title appeared in his on-screen label, as well as in Paxman's introduction. There is no doubt as to his entitlement to the title: PhD, Imperial College London, 2007**. In astrophysics. How does that--or indeed the reason which probably actually got him onto the programme--his previous association with some popular musical group called "Queen"--relate to his credibility as a badger advocate? (I'm with him on the badgers, as a cause, so I feel let down by his apparent need to appeal to false -OK, irrelevant--credentials.)


*  this is entirely a matter of convention, and as far as I know, the standard and equivalence of UK medical qualifications is globally acknowledged.

**  and all credit to him for completing it thirty years after starting it--lucky he did not fall foul of the pernicious "Levinsky rules".

22 October 2012

Items to Share: 21 October

14 October 2012

On Savile and his heritage

I don't much want to comment on the sordid case of Jimmy Savile, although I too had heard the rumours, years ago. But I have commented on similar issues here and here and elsewhere, trying to understand some of the issues which the promised inquiries will pursue.

Nige of Nigeness has an excellent (if arguable) piece about the basic problem of recognising a "wrong 'un".

I'm more concerned at the moment about the potential consequences. The Soham murders, for example, triggered a disproportionate "safeguarding" apparatus which probably had no positive but many negative consequences (Ian Huntley could apparently have been stopped by the diligent application of measures already in place) while the impact of new regulations may well have discouraged many potential volunteers from getting involved in youth groups, uniformed organisations, and even helping out neighbours...

Whitaker and Lieberman (1964) discuss how, confronted with a "focal conflict" of deep concern to a group, the group can all too readily come to a "knee-jerk" response, which they call a restrictive solution. That effectively puts a plaster on the problem, but at later great cost to the group. In their context (which was psychotherapy) they argue that the critical task is to get beyond such a response to a facilitating solution. The same process seems to occur in the political world, too, particularly when the cry to "do something" is amplified by the tabloid press. It takes great presence of mind to maintain a sort of "negative capability" and not to act. That may be one reason why the immediate reaction of politicians nowadays seems to be to call for an inquiry. It takes time, allows some passions to cool, and distances the events--and it's certainly better than the usual restrictive solutions such as scape-goating or ill-considered legislation (Dangerous Dogs Act, anyone?)

There are some interesting pieces cropping up in today's papers, exploring the argument about whether there was really a "different culture" back in the '70s and '80s; about the assumption of untrustworthiness which pervades the perception of adults; and Minette Marin in the Sunday Times (unfortunately behind a paywall) saying the unsayable, that women and girls should toughen up and not make such a big deal out of the "casual sexism" end of the spectrum.

It's a sad coincidence that yesterday Stuart Bell MP died: he resigned from the opposition front bench in 1987 so as to be free to fight the case of the families caught up in the Cleveland child abuse saga, when 121 children were removed from their parents amid allegations of organised sexual abuse, stemming from the reports of two paediatric consultants, and based on fallacious interpretations of one test. And then there was the Orkney "satanic abuse" case of 1991...

Whatever the casual sexual harassment which pervaded the BBC and other work-places, the evidence of such panic reactions by the authorities testifies to sensitivity to allegations more than twenty years ago. Just not to allegations made directly by victims, against powerful people.

Whitaker, D. S. and Lieberman, M. A. (1964) Psychotherapy through the Group Process.  New York: Atherton Press.

13 October 2012

On learning and Bayesian statistics

I have--rather to my surprise--just finished reading Sharon Bertsch McGrayne's The theory that would not die (London; Yale U P, 2011). I only picked it up because there was a 3 for 2 offer in the bookshop and I needed a third book in order not to miss out. The sub-title says it all: "How Bayes' rule cracked the Enigma code, hunted down Russian submarines, and emerged triumphant from two centuries of controversy." I first came across Bayes' theorem through an Open University course on Professional Judgment* in the later '80s, in the days when their courses were supported by late-night programmes on TV. As usual with those programmes, particularly in maths, I thought I understood them perfectly at the time but the understanding just evaporated within hours... Even so, the basic idea has stuck with me for twenty-odd years, which is more than I can say for the MOOC...

So what is Bayes/Laplace's theorem/rule? My understanding is limited, but it is fundamentally a statistical approach to informing decision-making under conditions of uncertainty and incomplete information, by refining probabilities based on information about prior conditions as well as current measurements/ assessments. To me, the overall process seems very like the way in which betting odds are arrived at (where the money bet is a proxy for positive or negative information about the object of the wager); or as Keynes put it, "When the facts change, I change my opinion. What do you do, sir?" (epigraph to McGrayne).

Here is a more respectable, and of course more detailed, account.

I was already aware of some of the basic principles as applied to assessment (here)...But here is why I am mentioning it now--it came up as a current story. 

McGrayne doesn't make the links to learning very much (just on p.158 and pp.247/8.) But it's not a giant leap of insight to make the connection between learning through successively better approximations and Bayesian principles:
  • Piagetian principles of adaptation-- assimilation and accommodation--are consistent with a Bayesian framework.The progress of a Bayesian calculation--up-dating predictions or odds on the basis of greater knowledge, is basically similar to Piaget's view of children's learning through assimilation, where each new instance of a concept informs and adds to existing understanding (as discussed in the bold linked article above).
  • And Hattie's meta-analytic findings on the importance of feedback  also fit, particularly the passage I quote on feedback from learner to teacher. The teacher is continually making adjustments to her strategy based on refinement of her uncertain and imperfect knowledge--some Bayesian understanding of the process may well help with the formulation of her strategy, and although this may be difficult to achieve in real time in the classroom, one can see how it could possibly be incorporated into an assessment strategy, or indeed an online course.
Or is the characteristic sound of a Sunday morning the sound of me barking up the wrong tree? (As Penelope Gilliat said of Harold Hobson.) The probability of that could also be computed using Bayes'. Probably.


*  See the reader for the course: Dowie J and Elstein A (eds.) (1988) Professional Judgment; a reader in clinical decision making Cambridge; Cambridge U P. Incidentally I also wrote about it here. What I realise only now--since reading McGrayne-- is that the dissenting voice granted a couple of minutes at the end of each programme represented an almighty row which was going on in the world of statistics; the main programme was unashamedly Bayesian, while the comment presumably represented the mainstream view, which McGrayne typifies as "frequentist".

09 October 2012

On the MOOC -- 4: Forums and Assignments

This is the last in a series of posts about participation in the free Massive Online Open Course [MOOC] on the History of the World since 1300 CE, from Princeton U via Coursera. Jonathan Rees, at More or Less Bunk, is also blogging his take on it. I'm sure he has more readers than me, so if you feel like commenting, please do there first--no objection of course to getting his leftovers!

I promised I'd look at the forums on the MOOC. It's when you do this that you realise just what "Massive" means. I gather that about 70,000 people are signed up, all over the world. (Here's a map of the distribution, as entered by participants.) Not everyone is posting, of course, but the simple truth must be that the "community" is unmanageable--and was always going to be. As Adelman has noted:
"The Forums have become an active site for the exchange of ideas, information, and solutions to technical problems. They are now overwhelmed. This "common good" that we have created is getting crowded out and I fear many of you will stop turning to it as a resource. I am no longer able to keep up with your conversations and as a result you are loosing (sic.) my engagement in the course." (Adelman, Thu 20 Sep 2012 1:14:00 PM BST)  
Coursera has been working on the threading and the facilities in the forums, but a casual review shows that despite entreaties from the moderating Teaching Assistants and Adelman himself, there are many repeated questions sometimes coming up on inappropriate forums. I'm sure that this is not because people can't be bothered to post appropriately, but that they don't know how to find the topic they are interested in.

But dig into the more specific and targeted sub-forums, and the impression which emerges is of a very thoughtful and well-informed conversation (with of course the occasional troll). And I can't fail to be impressed by the commitment of Adelman and his T.A.s to respond to the conversation; having run on-line courses myself, with much smaller groups, I'm well aware of how time-consuming it is. Despite his fears in the quotation above, he seems far from disengaged.

One feature of the lecture discussions which I suspect is unusual, however, is the number of posts correcting the lecturer (and even the textbook), which point to the atypicality of the constituency!

Just impressionistically, I've been trying to detect other more general patterns. Clearly some of the exchanges  take the format of hub and spoke, particularly when Adelman is involved, and that is as one would expect with the instructor responding to comments and questions. Others are more like nets, typically with just a few participants. I haven't come across any very long "rallies", as it were. But the regrettably typical viciousness which seems to characterise on-line arguments is sometimes here, too... It is very difficult to generalise--the course is so big that anything might appear.

Does it matter? Probably not. By which I mean that the forums are probably essential, regardless of what proportion of participants use them. In a MOOC, you're never likely to have them embarrassingly empty, which can all too easily happen in an ordinary on-line course, and leads to the use of assessment credits for level of participation almost regardless of a quality of content, which is a tactic fraught with unintended consequences. It may well be what they stand for which matters, rather than what they are supposed to achieve. They represent an essential channel back to the course organisers and teachers. They acknowledge, however crudely, many participants' desire to be part of a community which can share experiences and queries. They can model effective participation and the level of background knowledge expected of participants (dauntingly high on the evidence of what I've read so far, but then I'm not an historian). And I speak from experience when I say that the obligation to engage in forums as a tutor is a brilliant way to get a feel for your student group. "A" feel, of course. Not necessarily the best or most representative one, though.

Assignments

The first assignment was due yesterday. There was a choice from three titles, one of which was:
Option A - What changed, and what survived, as a result of the plagues and disasters of the fourteenth-century in Afro-Eurasia?
Faced with such a title, I realised I hadn't a clue what to do with it. Partly that was because I recognised that I don't actually know very much about what happened--and that may well be because I have concentrated far too much on the online pedagogy of the course rather than its content. And partly it is because it is over thirty years since I have had to write like that at someone else's behest; I no longer know how to do it, other than that I would start by deconstructing the title... (And I gave up setting assignments of that kind in my own teaching about sixteen years ago.)

I also don't know at what level the assignment is set. Looking at the provided guidance on writing, I am struck by its emphasis on clear expression of an answer.
Don’t present a reader with competing arguments and hope they can make up their mind.  [...] The reader wants to know what you think.
and, in the assessment criteria:
3 points - A clear response to the question in the terms posed in the assignment. 
(My emphasis) Oh well, bang goes the idea of deconstructing the title!

I'm probably making this more complicated than it really is, but the title could be calling for a basically narrative and factual account of changes and continuities on the lower levels of Bloom's taxonomy in the cognitive domain, or it could be demanding synthesis and evaluation, although that is something of a tall order with a 750-word limit. Actually, I think the titles are well chosen, and, like the multiple choice quizzes at the end of the lecture segments, they do force one to think about the processes of change, which is a main theme of the course. My difficulty is with the effectiveness of this kind of exercise as a teaching device; the constraints of the online format are both limiting and shaping content and process of the course.

This becomes even clearer in the guidance on how to write the essay:
"Material for these essays should be only drawn from lectures, recommended readings from Worlds Together, Worlds Apart and comments from the Forums from this course [...] This is important because peers will assess each other based on the knowledge they share from this course."
I've never been keen on sticking to set reading, at the best of times. But the reason for requiring it here, to facilitate the peer assessment (good idea in itself, but...) really shows that the constraints of the medium have won, well thought through though the actual peer assessment seems to be.

Of course, this may well suggest that there are epistemological considerations in what content is suited to being taught online. History is, like other humanities subjects, contestable. It is studied not only for its own sake, but also in order to develop skills of critical thinking and argument--and so its teaching media need to support that process. In STEM subjects, on the other hand, the balance is much further in favour of sheer content--at least, Laurillard argues, until the final undergraduate year. The distinction is allied to that between divergent and convergent thinking (Hudson, 1967).

However, I have now fallen so far behind, and missed the deadline for the first essay, that I and the MOOC are parting company (the attrition rate is enormous, supposedly 80-90%). It's partly because the announced time-commitment (up to seven hours a week) is more than I can manage at the moment, but it is also because the experience has been distinctly unrewarding. After less than three weeks, it has become a chore; but that may well say more about me than about the MOOC itself.

Here are some recent related pieces from other people:



07 October 2012

On informal learning and being nerdy

I've just been watching Evan Davis' Built in Britain on BBC2, and getting increasingly irritated about things probably no-one else has noticed. But I've just realised that I've acquired my sensitivity to them without ever having been taught them--purely from problem-solving experience.

Sync.I linked to the actual programme on iPlayer, because you need to see some of the speech-to-camera shots to get this. The sound/vision synchronisation is out, probably by only one frame (in old money), and in real-time I can't tell in which direction--but it bugs me!

My first efforts at movie-making were around 1960, and for amateurs the addition of sound (even as a mood musical accompaniment) was a considerable technical challenge, involving ingenious devices such as the Synchrodek.) I had --indeed still have--a Eumig P8 phonomatic projector which used a rheostat system to allow a reel-to-reel tape recorder to control the projection speed and achieve (after a fiddly cueing set-up) synchronisation to within half a second over a 200ft. reel  (about 15 minutes). "Lip-sync"--matching speech-sound to lip movement (effectively better than 0.06s)--was merely an aspiration...

I became hyper-sensitive to sync. Nowadays it should not be an issue. Video records video and sound together, and editing packages treat them as locked together by default. I can synchronise and mix a multi-camera setup using domestic/recreational standard kit on the basis of a simple loud clap, or a flash. (OK, there are more complicated scenarios, I admit.)

But it really gets my goat when I watch a TV documentary (such as an expose of funeral directors which I also watched in the past couple of weeks) where there are simple, straightforward interviews, and somehow they have managed to get the sync. a frame or two out. A few years ago, there was an ad campaign for a men's hair dye called "Grecian 2000" which was probably dubbed, but I felt the lack of attention to synchronisation said something about the advertiser's lack of respect for its audience. (Good grief--it's still being sold--Google turned up 1,830,000 hits for it.)

I sometimes think I am the only person who notices. I put that down to my heightened sensitivity from dealing with the challenge for 45 years (off and on)--but apart from occasional conversations at Altrincham Cine Club  (now apparently Altrincham Video Society) in the early '70s, I've never been "taught" that perspective.

I've gone on longer than I planned. But---the programme this evening also suffered from a problem (to my ears) with sound perspective. The interviews and the to-camera pieces were, to my ears, too uniformly "dead". Beautifully clear--but no ambience. And don't get me started on aspect ratios (particularly with still inserts--there were no problems before Ken Morse retired)...

OK--rant over! It's not the content which matters, so much as the way I (and I am in no way special) learned it. Alan Tough's thinking about adults' learning projects (1971) is rarely referred to nowadays, but fits exactly my acquisition of my (admittedly half-baked) knowledge and skills about movie- and video-making. And although I had previously thought of this as a matter of hints and tips, and the product of practice--important though that is--I'm coming to realise that without ever setting out to do so, that learning has changed my perception and what I pay attention to. It is not a matter of choice--I am unable to ignore these trivial but--to me--profoundly irritating faults. And of course it is a distraction from the content.

But--would I rather be able to ignore this stuff? Hmmm...

Items to Share: 7 October

Education Focus

It's largely about MOOCs etc. this week--otherwise rather fallow:
Two pieces on the experience of participating as a learner on-line:
Other Business 

Half of the Facts You Know Are Probably Wrong - Reason.com

The Oxford English Dictionary needs you! Announcing the new OED Appeals

Joking Matters (Experimental Theology)

01 October 2012

On fifty years on

I just realised that later this month it will be half a century since the Cuban missile crisis.

I was in my final year at school. I was preparing for scholarship examinations for Oxbridge (I didn't succeed). I remember very clearly sitting on the steps of the podium in the school assembly hall, talking to a couple of friends. One of them asked, "How long do you think we've got?" I replied, on the basis of no real knowledge, of course, but aspiring to be a 17-year-old sage,"About three weeks". I believed it, and I was far from alone.

The Cold War was real and in those three weeks it was on a nuclear hair trigger. The prospect was of being blown off the face of the earth, with just four minutes' warning. The apocalypse really was on the horizon.

I also remember watching the news coverage of the denouement, and apparently being alone in thinking that Khruschev had "won".

And I failed to rise to the occasion (in several senses)---my adolescent existentialism withered when confronted by my equally adolescent evangelicalism (of course my then girl-friend's catholicism didn't help...)

The apocalypse didn't happen, and my wife is now on holiday in Cuba.

So it goes.

30 September 2012

Items to Share: 30 September

29 September 2012

On a busman's holiday

I have delayed posting this for some time, because I don't want to point the finger at anyone, publicly. I debated whether or not to post it at all. As it stands it is merely opinionated commentary--a legitimate form of expression, but not one which can claim the interest of a reader. I am actually posting it to supplement my posting on a MOOC--where I have paraphrased and condensed some points, including events which happened after I wrote this version. Sorry--you didn't need to know that, did you?


I am on holiday; for once on a tour organised around a topic--the history of classical Greece. I won't go into more specifics for reasons which will become apparent.

On the whole it has been excellent. The site visits have been informative, and there is no substitute for going to the real locations. The organisation and the food have been almost exemplary. And the company of the other members of the party has been excellent.

Unfortunately the same cannot be said for the lecturer.

As I sat in the first lecture on the first morning, I berated myself for not having brought my trusty observation sheets with me. Had he been a student, I should not have been able to sign off on any item on my list. That is not in itself a problem (see here, for example), and indeed some of the things we are obliged to check would have been clearly inappropriate, such as "embedding functional skills". (It doesn't matter what that means.)

I note, re-reading the earlier post, that I commented then:
It was not about the tutor's technique... It was about "strategy", or really values.
And therein lies the difference. The lecturer started the session with the air of the whole thing being slightly beneath him--to think that it has come to this, to be hired by a package-tour company to lecture to a group of elderly people... There was evidence to support this, because he had clearly done very little preparation, despite--or perhaps because of--his apparent familiarity with the material. I say "apparent" because other members of the group who are more familiar with it than me have been more disparaging about his scholarship.

He did ask us who was in Greece for the first time. Otherwise he asked us no more questions. He said nothing about himself and his background, other than that this was the sixth time he had done this particular tour, and let slip references later to up to fifty years of visiting the eastern Mediterranean. He did decide not to undertake introductions, which was a fair call, probably; he obviously defined his role as an "expert" rather than a full-scale teacher. But it would have been interesting if he had shown just a small proportion of the interest in us which he clearly expected we would have in him. A show of hands on who were the old hands? On who spoke or read Greek? Considered themselves well-informed about the architecture, the history, the culture...? Five minutes would have sufficed.

He said he would get to know our names as time went on, and he did do that. (I could have said that he achieved this principally by counting us onto the bus, but that would be even snarkier than this account is already. Credit where credit is due!) But he missed out on so much information which could have been useful to a more confident and less arrogant person; there were people in the group with expertise from their professional backgrounds and travels who could have contributed fascinating material, which in practice was only shared with two or three others chatting over dinner.

Although I was not expecting and would not have wanted reams of paperwork, it would have been useful to have a list of titles of the lectures. However, it became apparent that in his view this was one long lecture which he would deliver in a series of chunks. Throughout the rest of the week, there was only the most token obeisance in the direction of a clear start and finish (except a sort of peroration in one talk given on the coach, but that was more about drama than structure).

He did supply a reading list; it was badly formatted and the bibliographical format was not standard. Who cares? Well, publishers and dates are quite useful. Perhaps more important, it had been corrected in long-hand and then copied without being re-typed. This clearly sends a message to the "class" that they are not worth serving properly; it amounts to an expression of contempt.

No visual aids. Well, he did have a carrier bag with some copies of picures from books, laminated, so he could hand them round. Given that all but the first of the talks were given on the coach, there might be something to be said for that, but the logistics of distribution and the number of copies, and their labelling, needs some thought. There was a single copy of each page to be shared sequentially among two dozen people, even if most of them were couples and would look at the page together.

He had prepared two pages on a flip-chart, though, showing a time-line. They were sloppily printed in marker pen, but they were big enough to read and he had covered them up with a blank sheet so they were not distracting until deliberately revealed.

So no presentation package, probably because of the setting of the talks, but also because I don't think he has the necessary skills to develop a slide-show. That might also account for the hand-written corrections on the book-list. Even so, the most important thing he could have achieved through a presentation, he could also have achieved for himself with a handful of 6x4 cards--a structure. But the consequence was that, together with a voice which sometimes descends into a mumble, and some irritating mannerisms, it was almost impossible to follow what he was talking about.

It is an egregious delusion that just because you know (or think you know) a lot about something, you can lecture about it. Even in an open-ended situation where the intention is to inform and perhaps entertain, where the group will not be assessed and they are free to take it or leave it at their discretion, where the language of "objectives" and "outcomes" is inappropriate--even then you need a structure. And when you are inclined to ramble on in a kind of drunkard's walk from one topic to another with little evidence of a theme, you definitely need a structure. I know because that is what I do, left to my own devices.

The simplest device of notes or a set of cards, each with only a key word or phrase on them demands some degree of planning. Cards are of course more flexible because you can re-order them, or take one out when you have answered a point in response to a question, earlier than planned...

So all this is very very basic. For most of the week I have been juggling hypotheses about what is going on. Is he merely incompetent? He is incompetent, but not merely so. His failings can be superficially rectified with advice, should he be inclined to accept it. But there is I think more to it than that; there's a fundamental self-absorption which suggests he hasn't got a clue about how other people respond to him and his work, and he doesn't care. (Apparently, nor does the company--I am led to believe that there has been critical feedback about him for years, but he is still employed.)

Beginning teachers are often very concerned about their own "performance" to the extent of not being able to pay attention to the students' performance; that's a natural stage which is soon overcome in most cases, and in any case their self-consciousness often makes them eager to seek and respond to feedback. For whatever reason, this guy is stuck...

But... all this does not extend to other aspects of his public role. Mingling with guests at social functions he is a little stiff and has to try hard to be charming. I empathise. I'm pretty inept at that, too: but then I don't set myself up to do a job which requires such skills. Tonight was a supposedly special dinner--characterised only by having to sit at long tables rather than self-selected small ones, and he was in "host" role. He was clearly not comfortable but he pulled it off quite well--better than I could have done, certainly. But his performance in making a simple vote of thanks for the organiser was largely about him and his next destination.

Something happens to this guy when he assumes the mantle of teacher or authority figure. What, why, how?

Thank goodness for local guides!

[There's no definitive answer, of course. But if you are tackling "the role of the teacher" on a post-school and adult education teacher training course, I think you might find this case-study stimulating.]

On the MOOC -- 3

This is one of a series of posts about participation in the free Massive Online Open Course [MOOC] on the History of the World since 1300 CE, from Princeton U via Coursera. Jonathan Rees, at More or Less Bunk, is also blogging his take on it. I'm sure he has more readers than me, so if you feel like commenting, please do there first--no objection of course to getting his leftovers!

I was going to talk about the forums this time, but an announcement tells us that they are still working on the "Global Dialogue", so I'll hold off that for a while.

This is getting harder work (and it is still only week 2). I started the first lecture of the week on Monday. I haven't been unusually busy this week but I didn't get to its third segment until Friday afternoon and its fourth on Saturday. It's not that the content is getting any more difficult, by any means. It's just that the prospect of another quarter-hour or so of Adelman's halting nasal sing-song drone is not exactly inviting. Nothing personal and not his fault, but putting him up as the presenter says interesting things about the course design.

We know that video lectures can be compelling stuff. TED talks are hugely popular, and perhaps the producers of this course have learned something from them in breaking the lectures up into chunks of under twenty minutes. But TED talks are rigorously rehearsed, with a professional director advising on expression, and pace, and visual aids... (Not to mention that presenters are presumably selected in part on the basis of their screen presence and articulacy, in the first place.)

Adelman has, in a sense, "rehearsed", in that he has delivered these lectures live, before. And to his credit he is not reading them from an autocue. But it doesn't appear that he has rehearsed specifically for this recording. And he is not in a lecture theatre with real live students around, just in a studio with his two assistants and a few technicians--and if he is in a studio, why is the assistants' sound hook-up so bad?  He may not realise it, but he is missing a whole world of feedback from his non-existent audience. Their posture, their expressions, their dozing disengagement, occasional blankness as they miss a point; the opportunity to focus on a particular student or two as barometers of engagement and interest--all that is missing, and a half-decent lecturer makes more use of that than she recognises. It is as if he were singing in an acoustically dead room, rather than in the shower... (I am giving him the benefit of the doubt here--his singing in the shower may well be as irredeemably dire as mine!)

There are two ways of re-couping that situation. Rehearsal and re-takes. They are basically the same thing--repeat performances until you get it right, either before the main performance or during it. When the main performance is a public event, retakes are difficult and so rehearsal is ever more important. But these are not public performances, and I have occasionally detected some continuity glitches in the lectures which suggest that there have been some retakes, but very few. (Lecture 3, segment 4 about 19:15m in)

This is not entirely straightforward. The faultless presentation becomes a "Spiel"--a slick salesman's patter which does not convince, and certainly lacks any sense of the thought and research and scholarship and debate which has gone into the considered and measured judgements of the lecture content. 
But... Academic presentation is not about the presenter, but the content. Sometimes the issue is about the academic superstar's "Look at ME!" obsession (I shall refrain from mentioning names...) This time it is certainly not that, but the way in which personal characteristics just obtrude into the presentation, unintentionally. Whichever way, we return to George Herbert, whom I quoted in the first post in this series--
A man that looks on glass,
On it may stay his eye,
Or, if he pleaseth, through it pass,
And then the heav'n espy.
The challenge for the presenter is to get out of the way so the student can engage as directly as possible with the content/

And that requires conscious and deliberate effort. And if it doesn't happen, it sends a message to the student. You ain't worth it. There are 70k students out there, we are told. The lecturing style of this course so far might pass muster for a couple of hundred students, live in a lecture theatre--where as I have argued, the situation is much richer than on-line. But for 70k students trying to engage with the material without the supporting ambience of a university, and a library... they need so much more. 

I am reminded of a post I wrote but never published from almost exactly a year ago, about an archaeology-themed holiday in Greece with a tour guide who was dire.
He rambled almost incoherently at inordinate length over the PA system on some very long coach rides (600 km on one day), his reading list was hand-written on top of typescript (and the citation was awful), his maps were badly photocopied from some school textbook, it appears... On the final evening, I took him aside and gave him some professional feedback (rising to the challenge of hints from some of the other participants*, and admittedly assisted by moderate wine consumption). I pointed out--much more gently than I would with my own students--that such an unprepared approach communicated effectively to the guests that this kind of job was really rather beneath him, and they weren't worth any greater effort.

It was when he admitted that the maps were not very good, but that he had not had time to get better ones, that I probably overstepped the mark. I reminded him that he had told us this was the sixth time he had done this tour. He rose, said he did not have to listen to any more of this, and walked off.
It's probably just me, with my background and professional interest, but I can't look beyond the presentation and "espy" the academic content. And I can't imagine--well, I can, actually--what it must be like to be a student on this course, where you are being assessed, and it is important that you complete it, and you find yourself approaching each lecture with foreboding... It's not that the experience is so bad, it's that it does not facilitate engagement with the subject-matter, it hinders it. Better not to have it at all.

The other point worthy of comment is the use--or lack of use--made of the assistants, who are brought in very very occasionally to answer questions about the images, with one or two word answers, as a cue for the lecturer to build on. Socratic questioning, it ain't. And the acoustics or sound-rigging make those answers barely audible. This is tokenism.

Sorry to have become so relentlessly negative.

* I do keep falling for this.

PS  Do take in  this post and comments from Historiann.

A useful selection of articles on MOOCs from the Chronicle of Higher Education