Posts Tagged ‘managing’
My Experiences Thus Far with MOOCs
I’m an information forager, someone who wanders among topics picking up bits and pieces of knowledge as I go. If you offer me a good way to gain information and experience, you’ll get my attention.
I’ve sort of fallen in love with the Massive Open Online Course (MOOC) offerings from Coursera. I’ve successfully completed seven of the courses, ranging from an easy introductory course on geospatial information and mapping to a challenging course on machine learning. I bit off substantially more than I could chew when I signed up for a natural language processing class, but at least I had the good sense to pack it in when I saw I didn’t have the skills to complete the assignments.
One of my just-completed courses was Model Thinking, by Professor Scott Page from the University of Michigan and the Santa Fe Institute. This session was the second time the course was offered and, as it turned out, it was an exact repeat of the first session. Dr. Page and his assistants didn’t update any of the lectures (or even edit out coughs and other flubs from original recording), participate in the class’s discussion forums, tweet from the advertised Twitter account, or update the class’s Facebook page or blog. As befits a summer offering, the class ran entirely on autopilot.
We’re very early in the days of MOOC development, so there are a lot of experiments going on as professors and institutions determine how to present MOOCs and incorporate them into university curricula. One of the big problems MOOC providers have to face is the immense number of individuals who sign up for the class but never watch a single movie. In some cases, only a third of students who sign up for a MOOC watch even one lecture, and most courses have pass rates of less than 10% (7% is typical). Part of the problem is that there’s no real penalty for not finishing the course — you know you didn’t do the work, but there’s no social stigma attached to it. And besides, you can always download the movies and watch them at your leisure.
Dr. Page seemed to address this dropout issue by making the Model Thinking class very easy to pass. Grades were calculated by adding 50% of your quiz scores (dropping the lowest two) and 50% of your exam scores, with everyone who scored a total of 75% or higher receiving a certificate. But here’s the kicker: you got three attempts at each quiz and the system displayed the correct answers after you took the quiz for the first time. All students had to do was write down the answers and re-take the quiz to get a perfect score.
Like the quizzes, you got three shots at the mid-term and final, but the system didn’t display the correct answers. It did tell you where to find the information required to answer the question, but you had to figure out the answer for yourself. Even so, if you received a perfect score on the quizzes (hard not to), you only had to get half the exam questions right to pass. The only reason a mildly attentive student couldn’t pass the course would be a lack of time to take the quizzes and exams. You barely needed to watch the lecture movies.
Is this strategy a good way to improve MOOC completion rates? Yes, if that’s your only goal. I would be very interested to learn how this Model Thinking class session’s completion and engagement rates compare to those of other MOOCs, but I wonder how much material students who took the easy route retained. If there’s no significant marginal cost per technically passing but unengaged student, perhaps it’s OK if they take little or no knowledge from the course. At the very least, it’s a worthwhile experiment.
Improv Should NOT Be a Surprise
My friend Rick Maue, a talented performer and innovator in the branch of stage magic called mentalism, identifies three types of performances:
- Theater, which is a show people come to see in a formal setting
- Entertainment at events such as banquets, where the performance is part of the overall evening’s activities
- Filler, where the audience has absolutely no idea you will be there or that there will be any kind of show
I’d like to add a fourth type: Hell, which is a Virgin Atlantic flight with musicians and improv comedians roaming the aisles. Don’t believe me? Here’s part of a Fast Company article describing the scheme:
Virgin Atlantic Little Red, a U.K. domestic rebranding of Virgin Atlantic, will feature “in-flight gigs” on selected flights that include live music and improv comedians. Entertainment will take place on flights headed to Edinburgh and Manchester, and performers will be selected from the talent pool at the Edinburgh Fringe Festival.
But here’s the kicker: While the acts will be mentioned on Virgin Atlantic’s Facebook and Twitter pages, the flights they will be performing on will be a surprise. We’re guessing that business travelers, improv comedy, and a confined environment will be a volatile mixture, but that’s just us.
I do improv and stage magic and think I’m pretty entertaining, but I only take a few strolling mentalism gigs at company parties a year. I want to be sure I’ll be a good fit and often look for reasons to break off from a group early rather than overstay my welcome. I don’t want to be what sports commentator Joe Buck refers to as “the guy at parties who insists on doing card tricks no one wants to see”. I don’t mind stopping to watch a street performer for a few minutes. In fact, I tipped a terrific human statue when my wife and I were in Tallinn, Estonia, in July.
I’d rather donate three pints of blood in an hour than be on a flight with a live musician or improvisers. I’m one of you, guys, and I don’t begrudge you the money, but I will not interact with you.
I think someone in Virgin corporate learned the wrong lesson from the funny PA announcements some Southwest flight attendants make. Those presentations work because they’re fast, they’re hilarious, and they’re over.
Gamification: Devising Activity Cycles
My previous set of posts described elements of gamification (such as meaningful choices and conflict) and how to incorporate them into business and improv. Kevin Werbach and his coauthor Dan Hunter also identify six steps to gamification (For the Win, p. 86), which I think provide an excellent framework for business and theatrical endeavors. I just examined how you can describe your players using personas. In this post, I’ll talk about devising activity cycles.
As a quick review, the authors’ six D’s are:
- Define business objectives
- Delineate target behaviors
- Describe your players
- Devise activity cycles
- Don’t forget the fun!
- Deploy the appropriate tools
In a gamification context, activity cycles are the actions you want your players (teammates, customers, co-workers, etc.) to take. You can think of activity cycles as patterns of interaction with your site that represent a task or series of tasks taken to completion. As an example, consider how you check in at sites on FourSquare. Your activity cycle involves pulling up the app on your phone, having it sense your location, and giving it permission to check you in at that location. You can also earn badges, receive special offers, and be named Mayor of a location by checking in there more than everyone else.
Some sites have longer activity cycles. TeamSnap offers a website where you can track your sports teams’ rosters, schedule practices, track attendance, and record game results. You can even assign team members (or their parents) tasks such as bringing snacks to the game. TeamSnap’s also useful for improv groups who want to track practices, send messages, and schedule shows. (Full disclosure: I’m good friends with several TeamSnap executives and my main improv group, ComedySportz Portland, uses their site to track our activities.)
Businesses have activity cycles in all aspects of their operations. Client generation, sales tracking, and customer service all lend themselves to gamification. In some sense, businesses that track sales performance and use other measures to rank their employees already use elements of gamification, but many times those scenarios take on the tenor of the “motivational speech” Alec Baldwin’s character Blake delivers at the start of a monthly sales contest in the film version of Glengarry Glen Ross. In that contest, first place is a Cadillac El Dorado, second place is a set of steak knives, and third place is “You’re fired.”
Some bosses thrive on intimidation and insult, but that approach goes against the spirit of gamification. If you want to gamify successfully, you can’t forget the fun.
Gamification: The Six D’s
I’m most of the way through the Gamification course I’m taking on Coursera. I’ve learned a lot and hope to apply some of the techniques in my own work.
Much of the course’s material appears in For the Win, written by the Coursera professor Kevin Werbach and his coauthor Dan Hunter (both of whom are faculty members at the University of Pennsylvania’s Wharton School). My previous four posts discussed four elements of gamification (such as meaningful choices and conflict) and how to incorporate them into business and improv. The authors also identify six steps to gamification (For the Win, p. 86), which I think provide an excellent framework for business and theatrical endeavors.
The authors’ six D’s are:
- Define business objectives
- Delineate target behaviors
- Describe your players
- Devise activity cycles
- Don’t forget the fun!
- Deploy the appropriate tools
My next six posts will address these D’s one at a time, starting with how to define your objectives.
Improv and Gamification: Structure
I’m taking the free Coursera course on Gamification, taught by Kevin Werbach from the Wharton School of Management. The book For the Win, which Werbach coauthored with Dan Hunter, mentions four basic elements of gamification:
- Motivation
- Meaningful choices
- Structure
- Potential conflicts
Werbach and Hunter use the structure element to ask: “Can the desired behaviors be modeled through a set of algorithms?” For San Francisco firm Keas, structure comes in the form of challenges participants undergo during the workday to improve their wellness, Microsoft gamified identifying translation errors in Windows 7 dialog boxes, and airlines provide better service as you accumulate more miles.
Measuring results in improv is a less exact process, but ComedySportz gets around the problem by having the audience vote to see which team gets the points for a pair of competing games. The idea that the show is a competition, where the players try to win but don’t care if they lose, provides a hook that makes the experience more than simple entertainment.
For businesses, organizational performance is often based on revenue, market share, and similar targets identified by the executive team. Individual employee performance is measured versus criteria set for each employee, but how do you provide an overall structure for a project, department, or division? Chip manufacturer Intel uses a Plan of Record, or POR, to identify goals and, in some cases, methodologies at all levels of the enterprise. That which adhereth to the POR is blessed; that which doth not is condemned.
Developing a structure to measure performance can be difficult, especially when applied to creative workers. Don’t feel compelled to gamify a process — the best gamification structure might be none at all.
Improspectives 
You must be logged in to post a comment.