THE WEEKLY BLAB
Volume 7, Issue 38 – July 15, 2013
And the living is not too easy. Today’s my birthday and I’m now an ancient 58 years old, having caught up with Jill who got there two months ago. What’s more, it’s too darn hot and someone needs to remind ex-Governor Perdue to pray for the rain to let up. I was gonna be clever and quote Mark Twain’s line “Everyone talks about the weather, but nobody does anything about it”, but snopes.com informs me that Twain never said that. He did, however, say: “If you don’t like the weather in New England, just wait a few minutes.” So there.
Early Warning and Intelligent Agents
A topic that arose at the last Deans Council meeting has attracted some attention (and perhaps concern), both in Joel Fowler’s unofficial meeting minutes and in an email from Meg Dillon. I thought I’d take the opportunity to give a little context to the topic.
As all of you should be aware, for the past several years, we’ve been carrying out an early warning system, wherein faculty report about student engagement at the end of the third week of classes. Originally, faculty reported students as being “engaged” or “not engaged”, though a few years in we added a third response of “not present”, in order to satisfy federal reporting requirements related to awarding of financial aid.
Students who are identified as being “not engaged” are sent letters and emails, suggesting that they speak to their teachers, consult their advisors, seek help in the ATTIC, and other such general advice. Some faculty have used the early warning system proactively, telling students on the first day of class how important it is to make a good start and that we’ll be evaluating their engagement at the end of the third week. They have reported that good things have resulted—their students get engaged earlier, leading to good academic results. The purpose of the early warning system is, obviously, to identify students early on who are getting into academic trouble, and to help them. We were one of the first in the USG to have an early warning system, but quite a few places have one now as part of Complete College Georgia.
The discussion at the Deans Council was to look at the early warning system and discuss a few issues. First, while the current early warning system tells us WHO is in potential trouble, it doesn’t tell us WHY. Thus, every student who is identified as being unengaged gets the same general response. A form used at California State University at Northridge was circulated as a possible model of how we might make the process a little more granular. On the form, the faculty members check off one or more boxes, such as “attendance”, “tardiness”, “lack of homework”, “low grades”, etc. So, IF we were to implement such a more granular process, faculty would check off the relevant box(es) that corresponded to WHY they marked the student as “not engaged”, obviously doing this only for students who they were marking “not engaged”. That’s it.
The outcome would be that we could give students more specific advice as to what was going wrong and what they should do about it. I asked if this was a way we might want to get more granular, or if there was some other way, or if we might want to do this just in certain courses (such as freshman gateway courses), or if we want to leave things alone.
Also, we discussed if we could use technology so that faculty wouldn’t have to do the early warning system report by hand—i.e., to make the job easier. Our new learning management system, D2L, has intelligent agents built into it. An intelligent agent is a logical IF/THEN statement. An example would be something like “IF a student misses three assignment in a row, THEN send email message #3”. Once the faculty member sets the criterion (missing three assignments in a row) and writes message #3 (‘Catch up with your homework’), the intelligent agent does the rest—whenever and for whichever student the statement is true, the email goes out automatically. What was raised in the discussion was, for those faculty using D2L, we might be able to pre-write some intelligent agents that would correspond to the early warning system. Faculty wanting to use them could modify them for their own purposes (one faculty member might want to make the threshold for “not engaged” be a grade of below 75 on the first quiz, whereas another might set the threshold at 65, and another might not use quizzes at all and use something else). Once the intelligent agent is written, it does all the work and can be used term after term.
The discussion then went into the weeds a bit, with one person saying: “Most of our classes are face-to-face, so wouldn’t faculty have to enter attendance data into D2L if they wanted to use an intelligent agent to do the early warning grades?” The answer is obviously “yes”—D2L has no idea who has shown up for your live class. If you want to use attendance as a criterion for engagement, you’ll have to enter the attendance into D2L in exactly the same way as if you’re going to use grades as a criterion—you have to enter the grades into D2L. Is this more work? I don’t think so—if you are currently using attendance as a criterion, presumably you’re taking the attendance and writing it down somewhere. Ditto with grades or whatever other criterion you’re using. Instead of writing them in a physical gradebook, you’d write them in the gradebook in D2L. Seems the same to me.
We then started arguing about a technical matter: whether the intelligent agents in D2L (as they are currently set up) can tell you how much time an online student has spent in D2L for a particular course, with some thinking the intelligent agents can’t do it, and some thinking they can. (Fact is, they can.)
In any event, no one is being forced to use D2L for early warning. It’s an idea I think that we should explore, since it might make some faculty’s lives easier. If entering attendance or grades into D2L is too big a deal, they can continue to use the current system.
There meeting also featured a disagreement between me and one of the deans. The dean argued whether we should change what we’re currently doing regarding the early warning system if we don’t know if the current system is doing what it should—we should gather data first to see if it is indeed, for example, increasing graduation rates (if that was indeed its purpose). I argued that we know what the early warning system is supposed to do (identify students who may be in trouble), and that is be impossible to measure if the early warning system leads to higher graduation rates. Our graduation rates are indeed rising, but you can’t attribute that to the early warning system or any other single factor—graduation rates are functions of multiple factors. You can hear the disagreement (and the full meeting) on the podcast if you’re interested, by clicking here.
So, does this whole deal rise to the statement that was reported, namely: “a more detailed system would greatly increase the workload of faculty teaching face-to-face classes”?
IF we decided to do everything that was discussed (and bear in mind that no such decision was made), these would be the results:
1) The “more granularity” part means that you’d have to check off a box or two telling WHY you marked any given student as “not engaged”, perhaps only in selected courses, and
2) We’d be testing to see if intelligent agents in D2L could be set up to do early warning grades automatically, and you’d decide if you wanted to use them or fill in the early warning grades as you do now.
You can decide if that’s a big deal and if it would “greatly increase your workload” or not. Feel free to post any comments you might have—I’d be interested in seeing them.
Finally, as to the issue of involving faculty as to whether we should change things—the consensus (such as it was) was that it is premature at this point. We need to see how easily the intelligent agents can be set up in D2L (perhaps laying out a sample course shell to illustrate how it might work), and to propose how we might make the early warning system more granular (if we decide to go there). When and if that’s done, we’ll bring it to the faculty for input and comments before implementing anything.
Report From RACAA
As promised last time, here’s a report of some of the highlights from the recent RACAA meeting, held July 7-9.
Sunday night, the after-dinner speaker was Amanda Seals, Executive Director of Government Relations for the USG. She mentioned that the legislature is very politically concerned, due to potential primary challenges from within their own party. She noted that all bills that weren’t acted on last time are still active, including bill to allow the carrying of guns on campuses. [A comment from the Student Affairs side on Tuesday was “The nuts are getting nuttier and now we’re going to arm them.”] Another bill that is of concern is to allow the technical colleges to become community colleges. The USG is following both bills closely, and working with legislators to represent our views.
Monday morning, Senior Vice Chancellor Houston Davis spoke about Complete College Georgia. He noted that a 3% increase each year in undergraduate degrees would take us from 41,000 to 62,000 degrees by 2025, resulting in a total of 147,000 additional degrees. The new funding formula will have at least one variable related to number of graduates (based on that the number of graduates should increase by 3% per year on each campus), and that other factors may include improvements in graduation rates, numbers of students who reach 30/60/90 credit milestones, and improvements in graduation rates for students from economically disadvantaged backgrounds and those who needed remediation. He noted that CCG outcomes should emphasize K-12 partnerships; college access, affordability and value; new, flexible, and affordable pathways to degree completion; support for at-risk populations; and maintaining and improving the quality of teaching and learning.
He also talked quite a bit about MOOCs, noting that they are another tool in the teaching “tool chest”, and we need to be aware of the current models. Private developers want to disrupt the current educational model in favor of open source and open learning objects. Their goal is to drive down cost of education and to make a profit doing it.
MOOCs are being looked at in terms of credits, course sequences, supplementing instruction, accelerating the path to a degree, and their ability to deliver full degrees and certificates. MOOC conversations are changing on a daily basis, and the pace of change is accelerating. He asked: “Can we use MOOCs in a cost effective manner to improve access and accelerate degree completion while maintaining quality? They are a
disruptive innovation that challenges the fiscal model and core components of our enterprise. They create a tension between student-centered and institution-centered worldviews.”
The initial USG thoughts about MOOCs are that we need to look at them from the following vantage points:
- Can they be used as an extension of the USG’s commitment to affordability, quality, access, and completion?
- We will need increased policy flexibility and options for campuses to experiment and be innovative.
- We can lead in the creation of complementary pathways to credit and credentials.
- We need to explore the implications of our quality review processes and general academic program approval/review mechanisms with respect to MOOCs.
- We will partner with other systems and states in developing some models.
- There is an opportunity for the USG to be a leader in using MOOC content for high quality, more affordable, course and program opportunities.
Curt Carver then spoke about what was necessary to enable student success through MOOCs. Lots of areas need to be present for a MOOC to be successful:
- Affordable resources, such as Galileo and the Georgia Knowledge Repository.
- Student support, including use of intelligent agents to track student progress.
- Networks—Peachnet gives us a good foundation
- Assessment: We will need to identify testing sites. Faculty governance and training will be issues. We need to research how to build appropriate online assessment tools.
- Analytics—There is no single standard currently in the USG. Daytona State University has a good system we should look at
- Mobile devices—a D2L mobile app is being deployed. We need to rethink classroom design as mobile devices become more dominant.
- ID Management—we need to partner with ATT and Verizon for verification and location tracking of online students.
- Financial—the goal is to produce a $150/3 credit course. The financial model to support such a goal is unclear.
The overall goal to reduce total cost of enrollment while increasing graduation rates and changing formula funding will be transformational to higher education.
Senior Vice Chancellor Davis summarized the next steps that will be taking place regarding MOOCs:
- Supporting Georgia Tech’s work in this space (i.e., their MS in Computer Science delivered by MOOC).
- Supporting the Next Generation Learning Challenge program redesign at Columbus State, and scaling the project.
- Building on the Coursera-USG relationship. We’re on the verge of a D2L MOOC partnership. Developing ties with Udacity, EdX, and others.
- A systemwide consortium will be developed to work on this. Georgia State will coordinate. Institutions may play one or more roles (lead institution, implementation partner, enrollment institution, expert assistance partner).
- UGA and four other schools are developing a pre-calculus course MOOC.
- President Rossbacher will chair the USG’s New Learning Models Advisory Committee. Its charge will be to review and advise on key eLearning trends, critical uncertainties, and strategic uncertainties.
More RACAA stuff next BLAB!
Last Week’s Trivia Challenge
Last time’s trivia challenge focuses on the word “blue” and related friends. Our winner was Marietta Monaghan, with a respectable four correct. Here are the answers:
- Popeye’s main enemy. Bluto.
- Classic Roy Orbison song. Blue Bayou.
- He’s under the haystack, fast asleep. Little Boy Blue.
- 1930 film starring Marlene Dietrich and Emil Jannings. The Blue Angel.
- The two Beatles songs with “Blue” in their name on Magical Mystery Tour and on the White Album. Blue Jay Way and Yer Blues, respectively.
This Week’s Trivia Challenge
Just to be fair, today’s trivia challenge focuses on the word “red” and related friends. No looking up the answers now! SEND ALL ENTRIES BY EMAIL TO firstname.lastname@example.org, since if you put them as a response on the BLOG, everyone will be able to see them!
- Almost got eaten by the big bad wolf.
- There’ll be no more sobbin’ when he starts throbbin’ his old sweet song.
- Cantankerous comedian, starred in Sanford and Son.
- British science-fiction TV show, about a mining spaceship inhabited by Dave Lister, Arnold Judas Rimmer, a senile computer, and an evolved cat.
- De facto national anthem of the People’s Republic of China during the Cultural Revolution.