Search News


Browse Archives

News

Students' 'Episodic' Engagement

January 22, 2010

Share This Story

FREE Daily News Alerts

Advertisement

WASHINGTON -- Jim comes to college with big academic ambitions, struggles with his grades as he balances course work with basketball and a social life, but emerges having found a career path that flows from his interest in sports.

Yasmin, a high school overachiever like many of her peers of South Asian descent, gets A's and B's but feels like her grades aren't good, values social relationships over her mostly "boring" courses, and seems to relish her academic work only at the point (in her junior year) when she sees it as linked to her to her personal and family life.

Oma, a Southerner with family in Africa, enters college with the weakest academic credentials of the three and gets the worst grades of the three once there. But she is captivated by an African history course she takes as a freshman; does summer field work that meshes her interests in history and music; and leaves college seemingly on a path to do graduate studies.

These students, three among the scores of Northeastern liberal arts college students that are part of a study by the New England Consortium on Assessment and Student Learning, offer greatly varying portraits of how students "engage" with their academic work and what happens to them as a result.

The unsurprising fact that students are very different from one another, and the slightly less expected reality that any individual student can be significantly more or less engaged at various points in his or her academic career, suggest the need for a far more nuanced understanding of the "student engagement" theory of learning than has sometimes been the case, several researchers involved with the consortium said at a presentation Thursday at the annual meeting of the Association of American Colleges and Universities here.

"Assessing the effect of engagement is messy -- and much more complicated than we've thought it was," said Suzanne Lovett, associate professor of psychology at Bowdoin College, who presented with her Bowdoin colleague Nancy Jennings and Lee Cuba, professor of sociology at Wellesley College. That is particularly true, they said, when it comes to the question of whether academically "engaged" students have higher grades than others -- a generalized conclusion of most engagement studies, but one that's not as clear-cut as it seems.

It's not that the three researchers or their colleagues from the consortium's other members (Bates, Colby, Middlebury, Smith, and Trinity Colleges) doubt that student engagement matters; unlike some recent critics of the National Survey of Student Engagement, who question its scientific validity, they believe that such surveys can give colleges helpful, broad data to help them assess how effective their large-scale educational practices are.

But by focusing at the institutional level and looking at individual students at a single point in time, rather than over time, much of the existing research on engagement may fail to capture the extent to which an individual student's connection to and immersion in his or her academic work can ebb and flow, among other limitations. The consortium's project combines quantitative surveys with interviews (many done by student peers) throughout a student's college career.

The researchers' presentation Thursday delved deeply into the representative cases of the three students whose college careers are (oversimplistically) described above, checking in with them multiple times each year (even, via Skype, when they studied abroad, as two of the three did) about their academic, social and other experiences (a sample of the sophomore year questionnaire is here).

The in-depth interviews reveal when students are focusing on their academic work ("It’s just interesting, and again, I could just apply everything I learned to the real world and that’s what I did, and it will definitely help me in the future,” Jim says of why he's liking sociology courses in the fall of his junior year) and when they're not, as Yasmin admitted near the end of her sophomore year: “I wish I was a little bit more academically charged and motivated. In high school I was ridiculous. I couldn’t, I couldn’t bear being second. I always had to get the top grade. I was ridiculous. If I had met myself back then I would have been like, ‘God, this girl needs to get a life.’ So now I’m kind of like just always partying and chilling, and I need to snap out of it, and I don’t know how to because my GPA is not that hot, and I know I can do better, but I just can’t find the motivation. So I need to find a major and I need to find the motivation.”

They reflect, in very specific ways, when exposure to professors has lit a fire under students ("I’ve just learned so much from it," Oma says of her first African history course. "Over one semester, I’ve just learned too much. Like a lot of information that I find very interesting. And I love the professor. I like how he teaches and like every morning I’m just ready to go to that class.“) and when pressure from parents has nudged students toward one curricular choice over another (as it did with Yasmin).

Summing up findings from a research effort that has a primary goal of showing how individualized and ever-changing student "engagement" is predictably challenging, as the researchers were quick to note. But one of their primary (preliminary) recommendations is that precisely because engagement is dynamic rather than static, college officials trying to measure the impact of engagement on student performance should consider changing the unit of measurement from overall grade point average to performance in an academic term, or even a single course.

The study suggests a "complex," and unclear, relationship between engagement and student grades, the researchers say. "Some students need to achieve a certain level of grades before they feel engaged," said Lovett, while for other students, there appeared to be little or no connection between how enmeshed they felt in their work and their grades in those courses.

Yasmin had the best grades but was clearly the least engaged, said Jennings, while Oma "had a modest GPA but was one of those exceptionally engaged students." For Oma, as with some of the others, she gets most immersed in those courses in which she has a personal interest (Oma actually talked her way, as a freshman, into the upper level courses that sparked her interest by attending a speech given by the instructor). And while her love of history does not result in better grades in history courses, neither does her GPA (about 3.0, overall) get in the way of her academic pursuits. "We watched for some evidence that her grades might become an issue, but at this point she hasn't let C grades [in some history courses] derail her interest in history," Jennings said.

The interplay between personal lives and academic engagement is equally complicated, the researchers find. For Jim and Yasmin, the two seem to compete. “Grades are important, but I know that if I get really, really good grades that will only keep me happy for like two days right after I get them," Yasmin said. "If I have like a really good semester in terms of my social life I’ll be much happier in the long run…. I know that’s really sad that everything I do should be driven by you know, how I’m interacting with my friends and if I’m having a good relationship and if my parents are happy. But like truly, that is what is most important to me… So yeah. Good grades would be awesome but they’re definitely not the most important thing.”

For Oma, meanwhile, finding her way academically (in terms of satisfaction and interest in her course work) helps ground her socially and personally in a way that had not previously happened for her. She hated the cold at the Northeast college and struggled to find her way at the predominantly white institution. But by the end of her sophomore year, her academic satisfaction has provided an anchor, and it alters her view. “I couldn’t have chosen a better place, honestly. I mean it doesn’t make it perfect. There are a lot of challenges for me -- there are a lot of challenges for a lot of students. But academics balances out all of those things and it’s just a great school.”

In the question and answer session that followed the presentation, an audience member posited that engagement may have more to do with students' expectations for how they will perform academically than with their actual grades. Yasmin came in with strong credentials and high expectations, and when she underperformed academically, she played down the importance of academic engagement.

While Oma's grades were lower, she performed better in college than her weaker credentials and her own lower expectations might have suggested, and found joy in her course work that, as the researchers discussed her, brought Jennings to the brink of tears.

See all postings »
Advertisement
Advertisement

Matching Jobs

Comments on Students' 'Episodic' Engagement

  • Engagement, yes, but what about self-efficacy?
  • Posted by Gerald Nelms , Instructional Consultant at Ohio State University on January 22, 2010 at 9:15am EST
  • The research reported is important but awfully narrow, it seems, in the variables it looked at. I would want to see not only the levels of engagement the students expressed as they moved from course to course, year-by-year, but also the levels of self-efficacy they felt as they started and ended each course. Seems to me that self-efficacy and their ability to self-monitor and self-regulate are crucially important variables in determining why students engage with one course but not with another. There's also Lee Shulman's idea of "signature pedagogies," "types of teaching that organize the fundamental ways in which future practitioners are educated," formative teaching that helps to shape students' academic interests (see Shulman's "Signature Pedagogies in the Professions," Daedalus 134.3 [Summer 2005] 52. See also Exploring Signature Pedagogies: Approaches to Teaching Disciplinary Habits of Mind, edited by Regan A. R. Gurung, Nancy L. Chick and Aeron Haynie [Stylus, 2009]. It would be interesting to explore with these three students how and when they formed their interests, over what range of years, in what classes (or out of school?), and whether and how those interests might have changed while in college.

  • Posted by David , Professor of Chemistry on January 22, 2010 at 5:00pm EST
  • Knocking research that people don't stick to complicated diet plans because they are too complicated, Jay Leno on last night's show retorted: "The reason people come out with these complex diet plans is because people can't follow the simple plan--STOP EATING!"

    Oma and Yasmin are individuals with individual ways of relating to the world in general, not merely to course material. Why shouldn't "assessing the effect of engagement" be highly complex when individual psychologies--individual subjects of being--are involved?

    Be that as it may, rather than seek new data and methods to manipulate students and their teachers, perhaps a return to the "simple plan" is more effective, however more work it requires on the part of faculties and their students who have let education become obscured behind grade inflation and teacher popularity polls: expect that faculties will structure their expectations around the centrality of student accountability that students will indeed do the intellectual work it takes to accede to high expectations. If the driving expectation for individual accountability and taking of responsibility for learning isn't at the heart of engagement--and I am increasingly concerned it is not--ever-so-nuanced and complicated bells and whistles in the toolbox, and even the most complicated of understandings of human behavior gleaned from highly nuanced classroom research surveys which have yet to appear, are perhaps too finely grained to get the job done.

    If education were really insanely unlikely "rocket science" we would have reason to doubt it could occur. As it is we have no one to blame but ourselves when we make it more complicated than it is.

  • My only two questions about this are
  • Posted by DFS on January 22, 2010 at 10:15pm EST
  • (1) Did they merit the grades they got for the curriculum they were pursuing, and
    (2) Was the institution correct in what it 'requires' for the award of the sheepskin?

    Everything else should be irrelevant, or reputations, and brands, will be continuously in flux.

  • What if...
  • Posted by Tom Krieglstein , Dir. of Operations at Swift Kick on January 23, 2010 at 8:45pm EST
  • While there are certainly issues with the study (as pointed out by the authors themselves) I appreciate the effort to try and quantify engagement. It's easy to point out an engaged student, but it's a real challenge to measure engagement. What if schools determined success at schools based on engagement vs comprehension? Assuming (my assumption no data backing me) there's a correlation between engagement and comprehension, if a student's engaged in a subject, they pass!

  • Posted by Dismal scientist on January 24, 2010 at 9:45pm EST
  • Yes, student engagement is important, but as the research discussed shows, it is very individualistic. What purpose is it going to serve to know that one student was excited about her courses, but not be certain that her comprehension was adequate? If the students show varying degrees of enthusiasm or lack of it depending on their personal proclivities, how is that to be translated into strategies for increased student engagement? Also, although I am not equating understanding closely with grades, there has to be some correlation. And then there are the problems of grade inflation, teacher popularity polls as mentioned in one post, which makes even that measure less that perfect.

    The researchers should find it necessary to compare the American college students with their counterparts in other countries. Even with all this emphasis on engagement and student-centered teaching, our young people show a glaring lack of awareness of the world around them. We rush headlong into new pedagogies and techniques, with not always stellar results. Since somebody mentioned Jay Leno, one of the most depressing segments of his comedy is the Jay-walking. As an academic I cringe at many college graduates' dismal performance.

  • Have you considered....?
  • Posted by J. Sharp , Mother of students, R.N. on March 5, 2010 at 1:45pm EST
  • I would have to agree that this study did not go into enough detail about the featured students' academic backgrounds before college or social/family history background to get a good understanding of their mindset - do they have an internal or external feeling of control of their lives and ultimately their education? That would help answer part of the level of how engaged they may possible get with their work.
    The other aspect I notice, being a parent and also with having been a school nurse, is there is no mention of the possible link of how these students could be gifted/talented and underachieving, that they could be twice exceptional (have learning disabilities - diagnosed or undiagnosed), or have co-morbid conditions that affect their learning (ex. depression as a result of bullying in school, isolation from being different from the other students or not being able to keep friends, etc.).
    School systems, in my experience, seem to be a one size fits all, despite IEPs, 504s, IDEA, not willing or able to do the testing needed to place the student where they need to be vs. where the school thinks the student should be, teachers being to busy to teach to the test to notice differences between school work, class test scores vs. state test scores, parent's comments, etc. . Students, ultimately, are forced to be "normal" in order to survive school.
    Schools and the medical system need to learn to communicate better within their own communities and with each other. If health care and education reform are done together, since they impact each other, all the invisible students that are getting overlooked because their grades don't show any "academic impact" since they have learned to compensate may stand a fighting chance to excel at life. These students have abilities, just not the ones that society values or they don't perform them the way the school wants them to (ex. showing their work in a series of steps or sitting still).
    The researchers will never truly know how engaged students are in the U.S. unless education and health reform addresses academic impact, the gifted and talented students, underachieving, bullying, stereotypes, sensory issues, co-morbid diagnoses, learning disabilites, and how they all relate to each other.