News, Views and Careers for All of Higher Education
March 20 Reality Check
Much comment has swirled around a proposal to create a large federal database that can track all college students from the moment they enter any higher education institution anywhere in America.
Such a database for student tracking has many possible uses: improving the ability of institutions to support the needs of students who attend more than one institution on the way to a degree, improving the federal and state oversight of higher education effectiveness and efficiency, standardizing curricular offerings nationwide, improving the transfer of credit by ensuring that all courses have equivalent content for students wherever the students may attend college, and permitting significant, wide ranging research on college attendance patterns and the effectiveness of institutions.
A recent report sponsored by the Lumina Foundation entitled “Critical Connections: Linking State’s Unit Record Systems to Track Student Progress” (January 2007) by Peter Ewell and Marianne Boeke of the National Center for Higher Education Management Systems provides a very useful survey of the current state systems for linking student records and a helpful commentary on the challenges and opportunities of a national version of such a system.
In academic settings, the creation of large databases can become a substitute for recognizing fundamental issues. While good information is always welcome, the fundamental problems in American higher education are probably not the result of inadequate information about the migration patterns of students or the peculiarities in the college transfer processes, although both are important issues. Most challenges in higher education come from a mismatch between the expectations of students, parents and employers and the investment in the institutions designed to meet those expectations.
While very wealthy private and elite public institutions can often mobilize sufficient resources to meet most of the expectations of their many constituencies (evidenced by the high demand for admission and significant success in placing graduates), most higher education institutions struggle with inadequate funding to serve populations of students that may include significant numbers of economically challenged or academically underprepared participants. The continuing decline in public funding and the mirror image increase in tuition and fees cannot be solved by better data.
National level databases have two major difficulties: expense and accuracy. The money part is easy to understand, especially for those who have participated in the last decade’s explosion of cost associated with complex computerized accounting and personnel systems on university campuses. The money will need to be spent by two categories of entities: individual higher education institutions and the federal government. The federal government will need to create a system like the Integrated Postsecondary Education Data System that can handle the massive amounts of data anticipated from the student tracking system. This is no small enterprise, and we have no real estimates of the cost. Some cynics might wonder if the initial start-up and the continuing operating costs might not produce more benefits invested in financial aid of some kind.
The higher education institutions, for their part, will need to invest in personnel and systems to capture the data required by the federal system, verify it, and send it forward. Many states have similar systems now for tracking students through their state higher education institutions, but it is almost certain that these will have to be revised to conform to federal standards or else institutions will need to maintain two parallel systems with different standards. The National Center for Higher Education Management Systems maintains a useful site with information on all the various state systems.
Adding to this complexity, most federal data systems associated with higher education that do not involve money rely on the good will and expertise of the institutions to verify the accuracy of the data. Experience with IPEDS, and especially experience with various ranking systems that rely on institutional submissions, demonstrates the difficulty of acquiring reliable, valid and consistent data across the universe of American higher educational institutions.
Many forms of error enter these systems. Sometimes institutions interpret data definitions differently (we’re still discussing how to define instructional employees as “faculty” for the various national data sets). Sometimes institutions choose different ways of reporting what appears to be similar data (on what day in the first semester do we count the freshman class and which individuals do we include when we count the average SAT of entering students). In other circumstances we report numbers that may or may not reflect what their name implies (we report instructional expenditures using an accounting definition that may not accurately separate out research from service from instructional costs).
If, as anticipated, a large database of linked student records is to be used for accountability and comparative purposes, there will be many incentives to fudge the data. Unless the federal government institutes some variety of audit function to ensure that the data are accurate and comparable among institutions, the utility of the information will be low but the temptation to use it will be high.
None of this is to say that such a system might not have considerable value for some purposes. The issue is more complicated. We like binary contrasts: bad and good. But this is not a binary issue. Accurate data are good, inaccurate or incomplete data are bad, expensive data may be good but not as good an investment as something else that contributes to student success or academic quality.
When particular categories of data are used for accountability purposes, institutions will change what they do, because institutional behavior tends to match whatever is measured. If we measure SAT scores, institutions work to increase the average SAT scores; if we measure graduation rates, institutions will do what it takes to graduate students; if we measure sports success, everyone wants a successful sports program. For this reason the quality, characteristics and type of data collected and used in any student unit record system on a national basis assume fundamental significance.
In this conversation, the reality check is to avoid minimizing the difficulties and expense of creating federal artifacts whose relative utility, compared to the real problems affecting American higher education, may be quite low.
We have many challenges in American higher education, but we should not assume that large scale data collection offers a reasonable substitute for actual investment.
It seems a shame, that colleges and universities will have to spend more money on compliance issues (reporting issues)
Most of the colleges and universities that I am aware of are already strapped for administrative and support people. So, we are adding another burden of “proof” here.
I would like to know what responsibility do our students have in getting an education? Post secondary education should not be like high school. Students choose to go, they are not yet mandated to go to college. So, these students are adults, and as adults make adult decisions. Once they make these decisions they need to “live” with them. Far to often in the education world, we let students “change” their decisions, because the student did not understand what they were doing, etc. These are the same students who borrow thousands and thousands of dollars, some needlessly, with just a signature. So, how can the colleges and universities “police” everything?
I like to say that students have choices: they can choose to succeed or choose to fail.
I know that sounds simple, but I think the responsiblity for a students education has to rest on the student. If we take all responsiblity away from the student, the system will fail. One of the outcomes from this national database could be mandated outcomes (graduaton) by the Federal Government, much like the mandated high school outcomes. Outcomes are a great idea, but again college is not high school. Our students are adults and as adults they make decsions, and therefore should be held accountable for those decisions.
But by all means, lets put all the information in a databased to track all the students...oh by the way, what happens when the student just guits showing up? He/She doesnt say anything, they just walk away. And at grading time their instructor, not wanting to be a “bad person” gives them an incomplete, which indicates that the student is “still” working on the course work. 24 weeks later the grade turns to an “F” now the student has completed the course. How does one account for that kind of data?
The rate of attrition has not improved significantly in the last 25 years, so by tracking more data, spending more money, we will see changes in this rate?
Lets hope the benefit will out weigh the cost.
Jim, at 12:00 pm EDT on March 20, 2007
If there is no actual need for data — then all reasonable questions have been answered?
If that is the case — how about answering a few, in the present moment?
* Do research dollars help support higher ed? If so — by how much?
* How many students drop out after the first year? Why?
* How many students graduate within six years? Why? Why not?
* How many HE dollars are used for direct classroom purposes? Why?
Leonard Washington, at 1:56 pm EDT on March 20, 2007
“How many students graduate within six years? Why? Why not?”
The first question is already answered; go to the NCES’s “COOL” (College Opportunities OnLine) website and you can look up the retention and graduation rates for any college that you wish. (Or use the IPEDS Peer Analysis system to download data from more than one school at a time.)
The questions of why or why not will not be answered by this mammoth unit record database. It will simply tell us who is graduating and who is not — but not why or why not. A lot of expense, for not very much information.
The answers to those why or why not questions can only be obtained with in-depth research into individual students’ experiences. That would be a worthwhile enterprise, but it would be silly to involve every single student in the country in it. Instead, the research should be done in the same way that most social science research is conducted: by looking at a SAMPLE of college students.
A longitudinal data set of say 100,000 students would be much larger than most any other social science data set — and would still be orders of magnitude less costly than the massive unit record data set. And it could actually be used to attempt to answer those important why or why not questions, which the unit record dataset will not be able to answer.
Instead of massive unit record databases or “huge IPEDS", the Ed Dept should be contemplating a “huge BPS” or “huge NELS", i.e. an upgraded version of the longitudinal education databases.
MKT, at 5:46 am EDT on March 21, 2007
” .. The first question is already answered ..”
Alrighty — then what is the answer, for a *specific* college? And guesstimates why high/low? Or — why not higher?
Sometimes answering the question asked does improve one’s grade. It can also prevent continued, less-polite questioning.
Leonard Washington, at 7:40 am EDT on March 21, 2007
Leonard Washington:
“Alrighty — then what is the answer, for a *specific* college? And guesstimates why high/low? Or — why not higher?”
The answers for specific colleges ARE in the COOL system. I would not expect a database to include “guestimates".
That said the existing data could be analyzed to look for common factors (for example GPA and test scores of the entering class probably correlates with retention).
About all a national system will do is assist in individual student tracking (e.g. what is the typical six year graduation rate for particular classes of students).
Strange as it may seem to some of our critics our university (and probably most others) are very concerned with improving our rentention and graduation rates.
Rob Rittenhouse, CS Faculty at McMurry University, at 12:16 pm EDT on March 21, 2007
” .. The answers for specific colleges ARE in the COOL system. ..”
As usual — if you need something, don’t rely on the government or anyone else.
COOL graduation report on McMurry University: 59%.
University of Massachusetts at Amherst: 65%.
U. of Minnesota, Twin Cities: 61%
” .. I would not expect a database to include “guestimates".
If you can read what I wrote, I wasn’t asking for that. I was asking for a logical, reasoned judgment. I didn’t get it.
Then again, I’ve never had a 41% failure rate on anything. But that’s another story.
Leonard Washington, at 2:50 pm EDT on March 21, 2007
I see, you wanted to know about some particular school.
Some possible explanations (guesstimates if you like) for the data you cite — all from the IPEDS database:
McMurry has a less academically qualified student body than the other schools you cited.
McMurry’s student body is also not particularly prosperous — note the dramatic differences in percent of students receiving financial aid at McMurry vs. the other two schools.
McMurry is not a particular rich school and cannot afford to be as generous in financial aid as we would like to be (note the distribution of financial aid between grants and scholarships vs loans for the three schools).
Demographics make a difference too — McMurry has a larger proportion of Black and Hispanic students than the other schools.
All these factors probably contribute to the differences in retention rate.
McMurry, U Mass Amherst and Minnesota Twin Cities are very different schools with very different student bodies. Try comparing McMurry to similar schools and I think it will look better. Otherwise try comparing any of the above to Harvard (now that’s depressing).
Rob Rittenhouse, McMurry University, at 5:45 am EDT on March 22, 2007
Your explanations are the same tired excuses that policy-makers get now...and they are already unsatisfied. Perhaps you think it is acceptable for students to graduate at a lower rate when they are less prepared than others, but given the fact the institution accepted them, wasn’t that based on an assumption of likely success? Or does your institution purposefully admit students unlikely to succeed? Did the institution tell these students they were unlikely to graduate because they were less prepared?
Answer these questions....and maybe the database and accountability discussions will go away. Or will you just fall back on arguments of caveat emptor?
Frustrated, at 1:42 pm EDT on March 22, 2007
MKT ” A lot of expense, for not very much information."I agree those mammoth data bases are expensive and tell use virtually nothing about the most important “why” questions.
HST, at 5:00 pm EDT on March 22, 2007
” .. McMurry’s student body is also not particularly prosperous .. McMurry is not a particular rich school ..”
I consider myself very well-read on cognitive research, from all viewpoints.
I have never seen any proof-positive that being less than middle-class brings about a 100% result of lower educational performance.
Rather, factors with greater impact: non-traditional family structure; single parenthood; abusive single-parent households; lack of discipline; lax educational management.
It doesn’t take a village. It takes committed parents and families. The alternative are hundreds of billions of government programs.
Leonard Washington, at 10:51 am EDT on March 23, 2007
” .. McMurry’s student body is also not particularly prosperous .. McMurry is not a particular rich school ..”
Quoting Leonard Washington:"I have never seen any proof-positive that being less than middle-class brings about a 100% result of lower educational performance.”
Nor did I suggest that being less than middle class results in lower educational performance. It does mean that the student has a lesser ability to pay for an education. This is a particular problem for Hispanics who (reportedly) are reluctant to take out loans.
I might also point out that not everyone who leaves a school without graduating flunks out. I don’t know the figures for our school (I’m not in enrollment management) but I do know that more students leave voluntarily than are kicked out. Many transfer to other institutions. Others decide that a college education is not really for them (no matter what their parents insisted on). Some run into unanticipated personal or financial problems (lot easier to have money problems when there isn’t much to bein with).
Do we purposely admit students that are not 100% likely to succeed? Yes we do and so do most other schools. Only diploma mills and extremely selective rich schools do otherwise. Would you limit college education to those with near 4.0 GPAs in HS, 2400 SAT scores and parents easily able to meet the costs? Close all the schools outside the Ivy League — nobody else achieves these goals or 90% plus graduation rates.
Enrollment management and financial aid policies in an institution such as ours are a balancing act between enrolling only those students most likely to succeed, giving weaker students “a chance” and admitting enough students to stay in business.
Universities work very hard to retain admitted students. We spend a great deal on remedial courses and academic support. The help is there IF the student is willing to make the effort. Unfortunately there’s no SAT test that measures this.
As for caveat emptor — none of the data we’ve discussed here is any great secret. The COOL data is public (even if Spellings had trouble finding it), US News, Princeton Review and all the other college rating services are readily available. Students should know the odds when they sign up.
Rob Rittenhouse, McMurry University, at 6:25 am EDT on March 24, 2007
Advertisement
or search for jobs directly.
Application Programmer Specialist position to support UGA Application and Database Development that run on the central ... see job
Major factors to be evaluated for this classification include knowledge of: Online course management systems such as WebCT. ... see job
Thornton, CO see job
Faculty Position Announcement: HEALTH, PHYSICAL EDUCATION & RECREATION Duties: Teach graduate and/or undergraduate courses ... see job
The Department of Mechanical and Aerospace Engineering (MAE) at Syracuse University invites applications for a ... see job
EFFECTIVE DATE: January 22, 2007 — June 1, 2007 (Spring Semester) DUTIES: Teach one to three courses in one or more of the ... see job
Troy University, Phenix City Campus, seeks Assistant-Associate Professor of Management. see job
RECRUITMENT #: 131 EFFECTIVE DATE: August 27, 2007 MINIMUM QUALIFICATIONS: A Ph.D. or D.B.A. in Human Resource Management, ... see job
American Sentinel University is experiencing a need for additional online adjunct faculty in a variety of disciplines. see job
The Associate Director of Purchasing Services oversees total annual purchasing expenditures of over $700 Million for ... see job
Advertisement
Lombardi is missing a trend here.
As we know, HE policymakers want to ram as many students as possible through the college-degree-production-pipeline, and they want to do this as fast as they possibly can. There is enormous pressure to “up” the graduation numbers; everyone is watching the end of the pipe. This is now a national pastime.
The problem is that hundreds of thousands of high school students are taking AP, dual enrollment, IB, credit-by-exams, etc., as part of nation-wide “degree acceleration” programs for the awarding of college credit at the local high schools. These programs are growing in leaps and bounds, and therefore need to be included in any unit record tracking proposal.
In the larger historical context, this means, quite literally, tearing down the wall that separates secondary and postsecondary education. Historically, it has taken more than a century of hard work and educational reform to align high school and college the way that they are. However, all this is now in flux, but Lombardi is ignoring these changes. He should look at the transcripts of his in-coming freshmen to get an idea of how pervasive these new trends are.
Glen S. McGhee, Dir., at FHEAP, at 9:51 am EDT on March 20, 2007