Originally written on August 21, 2012, with continued interest in the value equation for higher education this is worth looking at again.
No two universities are the same. No university was the same last year as it will be next year. Ditto for students. George Bernard Shaw wrote this in “Man and Superman”: “The only man I know who behaves sensibly is my tailor; he takes my measurements anew each time he sees me. The rest go on with their old measurements and expect me to fit them.”
When US News & World Report publishes its annual college rankings, two things happen. First, it is the most widely read issue of USNWR. Second, without fail, the editors tell the readers not to pay too much attention to the rankings because there are so many “intangibles” in student/university fit. No matter how many data points there are, too few exist to answer every question for every student and each university.
Academics occasionally look askance at the USNWR College Rankings: Institutional leaders are wary of the findings. Interestingly, a university that comes out near the top of any heap rarely hesitates to trumpet that on its homepage. What was previously considered with disdain becomes a point of pride. Yet, it was reported by The New York Times that Emory University had been cooking the books for a decade in an effort to increase its standing in the disdained ratings.
Meanwhile, state boards of higher education are clamoring for performance measures, so that they might appropriately direct resources to a state’s assemblage of tertiary institutions. Sometimes boards use too few measures of “quality” assessment. Worse yet, university leaders follow boards in fear of budget implications.
The marketplace works. USNWR sells so many copies of the annual college rankings because reasonably smart people review these and find some value and consistency in them as one means to assess quality comparatively. However, universities must display integrity in reporting data, otherwise, no ranking of any kind has any value.
Diane Natalicio, president of the University of Texas at El Paso, asked the right question in a talk entitled, “Graduation Rates: Whose Success Do They Measure?” when she correctly points out that 70% of UTEP’s graduates are not counted in UTEP’s graduation rates. Transfer students, part-time students, returning students and those who enroll in the spring semester are all under the radar. Only students who are first-time freshmen, enrolled full-time, seeking a degree and start in the fall are counted.
Many non-traditional students attend universities. A six-year graduation rate may be meaningless to a single mom or dad working full-time and spending a decade earning a degree while supporting a family and holding down a full-time job. “Late” graduation is not a failure, but a stunning attainment of a life-long ambition: A success for university and student alike.
University graduation ceremonies on military bases are a sight to behold. I have been there. Not a single graduate in his or her 20s, and by the clanging pots and pans and air horns, those in their 40s and 50s graduated with a tsunami of pride from spouses, children, coworkers and friends. A six-year graduation rate may have great value in measuring a university’s success in dealing with an 18-year-old who just graduated from high school. Any university that tends to the needs of non-traditional students will likely be hurt in this graduation-rate derby.
Graduation rates as measures of success germinated in the NCAA as a means to monitor the academic performance of student-athletes. This is most likely a valuable measure for student-athletes who are almost always members of the group of students that we call first-time, full-time freshmen. An intercollegiate athletics vehicle for measuring academic progress has leached into public policy. When institutional leadership offers no alternate, more appropriate, measures for university performance, things sink to the lowest common denominator in the quality equation.
Performance expectations are not only legitimate but essential. The quality and effectiveness of an institution’s success must be measured for audiences internally and externally. Oversimplified, sound-bite-driven assessment is just that. Most confounding and disconcerting is that a measure such as six-year graduation rates misses the changing demographics of college goers, and works on a goldfish-swallowing, raccoon-coat-wearing, notion of who goes to universities, and why.
A constant and deliberate “tailored” and evolving effort to collect data and look at trends grounded in a vision is required, not isolated snippets. Comparisons to peers from around the nation are appropriate, but peers must be true peers. For example, a state land grant university should never be compared to a state teachers’ college on any dimension.
Performance measures respectful to the needs of our universities and their students are required. However, tailored fit is essential. All else matters little.
Walter V. Wendler is President of West Texas A&M University. His weekly columns are available at https://walterwendler.com/.
