University of Alberta Edmonton, Canada May 30, 1997

KPIs: the internal question

Vice-President (Academic) tells GFC the Board also wants to measure progress

By Michael Robb

University administration doesn't want members of the Board of Governors picking up a copy of Maclean's every fall and using the magazine's annual rankings to pass judgment on University of Alberta performance.

Dr. Doug Owram told General Faculties Council members, May 20, that there are real problems with the magazine's rankings. The key performance indicators being developed by the provincial government in conjunction with the post-secondary institutions also have some problems.

"We wanted a set of measures that we felt reflected our internal priorities more," he said. "What we looked for were a series of measures we, the senior administration, could be held accountable for. Were we doing what we said we'd do?"

The Board of Governors has been asking what administration wants to be accountable for. It's a legitimate question, Owram said. "Okay, you, the administration, say you're headed in this direction, you say you have a handle on things, you say you're trying to target the University as one

of the best in the country. How do we as a board, with a limited amount of time and a limited understanding of the system-because we're volunteers for the most part-know where you're going?"

These are the principles Owram's draft internal performance measures are based on:

• Relevance: Is it relevant to what the University wants to do?
• Symmetry: Where can these measures be lined up with others, such as government KPIs?
• Balance: Do they reflect all parts of the university system?
• Clarity: Are they reasonably understandable?

Based on these principles, Owram's draft performance measures include ways of measuring student quality, the quality of the learning experience, career outcomes, academic quality and external support. For example, granting council success, number of national teaching awards received and the number of students with a 90 per cent matriculation average would be included.

Art and Design professor Dr. Jorge Frascara sounded a cautionary note: Quantity measures can be deceiving. What really matters is the quality of the books, papers and inventions, he said.

Students' Union Vice President Academic Seamus Murphy noted higher student completion rates would not necessarily indicate quality.

Folio front page

Office of Public Affairs

University of Alberta