Moiseyeva F.A., Donetsk national University of Economics and Trade named after M.Tugan-Baranovsky

Usikov V.A., Donetsk national University of Economics and Trade named after M.Tugan-Baranovsky

 

A retrospective look at teacher quality assessment in British Universities

 

Ukraine’s entering into the European educational environment has set new but rather ambiguous challenges in respect of developing new ways of providing quality, teacher assessment, measuring teacher effectiveness etc. all staff is rather vage for our educational system, so needs careful study of existing practices abroad, especially in UK. Falling within the scope of university management, the present article intends to study the experience of British Universities in implementing methods of quality measuring which further led to creating of quality management and quality assurance system (QMS and QAS). British educational experts has passed a long way of probes and mistakes to finally formalize practices into documents, recommendations or regulations. So we suggest to study British experience in order to escape possible mistakes on the way to implement QAS into HEI practices of Ukraine.

It's a true fact that the major concern of the British government at the moment is improving the quality of teaching in HEIs and implementation of definite procedures and structures to assure this quality. At the present survey we tried to analyze the efforts of the British government undertaken for the last 20 years to implement definite education policies targeted at improvement of teaching quality by means of increasing teacher effectiveness and provide some hints for Ukrainian university managers to utilize some of those practices in educational establishments of Ukraine.

In a survey of staff training and development activities in British universities, the Co-ordinating Committee for the Training of University Teachers (A.Main 1975) asked Registrars "whether there are any agreed criteria for the evaluation of teaching staff who are being considered for senior posts". In his review main stated that all the universities cited teaching as "an important consideration" in terms of promotion, and two of them reported the use of rating scales in evaluating teaching. One university said it applied its scale to three items: quantity of teaching, quality of teaching, and examining and responsibility for new courses. But Main concluded that "... there are generally no agreed, formal, publicised criteria".

Measurement implies selection of items to be measured, development or acquisition of adequate tools for performing the measurements, and purpose for performing the act or specification of use to which achieved results may be put. This is a positive approach which, as in cutting a door or a length of dress material, anticipates positive results in applying measurement to known or familiar tasks.

But measurement is also a method of enquiry in areas unfamiliar or unknown. Sidney Kettle (1975) stated his view that in the physical sciences, measurements taken in laboratory situations do not prove theories or display truths, rather they identify faulty or inadequate hypotheses and, within a particular system of enquiry, reduce the number of possibilities by discovering those which are reputable. If one accepts this as a premise, one may assume that the search for scientific truth is an effort to reject ideas which are unworkable or unuseful and measurement is the prime agent by which the necessary rejection is achieved. This may appear to be an ungenerous view of modern science, but such a view is neither novel nor lacking reputable support. T.S.Kuhn (1962) went much further in stating, "Scientific revolutions ... (have) necessitated the community's rejection of one time-honoured scientific theory in favour of another incompatible with it. Each produced a consequent shift in the problems available for scientific scrutiny and in the standard by which the profession determines what should count as an admissible problem or as a legitimate problem solution".

The same view cannot be lightly taken towards the act of measurement, methods of enquiry, systems of belief, and their effects in terms of the social sciences. Being value ourselves, human beings under scrutiny are not deemed to be expendable as are a few atoms in a laboratory. Equally, there is concern about the effect upon people of methods of investigation and the social consequences of theories, attitudes and prevalent beliefs. We are all aware of dramatic examples like the dangers surrounding theories of racial inferiority. But L.Hudson (1972) discussed the matter more quietly: "....we could follow the example of Heisenberg and the physicists; retain our concern for truth, but accept that even the most disinterested attempts to measure the natural world are bound to alter it - that, in our case, the assessments we attempt of other people may influence them in profound and harmful ways. If we grant this, it follows - again in Heisenberg's footsteps - that a knowledge of such influence and the uncertainty it entails must become integral parts of our discipline".

Hudson has not been alone in this concern, and investigations of human behaviour have often been limited by voluntary constraints. But other factors too make the human situation under enquiry difficult and elusive. To reduce the number of human and social variables sufficiently to achieve control of an experimental situation is to create a phenomenon which is unreproducible in normal life - which exists only in the laboratory and does not reflect either the complex factors of social organisation or the idiosyncratic nature of individual abilities and behaviours. It is factors such as behaviours (Many of which overlap), has confused the findings".

McNeil and Popham (1973) comment on the role of traditional research:

"...investigators have shown a lack of balance by directing most of their inquiries  toward development of schemes for analysing teaching and the conduct of studies that correlate process and product. ...we now need experiments showing that the teacher's use of these (instructional) variables can indeed produce predicted effects in learners. ...evidence cited in this chapter suggests that practice has been seriously weakened by the false belief that there are scientific c onclusions which correspond to good teaching".

Of course traditional research has been supplemented by newer approaches. In Britain there has been some growth of interest in the type of systematic investigation of student opinion that is now commonplace in the U.S.A. But regarding this as a basis for teacher assessment brings forward much controversy and doubt. J.H.Korn (1972) took specific issue with Hildebrand:

"Essentially they (Hildebrand and Wilson 1970) are saying two things, we do not agree on criteria of learning or how to measure it; the learner (therefore) is the best judge of whether he has learned. Unfortunately, however, one can't prove the latter until he has done the former".

K.E.Pole (1970) pointed to some of the problems in interpreting student opinion before resorting to factor analysis: these which take effect in the teaching/learning situation and impinge on every effort to identify educational truths. The closest we can come to understanding is by observing human beings in sufficient numbers to detect patterns in mass behaviour, postulate causal factors and measure the constancy of correlations, and attempt to calculate probabilities concerning the individual. L.C.Taylor (1971) put the whole matter rather better than we can and we quote him at length:

"...statistical statements, however subtle, involve telling lies about a series of real exceptions in order to encompass some abstract rule".

Taylor leaves us to ponder that a misjudged atom may not know or mind, but that a misrepresented human being may care very much indeed - that measurement has tremendous significance in terms of large populations and massive social organisation, but may be highly misleading when applied to the individual. Taylor himself applies such caution to the results of educational research and describes a corresponding scepticism among many teachers as a "genuine problem of scale and not some wanton conservatism". We believe this to be a very apt - expression of part of the existing ambivalence towards, for example, efforts to measure teaching effectiveness. It is felt by many that such efforts, and the growing "interest to develop objective schemes for assessing individual teaching, may be well-motivated but may also, in the world of normal daily teaching experience, be unable to measure what they really wish to, and may thereby misinform our judgements".

Having indicated certain difficulties concerning the process of measurement itself, perhaps it is an appropriate point at which to return to our original premise that measurement implies selection of items to be measured, development of appropriate tools, and specified use of results. Me have to consider each of these in turn and apply them to the question of assessing teaching effectiveness.

 

Bibliography:

1.       Korn J.H. (1972) Promoting Good Teaching Journal of Higher Education XLIII (2).

2.       Kuhn T.S. (1962) The Structure of Scientific Revolutions University of Chicago Press.

3.       Main A. (April. 1975) The Training of University Teachers: Developments in Britain Association of Commonwealth Universities Bulletin of Current DocumentationNo. 18.

4.       Kuhn T.S. (1962) The Structure of Scientific Revolutions University of Chicago Press.

5.       Kuhn T.S. (1962) The Structure of Scientific Revolutions University of Chicago Press.