Science of Science. «Public health and health care»

Prof., MD, Vialkov A.I.

PhD, Gluhova E.A.

First Moscow State Medical University, Russia

Monitoring processes and procedures for measuring the quality of the organization's scientific work specializing in "Public health and health care"

Abstract.

This paper proposes a method for monitoring the processes and procedures for measuring the quality of the main activities of the state scientific organization with the requirements of continuous improvement, the importance of expert evaluation of scientific achievements of a specialist, research group, or organization.

A complete system of indicators, research and innovation quality criteria, and target indicators (mean values, standard required values) was formed, which are benchmarks for assessing the performance of monitoring processes in the state sector of science specialty "Public health and health care."

Keywords: monitoring processes, quality measurement procedures, research and innovation, scientific organization, quality management system.

I. Introduction.

The significance of research is due to the search for standard methods for monitoring and procedure performance measurement for key processes within the quality management system (QMS) of scientific organization.

The need for monitoring system and evaluation of the results of public research organizations is due to the need to develop a feedback tool between results and resources, flexible redeployment of resources, the formation of state objectives for execution of work for the implementation of research and development in the institutions of science and education [1].

In the domestic experience sphere, experiment process monitoring and evaluation of the results of science in the state sector is limited by federal target programs, research foundations, universities accredited educational programs, and innovative research programs contests [2].

Limitations of the system of monitoring and evaluation in the state sector science include an imbalance of existing methods and estimation procedures (the predominance of expert evaluation with a lack of objective quantitative methods), the problem of access to primary data (closed internal system of accountability of departmental research institutions), lack of performance indicators.

The basic requirements of building an information system for monitoring include: the formation of a unified database based on the results of scientific organizations evaluation. There is also a need to develop procedures for monitoring and evaluation procedures, including the development of standard methods, organization of regular statistical surveys and reviews, receive substantial reports on the performance of the organization, including recommendations for further work organization and funding [3].

II. Formulation of the problem.

The purpose of this research is to develop and test a methodology for monitoring the processes, procedures for measuring the quality of the major activities of scientific organization, with the requirements of continuous improvement.

Research methods: poll, scoring methodology, the ranking, the summation on the scale of expert assessments, valuation indicators, ratings.

The object of the study - a scientific and innovative activity of organization specialists.

Sources of information: an expert polling survey of heads of structural subdivisions, personalized database of publications of scientific employees, citing data of publications in the library of the Russian Science Citation Index.

Organizational and technical solution: a prototype information system for monitoring processes and procedures for measuring the quality of computer processing providing the effective support, scalability, integration of primary data from different organizational units.

The monitoring system, performance measurement of processes of QMS consists of components that are part of a single technology: scientific approaches to the development and implementation, processes structure, functions and management methods, procedures of result identification [4].

Approach to the development and implementation of information system for monitoring in the organization consisted of several steps, which include:

- Identify the needs of and expectations of internal consumers (research and teaching staff - RTS);

- Determination of the processes necessary to achieve the quality objectives;

- Justification of methods of monitoring, measurement of main activities (processes);

- Evaluating the performance monitoring of each activity category (process) on current and fixed values of the indicator;

- Developing the procedure of peer evaluation, including method of rating scoring, the organization of regular statistical surveys, receiving informative reports on the performance of processes structure within an organization.

In the first step we studied the satisfaction of internal customers - RTS of the organization, numbering 112 persons. According to the survey about 86% of employees are satisfied with the conditions of the organization of scientific activity.

In the second step we set the structure of the processes interaction in the organization, displaying the relationships between the elements of a monitoring system for measuring the effectiveness of processes and management. In the organization we established the main processes (research, innovation) and procedures to improve processes based on the principles of quality management system (management leadership, the creation of products, services, measurement, analysis and improvement, resource management and personnel).

To the QMS supporting processes include: records and documentation management, quality control, corrective and preventive actions, control of inappropriate product.

Required (planned) monitoring performance value of each process on the selected quality criteria is determined as the average value of the indicator for the previous 7-year period of operation.

A system for evaluating monitoring performance value for the main processes was developed using the following positions: the creation of products and services, measurement, analysis and improvement.

In the system of performance monitoring evaluation we identified key quality criteria:

1) The production of knowledge - Publication activity (high-quality publications and their citation in connection with the journals impact factor);

2) The reproduction of knowledge - academic activity (the system of scientific thesis defense and monographs) and communication activities (involvement in the international scientific community);

3) The diffusion of knowledge - innovation activity (innovative research and development).

In the fourth step we developed basic requirements for introduction of a unified processes monitoring and evaluation of their effectiveness system which includes:

- Definition of the application area (the formation of plans and determination of volumes of financing);

- The formation of a single database according to the results of processes monitoring;

- Order of evaluation, including recommendations for further work organization and financing).

III. Results.

Results of monitoring processes (statistical reports of the organization) are shown in Table 1.

Table 1. Results of monitoring processes.

Indicators	Required value	Current value	Value for the previous period
1. RTS satisfaction with the quality of the scientific process	70%	86%	80%
2. The amount of funding per unit of RTS, thousands of rubles	70	85,2	87
3. Publication activity (high-quality publication per author)	1,2	1,4	1,3
4. Citation level of high-quality publications	2,4	2,8	2,7
5. Proportion of high-quality publications	40%	51,4%	41,5%
6. Number of scientific defenses for 100 staff units of RTS	5	6	5
7. The number of monographs for 100 staff units of RTS	7	4	3
8. Number of conferences organized by technopark for 100 staff units of RTS	4	4	3
9. The number of reports on international conferences for 100 staff units of RTS	7	17	16
10. The number of innovative developments for 100 staff units of RTS	1	2	1

IV. Conclusions.

According to the organizations scientific reports the following conclusions about the effectiveness of QMS processes can be made:

1. There is an observed increase in the level of publication activity (increase in the proportion of highly cited publications from 41.5% to 51.4%).

2. There is a high level of involvement of staff in the global scientific community and the productivity of the approved scientific and technical products.

3. There are signs of organizational development (organization of four scientific conferences through techno park).

4. There has been activity in the transfer of organizational and information technologies to the Center of information technologies and systems, Patent Department of the University (research reports using state standards, patent applications).

5. There is an observed weak relationship of the organization with the real sector of extra-budgetary competitive funding of scientific research.

As a result of this pilot survey analytical material was prepared on the organization's QMS with recommendations for improvement.

The project information system for monitoring and evaluation of quality of basic types of scientific activity is seen as a technological basis for solving problems of medium-term government planning of research and development works.

In addition, as a technological solution, possible documentation handling, use of algorithms and software in the form of a utility model and a new computer program are considered.

References:

1. Kitov G.A. Public institutions of science: the contours of the forthcoming reform / / Forsythe. – 2010. - № 3. - C. 40-54.

2. Kuznetsova T.E. Assessing the impact of scientific organizations in Russia: fashion or an urgent need / /Civilization of knowledge: global crisis and an innovative choice of Russia. - RosNou, 2009. - C. 124-131.

3. Scientometric study of "Healthcare Manager". Ed. house "Healthcare Manager" - 2011. - 8 c.

4. Report of a scientific research, № state registration 01201066250 "Testing of the model of rating performance of research activities in the Institute of Public Health and Health Management." M., 2010. - 28 c.