Fundamental part of good decision making is evaluation which its information will be used in developing a precise perception of outcomes of a program and input requirements like personnel and financial [1].

Evaluation of higher education increasingly is affecting academic quality, accountability of authorities, and universities ranking. Faculty members at universities are considered as effective and main factors in quality insurance of teaching–learning process in educational systems [1]. In many evaluation literatures, the CIPP model or Context, Input, Process, Product model is a very recommendable method for educational evaluation [2,3,4,5]. Complete definition for evaluation in the CIPP model is “Evaluation is a process of specifying, acquiring and providing descriptive information and making judgments about value and utility of goals, plans, performance and results to guide decision making, providing accountability, and greater understanding of phenomena under the study [6].”

From the CIPP model point, we can breakdown these eight evaluated factors into four sections:

(1) Context

(2) Inputs

(3) Process

(4) Product (output)

This study aimed to examine faculty and library staff perspectives on undergraduate program quality and weak points within universities and factors that may facilitate program quality–improvement. Although undergraduate programs within Tehran University of Medical Sciences (TUMS) are the focus of this paper, one must also keep in mind the broader context of undergraduate programs and other school’s essential needs which are common among all universities and schools. Objective of this research is to find out weaknesses of undergraduate programs in terms of personnel and financial, organizational management and facilities in view of faculty and library staff, and determining factors that may improve its quality.

This is a descriptive analytical study conducted in four selected faculties at TUMS in 2014. We selected our sample only from Public Health School, Faculty of Nursing and Midwifery, Faculty of Rehabilitation and Faculty of Allied Medical Sciences that have undergraduate programs. Statistical population were consist of three sub-groups including department head (n=10), faculty (n=61), and library staff (n=10) with total population of 81 people. After receiving the permission from Ethics Committee of Tehran University of Medical Sciences with number (IR.TUMS.REC.1394.2156), sampling was done as a census among head of departments, faculty and library staff.

We used three separate researcher-made questionnaires inspired from the CIPP model and internal evaluation literatures to collect data, based on eight factors in four area of CIPP evaluation model, consist of demographic data such as place of work, educational degree, teaching status, scientific ranking and multiple choice questions that were used based on Likert scale rating 1 to 5 digits, grading from very low, low, medium, high, and very high. Thus, if the score of a factor became less than 49.9%, it was assumed undesirable; if the score was between 50% and 74.9%, it was considered as relatively desirable situation; and if the score was more than 75%, the factor had a desirable situation. The accuracy of the questions, topic, and research goals were validated by consulting expert, supervisor, and advisor. Cronbach α coefficient formula was used to determine department head, faculty and library staff questionnaire’s reliability which estimated at α=0.97, α=0.92, and α=0.87, respectively that suggests the questionnaires have had the required reliability.

The questionnaires were distributed and collected via face to face approach. The data were then analyzed using descriptive and inferential statistics including distribution of population, frequency, percentage, and Fisher exact test. Collected data was analyzed by SPSS version 20.0 software (IBM Corp., Armonk, USA).

In this study first, the context (goals, management and organization area) was evaluated and then, the education system indicators were determined, by using facilitate decision-making model of CIPP. These factors are including: input (students, human resources, educational and research spaces and equipment/spaces and facilities); process (educational courses and programs, teaching and learning process, program evaluation, and administration and financial); and product (graduates).

The result showed that highest response rate among faculty members is from public health faculty with 38.3%. Also assistant professor is the most frequent ranking among faculty members (43.9%) and most of faculty members teach full time in their faculties. Among library staff, most of them (60%) have bachelor degree. Most frequent scientific ranking and degree among department head is associate professor with 44.4% and PhD with 88.9%, respectively.

Comparing our study and ones which have been conducted in past in same university highlights the significance of periodic evaluation of universities and reflection of its results to top authorities in order to identify gaps and improve universities quality accordingly.

In context area, goals, management, and organization factor was evaluated and has relatively desirable situation in view of department head and faculty members. Our findings is in opposition to results of Farzianpour et al.’s study [7] in Environmental Health and Engineering School of Public Health and Farzianpour et al.’s study [8] in Endodontic Department, Faculty of Dentistry at TUMS which showed desirable situation in management and organization. Findings of Farzianpour et al. [9] showed undesirable situation of goals and rather desirable situation of organizational and management structure in Epidemiology and Biostatistics Department in Public Health School at TUMS.

In input domain, our result showed that research and educational spaces and equipment/facilities and spaces factor was in undesirable situation which is against to result of studies in Biochemistry Department of Medicine Faculty, and in Healthcare Management Department of Allied Medical Sciences Faculty and in Epidemiology and Biostatistics Department in Public Health School at TUMS which showed relatively acceptable situation regarding this factor [9,10]. But findings of evaluation studies in Department of Environmental Health and Engineering, School of Public Health and in Endodontic Department, Faculty of Dentistry, TUMS, are similar to our results and showed undesirable situation in research and educational spaces and equipment [7,8].

Factor of human resources in input area is in desirable situation in view of library staff which is opposed to the results of Farzianpour et al. [10], which showed relatively acceptable situation in Biochemistry Department, Faculty of Medicine, TUMS. Farzianpour et al. [7] also showed relatively acceptable situation in manpower in Department of Environmental Health and Engineering School of Public Health, TUMS. Our finding is similar to results of Farzianpour et al. [8] in internal evaluation of Department of Endodontic, Faculty of Dentistry, TUMS.

In our study, students have relatively desirable situation which is aligned with findings of evaluation studies in Epidemiology and Biostatistics Department, Public Health School at TUMS and in Healthcare Management Department, Allied Medical Sciences Faculty [9]; but this result is in opposition of finding of evaluation studies in Department of Environmental Health and Engineering, School of Public Health and in Endodontic Department, Faculty of Dentistry at TUMS [7,8].

In process domain, in view of department head, educational courses and programs, teaching and learning process is in desirable situation, but in view of faculty members this factor is in relatively desirable situation that is aligned with the findings of Farzianpour et al. [11] in Healthcare Management Department, Allied Medical Faculty, TUMS and finding of Farzianpour et al.’s study [8] in internal evaluation of Endodontic Department, Faculty of Dentistry, TUMS. Results of Farzianpour et al. [9] showed rather desirable situation of educational courses and curriculum in Epidemiology and Biostatistics Department at TUMS.

Administration and financial is in undesirable situation.

Program evaluation is in desirable situation in view of department head and in relatively desirable situation in view of faculty member which is similar to findings of Farzianpour et al. [10], which showed relatively acceptable situation in Biochemistry Department, Faculty of Medicine, TUMS.

In output scope, graduates are in relatively desirable situation that is similar to findings of Farzianpour et al. [9] which showed rather desirable situation of graduates in Epidemiology and Biostatistics Department at TUMS. These similarities and contradiction between their findings and ours in some factors confirm the result of Fisher exact test which showed there are some significant differences between four faculties regarding to evaluated factors in view of faculty and library staff. This comparison also indicates that situation of some factors were desirable or relatively desirable in past but now have undesirable situation, it means that top authorities do not have had equal view to all faculties in terms of financial and providing facilities at TUMS or there has been some neglects during this time. Some similar findings also indicate that despite of undesirable situation in some faculties regarding to evaluated factors in past, they did not take them into consideration and did not act accordingly which affected quality and situation of those faculties in terms of education, research and facilities and they are still in undesirable situation in view of faculty and library staff in our study. These factors have been determined which may facilitate quality–improvement of program: development of a system for reflecting of student and faculty member’s criticism, satisfaction and views about department head; improvement of goals and mission of programs in dealing with graduates; development of a report on changes made during past 3 years by department head; development of documentary regulation in the department; allocating sufficient budget to increase and improve the quality of academic spaces for faculty members and students; establishing a system evaluation in library regarding to services, collection, facilities, quality and appropriateness of text book, internal and external scientific journals based on the field and availability of print and copy in the library; development of framework to estimation of needed human resources; establishing a systematic mechanism for allocation of facilities and services to faculty members in the department; increasing cooperation between universities regarding to research project, consultant services and executive activities. Besides, there should be more seminar and scientific conference for students and graduates and continuous assessment and evaluation for courses and programs; community needs, professional problems, proportional between theoretical and practical work should be considered in curriculum. Also there should be a system to record needed information about graduates, their skills, their satisfaction and their situation after graduation and for communication with them.

In this study, we faced with limitations such as lack of cooperation of faculty due to time constraint that prolonged the time to collect data. Besides, faculty wanted to modify the questionnaires according to their will.