skip navigationHome

CALIFORNIA STATE UNIVERSITY, SAN BERNARDINO

FACULTY SENATE

 

 

Educational Policy and Resources Committee March 2000

 

PERIODIC ACADEMIC PROGRAM REVIEWS

 

 

FSD 99‑03.R1

(superseded 79‑219. R3)

 

 

Introduction:

 

The campus must ensure the continued enhancement of the quality of academic programs and the flexibility and vitality of the academic enterprise. The public, the legislature, accrediting bodies, the CSU Trustees, and the Statewide Academic Senate have all called for campuses to develop programs of assessment and review that provide evidence of the quality of degree programs. The Western Association of Schools and Colleges terms this emphasis on proof of academic achievement and excellence a "Culture of Evidence."

 

The emphasis has changed from focus on Inputs (resources, number of faculty, ability of students at entrance, etc.) to Outcomes (demonstrated results, student and employer satisfaction, and proof of how students have met stated program goals and objectives.)  Increasingly academic departments must specify desired learning outcomes and collect data and information about the accomplishments and progress of their graduates and the student teaming outcomes they desire.

 

Outcomes Assessment involves defining the programs goals and objectives, specifying the criteria and methods to be used to determine whether students have reached the level of achievement expected, and analysis and use of the assessment findings for program improvement. The overall focus is determining what graduates of the program know, what they have experienced, and what they are able to do on completion of the course of study. Each department or program is responsible for designing its own outcomes assessment policy in accordance with its own specific disciplinary goals and practices. Outcomes assessments should normally include both qualitative criteria and quantitative measurements.

 

Program review is essential to this process. It is a tool to examine effective instructional strategies, to focus on the adjustment of curricula to changing student clientele and new knowledge, to identify other areas for improvement, and to assess the effectiveness of earlier actions taken to enhance the quality of a program. Program review can also assist the campus to make informed decisions about academic program priorities and the allocation of limited resources, although care must be taken to assure that programs are not penalized for frankness and honesty in their self‑study. Program review provides information valuable to evaluation of proposals for new programs and to decisions regarding existing programs.

 

Periodic reviews of each of the University's academic programs have been mandated by the Chancellor's Office for many years. Each program (majors, certificates, and credentials) must be reviewed every 5 years, unless special circumstances warrant a more frequent review. Under normal circumstances, all degree programs housed in a particular College are reviewed during the same academic year.

 

After consultation and approval of the College Dean and the Associate Provost for Academic Programs, programs which have specialized professional accreditation by state or national accrediting bodies may modify the normal, procedures and time lines to avoid ­duplication of effort. All areas and issues covered by this document must be covered in the self‑study, however.

 

This policy provides for review of the departmental self‑study efforts by a team of CSUSB faculty from the Colleges that are not involved in periodic program review that year. This will provide each department the benefit of advice from experienced colleagues outside of their discipline.

 

Purpose:

 

Several purposes are intended for and accomplished by Program Reviews. The review is expected to:

 

1.      Assess changes and progress towards program goals since the last review.

 

2.      Assess and monitor program quality, and indicate how that quality is to be maintained.

 

 

3.      Analyze systematically the objectives and performance of the program/department.

 

4.      Compile informed feedback about the program from a wide range of sources: faculty, students, and other constituents involved with the program.

 

5.      Indicate how the needs/demands of the students and region are balanced by the desire to maintain quality.

 

 

6.      Identify strengths and weaknesses of the program.

 

7.      Compare graduate programs with recognized national standards of excellence.

 

8.      Tie program evaluation results to university‑wide planning and budgeting.

 

9.   Develop plans for change and improvement.

 

The Review Process:

 

The self‑study representatives and the college dean will meet, following the annual calendar (see Appendix 11, "Self‑Study Deadline Calendar"), with the Associate Provost for Academic Programs, (the campus‑wide self‑study coordinator) for orientation, directions and questions. At that time, data from Institutional Research and Academic Programs offices will be supplied. (See Appendix III, "Data to be Included in Self‑study Reports.")

 

Self‑Study reports will be written by the end of fall term. Drafts will be reviewed and revised during December. The final version of report will be completed by mid‑January and distributed. Each department/program report will be reviewed by all members of that department/program, the College Dean, the Dean of Graduate Studies (where master's degrees are offered) and the Associate Provost for Academic Programs. The report will then be forwarded to the University Self‑Study Review Committee, an ad hoc committee of the Faculty Senate. This committee will read all department, program and college reports, meet with those under review, ensure the general accuracy and consistency of these self­-study reports, and prepare a brief report of its major findings and recommendations, including results of annual reviews of outcomes assessments.

 

A summary statement for each department/program be will prepared by members of the University‑level Self‑Study Committee and reviewed by the College Dean prior to being forwarded to the President, Provost, and Budget/Planning Committee. The Associate Provost for Academic Programs will further summarize the findings and report them to the Chancellor's Office for presentation to the CSU Board of Trustees.

 

Role of Department/Program:

 

The format for the self‑study process will involve the department faculty in gathering and reviewing data about the findings of their annual outcomes assessment and other ongoing measurements of student achievement and learning. In addition, the reports will relate measurements of student achievement to the operations of the department, its curriculum and courses, its instructional modes, its students and its resources. The College as a whole will also be reviewed. (See Appendix 1, "Organization of Self‑;Study").

 

The focus of the review and of the resulting report and recommendations will be on examining strengths, weaknesses, needed changes, and the outlook for the future. The results of department outcomes assessment and other ongoing measurements of student achievement will be reflected on and used for program improvements and modification where needed.

 

Each department and/or program will assign, where possible, one of its own tenure‑track faculty members who has been at the University for at least two years to act as its self-­study representative.

 

Role of Outside Consultants:

 

Funds will be made available by the Academic Affairs Office to provide each college with off‑campus consultants. Graduate Programs should have a separate off‑campus consultant. The outside consultants will:

 

1.      Provide disciplinary expertise and objectivity, and may be involved in the preparation of departmental reports;

 

2.      Provide an outside/national perspective;

 

3.      Meet with department chair, faculty, students, members of University Self‑Study Review Committee, and Provost to discuss the report; obtain information, clarify issues, and develop perspective;

 

4.      Verify the accuracy of the self‑study;

 

5.       Provide assistance in addressing problems and reaching goals;

 

6.       Provide confirmation of the department/program's conclusions;

 

7.       Prepare a brief report with analysis of strengths and weaknesses found;

 

8.      Make recommendations for change and improvement which will supplement the departmental reports and findings.

 

The Campus Self‑Study Review Committee will recommend consultants to be invited by the University selected from a list of three names per consultant position submitted by the college dean following consultation with department chairs and program coordinators. For off‑campus consultants, names should be accompanied by brief biographical‑ sketches. (See form provided.)

 

University Self‑Study Review Committee

 

The Self‑Study Review Committee will consist of four faculty from outside the college under review, one college‑dean (usually chosen from the college reviewed the previous year), and one administrative representative.

 

The faculty will be selected, one from each college (exclusive of the college currently being reviewed), by the Executive Committee of the Faculty senate from among the senior faculty. The college dean and administrative representative will be appointed by the President. The committee will elect its own chair and proceed according to steps its members agree upon.

 

Appointments to this committee will be for one year. However, committee members may be reappointed. 

 

Functions of University Self‑Study Review Committee:

 

1.   To approve external reviewers nominated by programs,

 

2.   To approve and review document drafts,

 

3.   To assist writing and revision or report where needed,

 

4.   To note (and where possible reconcile) discrepancies between the program's views and the conclusions and recommendations of the outside consultant,

 

5.      To summarize the department and college findings,

 

6.   To make recommendations to the Dean, Provost, President, and Budget/Planning committees,

 

7.   To report to the Faculty Senate.

 

The Report of the University Review Committee should include discussion of the following:

 

1.      Does the department culture encourage and reward high‑quality teaching?

 

2.       Are department teaching loads reasonably similar to those at comparable universities?

 

3.      Are the department's grading practices reasonably similar to those of the College end University? If not, is there a reasonable justification for the deviation?

 

4.      An overall evaluation of the unit's efforts to promote teaching and learning.  This should include a discussion of the department's strengths and weaknesses.

 

5.   Is the department provided with services and resources adequate to its mission, goals, and objectives?

 

6.      Suggestions about how the program could improve its performance.

 

Role of the College Dean

 

The College Dean will:

 

1.      Oversee the preparation of the departmental and program reports to ensure timeliness, accuracy, consistency, and completeness. It is particularly important that the dean impress upon the department that the self‑study is to be a frank self‑assessment and not a public relations report.

 

2.      Provide logistical and operational support as required. This may include assigned time for coordination and preparation of reports of interdisciplinary programs which have no department or faculty.

 

3.       Provide the University Self‑Study Committee with a report of the disposition of recommendations of the most recent program reviews.

 

4.       Review program reports and provide an overview and summary from the college's perspective, noting patterns, issues, and concerns which span departments. The College Dean may make recommendations for change and/or for further study and analysis.

 

5.       Assist the departments and programs in developing a Plan of Action for responding to the findings and recommendations of the reports of program, consultant and university‑level review committee. .

 

6.      Provide follow up and assistance (both financial and operational) in addressing the recommendations and needed actions.

 

Role of Graduate Dean

 

The Graduate Dean will:

 

1.       Provide additional nominations and review of possible outside reviewers to be selected for master's degree programs.

 

2.       Review self‑study documents for graduate programs to ensure completeness, accuracy, objectivity, and breadth of perspective beyond the campus and the CSU.

 

3.   Meet with and provide information to outside reviewers regarding curriculum, admissions and candidacy procedures, academic standards, quality of theses and projects.

 

4.      Provide data from surveys of graduating master's degree students.

 

5.       Communicate results and findings of completed self‑study, consultant's reports, and recommendations to the graduate coordinators.

 

6.   Assist programs in follow up and carrying out the Plan of Action for addressing University Self‑Study Committee summary recommendations and needed changes.

 

7.      Convey findings of graduate program reviews to the graduate coordinators for discussion of general issues of quality of graduate programs.

 

 

Role of the Program Review/Self‑Study Coordinator (Associate Provost for Academic Programs).

 

The Associate Provost will:

 

1.       Notify college and programs of the review schedule.

 

2.      Establish a budget for the review.

 

3.      Oversee appointment of committee personnel.

 

4.       Oversee general conduct of the review.

 

5.      Submit final review outcomes to the President, Provost, and Faculty Senate.

 

6.   Prepare summary of findings for report to Chancellor's Office and Board of Trustees..

 

 

Post‑Review Procedures

 

After the self‑study review committee has presented its report, the college dean, department/program representatives, and campus‑wide self study coordinator will meet to identify problem areas, coordinate recommendations and plan appropriate steps to convert recommendations into curricular and other proposals.

 

The department/program, working in conjunction with the college dean; will prepare a Plan of Action for addressing the recommendations and concerns noted ire the self‑study and reports of consultants and university committee. Each item to be addressed will have an indication of the following:

 

1.       The expected action/change to be taken, e.g. revision of curriculum, addition of faculty, purchase of equipment, etc.'

2.   A specific time line for when the task will be completed.

3.      Persons) responsible for carrying out the needed change.

4.      What the anticipated cost will be.

5.       Where the resources will come from.

‑‑reallocation within department

‑‑reallocation from College

‑‑funding from Academic Affairs division

‑‑grants and other outside sources

‑‑University resources to be requested through budget process

 

6.   A full report on the actions carried out will be sent to the Provost, Associate Provost and Dean by dates established and agreed upon in the Plan of Action. Some reports will also require conveyance to other groups such as the Strategic Planning Council, Budget Council, or specialized accrediting body as appropriate and needed.

 

Cycle of Reviews


1999‑2000             College of Natural Sciences 2000‑2001College of Social and Behavioral Sciences

 

2001‑2002            College of Business and Public Administration ,

 

2002‑2003             College of Arts and Letters­

 

2003‑2004            College of Education (And so forth…)

 


Appendix 1

 

ORGANIZATION and FORMAT OF THE SELF‑STUDY

 

The following questions should be addressed by each department, program and college preparing a self‑study. Because of the diversity among the groups involved it is appropriate to emphasize those aspects of greatest concern to the group undergoing self‑study. The emphasis should be on providing evidence of quality and proof that the department/program is meeting its stated Mission, Goals and Objectives. The self‑study report should be analytical as well as descriptive.

 

Evaluation and recommendations resulting from the self‑study findings should be included in the appropriate sections of the report. Substantiate each of your statements with evidence of student learning outcomes, data gathered in your annual assessment process, and other trends in program and course enrollment, retention, graduation rates, graduate school acceptances, student job placement, etc. Avoid self‑praise; instead let your achievements speak for themselves. Highlight quality, strengths and weaknesses, and be sure to include recommendations for change.

 

The essential questions are:  What do you do?  How do you do it?  How well do you do it?  What difference does it make whether you do it or not?  How well does what you actually do relate to what you say you do?

 

Special Focus for Graduate Programs:

 

Masters' degree programs as well as all credential programs shall be reviewed separately from undergraduate programs. The nature of graduate education requires that special questions be asked. The criteria and standards for evaluation should be higher than and different from the undergraduate program.

 

Separate reviewers and consultants will be employed for each graduate program to evaluate and compare the program from a national perspective. They should be chosen for an objective, unbiased viewpoint and have no prior association with the program.

 

The graduate dean, graduate program coordinator and graduate student leaders should all be involved in the review, participate in the development of the self‑study report, take part in interviews, and meet with outside consultants.

 

Graduate programs will be asked (in addition to the information requested below from undergraduate programs) to provide additional information on their graduate students and alumni:

 

1.   Enrollment and graduation figures for the past five years.

 

2.   Projected graduate enrollment for the new five years.

 

3.      Data on average time to completion of degree.

 

4.       Sources of applicants: CSU, other institutions, .international students.

 

5.       What do program graduates do after leaving the university? Percentage of students who continue to a Ph.D. program or other terminal degree? Initial employment of students upon graduation? .

 

6.      Outcomes of thesis work: Information on publication of graduate research, presentations, performances, exhibitions, or critically reviewed performances.

 

7.       Funding and financial support for graduate students: University sources, external scholarships, faculty research grants or contracts. Proportion of students receiving support and average amount of support per student for each of the last five years.

 

8.       Physical Resources: Indicate strengths and weaknesses of the program regarding library resources, laboratory facilities, computer facilities, clinics, etc.

 

9.       How is the graduate program contributing to the discipline or profession?

 

10.       How does the program respond to the profession's and/or community's needs?

 

11.      How is the program assessed or regarded by experts in the field?

 

 

Content of Self‑study Document

 

A.                 Preparation of the self‑study. Who participated in the self‑study and preparation of the report?

 

B.             Response to recommendations of the previous program review.

 

1.       What were the recommendations made as a result of previous self‑studies?

 

2.       What actions have resulted from them? What success have you had in implementing those recommendations?

 

3.      Include results of specialized accreditation by national professional groups.

                   

C.        The department (or program or college. Briefly state:

 

1.       The Department Mission, Goals and Objectives.

 

2.      The number and composition of faculty, e.g., 7 full‑time, 3 part‑time;

 

3.   Number and kinds of support staff members.

 

4.      How many undergraduate majors and graduate students are enrolled?

 

5.   What degree and certificate programs are offered?

 

6.   What special programs, if any, does the department operate? (Special programs include the Slide Library, Counseling Clinic;, Reading Clinic, Desert Center, etc.)

 

7.      Description of departmental budgets and administration.

 

8.       Describe and assess the adequacy of administrative and budgetary support granted to the department (or program or college), consistent with its mission, goats, and objectives.

 

D.        The Curriculum.  Describe each of the curricular programs offered. Include the Mission, Goals and Objectives for each major and program concentration. (Are they different from those of last review?) For each program indicate those skills, concepts and experiences which each graduate should possess, and the courses in which they are acquired.

 

1.      How does the curriculum reflect your goals and objectives for students?  Describe the function of each course or group of courses.

 

2.      Review the scope anti level of complexity of courses offered, and recommend modifications, additions and deletions as appropriate. This review should involve as many of the department ~faculty as possible.

 

3.      Present and review the enrollment history of each course offered by the department. (A syllabus for each course, together with sample exams, text titles and assignments are placed in a file folder available for inspection by the consultant and self‑study review committee.) Recommend changes as appropriate.

 

4.      Include a separate review of the general education courses offered by the department.

 

5.      Describe and analyze the findings of outcomes assessment done under Program Assessment Plan.

 

Based upon the findings of these measures, indicate whether the department and its students are meeting the established objectives after review of curricular and enrollment data presented above, and recommend directions of future curricular development and improvement of instruction.

 

E.                 Instruction.

 

1.      What are the instructional modes or formats currently employed?  Are the formats used the most desirable ones possible?  If not, recommend changes, as appropriate.

 

2.      Where supervised instruction is offered, e.g., internships, describe and evaluate the methods of supervision and evaluation of student performance.

 

3.      What innovative instructional methods are being employed?  Evaluate these.

 

4.      Present a history of department grading practices.  Evaluate and recommend changes, as appropriate, in the methods of assessing student performance and the standards established by the department.  If department’s grading practices are significantly and consistently above or below College or University averages, the unit should offer an explanation for the variance.

 

5.      Do grading practices correspond to other formative and summative measures of student achievement?

 

6.      Discuss quality of teaching and learning in the department.  How does the program regularly examine its teaching and how does it determine whether learning is occurring?

 

7.      Provide analysis of trends in class size at lower-division, upper-division, and graduate levels.

 

8.      Analyze faculty teaching loads and number of student credit hours generated in comparison to other departments on our campus and to similar departments in the CSU.  Note any special departmental factors influencing credit hour production and faculty teaching loads.

 

9.      Describe and evaluate the program’s use of computers, multi-media and other technology for instruction and student earning.

 

F.         The Faculty.

 

1.      Provide a brief summary of the professional background, areas of teaching, and professional accomplishments for each full-time member of the department.  (See form provided.)

 

2.      Tabulate the courses offered by each member of the faculty.

 

3.      Based on this information and upon future curricular areas indicated under D above, discuss the kinds of individuals to be added over the next few years, where possible, and changes in faculty course assignments that appear desirable.  (Personalities and individual problems should not be a part of this report.)

 

4.      Present an examination of your department’s (program’s) use of part-time faculty.

 

5.      Analyze data on teaching loads provided by Institutional Research.

 

--number of courses taught,

 

--number of student credit units taught by each faculty member and by department,

 

--Student/Faculty Ratio for each of last five years.

 

6.      Assess department’s success in hiring faculty.  What factors worked for or against hiring the most qualified applicants?

 

7.      Assess department’s record of hiring and retaining qualified women and minority faculty.

 

8.      Amount of non-instructional “assigned time” and how used to support the program activities and faculty?  Number of sabbaticals and leaves?

 

 

G.        The Students.

 

1.      Present, analyze and discuss historical trends in the number of majors and graduate students.

 

2.      Discuss the results of student and alumni surveys.  For example, what has happened to individuals who have graduated with a degree from this department?  To what extent are departmental majors and others served by the department satisfied with the curriculum and instruction offered by the faculty?  (Include pertinent data from college survey in body of text along with comparative data from program survey.  How does program compare to other programs in the college and similar programs elsewhere?)

 

3.      Describe how advising is conducted in department, discuss how you assess and evaluate the effectiveness of departmental advisement program, and recommend changes, as appropriate.

 

4.      Describe and evaluate student clubs, organizations and co-curricular activities of the department/program.

 

5.      To what extent are students involved in research activities and projects or faculty and department?

 

6.      What has department/program done to retain students?  How could this effort be improved?

 

7.      How has department/program recruited and attracted students?  How would you assess this effort?  What could the department do to improve its recruitment?  What has been done to maximize enrollment?

 

8.      Interpret trends in student credit hour generation, numbers of majors, number of graduates, and class size.  Do the trends indicate the need for changes in what you currently do?