CALIFORNIA
STATE UNIVERSITY, SAN BERNARDINO
FACULTY SENATE
Educational Policy and Resources Committee March 2000
FSD 99‑03.R1
(superseded 79‑219. R3)
Introduction:
The campus must ensure the continued enhancement of the quality
of academic programs and the flexibility and vitality of the academic enterprise.
The public, the legislature, accrediting bodies, the CSU Trustees, and the
Statewide Academic Senate have all called for campuses to develop programs
of assessment and review that provide evidence of the quality of degree programs.
The Western Association of Schools and Colleges terms this emphasis on proof
of academic achievement and excellence a "Culture of Evidence."
The emphasis has changed from focus on Inputs (resources,
number of faculty, ability of students at entrance, etc.) to Outcomes
(demonstrated results, student and employer satisfaction, and proof of how
students have met stated program goals and objectives.) Increasingly academic departments must specify
desired learning outcomes and collect data and information about the accomplishments
and progress of their graduates and the student teaming outcomes they desire.
Outcomes Assessment involves defining the programs goals and
objectives, specifying the criteria and methods to be used to determine whether
students have reached the level of achievement expected, and analysis and
use of the assessment findings for program improvement. The overall focus
is determining what graduates of the program know, what they have experienced,
and what they are able to do on completion of the course of study. Each department
or program is responsible for designing its own outcomes assessment policy
in accordance with its own specific disciplinary goals and practices. Outcomes
assessments should normally include both qualitative criteria and quantitative
measurements.
Program review is essential to this process. It is a tool to
examine effective instructional strategies, to focus on the adjustment of
curricula to changing student clientele and new knowledge, to identify other
areas for improvement, and to assess the effectiveness of earlier actions
taken to enhance the quality of a program. Program review can also assist
the campus to make informed decisions about academic program priorities and
the allocation of limited resources, although care must be taken to assure
that programs are not penalized for frankness and honesty in their self‑study.
Program review provides information valuable to evaluation of proposals for
new programs and to decisions regarding existing programs.
Periodic reviews of each of the University's academic programs
have been mandated by the Chancellor's Office for many years. Each program
(majors, certificates, and credentials) must be reviewed every 5 years, unless
special circumstances warrant a more frequent review. Under normal circumstances,
all degree programs housed in a particular College are reviewed during the
same academic year.
After consultation and approval of the College Dean and the
Associate Provost for Academic Programs, programs which have specialized professional
accreditation by state or national accrediting bodies may modify the normal,
procedures and time lines to avoid duplication of effort. All areas and issues
covered by this document must be covered in the self‑study, however.
This policy provides for review of the departmental self‑study
efforts by a team of CSUSB faculty from the Colleges that are not involved
in periodic program review that year. This will provide each department the
benefit of advice from experienced colleagues outside of their discipline.
Purpose:
Several purposes are intended for and accomplished by
Program Reviews. The review is expected to:
1.
Assess changes and progress towards program goals since the
last review.
2.
Assess and monitor program quality, and indicate how that quality
is to be maintained.
3.
Analyze systematically the objectives and performance of the
program/department.
4.
Compile informed
feedback about the program from a wide range of sources: faculty, students,
and other constituents involved with the program.
5.
Indicate how the
needs/demands of the students and region are balanced by the desire to maintain
quality.
6.
Identify strengths
and weaknesses of the program.
7.
Compare graduate
programs with recognized national standards of excellence.
8.
Tie program evaluation
results to university‑wide planning and budgeting.
The Review Process:
The self‑study representatives and the college dean will
meet, following the annual calendar (see Appendix 11, "Self‑Study
Deadline Calendar"), with the Associate Provost for Academic Programs,
(the campus‑wide self‑study coordinator) for orientation, directions
and questions. At that time, data from Institutional Research and Academic
Programs offices will be supplied. (See Appendix III, "Data to be Included
in Self‑study Reports.")
Self‑Study reports will be written by the end of fall
term. Drafts will be reviewed and revised during December. The final version
of report will be completed by mid‑January and distributed. Each department/program
report will be reviewed by all members of that department/program, the College
Dean, the Dean of Graduate Studies (where master's degrees are offered) and
the Associate Provost for Academic Programs. The report will then be forwarded
to the University Self‑Study Review Committee, an ad hoc
committee of the Faculty Senate. This committee will read all department,
program and college reports, meet with those under review, ensure the general
accuracy and consistency of these self-study reports, and prepare a brief
report of its major findings and recommendations, including results of annual
reviews of outcomes assessments.
A summary statement for each department/program be will prepared
by members of the University‑level Self‑Study Committee and reviewed
by the College Dean prior to being forwarded to the President, Provost, and
Budget/Planning Committee. The Associate Provost for Academic Programs will
further summarize the findings and report them to the Chancellor's Office
for presentation to the CSU Board of Trustees.
Role of Department/Program:
The format for the self‑study process will involve the
department faculty in gathering and reviewing data about the findings of their
annual outcomes assessment and other ongoing measurements of student achievement
and learning. In addition, the reports will relate measurements of student
achievement to the operations of the department, its curriculum and courses,
its instructional modes, its students and its resources. The College as a
whole will also be reviewed. (See Appendix 1, "Organization of Self‑;Study").
The focus of the review and of the resulting report and recommendations
will be on examining strengths, weaknesses, needed changes, and the outlook
for the future. The results of department outcomes assessment and other ongoing
measurements of student achievement will be reflected on and used for program
improvements and modification where needed.
Each department and/or program will assign, where possible,
one of its own tenure‑track faculty members who has been at the University
for at least two years to act as its self-study representative.
Role of Outside Consultants:
Funds will be made available by the Academic Affairs Office
to provide each college with off‑campus consultants. Graduate Programs
should have a separate off‑campus consultant. The outside consultants
will:
1.
Provide disciplinary expertise and objectivity, and may be
involved in the preparation of departmental reports;
2.
Provide an outside/national
perspective;
3.
Meet with department
chair, faculty, students, members of University Self‑Study Review Committee,
and Provost to discuss the report; obtain information, clarify issues, and
develop perspective;
4. Verify the accuracy of the self‑study;
5. Provide assistance in addressing problems
and reaching goals;
6. Provide confirmation of the department/program's
conclusions;
7. Prepare a brief report with analysis of strengths
and weaknesses found;
8. Make recommendations for change and improvement
which will supplement the departmental reports and findings.
The Campus Self‑Study Review Committee will recommend
consultants to be invited by the University selected from a list of three
names per consultant position submitted by the college dean following consultation
with department chairs and program coordinators. For off‑campus consultants,
names should be accompanied by brief biographical‑ sketches. (See form
provided.)
The Self‑Study Review Committee will consist of four
faculty from outside the college under review, one college‑dean (usually
chosen from the college reviewed the previous year), and one administrative
representative.
The faculty will be selected, one from each college (exclusive
of the college currently being reviewed), by the Executive Committee of the
Faculty senate from among the senior faculty. The college dean and administrative
representative will be appointed by the President. The committee will elect
its own chair and proceed according to steps its members agree upon.
Appointments to this committee will be for one year. However,
committee members may be reappointed.
Functions of University Self‑Study Review Committee:
1. To approve external reviewers nominated by programs,
2. To approve and review document drafts,
3. To assist writing and revision or report where
needed,
4. To note (and where possible reconcile) discrepancies
between the program's views and the conclusions and recommendations of the
outside consultant,
5.
To summarize the department and college findings,
6. To make recommendations to the Dean, Provost,
President, and Budget/Planning committees,
7. To report to the Faculty Senate.
The Report of the University Review Committee should include
discussion of the following:
1. Does the department culture
encourage and reward high‑quality teaching?
2. Are department teaching
loads reasonably similar to those at comparable universities?
3.
Are the department's
grading practices reasonably similar to those of the College end University?
If not, is there a reasonable justification for the deviation?
4.
An overall evaluation
of the unit's efforts to promote teaching and learning. This should include a discussion of the department's
strengths and weaknesses.
5. Is the department provided with
services and resources adequate to its mission, goals, and objectives?
6. Suggestions about how the
program could improve its performance.
The College Dean will:
1. Oversee the preparation of the departmental
and program reports to ensure timeliness, accuracy, consistency, and completeness.
It is particularly important that the dean impress upon the department that
the self‑study is to be a frank self‑assessment and not a public
relations report.
2. Provide logistical and operational
support as required. This may include assigned time for coordination and preparation
of reports of interdisciplinary programs which have no department or faculty.
3. Provide the University Self‑Study
Committee with a report of the disposition of recommendations of the most
recent program reviews.
4. Review program reports and
provide an overview and summary from the college's perspective, noting patterns,
issues, and concerns which span departments. The College Dean may make recommendations
for change and/or for further study and analysis.
5. Assist the departments and
programs in developing a Plan of Action for responding to the findings and
recommendations of the reports of program, consultant and university‑level
review committee. .
6.
Provide follow up and assistance (both financial and operational)
in addressing the recommendations and needed actions.
The Graduate Dean will:
1. Provide additional nominations
and review of possible outside reviewers to be selected for master's degree
programs.
2. Review self‑study
documents for graduate programs to ensure completeness, accuracy, objectivity,
and breadth of perspective beyond the campus and the CSU.
3. Meet with and provide information
to outside reviewers regarding curriculum, admissions and candidacy procedures,
academic standards, quality of theses and projects.
4. Provide data from surveys
of graduating master's degree students.
5. Communicate results and
findings of completed self‑study, consultant's reports, and recommendations
to the graduate coordinators.
6. Assist programs in follow up
and carrying out the Plan of Action for addressing University Self‑Study
Committee summary recommendations and needed changes.
7.
Convey findings of
graduate program reviews to the graduate coordinators for discussion of general
issues of quality of graduate programs.
Role of the Program Review/Self‑Study
Coordinator (Associate Provost for Academic Programs).
The Associate Provost will:
1. Notify college and programs
of the review schedule.
2. Establish a budget for the
review.
3. Oversee appointment of committee
personnel.
4. Oversee general conduct
of the review.
5. Submit final review outcomes
to the President, Provost, and Faculty Senate.
6. Prepare summary of findings
for report to Chancellor's Office and Board of Trustees..
After the self‑study review committee has presented its
report, the college dean, department/program representatives, and campus‑wide
self study coordinator will meet to identify problem areas, coordinate recommendations
and plan appropriate steps to convert recommendations into curricular and
other proposals.
The department/program, working in conjunction with the college
dean; will prepare a Plan of Action for addressing the recommendations and
concerns noted ire the self‑study and reports of consultants and university
committee. Each item to be addressed will have an indication of the following:
1. The expected action/change
to be taken, e.g. revision of curriculum, addition of faculty, purchase of
equipment, etc.'
2. A specific time line for when
the task will be completed.
3. Persons) responsible for
carrying out the needed change.
4. What the anticipated cost
will be.
5. Where the resources will
come from.
‑‑reallocation
within department
‑‑reallocation
from College
‑‑funding
from Academic Affairs division
‑‑grants
and other outside sources
‑‑University
resources to be requested through budget process
6. A full report on the actions
carried out will be sent to the Provost, Associate Provost and Dean by dates
established and agreed upon in the Plan of Action. Some reports will also
require conveyance to other groups such as the Strategic Planning Council,
Budget Council, or specialized accrediting body as appropriate and needed.
1999‑2000 College of
Natural Sciences 2000‑2001College of Social and Behavioral Sciences
2001‑2002 College of Business and Public Administration
,
2002‑2003 College of Arts and Letters
2003‑2004 College of Education (And so forth…)
The following questions should be addressed by each department,
program and college preparing a self‑study. Because of the diversity
among the groups involved it is appropriate to emphasize those aspects of
greatest concern to the group undergoing self‑study. The emphasis should
be on providing evidence of quality and proof that the department/program
is meeting its stated Mission, Goals and Objectives. The self‑study
report should be analytical as well as descriptive.
Evaluation and recommendations resulting from the self‑study
findings should be included in the appropriate sections of the report. Substantiate
each of your statements with evidence of student learning outcomes, data gathered
in your annual assessment process, and other trends in program and course
enrollment, retention, graduation rates, graduate school acceptances, student
job placement, etc. Avoid self‑praise; instead let your achievements
speak for themselves. Highlight quality, strengths and weaknesses, and be
sure to include recommendations for change.
The essential questions are: What do you do? How do you
do it? How well do you do it? What difference does it make whether you do
it or not? How well does what you
actually do relate to what you say you do?
Special Focus for Graduate Programs:
Masters' degree programs as well as all credential programs
shall be reviewed separately from undergraduate programs. The nature of graduate
education requires that special questions be asked. The criteria and standards
for evaluation should be higher than and different from the undergraduate
program.
Separate reviewers and consultants will be employed for each
graduate program to evaluate and compare the program from a national perspective.
They should be chosen for an objective, unbiased viewpoint and have no prior
association with the program.
The graduate dean, graduate program coordinator and graduate
student leaders should all be involved in the review, participate in the development
of the self‑study report, take part in interviews, and meet with outside
consultants.
Graduate programs will be asked (in addition to the information
requested below from undergraduate programs) to provide additional information
on their graduate students and alumni:
1. Enrollment and graduation figures
for the past five years.
2. Projected graduate enrollment
for the new five years.
3. Data on average time to completion of degree.
4. Sources of applicants: CSU, other institutions,
.international students.
5. What do program graduates do after leaving
the university? Percentage of students who continue to a Ph.D. program or
other terminal degree? Initial employment of students upon graduation? .
6. Outcomes of thesis work: Information on publication
of graduate research, presentations, performances, exhibitions, or critically
reviewed performances.
7. Funding and financial support for graduate
students: University sources, external scholarships, faculty research grants
or contracts. Proportion of students receiving support and average amount
of support per student for each of the last five years.
8. Physical Resources: Indicate strengths and
weaknesses of the program regarding library resources, laboratory facilities,
computer facilities, clinics, etc.
9. How is the graduate program contributing
to the discipline or profession?
10. How does the program respond to the profession's
and/or community's needs?
11. How is the program assessed
or regarded by experts in the field?
A.
Preparation of the self‑study. Who participated
in the self‑study and preparation of the report?
B. Response
to recommendations of the previous program review.
1. What were the recommendations
made as a result of previous self‑studies?
2. What actions have resulted from them? What
success have you had in implementing those recommendations?
3. Include results of specialized accreditation
by national professional groups.
C. The department
(or program or college. Briefly state:
1. The Department Mission,
Goals and Objectives.
2. The number and composition of faculty, e.g.,
7 full‑time, 3 part‑time;
3. Number and kinds of support
staff members.
4. How many undergraduate majors
and graduate students are enrolled?
5. What degree and certificate
programs are offered?
6. What special programs, if any,
does the department operate? (Special programs include the Slide Library,
Counseling Clinic;, Reading Clinic, Desert Center, etc.)
7.
Description of departmental
budgets and administration.
8. Describe and assess the
adequacy of administrative and budgetary support granted to the department
(or program or college), consistent with its mission, goats, and objectives.
D. The Curriculum. Describe each of the curricular programs offered.
Include the Mission, Goals and Objectives for each major and program concentration.
(Are they different from those of last review?) For each program indicate
those skills, concepts and experiences which each graduate should possess,
and the courses in which they are acquired.
1.
How does the curriculum reflect your goals and objectives for
students? Describe the function of
each course or group of courses.
2.
Review the scope
anti level of complexity of courses offered, and recommend modifications,
additions and deletions as appropriate. This review should involve as many
of the department ~faculty as possible.
3.
Present and review
the enrollment history of each course offered by the department. (A syllabus
for each course, together with sample exams, text titles and assignments are
placed in a file folder available for inspection by the consultant and self‑study
review committee.) Recommend changes as appropriate.
4.
Include a separate
review of the general education courses offered by the department.
5.
Describe and analyze
the findings of outcomes assessment done under Program Assessment Plan.
Based upon the findings of
these measures, indicate whether the department and its students are meeting
the established objectives after review of curricular and enrollment data
presented above, and recommend directions of future curricular development
and improvement of instruction.
E.
Instruction.
1.
What are the instructional
modes or formats currently employed? Are the formats used the most desirable ones
possible? If not, recommend changes,
as appropriate.
2.
Where supervised
instruction is offered, e.g., internships, describe and evaluate the methods
of supervision and evaluation of student performance.
3.
What innovative instructional
methods are being employed? Evaluate these.
4.
Present a history
of department grading practices. Evaluate
and recommend changes, as appropriate, in the methods of assessing student
performance and the standards established by the department.
If department’s grading practices are significantly and consistently
above or below College or University averages, the unit should offer an explanation
for the variance.
5.
Do grading practices
correspond to other formative and summative measures of student achievement?
6.
Discuss quality of
teaching and learning in the department. How does the program regularly examine its teaching and how does
it determine whether learning is occurring?
7.
Provide analysis
of trends in class size at lower-division, upper-division, and graduate levels.
8.
Analyze faculty teaching
loads and number of student credit hours generated in comparison to other
departments on our campus and to similar departments in the CSU.
Note any special departmental factors influencing credit hour production
and faculty teaching loads.
9.
Describe and evaluate
the program’s use of computers, multi-media and other technology for instruction
and student earning.
F. The Faculty.
1.
Provide a brief summary
of the professional background, areas of teaching, and professional accomplishments
for each full-time member of the department. (See form provided.)
2.
Tabulate the courses
offered by each member of the faculty.
3.
Based on this information
and upon future curricular areas indicated under D above, discuss the kinds
of individuals to be added over the next few years, where possible, and changes
in faculty course assignments that appear desirable. (Personalities and individual problems should
not be a part of this report.)
4.
Present an examination
of your department’s (program’s) use of part-time faculty.
5.
Analyze data on teaching
loads provided by Institutional Research.
--number of courses taught,
--number of student credit
units taught by each faculty member and by department,
--Student/Faculty Ratio for
each of last five years.
6.
Assess department’s
success in hiring faculty. What factors
worked for or against hiring the most qualified applicants?
7.
Assess department’s
record of hiring and retaining qualified women and minority faculty.
8.
Amount of non-instructional
“assigned time” and how used to support the program activities and faculty?
Number of sabbaticals and leaves?
G. The Students.
1.
Present, analyze
and discuss historical trends in the number of majors and graduate students.
2.
Discuss the results
of student and alumni surveys. For
example, what has happened to individuals who have graduated with a degree
from this department? To what extent
are departmental majors and others served by the department satisfied with
the curriculum and instruction offered by the faculty? (Include pertinent data from college survey
in body of text along with comparative data from program survey. How does program compare to other programs
in the college and similar programs elsewhere?)
3.
Describe how advising
is conducted in department, discuss how you assess and evaluate the effectiveness
of departmental advisement program, and recommend changes, as appropriate.
4.
Describe and evaluate
student clubs, organizations and co-curricular activities of the department/program.
5.
To what extent are
students involved in research activities and projects or faculty and department?
6.
What has department/program
done to retain students? How could this effort be improved?
7.
How has department/program
recruited and attracted students? How would you assess this effort? What could the department do to improve its
recruitment? What has been done to
maximize enrollment?
8.
Interpret trends
in student credit hour generation, numbers of majors, number of graduates,
and class size. Do the trends indicate
the need for changes in what you currently do?