logo
SOCIAL SCIENCE RESEARCH LAB

SPTE Frequently Asked Questions (FAQs)

What does the SPTE instrument look like? What questions are on it?

Information concerning the layout of the SPTE can be found in the SPTE Technical Guide. If you would like a copy of the SPTE Instrument that the students fill out, please contact us.

How do I request a SPTE?

SPTEs are only administered to courses whose faculty request it. Several weeks prior to SPTE administration, each department is sent SPTE Request Forms for that semester's teaching faculty. The department secretary is to give the forms to their faculty. The instructor is to fill out the form and return it to us. If you would like to use SPTE and do not receive a request form, you may request one from our office or from your departments secretary.

For your convenience, you can print the form from this link SPTE Request Form.

When are SPTEs Administered?

The SPTE instrument is administered to scheduled* courses up to five weeks before finals. *scheduled courses are those classes for which instructors requested a SPTE for.

Who and when do you come to administer my SPTE?

The SSRL hires student proctors to administer the SPTEs. The proctor will administer your SPTE on the scheduled date, at the beginning of class time, unless otherwise noted.

How do I know what my scheduled date is?

After you have mailed in your SPTE Request Form, the SSRL schedules an administration date for your class(es). You will then be mailed a SPTE Confirmation Letter that will give you the administration date, time and location of your SPTE.

Why do you hire proctors instead of letting the instructor or students of the class administer it?

With having someone administer the SPTE who is not associated with the class helps with confidentiality between the students and instructor. This way students feel they can truly give their input without their concern that the instructor could potentially see their response before their final grade is recorded.

On my scheduled date what should I do?

Please be present at the beginning of the class so that you may meet the proctor and let the proctor know where to locate you once they are finished. This way you may resume class as soon as the administration is complete.

How long is the SPTE Administration?

For the most part 20 minutes. However, with the revision of the SPTE in 1996, we are noticing that it is taking students less time to complete the instrument. Time used mainly depends on how large your class is, the speed in which they normally read and/or write, and the time needed to fill out the comment sheet. The proctors are to notify the students when 5 minutes remain and proctors try to get them all collected within 20 minutes.

How is the SPTE administered?

The proctor comes to your class on your scheduled date with a packet of evaluations for your class. Since you may not be present during the administration, the proctor will ask you to step out of the room. The proctor reads a speech to the students asking them to please read the questions carefully, notifies them of the confidentiality of their responses and that you will not see the results until after final grades have been recorded. When students are finished, the proctor will place the completed forms in the packet and clips it shut. The proctor will then locate you at the location you told them at the beginning of class. The proctor will then have you sign the packet and you may then return to the classroom.

If you are not present at the beginning of class, the proctor will begin the adminstration. Once they are done, they will try to find you close to the classroom. If they are unable to locate you, they will have 2 students in the class sign the packet and return to the office. It is thus important to be in the classroom at the beginning of class, so class time is not wasted.

I teach at an off-campus site, can I get an SPTE administered?

Yes you can. You need to complete an SPTE Request form. You can pick up a request form from your department, contact us or you can print the form from this link SPTE Request Form.

What should I do if no one shows up to administer my SPTE?

If your class is at an off-campus location, please notify someone at the front desk. The off campus locations assist us in the administration of the courses at their location.

If your class is at the main campus, please call us and we will check into the situation.

Please note that the clocks around campus are not the same time. We use our clock in the department as our point of reference. Please give us a couple of minutes in case the clocks have different times.

When and how do I receive my SPTE Results?

 

You should receive them within 3 weeks after finals (please note that for the fall semesters this does not include the days WSU is closed).  This means that departments should receive their results by the end of the second week in January for the fall semesters and for the spring by the end of the first week in June.  However, this time frame does not apply for the summer semesters, since we can process them much quicker because there are not as many.

Your SPTE packet will be mailed to your department. Your department will then give you your packet. Inside the packet will be a printout of the results from the evaluation and the written comment sheets from the students.

Please note your department may have their own policy on SPTE Results. Make sure you are aware of their policy.

How do I interpret my results?

Identifying Information

At the top of the front page, you will find the SPTE title with the semester your results were processed.  You will then find your department followed by your college.  Be sure your department is correct.  It determines the norm base used for your scores.  If it is not correct, notify us immediately (978-3384).  This is followed by your assigned ID number, course number, your college or division and your CRN.  The next few lines contain the number of students from your class who filled out the SPTE, as well as the number of sections on which your profile is based.

The Profiles and their Corresponding Norm Bases

Usually, there will be two profiles on the first page of your SPTE results.  The first profile compares your SPTE scores with the scores of everyone at your university who has used SPTE (at this time, one semester's data).  The second profile compares you with your college norms.  For WSU Liberal Arts and Sciences instructors and PSU Arts and Sciences instructors, the second profile is based on division norms.  The college/division norms are also based only on this semester's data, and as mentioned on the first page, you may not have a college/division profile due to an inadequate norm base.  We update both norms each semester.

Notes about the Scales

There are two sections to each profile: (a) the OVERALL EVALUATION along with the four scales of which it is a weighted combination (Rapport with Students, Course Value, Course Design, and Fairness of Grading); and (b) COURSE DEMANDS with its two scales (Difficulty, and Workload). The Overall Evaluation along with its associated scales may be considered measures of perceived quality, while Course Demands and its associated scales are measures of perceived course demands.

Your percentile score for each scale can be found at the top and bottom of each profile.

The SCALE Scores

Under each profile, you will find a column labeled "SCALE." The values in this column are your SCALE scores for each of the eight scales. A SCALE score is a one to ten scale with a mean of 5.5 and a standard deviation of 2. Almost everyone (99%) will fall between one and ten. Depending upon the scale, a high score indicates either a desirable score or that the instructor placed high demands upon students.

The Relationship Between the Overall Evaluation and Course Demands

We have computed the correlation coefficient between Overall Evaluation and Course Demands. The correlation was not significant. In fact, it was essentially zero (r=.04). Thus Course Demands and its associated scales should NOT be considered quality indicators.

Item Summary

On the second page of your results, you will find a summary of your scores on each item. The items are organized according to the scale (factor) to which they are related. On the far right is your raw score (Score) for that particular item; this is the mean of all your students who completed that item on the SPTE (with a 1-5 range). Next is your SCALE score (described above) for each item followed by a "plot" of your SCALE score. The SCALE scores are based upon your college or division norms when possible, and the all-university norms if no college or division norms are available. (NOTE: Items have been rescaled so that a high score always means either "socially desirable" or "difficult.")

Bias Correction

All scores (scale and item SCALES) are corrected for two sources of bias: (a) number of raters (roughly your class size) and (b) a priori student motivation. This correction results in NO correlation between the SPTE Scales/Items and either the number of raters or our measure of student motivation.

For more information, click on Interpretation Guide or the Technical Guide

Are there documents regarding the results?

To access the various documents regarding SPTE Results, click Results.

I still don't understand my results where can I find help?

Please contact us. We can talk to you personally, as well as conduct workshops if enough people are interested.

What do I use for Tenure & Promotion, Salary Evaluation, etc.?

We believe strongly that SPTE or any other measure of students perceptions of teaching effectiveness should not be the ONLY data used for teaching evaluation. While student perceptions of teaching quality should play a significant role in teaching evaluation, the use of other data such as course materials, peer evaluation, syllabi, graded exams and papers, etc. is essential.

When using SPTE for evaluation, it is our opinion that the first page of your results (the profiles) is appropriate for such purposes. The second page (the item summary) IS NOT appropriate for Tenure - Promotion or Salary decisions. Items have less stability, less variance and are more susceptible to chance variation. The item summary is intended only for your formative use.

Is there more information on how the results are compiled?

Yes, more information is found in the Technical Guide.

My students have to take this class, will my results be low?

Previous research demonstrates that students who have low motivation to take a course will consequently report poorer evaluations of instructors of those courses. Therefore, SPTE results are corrected for student motivation. The SPTE motivation scale is measured during SPTE administration (later in the semester). We have wondered how accurate students are in reporting their a priori motivation (their motivation to take the course before registering for the course) after considerable exposure to the course and instructor. So during the Fall 1996 and Spring 1997 semesters, 193 sections administered motivation assessments to 5,154 students on the first day of classes (our "true" a priori motivation measure). We are now comparing this to the SPTE motivation measure. Data analysis of the combined semesters has not yet been completed, but preliminary analysis indicates that the correlation between the a priori and SPTE motivation scales is .85. Apparently it does not matter how late in the semester student motivation is measured.

Instructors may be interested in the data we collected on the amount of information students hear about classes and instructors before they take the class. According to our data, 47% of students reported hearing no word of mouth@ information about the course and 64% reported hearing nothing about the instructor. Less than 1% of students reported hearing a great deal about the course, while 11% reported hearing a great deal about the instructor. For students who reported hearing anything about the class or instructor, 86% reported hearing neutral-to-favorable information about the course, while 90% reported hearing neutral-to-favorable information about the instructor. Apparently our students do not bad-mouth instructors as much as some suspect. Only 25% of students who had heard information about a course (22% for those reporting hearing information about the instructor) reported that the information had an impact on their decision to take that course. We speculate that these percentages are particularly low at Wichita State University because of the high percentage of students who commute to school and presumably have relatively little communication with other students.

My class is a difficult class, will my results be low?

Not necessarily. We have computed the correlation coefficient between Overall Evaluation and Course Demands. The correlation was not significant. In fact, it was essentially zero (r=.04). Thus Course Demands and its associated scales should NOT be considered quality indicators.

My class is large, will my results be affected?

If left uncorrected, class size can affect student ratings (it is modestly correlated with the ratings students give their instructors). Instructors with larger classes tend to get lower ratings by their students. Instructors with smaller classes tend to get higher ratings.

To deal with this, (since class size is rarely in the control of the instructor), all SPTE results are corrected for class size using the number of raters as an approximate measure of the class size. In other words, when you receive your SPTE results, they are completely unrelated to the number of people in your class who completed the SPTE.

On another note, if less than four students had been able to complete the SPTE, you will not receive SPTE results. In order to protect the anonymity of the students as much as possible, we do not generate SPTE results for less than four raters.

My class is small can I be evaluated?

SPTE results are not generated for classes that have fewer than 4 raters. This was done primarily to protect student anonymity. Also, the class means are not as meaningful for small classes and not a good representative of large class perception if only 3 people fill out the SPTE. The cutoff of 4 raters was chosen because it seemed like a good number to help with student anonymity. However, we are discussing what could be done for those low enrolled courses.

Do you take for granted that students are going to take evaluation seriously?

No, we do not take for granted that students are not taking the evaluation seriously. Therefore, we have two items on the SPTE instrument to check for random marking. If a student misses either of these 2 check points, that evaluation is removed.

The number of raters posted on my results were less than the number of students present on administration day. Why?

The lower number may be for a couple of reasons. Students may have chosen not to fill out an evaluation. They may have used ink to
fill out the form instead of pencil. Lastly, they may have missed filling out the form properly. (see FAQ above)

Why were there less comment sheets than raters?

There typically is not a 1 to 1 ratio between number of student raters and comments. You may have students who choose not to leave
comments.

I/my department/my university is interested in the SPTE wherecan I receive more information?

We would be happy to provide you with more information. Just e-mail us that request, or you can contact us through other means listed below.