Ó the Journal of Behavioral and Applied Management – Summer/Fall 2001 – Vol. 3(1) Page 3

Comparison Of Campus And Distance Undergraduate Leadership Students’ Attitudes
Susan Fritz
University of Nebraska-Lincoln
Terri Jo Bek
Nebraska College of Technical Agriculture
David L. Hall
University of Nebraska-Lincoln

ABSTRACT

Among the many questions faculty pose about distance delivery are concerns about the quality of students’ learning experiences.  Specifically, when comparing distance delivery to classroom delivery, is the education as effective, is satisfaction as high, and can distance delivery accommodate all types of learning styles, classes, and subjects? This study explored some of these questions by comparing the pre and post-test attitudes of students enrolled in a satellite-delivered, undergraduate leadership course and experiencing the course at a distance or on the campus. The results indicate that overall students in the distance class reported less attitudinal change, were less satisfied with their interaction with the instructor and peers, felt the majority of the teaching methods were less effective, and their course evaluations were lower than their peers in the campus class. Recommendations were made for student orientation to distance technologies and instructional design expertise to vary interaction strategies.

Introduction

The public expects education to be accessible in the workplace, marketplace, and home, as well as in traditional educational settings (Nebraska Network 21 Project Team, 1995).  These expectations are increasingly met by using technology to deliver both credit and non-credit education via distance.  A recent article in the Chronicle of Higher Education reported that distance delivery, as an industry, has moved from barely existing three years prior to an activity level described as “dizzying” (April 9, 1999, A27).  Research conducted in 1997 and 1998 indicated 44% of two-year and four-year higher education institutions were offering distance education courses, up 11% from a previous study in 1995 (Lewis, Snow, Farris, Levin & Greene, 1999).  With the increase in distance offerings have come concerns voiced by stakeholder groups (e.g. the public, the legislature, and consumers) about the quality of off-campus course offerings (Olcott, 1991; 1999).

Research has determined faculty and students also have concerns about course quality (The Institute for Higher Education Policy, 1999). Miller and Pilcher’s (1999) study of students and faculty in a college of agriculture found both groups perceived off-campus courses to be of lower quality than on-campus courses.  They concluded that if off-campus courses are to be offered, emphasis must be placed on “improving the production, quality control, and distribution systems for courses and course materials (p. 375).”  A meta-analysis of research studies regarding the effectiveness of distance courses (telecourses) determined instructional features which impacted learner achievement were the kind of interaction during the broadcast, the kind of course and the kind of remote site (Machtmes & Asher, 2000).

Ó the Journal of Behavioral and Applied Management – Summer/Fall 2001 – Vol. 3(1) Page 4

In the conversion from classroom based to distance delivery, the instructor must consider a number of issues related to quality, and of paramount concern is the issue of social interaction (Cyrs & Conway, 1997).  Social interaction in distance education traditionally described a process between the student and instructor that was mediated via correspondence.  Unfortunately, this method of delivery has been plagued with problems associated with the student’s sense of isolation and lack of affiliation contributing to drop out rates in correspondence courses of between 40 to 90 percent (Garrison, 1989).

To combat the problems associated with mail-delayed correspondence teacher-student communications and to capitalize on emerging technology, distance education now encompasses a broader array of communication forms.  One form, the interactive satellite system, is believed to most closely replicate a “real classroom” environment for the off-campus student partially because of the increased potential for social interaction.  For the off-campus student, this delivery method greatly enhanced both student-to-student and student-to-instructor interaction.  Unlike some other forms of distance delivery it offers the student and teacher the opportunity for synchronous social interaction bridging the gap of distance (Dille & Mezack, 1992).  Enhanced social interaction is predicted to have the potential to increase the perception of quality and to lower notoriously high drop out rates because students may not feel as isolated or alienated by the delivery system.

The University of Nebraska, much like other institutions of higher education, is recognizing the need to convert classroom-based courses to distance offerings to meet learner demands for educational opportunities throughout the state (Schauer, Rockwell, Fritz & Marx, 1998a & b). This study focuses on student reaction to a formerly classroom-based leadership course that was converted to a campus/distance offering.

The subject of leadership is one in which the process of teaching the subject, and social interaction of the students is almost as important as the material or medium that is being used (Cini, 1998).  For this reason, naturally questions arose regarding whether leadership courses that are taught from a distance are as effective, and students are as satisfied, as when they are taught in a traditional classroom.  Therefore, comparisons were made of campus and distance undergraduate leadership students’ attitudes towards the following:

1)     The impact of the course on the likelihood of student involvement in the classroom, on campus and in the community;
2)     Distance technology;
3)     Teaching methods;
4)     Comfort level prior to and after experiencing the distance-delivered course; and
5)     Course evaluations.

Ó the Journal of Behavioral and Applied Management – Summer/Fall 2001 – Vol. 3(1) Page 5

Methodology

Annually, faculty in the Department of Agricultural Leadership, Education and Communication, University of Nebraska, teach a course entitled “Interpersonal Skills for Leadership” to more than 600 undergraduate students on campus.  The course fulfills a communication requirement in several colleges and is widely subscribed.  Because of the reputation and impact of the course, Nebraska College of Technical Agriculture, a sister campus and two-year college located at the opposite end of the state, contracted with the Department of Agricultural Leadership, Education and Communication to deliver the course to their campus via satellite for credit from their institution.

Twenty-three University of Nebraska students (on campus) and 18 Nebraska College of Technical Agriculture students (distance) registered for the course.  The course was delivered via satellite with two-way audio and one-way video transmission, and no distance site facilitation.  Synchronous student-to-student and student-to-teacher interaction was achieved through suspended microphones in the campus classroom, and a “push-to-talk” microphone located in the center of the distance students’ classroom.  Assignments and course expectations were equal for both groups of students.  (For example, students in both classes were expected to submit weekly journal entries to the instructor via e-mail.) Two weeks into the semester, two campus students dropped the course; 21 campus and 18 distance students completed the course.

A quasi-experimental pre, post test design was used to measure campus and distance undergraduate leadership students’ attitudes towards the impact of the course on the likelihood of their student involvement in the classroom, on campus, and in the community, attitudes toward distance technology, teaching methods, comfort level prior to and after experiencing the distance-delivered course, and comparisons of course evaluations (Campbell & Stanley, 1963).  While sample size was small, the students in the study represented all of those who enrolled and completed a leadership course.  Variances in instructor, assignments, and grading were controlled, however, sample size, and related generalizability, was a study limitation.

One component of the survey was designed by Foster and Fritz (1992) to measure the likelihood of student involvement in the areas of:  (1) academic (classroom) setting, (2) university organizations, (3) social organizations, (4) volunteerism, (5) organizations related to their major, and (6) community activities (non-university).   Each subscale contained statements that related to dimensions of involvement.  A Likert-scale was used, with “1” indicating “not likely” to participate, “3” indicating “moderately likely” to participate, and “5” indicating “highly likely” to participate.   These statements were randomly dispersed throughout the survey.   Responses were collapsed into six subscales.

A jury of University of Nebraska faculty members reviewed the survey to establish face validity.  A Cronbach Alpha of r=. 94 was calculated for the entire survey, indicating a highly reliable data collection instrument.

Ó the Journal of Behavioral and Applied Management – Summer/Fall 2001 – Vol. 3(1) Page 6

In addition to the pre-test items, the post-test also contained statements that measured the:  (1) attitudes toward distance education,  (2) attitudes toward teaching methods used, and (3) comfort level of students before and after the class in regards to distance delivered courses.   Attitudes toward distance education were measured with a series of eight statements.  The instructions for this section are as follows:  “You have just completed Interpersonal Skills for Leadership using distance education methodology.  Please think about your learning experience and hypothesize how it would compare to a learning experience in a traditional classroom.  In other words, do you feel that the distance education format provided education experiences that were better than, equal to, or less than educational experiences in a traditional classroom?” The eight questions could be answered on a three point scale with “1” being “better than”, “2” being “equal to”, and “3” being “less than”.  Two open-ended questions were include that allowed the students to write openly about their feelings toward this learning experience, and to suggest any strategies that might have enhanced their learning experience.

A Likert scale was used to measure the students’ attitudes towards different teaching methods used throughout the semester.  Twelve statements were used to measure the attitudes with a “1” indicating “quite unsuccessful”, “3” indicating “somewhat unsuccessful”, and a “5” indicating “not applicable”.  A question was included to give the students an opportunity to makes suggestions on different teaching methods that might be helpful.

The students were asked to use a one through five Likert scale to measure the students comfort level at the end of the course, and also asked to answer the same statement on another one through five Likert scale that measured their comfort level at the start of the course.  Both of the Likert scales had “1” indicating “very comfortable”, “3” indicating “uncomfortable”, and “5” indicating “not applicable”.  A question was included that allowed students to describe any problems they may have had with the distance learning methodology.

Students evaluated the course at the end of the semester using the Course Instructor Evaluation Questionnaire (CIEQ).  The CIEQ contains 21 Likert items with “l” indicating “strongly agree”, “2” indicating “agree”, “3” indicating “disagree” and “4” indicating “strongly disagree.”  The 21 items are collapsed into five subscales: general attitude, method, content, interest, and instructor.  The first four subscales are comprised of four (each) of the 21 items, the fifth subscale, instructor, is comprised of five items.

Collection of the Data

Students completed the survey during the first week of classes.  The post-test was given during the final week of classes, prior to final examinations  (Fritz & Foster, 1992).  The post-test contained the same questions that were asked on the pre-test, with areas added on the post-test measuring students’ attitudes toward distance education, teaching methods, and their comfort level before and after the class in regards to distance delivered courses.

 Ó the Journal of Behavioral and Applied Management – Summer/Fall 2001 – Vol. 3(1) Page 7

Once the instruments were administrated and collected, coding of the data was done so the information could be entered into SPSS.  Students completed the CIEQ at the end of the semester.  This information was coded and analyzed as well.  Significance for this study was set at .05.

Analysis of Data

Once the data was coded and entered into SPSS, a comparison of overall, campus, and distance pre-test means were computed for the following subscales:  (1) academic (classroom) setting, (2) university organizations, (3) social organizations, (4) volunteerism, (5) organizations related to their major, and (6) community activities (non-university).  T-test comparisons were made of the overall, campus, and distance post-test subscale means.

The post-test examined the attitudes of on-campus and distance students towards distance education, teaching methods, and comfort level of students before and after the class with regard to distance-delivered courses. Chi-square comparisons of student attitudes toward distance technology were computed.

An ANOVA comparison was used to contrast the comfort level of on campus and distance students prior to, and after the distance-delivered course.  ANOVA was also used to compare on-campus and distance student evaluations of the general attitude, method, content, interest and the instructor.

Findings

Student Involvement

Campus student pre-test mean scores were significantly higher than distance mean scores on the subscales of university organizations and social organizations.  Campus student post-test scores on the subscales academic involvement, university organizations, social organizations, and organizations related to major were significantly higher than distance student mean scores.

 Ó the Journal of Behavioral and Applied Management – Summer/Fall 2001 – Vol. 3(1) Page 8

Distance Technology

Distance students reported significantly less learning in the class than the campus students did, and significantly less change in their opinions.  Distance students reported significantly less interaction with the instructor than campus students.  Distance students also reported significantly less interaction with other participants than campus students.