Introduction
The acquisition of skills in administration and leadership is one of the most important needs is nursing education identified in recent studies 1 and has a clear repercussion for the present and future of the profession. (2 Because of this, numerous educational institutions include this training in their pre- and postgraduate training programs in nursing and other healthcare professions.3
Recently, various international organizations have asked for innovative reforms in the teaching methodology used in the education of the health professions and there are quality studies that indicate that these reforms can be very positive.4 However, teaching and assessment methodology is not always enough innovative in our institution and in other nursing education institutions around the world.5
Furthermore, since the implementation of the European Higher Education Area, assessment has become a challenge of great complexity for teachers at European universities, as it involves making assessment a “tool for improvement” (6 and not only a system of control. Many and varied initiatives have been carried out in this regard, from the use of portfolios 7 and/or rubrics 8 to the holding of simulated congresses,9 debates,10 and even the design and use of blogs as a tool for teaching and evaluation.11
In fact, evaluation is one of the aspects of education that most generates dissatisfaction among university students. 12 In nursing, on top of this discomfort students have unpleasant experiences in clinical settings, such as the lack of connection with clinical mentors 13 or the mismatch between the teaching received at university and the real examples, 14 which can be particularly relevant in the case of leadership and management because many students don’t understand very well how this content fits into the nursing educational program.
Implementing various technologies and allowing students to participate in experience-based learning and teamwork activities fulfils the needs of millennial students, who are adept at using scientific technology. 15
It therefore seems important that university teachers of nursing make an additional effort to ensure that their students have a positive experience of their learning about management and leadership. This can imply personal work by teachers in increasing their credibility as leaders 16 as well as a review of the teaching methods deployed, including assessment.
Flipped learning is a student-centered model in which professor becomes a facilitator of learning, as it requires them to study the material before the class take place. From this way, the class will not be oriented to an explanation of the theorical contents; it focuses on student’s participation, collaboration, and debate with classmates and resolution of doubts.17 The flipped learning encouraged the students to be motivated and led to self-directed learning. The findings from the survey provide the opportunity to elicit a holistic understanding of the students’ views and experiences 18) and encourages students to actively engage in learning on a deeper level than a more traditional lecture might. 19
A recent change in the assessment regulations of the University of Huelva has provided an opportunity for researchers to carry out an initiative of teaching and assessment innovation in the subject Administration and Management of Nursing Services (AGSE, according to its initials in Spanish) in the third year of the degree in nursing at the University of Huelva. The innovation consisted of the use of a gradual introduction of the flipped method and the carrying out of partial exams. The gradual introduction of this teaching method, new in this context, allows teachers and students’ adaptation to changes. (20
The objective of this study is to describe the students’ perception of a teaching innovation based on the use of the flipped classroom and continuous assessment through partial exams. It also seeks to know the students’ own evaluation of the teaching material used, and to evaluate how students have experienced the new system of assessment.
Methodology
Design
Qualitative study, by means of an anonymous survey, which analyses the perceptions and experiences of nursing students who had have taken the AGSE course during the 2019/20 academic year.
Study population
The population studied comprised all the students (140) enrolled in the AGSE course of the third year of the degree in nursing at the University of Huelva during the 2019/20 academic year.
Teaching intervention
Before class. Accordingly, with flipped method, students were able to access to lectures and videos online while at home before each class when the professor is available. A week before each face-to-face teaching session, various notes written ad hoc by the main teacher, as well as complementary materials (scientific articles, institutional documents, videos, etc.), were made available to the students (on the Moodle platform).
In class. The face-to-face sessions were oriented to active learning and dedicated to resolving students’ questions about their out-of-class autonomous work (based on the notes and other materials provided). Also, were class sessions in small (learning) groups, dedicated to do practical sessions on several subjects (use of digital tools in management, communication skills, etc.).
After class. Digital ways of communication (email and Moodle forms) were always open to continue to work on the contents treated in class.
The assessment of the large groups was made through two partial exams (week 4 and week 9), comprised of test-type questions, which were carried out online through the Moodle platform, with students receiving their grades immediately after handing in their exams.
For a more detailed description of the module program see Annex 1.
Material and method
The research was conducted using qualitative research paradigm base on description of the perception as presented by participants. 21 This approach reveals several main themes that were codify and categorized in concepts and categories to reflect relevant components.
The data collection instrument was an anonymous self-completing survey that the students completed on-line. Students’ satisfaction with traditional and flipped classroom formats was measured at the end of the course, measured as El-Banna et al. 22 using 8 questions (related to the previous education of the students, the methodology employed, and the system of evaluation), and 10 open questions (on content covered, organization of teaching, and available resources) adopted from the standard university course evaluation. Demographic data were collected with 3 questions: sex, age and previous training in health.
Data analysis
The sociodemographic data and the responses to the dichotomous questions were put into an Excel sheet of the Microsoft Office software and analysed with the SPSS statistical software, version 23. For the descriptive analysis, the categorical variables have been shown in frequencies and percentages, and the quantitative ones in averages and standard deviations.
The answers to the open-ended questions were entered into an Excel spreadsheet. After a detailed reading by the research team, based on the manifest content of the questions, the existing relationships between the units of meaning were identified and grouped according to subcategories, categories, and themes, with their respective codes. This allowed the synthesis of the information through reduction and grouping of the data and facilitated the triangulation of the data, to obtain the maximum yield of the information.23 Three main categories emerged: evaluation of the content covered, evaluation of the organization of the teaching, and evaluation of the available resources.
Results
Sociodemographic data
A total of 112 students (80 % of the total of 140) answered the survey, of which 77.7 % (87) were women and 22.3 % (25) men. The average age was 22.47±5.65, with the youngest participant 19 years old and the oldest 57. Out of all of them, 37.5 % (42) had received previous training in health sciences.
Assessment of the teaching methodology and the evaluation system used
Some 87.5 % of the students said that studying the material before attending the classroom helped them acquire knowledge, 88.4 % indicated that they thought that this methodology would give them greater security in applying knowledge safely in practice, and 87.5 % considered that it had helped them to cope with the exam. In terms of satisfaction, 92 % showed themselves to be satisfied with the teaching methodology and 92.9 % with the assessment. Only 31.5 % had used it before, however 83 % would like to use it in more courses (Table 1).
The comparison of these answers grouping students by sex did not show any statistically significant differences (Table 2) and nor were statistically significant differences found when comparing the replies of students with or without previous education in health sciences (Table 3). There were also no significant differences when comparing the average ages of the students with favourable and unfavourable responses to the methodology used (Table 4).
Assessment of the content covered, the organizing of teaching, and the available resources
Responses to the open questions were very homogenous, which expresses a consensus among the students about the fundamental aspects of the teaching.
Content covered
Being a subject that at first sight struck them as “dense”, “boring”, or “complex”, for being - in the opinion of the students - “a long way from a nurse’s typical work”, many students comment that thanks to the methodology used it has become more practical: “The way of teaching the material has improved the subject.”
Regarding the sequence of the topics, the students indicate that the second part of the curriculum (dedicated to the administrative process) is generally harder to understand, while the first part (the health system) was more accessible in general.
Asked if they would include or eliminate any of the topics, the students found no need to change the program, add or remove topics, although some did advise revising specific topics where the extent and complexity of the content could be slightly reduced.
Organization of the teaching
Regarding this question the answer was generally positive, with assessments including terms such as “scheduled”, “organized”, “fulfilled the timetable”, “use of partial exams”. The only thing they considered to be lacking, on the part of the University, was greater agility in contracting teachers to cover the leave of absence of one of the tenured teachers, a topic that was unconnected to the course itself.
In terms of the theoretical classes given in large groups, there was unanimity in assessing them positively, highlighting “the dynamism”, “good organization of time and subject matter”, “practicality”. “Having to read the topics to ask questions rather obliges you to study, which helps you understand the class better.” We found “enjoyable” and “entertaining” to be the most repeated adjectives, from which it seems that the approach of the theoretical courses has been successful and well received by the students.
Regarding the interview with the nurse manager, we found the most unanimous and positive opinions among all the questions asked: “for me it has been like seeing the reality of everything we have talked about during the course, so I believe it was of great interest.” The students consider that it has been “very useful”, “necessary”, “has clarified abstract concepts”, and give a very high evaluation of the ability of the interview to get bring the professional reality of nursing management closer to university classrooms.
Available resources
The technological media used (the Moodle platform and the computers and mobile telephones of the students) were evaluated as necessary, as they “bring the social reality of the use of technologies in daily and work situations into the university context.” The immediacy provided by the technology was particularly well rated: “The use of computers for the exam and to be able to see the grade immediately has been good.”
There were different opinions about the notes available in Moodle, more centered on the type of topic than the notes themselves: “The pre-written notes were complete and understandable. The ones we had to do ourselves were more complex because we did not know what was important.”
Other comments
The final question in the survey asked students to make any other comment they considered relevant for the assessment of the teaching and organization of this course. Of the responses, we would emphasize that the students focused on highlighting the good teaching practices and the assessment methodology used: “I have particularly liked the method of assessment, as it is a simpler way to pass the course and I also think that one learns a lot more studying little by little than in one single exam at the end of the course”; “in terms of teaching, I have found the classes enjoyable and interesting, as in my opinion it is very useful to bring the read material to class and resolve questions about it.”
We thus find that most of the suggestions made by the students are aimed at implementing the methodology of this course in others in the nursing degree, and to not cease from applying this method to AGSE in future academic years: “It has been a very positive experience and I think that it should be taken into account in other courses, as the use of a methodology that obliges you to study the course every day has been very appropriate”; “I would invite the teacher to continue with continuous assessment and propose it for the other courses. This is the first time we have done it in my career, and it seems to me to be a good method”; “all the courses of nursing should follow this methodology. Better results would be achieved, and more learning would be obtained, which is what is most important. My congratulations to the teachers for carrying out this type of methodology.”
Discussion and conclusión
This study aims to improve our knowledge about the students’ perception of a teaching innovation based on the use of the flipped classroom and continuous assessment through partial exams.
Its main limitation is that it has only been possible to study the methodology-teacher-student interaction in a group of students of the same subject, so it would be convenient to carry out this same innovative experience with other groups of students and teachers in the same context -and in different contexts- and evaluate the differences.
Our findings are consistent with other studies (using quantitative, qualitative, and mixed methods) showing the satisfaction of the students with the flipped method and with the innovations introduced in the method of assessment. These evaluations by the students seems to be independent of sex, age, and previous education in health sciences.
It is necessary to highlight the high level of response to the survey by the students (80 %), which is in line with that registered in other studies of perceptions and satisfaction of students with various teaching and assessment methods in Spain 24 and very much higher than those carried out in other contexts. 25-26
Different studies have investigated the satisfaction of university students with flipped method. The results are mixed, but in general a certain resistance to change among students is detected. Thus, Betihavas et al. 27 conducted a systematic review that indicated favourable or neutral results in terms of the repercussion of this methodology in academic performance and more variable results in relation to satisfaction (this review did not include any study carried out in Spain). Bingen et al. 20 also identified resistance from nursing students to the implementation of the practice of the flipped classroom.
However, as in other studies, 28 a large percentage of our participants (92 %) showed themselves to be satisfied with the new methodology that was applied. This is consistent with recent wide literature review. 29 Similarly, as in the study by Green & Schlairet 30 with students of the same age, our students associated the flipped classroom with positive experiences. We think that these differences with the studies that indicate unfavourable results in satisfaction can be attributed to the fact that 31.5 % of our students had already used it previously and to cultural factors (none of the studies mentioned above was carried out in Spain).
On the other hand, the most relevant outcome was that students expressed consistently that the flipped method used makes useful their learning increasing their security in applying knowledge (88.4 %), something that is very important in a non-usual subject as nursing management, first time treated by these students during the course evaluated. Other recent studies with nursing students 31 and business computing students 32 also shows findings in this way, correlating students’ satisfaction and perceived learning outcomes.
Joyce et al. 33 identified an improvement in the process of teaching in nursing using continuous assessment. In terms of the few studies of this matter carried out in our own area, our results confirm those of Fernández Ponce et al., 34 in that continuous assessment encourages the involvement of students and increases their satisfaction. We also coincide with Rozas et al. 24 in the positive assessment made by students of the speed of the response of correction in relation to their online work. This same study, and that of Craft et al., 35 as well as the meta-analysis of Liu et al.,36 also concluded that active work by the students on the content before the exam makes them feel better prepared for it.
Most of the student participants in this study showed themselves to be satisfied with the teaching and assessment methodology used. The results obtained favour and encouraged the use of the methodology employed in future academic years and in other courses of the degree in nursing, especially within a framework of virtual teaching. Furthermore, they provide a motive to continue investigating not only the perceptions of the students but also, through intervention studies, the impact of this teaching and assessment methodology on the results of the teaching-learning process in university education in nursing.