Using Learning Gain to Evaluate Undergraduate Business Education: Comparison
Please note this is a comparison between Version 1 by Martyn Polkinghorne and Version 5 by Martyn Polkinghorne.

During the COVID-19 pandemic, universities across the globe replaced in-person teaching, with online teaching, because of widespread campus shutdowns. Through the application of a pre-existing learning gain model, itf was possible to review the learning of one cohort of students receiving in-person teaching, and then the next cohort of students on the same course receiving the online teaching. Overall, a drop in perceived learning was reported from the cohort of students receiving online teaching. For female students, the most significant drop in learning related to practical understanding, whereas for male students, the most significant drop in learning related to theoretical knowledge.

  • marketing education
  • student learning
  • learning gain
  • higher education
  • teaching quality
  • marketization
  • business education

1. Introduction

Students enrolling on undergraduate degrees now are unlike any generation that has preceded them. The population cohort commonly known as Generation Z (Gen Z) were born between 1995 and 2012 [1], and this group currently forms approximately 60% of the undergraduate university students in the UK [2]. They were born into a world where Google and Wikipedia already existed. They have never known a life without computers, or the internet, and do not see these technologies as tools, but as an integral part of their everyday existence [3]. They do not even view their mobile phones as being luxury items of technology, but instead consider them to be an essential part of everyday life [4]. These students are at home with the concept of social media, and use platforms such as Snapchat and Instagram for the majority of their communication. In fact, it is a generation that has garnered significant attention for its uniqueness in comparison with previous generations [3]. Together, these factors have a direct impact upon how we market the benefits and opportunities of higher education to them.
Simultaneously, university internationalization has become an important investment for education institutions in recent decades [5][6][5,6], and this has seen the higher education sector become an active player in the global marketplace [7]. Whilst this increased number of overseas students in the UK brings much added value to ongoing issues, such as classroom diversity and tuition fee income [7][8][7,8], it further challenges the operational ‘norms’ of pedagogy, with student demands for more technological interaction and experiential learning becoming more common.
Concerted effort to increase academic adoption and integration of digital, and social media, technologies to support contemporary pedagogic practice has been evident across the sector [3]. However, whilst the landscape of higher education has embraced advancements in technology-enhanced learning (TEL), to meet the needs of the 21st-century learner, students from this generation themselves were certainly not prepared to, or expecting to, experience their undergraduate degrees entirely through online learning, which has been the primary resulting impact for them of undertaking higher education during a pandemic which forced university campuses in the UK to close for approximately 18 months.
The shift from didactic face-to-face time with students to a complete program of online learning happened literally overnight for the higher education sector, as social distancing restrictions were put into place by the government, and new terminologies, such as ‘lockdown’ and ‘the tier system’, became the norm. Educators duly faced a number of social, pedagogical, and technological challenges in this new era of learning remotely through online teaching [9]. As a result, educational institutions continue to experience unprecedented times as they navigate students’ expectations with a range of TEL tools available, while balancing this with the reality of their own institutions’ ability to deliver a high-quality educational experience for students.

2. Online Teaching Pedagogies

Takavarasha [10][11] asserts that technology is now an integral part of everyone’s lives. The 21st-century consumer is a digitally ‘savvy’ choice maker [11][12] whose expectations, motives, and experiences are socially constructed [12][13]. This is evident in higher education, where thwe researchers witness innovative technology-enhanced teaching and learning models, often driven by student demands for bespoke learning [13][14]. Technology can positively impact student learning by offering a personalized and interactive experience, thereby enabling students to take a deeper responsibility for their educational journey [14][15]. Clearly, successful teaching strategies can minimize any resulting learning anxiety [15][16]. Furthermore, these creative approaches can be adopted by higher education institutions in an attempt to build synergy with the latest trends in educational technologies [16][17]. The authors acknowledge that shifts in education, and the introduction of technology-enhanced learning, were ongoing before the arrival of the COVID-19 pandemic. However, the campus closures due the pandemic acted as a catalyst for demanding rapid change which might otherwise have taken a decade or more to achieve. As a sector, we have therefore seen a shift from didactic teaching approaches in higher education to embracing creative pedagogies centred upon enhancing the student learning experience [17][18], with tactics such as flipped classroom (students receive teaching materials beforehand so that subsequent lecture time can be used to reinforce learning) and gamification (the use of game mechanics, such as points scoring and league tables within teaching to increase student engagement) now more commonly applied. This approach complements the characteristics of the modern-day student, who demands speed, nonlinear processing and social learning [18][19], collaboration [19][20], and multitasking [20][21].

3. Learning Gain

With the ever-increasing costs of higher education tuition fees [21][22][23][22,23,24], and an opposition to student loan funding support [24][25], the value of higher education is often questioned by students [25][26][26,27] and there is growing pressure to ensure the availability of relevant metrics to support the ongoing marketization agenda [6]. As a result, educators must consider the value and impact of their own teaching [27][28][29][30][28,29,30,31], whether it is delivered face-to-face, online, or as a hybrid of both. The landscape of higher education has therefore experienced a shift which has seen more measurement and assessment of student learning outcomes. This reliance upon metrics forms part of a performativity agenda [31][32]. Within such a metric-driven environment, the learning gains of students are now considered to be key indicators of teaching and learning excellence [32][33], and whilst other metrics may only feed into the cynicism discourse (moving to a consumerist model), and the pragmatism discourse (demonstrating value to stakeholders) of teaching excellence, evaluating student learning gain both supports these, and also supports the aspirationalism discourse relating to the integrity of teaching enhancement undertaken [33][34]. A recent office for students study concluded that existing methods for determining student learning gain need more development to enable them to account for contextual and subject factors [34][35][35,36]. Andrade [36][37] proposes that the actual definition of learning gain should be for individual higher education institutions to determine, but Arico et al. assert that ‘learning gain is now prominent when considering the effectiveness of higher education’ [37][38] (p. 249). As such, our understanding of student learning gain should help us to understand how we can maximize the effectiveness of our own teaching [28][29], and how the value of our teaching may have changed with the transition from face-to-face to online teaching. Taking these considerations into account, research has been undertaken which used an alternative learning gain model first proposed by Polkinghorne et al. [38][39], and subsequently detailed by Polkinghorne et al. [39][40], which integrates both student explicit knowledge (subject learning that can be codified and verbalized as theory) and tacit understanding (experience and practical application of knowledge) to create a unique two-dimensional evaluation of student learning. Therefore, the model is suited perfectly for holistically assessing learning outcomes, and for informing the continuous improvement process [40][41] to ensure that the quality of teaching being delivered, and the resulting student learning experience, can be understood, and then improved upon year on year.

4. Using Learning Gain to Evaluate Undergraduate Business Education

EvThe learning gain modeluating was applied to cohort of business studies student learning gain can help educators to understand how student learning on as at a UK university who received in-person teaching, and the following year (during the pandemic) the same learning gain model was applied to the next cohort of business studies students on the identical course may change year on year, to direct their attention with regard to how, but this time the students were receiving online teaching. Overall, the perceived learning reported by the students who received online teaching was lower. From the results o improve specific aspects off this study, it was of particular interest that the learning process for their students, and to monitgain model used enabled the academic team to appreciate, for the effectiveness of different delivery methods such as in-person, hybrid andfirst time, that in the case of the female students, the practical side of their education was perceived to be more affected by the change to online teaching. Furthermore, evaluating student, whereas the male students reported that the more theoretical side of their learning gain can assist educators to appreciate how the effectiveness of theirwas perceived to be more affected. Such gender variations need now to be confirmed by further studies, but if true, this may have significant implications for how we teaching may vary between online to ensure equity and inclusion. Such a potential different student groupings within the overall student cohort, e.g. gender, social background and/or entry qualifiiation in learning based upon gender needs to be accounted for in the online and hybrid models of university teaching currently being used across the global higher educations sector.