Comparison of tools
Of the 50 students completing the survey, only 26% (N = 13) reported using Twitter to support learning during their undergraduate studies in comparison to 42% (N = 21) reporting using forums. Chi-Square analysis revealed there was no significant association between use of the two technologies (χ2 (1) = .124, p = .724) meaning that whether a student engaged with one tool did not relate to whether they used the other. Overall ratings for Twitter and forums as learning tools did differ significantly (t (45) = 2.0418, p = .0471) with Twitter receiving significantly higher ratings (mean ± SEM = 4.64 ± 0.23) in comparison to forums (3.76 ± 0.26).
General approaches to using forums
Of the 21 students who had previously used online forums to support learning, for the majority (42.9%) of students this forum use was part of both formal teaching and independent learning, whilst 38.1% reported only using them as part of formal teaching and 19.0% using them exclusively for independent study. Of those using forums 80.9% report using forums provided by the university, whilst 71.4% reported using forums on social media associated with their course e.g. Facebook groups and 42.9% report using forums that have no association to their programme or course.
When asked about the types of interactions they engaged with on forums the around one quarter reported never interacting with teaching staff (28.6%) or others (25.0%) (Fig. 1) whilst only 4.8% reported no interaction with their peers. The most common type of interaction was with peers, with 62% engaging in this type of interaction always or often.
Examining the types of uses students reported for forums shows that the most common uses, where students report using forums often or always, were module discussions (57.1%), accessing additional material from peers (52.4%) and assessment support (52.4%). The least common uses were to access additional material from others (38.1%) or to find relevant news/media information (42.8%) (Fig. 2).
Students were asked to indicate whether they had used forums to support specific types of learning outcomes. The majority (90.5%) had used forums to support knowledge and understanding, for development of key skills (87.5%) and cognitive skills (87.5%). Fewer students reported use for professional and practice skills learning (71.4%). Of those using forums to support a specific type of learning outcome, the ratings of effectiveness varied considerably. For knowledge and understanding, all students felt it had some degree of effectiveness (63.1% Extremely effective; 31.6% Very effective and 5.2% Moderately effective). A similar pattern was found for key skills (27.8% Extremely effective; 33.3% Very effective and 33.3% Moderately effective; 5.6% Somewhat effective). However, for cognitive skills a small percentage did find forum use to be not all effective (5.6%) with the remainder seeing it as having a range of degrees of effectiveness (27.8% Extremely effective, 38.9% Very effective, 16.7% Moderately effective, 11.1% Slightly effective). A similar pattern was found for professional and practice skills (26.7% Extremely effective, 26.7% Very effective, 26.7% Moderately effective, 6.7% Slightly effective, 13.3% Not at all effective).
Factors predicting forum use in current users
Correlation and backward regression were conducted on the factors that may predict the overall rating of forums for learning. Significant correlations were found for only two factors ‘Enjoyable to use ‘Improved grades’ (Table 1). At the first step, a model comprising ‘Improved grades’ and ‘Enjoyable to use’ explained 50.5% of variance in attitude towards forums (R2 = .505, Model F (2, 18) = 11.192, p = .001). No variables were removed. Within this model, ‘Improved grades’ (B = .527, p = .015) and ‘Enjoyable to use’ (B = .370, p = .034) were both positive predictors of ratings for using forums (Table 2).
Table 1 Correlates between overall ratings of online forums as a learning tool and beliefs about how it is used and the perceived impact. In all cases N = 21 *p < .05 **p < 0.001 Table 2 Final multiple regression model: predictors of rating of forums as a learning tool. *p < .05 Factors predicting forum use in non-users
Significant correlations were found between the overall rating of forums as a learning tool and i) Knowledge staff write posts ii) Supports learning outcomes iii) Skills working with peers iv) Skills working with staff v) Comfort on difficult issues vi) Improved understanding vii) Comfort asking questions viii) Enjoyable to use ix) Consideration of others views and x) Improved grades (Table 3). At the first step, these variables explained 82.4% of variance in their rating of forums as a learning tool (Adjusted R2 = .824, Model F (10, 28) = 14.116, p < .001). Removing all variable except ‘Comfort on difficult issues’ and ‘Improved grades’ through a stepped process did not significantly improve the predictive power of the model but did create a more parsimonious model, whereby these final two variables accounted for 83.1% of the variance in forum ratings (Adjusted R2 = .831, Model F (2, 28) = 70.033, p < .001) (Table 4).
Table 3 Correlates between overall ratings of online forums as a learning tool and beliefs about how it is used and the perceived impact. In all cases N = 29 *p < .05 **p < 0.001 Table 4 Final multiple regression model: predictors of rating of forums as a learning tool. *p < .01 **p < .001 Comparison of the ratings given by users and non-users showed that there were no significant differences between scores for any variable once the Bonferroni correction was applied. However, there were some differences where p < .05 is employed, noted because of the conservative nature of the correction. Non-users rated the likely improvements in working with others (t (48) =2.066, p = .044) and understanding different viewpoints (t (48) =2.131, p = .038) more highly than users. They also gave an overall higher rating for forums as a learning tool (t (48) = 2.668, p = .01).
General approaches to using twitter
Of the 13 students using Twitter to support their learning, most (92.3%) reported that this had been part of their independent study rather than structured within their formal teaching (7.7%). Most students (92.3%) also reported having a single twitter account that they used for both personal and study purposes. Only one student (7.7%) stated that they have multiple accounts, although they did not distinguish between them in terms of uses. When asked about the types of interactions they engaged with on twitter the majority (66.7%) reported no interaction with teaching staff at all (Fig. 3) and around one third (30.8%) reported no interaction with their peers. The most common type of interaction, which was engaged with often or always (38.5% total) was with others outside of their programme.
This pattern of interaction is not particularly surprising when the main uses of Twitter are examined. The most common uses, where students indicate they engage with this use often or always were accessing relevant news/media information (69.3%) or access additional material from others (38.5%). This was followed by taking part in module discussions (30.8%). The least common use was to obtain assessment support (7.7%), additional material from their teacher (15.4%) or administrative information (15.4%) (Fig. 4).
Students were asked to indicate whether they had used Twitter for learning to support specific types of learning outcomes. Over three-quarters (79.9%) had used twitter to support knowledge and understanding learning outcomes and 61.5% had used it for development of key skills. Fewer students reported use for professional and practice skills learning (53.8%) and cognitive skills (46.1%). Of those who reported using Twitter to support knowledge and understanding there was a range of beliefs about its effectiveness, with 30% stating it was extremely effective, 30% considering moderately effective and a further 30% considering it slightly effective and only 10% considering not effective at all. For cognitive skills 16.7% of those who had used it for the purpose felt it was moderately effective whilst the remaining 83.3% felt it only slightly effective. For key skills the majority of those using it felt it to be moderately effective (62.5%) with the remaining equally split across very effective, slightly effective and not effective at all. Finally, for professional and practical skills, of those using it in this way the majority felt it was moderately effective (71.4%) with the remaining equally split between extremely effective and not at all effective.
Factors predicting twitter use in current users
Pearson’s correlations between each hypothesised predictor variable and the Twitter rating were identified (Table 5). Significant correlates (p < .05) were used in a multiple regression model. At the first step, a model comprising ‘Skills working with peers’ and ‘Enjoyable to use’ explained 36.3% of variance in their rating of Twitter as a learning tool (Adjusted R2 = .363, Model F (2, 10) = 4.422, p = .042). Removing ‘Enjoyable to use’ at the second step did not improve the predictive power of the model but created a more parsimonious model, which explained 41.7% of variance in rating (Adjusted R2 = .417, F change = .064, p = .806; Model F (2, 10) = 9.598, p = .010). Within this model, ‘Skills working with peers’ (B = .636, p = .010) was a positive predictor of ratings for using twitter (Table 6).
Table 5 Correlates between overall ratings of twitter as a learning tool and possible factors predicting use in current users. In all cases N = 13 *p < .05 **p < 0.001 Table 6 Final multiple regression model: predictors of rating of Twitter as a learning tool in current users. **p = .01 Factors predicting twitter use in non-users
Significant correlations were found between the overall rating of Twitter as a learning tool and i) Knowledge other students read posts i) Efficiency of large group communication iii) Skills working with peers iv) Skills working with staff v) Comfort on difficult issues vi) Improved understanding vii) Comfort asking questions viii) Enjoyable to use ix) Consideration of others views and x) Improved grades (Table 7). These variables were therefore entered into a regression. At the first step, these variables explained 76.3% of variance in their rating of Twitter as a learning tool (Adjusted R2 = .763, Model F (11, 36) = 11.539, p < .001). Removing posts i) Knowledge other students read posts ii) Efficiency of large group communication iv) Improved understanding v) Comfort asking questions vi) Enjoyable to use vii) Consideration of others views in subsequent did not improve the predictive power of the model but created a more parsimonious model containing only i) skills working with staff, ii) discussion of sensitive and controversial issues and iii) improve grades accounting for 80.1% of the variance in twitter rates (Adjusted R2 = .801, Model F (3, 33) = 49.231, p < .001) (Table 8).
Table 7 Correlates between overall ratings of twitter as a learning tool and possible factors predicting use in non-users. In all cases N = 37. *p < .05 **p < 0.001 Table 8 Final multiple regression model: predictors of rating of Twitter as a learning tool in non-users. *p < .05 **p < .001 Comparisons of the ratings given by users and non-users showed that there were no significant differences between scores for any variable once the Bonferroni correction was applied. Given the conservative nature of the correction, it is noteworthy that there were some differences where p < .05. Current Twitter users rated the importance of expectations of staff (t (48) =2.122, p = .039), the knowledge that staff read posts (t (48) =2.727, p = .009) and that staff wrote posts (t (48) = 2.196, p = .0033) more highly than non-users.