key: cord-1032977-emw80a4n
authors: Namome, Catherine; Moodley, Maglin
title: ICT in mathematics education: an HLM analysis of achievement, access to and use of ICT by African Middle School Students
date: 2021-09-01
journal: SN Soc Sci
DOI: 10.1007/s43545-021-00230-6
sha: aef7ae2becf1c664a0f7768e6125b2954177fd34
doc_id: 1032977
cord_uid: emw80a4n

This study examined the influence of access to and frequent use of information and communication technology (ICT) in school and home settings on achievement in mathematics for Grades 8 and 9 African students. A large-scale international database, that of the 2015 Trends in International Mathematics and Science Study was used and hierarchical linear models were employed to examine school- and student-level variables. Findings showed that student access to ICT during a lesson was significant and a positive predictor for student learning outcomes in mathematics, while teacher integration of ICT into pedagogy as a mediating factor had a negative association. Student-level ICT predictors, for example access to ICT at home, had a positive association with student learning outcomes in mathematics, while intensity of student ICT use was a negative predictor; this applied even after controlling for age, gender, and educational resources at home.

The COVID-19 pandemic continues to redefine the way in which schools conduct teaching and learning. While the global schooling system has been greatly disrupted, the impact of the pandemic on the African schooling system has been exceedingly telling. Most African schools have been closed for prolonged periods, yet they are not equipped with information and communication technologies (ICT) to enable SN Soc Sci (2021) 1:224 224 Page 2 of 21 them to continue with teaching and learning during such disruptions. Africa needs a major impetus for education-based ICT innovation, reform and expansion for the continent's education system. Some efforts are under way to encourage the introduction and integration of information and communication technologies (ICTs) into schools, but the pace remains slow. Examples include initiatives such as ICT Transforming Education in Africa (UNESCO 2018), One Laptop per Child (Fajebe et al. 2013) , the Africa Digital Schools ICT project (Agyei and Voogt 2011) , the EdQual project (Rubagiza et al. 2011 ) and the NEPAD e-Schools Initiative (Adeosun 2010) .

Despite these initiatives, achievement in mathematics among African students has stagnated with little improvements. Figure 1 shows average mathematics achievement scores for African countries that participated in the Trends in International Mathematics and Science Study (TIMSS). South Africa and Egypt have shown some positive changes, with South Africa having earned 37 average score in the past 10 years while for Morocco the changes are minimal (17 average score). Botswana had a decline in mathematics performance in 2015. These scores remain low compared to countries in Asia or Europe.

Theory and literature suggest that student background, school and home access to and frequency of ICT use are among important determinants of educational performance (Eickelmann et al. 2012; Hu et al. 2018; Hudson and Porter 2010; Skryabin et al. 2015; Spiezia 2011) . In this paper, we test the robustness of these previous findings in an African context by constructing and estimating an education production function for Africa. The paper focuses on the relationship between mathematics achievement, school/home access to and frequency in use of ICT resources and student background characteristics. Four African countries participated in TIMSS 2015, that is, Botswana, Egypt, Morocco and South Africa are part of the current study.

A major contribution of this study to the literature relates to the influence of access to ICT and use of ICT has on student performance in an African context. The current study sheds light on the complex influences of access to ICT and its use by investigating a wide spectrum of students in Africa; therefore, the findings from this study are better suited to generalisation. In addition, by estimating hierarchical linear models (HLMs), different mediating variables are controlled at different levels and the findings are thus significant for better understanding how access to ICT and its use influences student academic achievement in mathematics.

The general research objective of this study was to determine if access to and frequency of use of ICT resources influenced the academic achievement of Grades 8 and 9 African students in mathematics. Within the context of this study, the terminology 'access to' refers to the availability of ICT resources at both the school and home settings, while 'frequency of use' refers to their rate of use of these ICT resources they have access to. The study was guided by the following research questions. Main research question: How does access to and frequency of use of ICT resources influence the academic achievement in mathematics of Grades 8 and 9

African students? Sub research questions:

1. Is student ICT access at home and school related to their mathematics performance at school? 2. What student background factors mediate the association between access to and frequency of use of ICT with mathematics achievement? 3. How does student frequency in use of ICT resources at school/home influence student mathematics achievement?

An African teacher is often characterised as the sole source and sender of knowledge through "chalk-and-talk" (Barakabitze et al. 2015) . This trajectory, however, is steadily changing. African governments are aspiring to become information societies, in part to be equal partners in the global knowledge-based economy (Ponelis and Holmner 2015 -UIS 2015) . In terms of computer density (student to computer ratio) it was reported that computers were unevenly spread, often being concentrated in the relatively few schools with basic ICT infrastructure. Furthermore, it was noted that computers were often stored and unused, for reasons which include lack of teacher training in ICT or anxiety related to computer use. In Botswana and South Africa, it is reported that student to computer ratios in primary education are 40:1 and 90:1, respectively. Computers are more frequently available for secondary education, with Botswana having a ratio of 17:1 for upper secondary and 15:1 for lower secondary education (UNESCO-UIS 2015) . South Africa, with a combined secondary education, has a ratio of 54:1 (UNESCO-UIS 2015) . For Egypt, the student (pupil) to computer ratio is 48:1 (UNESCO-UIS 2016).

This high student to computer ratio often hinders meaningful learning. Computer density remains very low in a number of African countries; for example, UNESCO-UIS (2016) reported that 49% of schools in Egypt had internet connectivity. Data on ICT remain a challenge, and we could not find relatable data on student to computer ratios for countries like Morocco. Internet access to support online learning ranges substantially across countries, and education ministries often have little or no control over internet connectivity in schools (UNESCO-UIS 2015) . Data on internet usage and computer-assisted instruction in primary and secondary schools were not available for the countries of interest.

In education, literature shows that ICTs are effective in addressing educational needs (Skryabin et al. 2015) . This has increased research on the causal and relational/associations of ICTs and education attainment. Two broad research areas have emerged: the first focuses on the causal relationship, essentially addressing the effectiveness of ICT resources on student academic achievement; the second considers the influence ICT access and use has on student academic achievement, often using crosssectional survey data. Angrist and Lavy (2002) analysed how a computerised policy affect some schools that received computers and control schools that did not. Their findings showed that after controlling for observable characteristics, use of educational computers did not have a positive effect on students test scores. In fact, the relationship between computer use and mathematics achievement in Grade 4 was negative and significant. In contrast, Banerjee et al. (2007) analysed the outcome of a randomised policy in India that aimed at improving mathematical skills, and found a positive impact on achievement scores. A similar positive impact was reported by Barrow et al. (2009) , who randomly assigned students to a computer-aided instruction programme and reported higher scores in pre-algebra and algebra tests compared to students not on the programme. Despite the potency of causal studies, other studies have tended to focus on largescale cross-sectional survey data to examine relationships between the access to ICT and its use and student academic achievement. For example, Wittwer and Senkbeil (2008) analysed the relationship between computer use at home and student achievement using the 2003 Programme for International Student Assessment (PISA). They find that students' access to a computer is not linked to performance in mathematics, but a positive influence on mathematics was observed for a small group of students who used the computer in a self-determined way where they engaged in problemsolving activities. Eickelmann et al. (2012) uses TIMSS 2007 data and applies a multi-level approach to conduct an analysis examining whether use of ICT in mathematics education in primary schools predicts mathematics achievement in Asia, Oceania and Europe. Their findings indicate a significantly positive association between computer use at home and mathematics achievement. A similar relationship was identified for computer use at school in Singapore and Australia, but there was no relationship with student achievement in Germany. Zhang and Liu (2016) investigated trends in the relationship between ICT use and students' mathematics and science achievement from five waves of the PISA data. Their findings indicate that the relationships between types of ICT use and mathematics achievement were negative in the long term when controlling for students' socio-economic status. What emerges from this review is that there is mixed evidence supporting the hypothesis of a relationship of access to ICT, use of ICT and students' mathematics achievement, from both causal and large-scale cross-sectional survey studies. However, is this relationship different within the African context? According to Bray and Tangney (2017) , the positive relationship between student achievement in mathematics and the use of ICT would only be achieved through a combination of appropriate pedagogy and ICT, and their study further reiterates that positive achievement in mathematics through the use of ICT allows for the creation of realistic problem-solving contexts. This view is further emphasised by Graham et al. (2020) who support the views of Wittwer and Senkbeil (2008) and Bray and Tangney (2017) , by highlighting that the data from the South African component of the TIMSS 2015 shows that the use of ICT in teaching can assist in improving the achievement of students.

However, their study also highlighted that for student achievement to improve, specific teacher factors like attitude, confidence and pedagogical understanding is essential. In a study conducted in Botswana, Tsayang et al. (2020) , found that ICT resources were only used for specific subjects and furthermore noted that ICT use does influence educational outcomes and that the use of technology helps students to better understand and retain subject content while improving their attitude towards learning. These findings were also correlated by Ndlovu et al. (2020) , who found that ICT if used effectively can influence student mathematics achievement. The findings showed that South African preservice teachers identified the following key factors as being essential for using ICT to influence achievement, these included: mathematics teachers must adjust to the demands and challenges of the digital era; belief in a changing mathematics teacher identity; mathematics teachers must have SN Soc Sci (2021) 1:224 224

Page 6 of 21 strong competencies to use ICT in their classroom and there should be adequate resources and proper planning. According to Garegae (2015) , Botswana's performance in TIMSS 2003 and 2007 studies confirm low performance of schools in Botswana, as it was one standard deviation below the international mean. Various studies (Garegae 2015; Tsayang et al. 2020 and Ndlovu et al. 2020 ) affirm that the use of ICT in teaching and learning can influence student achievement levels. However, Graham et al. (2020) and Umugiraneza et al. (2018) noted that even though schools within the African context may be provided with the necessary resources and teachers are technically upskilled, it does not guarantee the use of ICT in teaching, but that a series of factors eventually influences the use of ICT in teaching and learning. Berrado et al. (2009) investigated the influence of ICT in student achievement in mathematics and the sciences in Morocco and their findings showed that the influence of ICT was not consistent across all the schools, but that socio-economic and school environmental factors greatly influenced student achievement. Hence from the literature it becomes very evident that while there is a general consensus that ICT can influence teaching and learning and ultimately student achievement, there is also a school of thought in the literature that contends that there are factors both intrinsic and extrinsic to students and teachers that influences the use of ICT in teaching and learning.

Before examining the influence of access to and usage of ICT resources on student achievement, assessing the conceptual groundwork of how achievement could be influenced is important. We follow Hanushek (1979) and think of the educational system as an education production process (Carrillo et al. 2011; Erdogdu and Erdogdu 2015; Lamdin 1996) . Conceptually, we then define an education production function as Eq. (1): where for student i , Y it is the mathematics achievement test scores measured at time t , B it is a vector of student background characteristics, and S it is a vector of school ICT inputs. Vectors A it and I it denote student academic abilities, which could change over time. How then can access to ICT and its use in school and home settings influence mathematics achievement? We think there are at least two ways in which access to ICT and its use can have an influence on students' mathematics outcomes. Firstly, in school settings, provision of ICT to students through computer labs and software and training teachers in ICT professional development can improve school assets and teaching quality, which can potentially improve learning outcomes. Secondly, student exposure and access to ICT at home facilitates completion of their school homework and always being informed about their subject content. This may shift the cognitive abilities of students, allowing them to learn faster (Carrillo et al. 2011 ).

(1) Empirically, we measure the influence of ICT access and usage by estimating a linearised form of Eq. (1), which is implemented using hierarchical regressions. The equation is written as Eq. (2): where Y i is the test score of student i , T i , S i and ICT i are vectors of variables that measure teacher-, student-and ICT-related characteristics of teachers, and is the intercept. is the iid disturbance term that captures all of the unobserved factors that could influence student performance, and is specified as follows:

where and represent student time-invariant unobserved factors. If we estimated Eq. (1) by OLS, this could yield biased estimates, especially when unobserved factors are correlated with the variables in the ICT vector. This may be the case when neither teachers nor students are randomly distributed across schools (and across classes within schools), or when the use of ICT teaching practices is influenced by teachers' unobserved characteristics that could in turn influence student performance (Comi et al. 2017) .

Since students are nested within classes, using HLMs is appropriate for the analysis. Hierarchical linear modelling is a form of ordinary least squares regression that analyses variance in the outcome variable when the predictor variables are at different levels (Woltman et al. 2012 ). In the present analysis, students nested in a classroom share variance according to their teachers and classrooms (Woltman et al. 2012 ). Thus, HLM accounts for the shared variance in hierarchically structured data such as that gained from the TIMSS. The technique estimates lower-level slopes (for example, student level) and their influence in estimating higher-level outcomes (classroom level) (Goldstein 2011; Hox et al. 2017; Woltman et al. 2012) . Hence, with TIMSS data HLM would have an advantage over other regression analyses in dealing with estimation problems, for example aggregation bias or under-estimated standard errors (Skryabin et al. 2015) as cited in Lee (2000) .

Typically, the analysis begins with null models that determine the extent to which observations within schools are correlated. The intraclass correlation coefficient (ICC), which indicates the size of the clustering effect, is then calculated to estimate the degree to which between school variances were represented in the total variation of the student mathematics scores:

where Y ij is the mathematics scores for student i in school j , 00 is the grand mean of mathematics scores for all participating schools, e ij is the residues for student i in school j , r 0j is the residues for school j.

Then prediction of variables from the student level (access to ICT, frequency of use, school-related variables) are included sequentially as in Eq. 4. Hence the final HLM model is written as follows:

(2) where uj is the slope of U student-level variables for student U in school j , vj is the slope of V school variables for school j.

This study utilises data from TIMSS, a large-scale assessment undertaken by the International Evaluation Assessment (IEA). TIMSS surveys use systematic probability proportional to size (PPS) sampling techniques which match with the hierarchical nature of the clustered sampling units. Multistage cluster sampling is used, together with jack-knife replication technique of 75 replicates for estimating the sampling error. The sample for this study was drawn from the TIMSS 2015 dataset which was released in December 2017. Four African countries participated in TIMSS 2015: Botswana, Egypt, Morocco and South Africa. The sample consists of Grades 8 and 9 students; Botswana and South Africa assessed Grade 9 students, while Egypt and Morocco had Grade 8 students. In this sample we use student and teacher data, which includes 39,372 students and 1007 teachers.

In the student sample, girls account for 50.07% and boys for 49.93% (Table 1 ). The age range of the students was between 9 years and 4 months, and 19 years and 9 months. In addition, the total percentage of students with ICT access at home was 40.39% and at school was 15.79%. The percentage was much lower for students who had access to ICT both at home and at school (8.42%).

A two-level HLM model was developed to examine the relationship between mathematics achievement and students' access to and use of ICT. Mathematics scores were used as the dependent variable. TIMSS assessments used a rotated-booklet design for testing students' mathematics skills. This implies that each student only completed a small section of the entire set of test items. Thus, TIMSS allocated a score to each student, and this score was comparable across all students that participated in the assessment. TIMSS computed five plausible values (PVs) of mathematics to measure students' performance (see Table 2 ). This study followed the recommendations for addressing PVs in large assessments, considering all five PVs simultaneously as the representation of each participating student. The five PVs are a representation of the range of abilities that a student could attain if she/he had completed the entire test, considering the measurement error in the test (Willms and Smith 2005) as cited in Skryabin et al. (2015) .

(4) Y ij = 00 + uj Student ij + vj School 0j + e ij + r 0j SN Soc Sci School-level variables The school level consists of three primary variables: students' access to instructional computers, teachers' ICT integration in a lesson, and teachers' job satisfaction. The students' access to instructional computers index was calculated from three item responses: (a) Each student has a computer, (b) The class has computers that students can share, and (c) The school has computers that the class can use sometimes. The index for teacher ICT integration in a lesson was computed on the basis of four items that measured teachers' perceptions of how they use ICT in a lesson: (a) I let students to use computers to explore subject, principles and concepts, (b) I let students to use computers to practice skills and procedures, and (c) I let students to use computers to process and analyse data. These indices were constructed using principal component analysis, and both had one component each. Higher scores indicated better access to instructional computers in the case of students, and better use of ICT by teachers. The third school variable, used as a controlling variable, was teacher job satisfaction, which is an IEA TIMSS indicator.

The student-level variables included demographic and ICT access-/use-related variables. Three variables that indicated student background were used as controlling variables in the models: home resources, gender (1 = 'male', 0 = 'female') and students' age. On the TIMSS student questionnaire, students were asked if they (a) owned a computer or tablet at home, (b) shared a computer or tablet at home, and (c) had an internet connection at home. These items were used to create the home ICT access index. This index was also developed through a principal component analysis. A higher score indicated that a student has sufficient ICT resources at home. Descriptive statistics for the selected variables are presented in Table 3 . The dimensions on frequency of ICT use were based on items that asked students how often you use a computer or tablet at home, school and other places. This was measured on a Likert scale of Every day, Once or twice a week, Once or twice a month, and Never or Almost never. The responses to this question were low, and so we dichotomised frequency at the different places into Yes = 1, No = 0, Yes indicating that the student selected that they frequently use ICT and No for not using ICT frequently. 

The analysis started with a null (unconditional) model that was developed to determine the extent to which observations within schools were correlated. The procedure involves the use of one-way analysis of variance (ANOVA) with random effects (Raudenbush and Bryk 2002) . The null model (unconditional mean model) is used to partition the variance in the outcome variable (for example, mathematics scores) into within and between group components (Willms and Smith 2005) . This provides a clear justification of estimating with HLM rather than other multiple regression techniques. The ICC, an indicator of the size of the clustering effect, was calculated to estimate the degree to which between school variances were represented in the total variation of the student model. The second step included all of the control variables from the student level (home educational resources, student age and gender) in the model. The final step of the analysis included the ICT explanatory variables from student variables and school-level data. The final two-level HLM model is written as follows:

Level 1 model:

where score ij is the mathematics score for student i in school j , 00 is the mean mathematics score for all schools in the sample, 1j is the slope of ICT at home for student i in school j , 2j is the slope of frequency in ICT use at home for student i in school j , 3j is the slope of frequency in ICT use at school for student i in school j , 4j is the slope of age for student i in school j , 5j is the slope of gender for student i in school j , 5j is the slope of home education resources for student i in school j , r ij is a unique error associated with student i in school j , 01 is the slope of students' access to instructional computers in each school, 02 is the slope of teacher ICT integration in each school, 03 is the slope of teacher job satisfaction in each school, and u 0j is a unique error to the intercept associated with school j and has the variance r 00 . Table 4 shows the results from the null model, the purpose of this model is to calculate the ICC in order to examine whether the variance was significant between schools and students. The null model results show that there was a 24% variability, which could be attributed to schools (between school variance). This result further implies that, for this sample, further analyses with HLMs were necessary to examine the impacts of explanatory variables from the different levels.

In the second stage of the analysis, student-level control variables were incorporated into the model (see Table 5 ), with the aim of identifying the effectiveness of the selected explanatory variables. This section responds to the research question about the influence of student level background factors. All three student control variables were found to be significantly associated with students' mathematics achievement. In terms of gender difference, the results show that the gender gap is wider in mathematics performance: on average, male students achieved higher performance scores in mathematics compared to girls. The age variable was also significant, and it showed that older students lost 17.96 points in their mathematics achievement. The home educational resources index had a significant influence on achievement, with students with more educational resources achieving scores 6.12 points higher. Comparing model 1 and the null model, it can be concluded that students' demographic factors do contribute to explaining the additional variations in student achievement. In model 1 with student controlling variables, the reduced variation was 25% at school level and 11% at student level.

In this third and final stage (model 2) of the analysis, all ICT-related variables from the student and school levels were included, along with the teacher job satisfaction indicator as a school control variable. These set of results respond to research question that relates to how access to and use of ICT in school and home settings influenced mathematics achievement. Comparing these results to model 1 in the second stage of the analysis, the inclusion of all ICT-related variables in Model 2 accounted for approximately 30% of the variance at school level and up to 12% at student level. Table 6 presents the results of the full model (model 2) for mathematics achievement. The school-level results show that school ICT-related characteristics had mixed effects. The indicator that showed teacher ICT use, or rather how teachers integrate ICT in teaching and learning, was negatively associated with student achievement. In this sample, a one-point increment in this indicator is associated with a 2.98-point decrease in the mathematics achievement score. This result could suggest that teachers are not well trained in ICT-related skills to use digital devices for instruction. In contrast, students' access to instructional computers was positively associated with student achievement; this positive association indicates that a one-point increment in the number of computers was associated with a 4.80-point higher achievement in mathematics. Teacher job satisfaction, as a control variable in the level 2 model, had a positive association with student achievement score.

At the student level, the home resources variable was found to have a consistent and significant positive influence on student achievement. This implies that students who had higher levels of home resources showed higher achievement indicators. In terms of ICT-related variables, two broad variables were examined on TIMSS surveys: access to ICT at home and frequency of using ICT either at home, school or some other place. In the analysis we used only frequency of using ICT at home and at school.

It was found that access to ICT at home index had a significantly positive association with student achievement, suggesting that students who owned or shared a computer at home and also had an internet connection, had higher achievement in mathematics. The positive association for the ICT at home indicator implies that a one-point improvement in the access to ICT at home increased students' mathematics scores by 8.59 points. The frequency of use of ICT both at home and at school had a significantly negative influence on student achievement. This suggested that students' time spent using ICT programs and software did not necessarily correlate with higher mathematics performance.

The results from the multilevel models suggest that-as ICT advocates have asserted-ICT does matter to academic achievement; however, an important caveat is that whether it matters depends on how it is used (Wenglinsky 1998) . The important contribution of this research is that it adds to the literature on how student-and school-level ICT access and usage influence student achievement in Africa. This has previously been an overlooked area in research and remains largely unexplored. By estimating a two-level HLM for a sample of four African countries, this research allows us to examine the relationship of ICT and education attainment. The findings are helpful for a better understanding of how and the extent to which school ICT development influences students' learning outcomes. Moreover, using TIMSS assessments, this study provides inclusivity in examining students' diverse ICT use and ICT influences on their achievement in Africa. This study included all four SN Soc Sci (2021) African countries that participated in TIMSS 2015, which previous studies have failed to do. Therefore, this study's findings have better generalisability and are of particular importance for policy makers, education researchers, and/or academicians.

The overall findings in terms of the effects of student and school background variables are strong. Male students were found to have better learning outcomes than female students, which was consistent with the previous findings (Gumus and Atalmis 2011; Zhang and Liu 2016) . Zhang and Liu (2016) explain that the gender gap in mathematics could be due to higher levels of anxiety, and less interest and confidence in mathematics. They suggest that additional support, like introducing interactive teaching strategies, could improve classroom environments (Liu and Wilson (2009) . Consistent with previous research, home educational resources were strongly associated with learning outcomes (İnce and Gözütok 2018; Zhang and Liu 2016) . The age variable was also strongly associated with achievement.

The evidence on student ICT access at home indicates that access generally has a positive association with learning outcomes. Consistent with previous studies, we can argue that students with access to ICT are associated with higher achievement scores. According to Kuhlemeier and Hemker (2007) , students with access to ICT devices (for example, computers) at home have sufficient computer skills and better learning outcomes. We can further argue that students' frequent use of ICT does not necessarily relate to better learning outcomes-although given that there is increasing investment in ICT in Africa, this could change over time. This result is consistent with previous research by Jager et al. (2008) , Eickelmann et al. (2012) , and Zhang and Liu (2016) . The authors found that the intensity of ICT use at home was negatively associated with learning outcomes. In particular, Eickelmann et al. (2012) found that frequent computer use correlated with low achievement among students who participated in TIMSS 2007, because low achievers were likely to use computers at school to make up for the slow progress. Li and Ma (2010) explain that one possible interpretation of the lower student performance with increased use of ICT is that simple ICT skills such as word processing and creating spreadsheets are likely to help students in accomplishing important tasks.

Based on previous research, the association between the frequency of using ICT for schoolwork and learning outcomes remains inconclusive. According to the findings of Skryabin et al. (2015) , it appears that there are mixed results concerning the intensity of ICT use and achievement. Skryabin et al. (2015) found differences between Grade 4 and Grade 8 students, where Grade 8 students with more frequent ICT usage in school were associated with lower learning outcomes. In contract, ICT usage among Grade 4 students had a positive influence on learning outcomes. SN Soc Sci (2021) Skryabin et al. (2015) also noted that students who frequently used ICT at home for school-related tasks were more likely to have better achievements.

In conclusion, the literature notes that ICT usage may affect narrow learning areas and may not have a strong and clear association with learning outcomes. Consequently, further exploration regarding the influence of frequency of ICT usage on learning outcomes is required.

In this study, at the 10% significance level there is a positive association between students' access to instructional computers and mathematics performance. In the existing literature, Skryabin et al. (2015) showed that ICT use at school was positively associated with students' mathematics learning outcomes, which aligns with the research findings of Carrillo et al. (2011) .

The result regarding the influence of teacher ICT integration in a lesson is significant and negatively associated with mathematics learning outcomes. A possible explanation for this result is that in most African schools, teachers' ICT integration does encounter a number of technological and attitudinal challenges. Such challenges are also referred to as extrinsic and intrinsic barriers (Xiao et al. 2019) . Extrinsic challenges could include the lack of ICT support and training or sufficient resources in teaching and learning. Intrinsic challenges could include practices, attitudes and beliefs towards ICT use in teaching. Even if teachers believe that the use of ICT in teaching is beneficial, such as using PowerPoint slides for mathematics lessons, they could have limited ICT skills in delivering lessons with advanced ICT devices or mathematics programs. Xiao et al. (2019) suggest that there is a lack of skills in modelling software and programming languages adapted for lessons such as mathematics. The negative correlation of teacher ICT integration could be because the use of ICT in a classroom environment is perhaps restricted to simple pedagogical practices, rather than effectively integrating ICT into the curriculum Aydin (2013) . Hence, schools need to provide consistent support, such as school-based ICT training, to equip teachers with the necessary ICT skills. In addition, technical ICT support should be provided to address any difficulty in using ICT in the classroom (Xiao et al. 2019 ).

This study makes a new contribution to literature about the relationship between school ICT development, student ICT access and usage, and mathematics learning outcomes in an African context. The results show that student access to instructional computers during a lesson was a significant positive predictor of mathematics achievement. Recommendations for education policymakers should be to provide the required ICT infrastructure to schools, which is in line with the findings by Garegae (2015) , who noted that teachers in the study schools in Botswana identified the lack of ICT resources as impeding their potential to use ICT in teaching. However, SN Soc Sci (2021) 1:224 224 Page 18 of 21 policymakers should also take heed of the findings by Tsayang et al. (2020) , who argued that access to resources was not the only factor to promote ICT use, but that teachers had to possess the necessary skills and pedagogic insight in order for them to effectively use ICT for teaching and learning. The result on teacher ICT integration indicated that teachers still lack current ICT skills to blend with pedagogy. Recommendations for educationists should be to bridge this gap by providing technical support and consistent ICT training to teachers. The need for ongoing ICT professional development is also noted by Bray and Tangney (2017) who emphasised skills development so as to use ICT in a more transformative and constructive manner.

Student ICT access at home also had a significant positive influence, indicating that students with ICT at home had more computer skills and were associated with higher learning outcomes. It is recommended that parents/guardians consider providing educational ICT devices and programs to students.

The frequency or intensity of ICT use both at home and school had negative associations with learning outcomes. This result remains contentious, according to findings from Tsayang et al. (2020) , the increased frequency of use of ICT devices led to improved student performance, which also led to improved results. While this study engaged with limited literature that showed increased frequency results in improved achievement, there needs to be more research to investigate the levels at which the intensity of ICT use is to be accommodated.

Like all cross-sectional studies, this study also has limitations. In this study we only investigated associations between learning outcomes and variables of interest; therefore, no conclusions can be made on causal effect implications. Future research studies should consider experimental designs of such datasets to determine the cause-and-effect impacts of these variables. The second limitation relates to the lack of policy, infrastructure and national development ICT data; these kinds of data can provide more insight into how the national development of ICT affect learning outcomes.

Quality basic education development in Nigeria: imperative for use of ICT

ICT use in the teaching of mathematics: implications for professional development of pre-service teachers in Ghana

New evidence on classroom computers and pupil learning

Teachers' perceptions about the use of computers in EFL teaching and learning: the case of Turkey

Remedying education: evidence from two randomized experiments in India

Exploring students' skills and attitudes on effective use of ICTs: case study of selected Tanzanian public secondary schools

Technology's edge: the educational benefits of computer-aided instruction

Measuring the impact of introducing ICT into the instruction of mathematics, physics, and earth and life sciences in the three Middle School Levels in Morocco

Technology usage in mathematics education research: a systematic review of recent trends

Information technology and student achievement: evidence from a randomized experiment in Ecuador

Is it the way they use it? Teachers, ICT and student achievement

ICT-use in primary schools and children's mathematics achievement-a multi-level approach to compare educational systems through an international lens with TIMSS data

The impact of access to ICT, student background and school/home environment on academic success of students in Turkey: an international comparative analysis

Is the one laptop per child enough? Viewpoints from classroom teachers in Rwanda

Issues and concerns about the integration of ICT into the teaching and learning of mathematics in Africa: Botswana case

Teacher practice and integration of ICT: why are or aren't South African teachers using ICTs in their classrooms

Exploring the relationship between purpose of computer usage and reading skills of Turkish students: evidence from PISA 2006

Conceptual and empirical issues in the estimation of educational production functions

The relationship between ICT and student literacy in mathematics, reading, and science across 44 countries: a multilevel analysis

ICT use to improve mathematics learning in secondary schools. Paper presented at the ACEC2010: Digital diversity

Measuring digital development: facts and figures

Effect of parental education and home educational resources to students' results of PISA reading skills test

Impact of ICT on production of goods and services: measuring the impact of ICT on education

The impact of computer use at home on students' internet skills

Evidence of student attendance as an independent variable in education production functions

Using hierarchical linear modeling to study social contexts: the case of school effects

A meta-analysis of the effects of computer technology on school students' mathematics learning

Gender differences in large-scale math assessments

Preservice teachers' beliefs and intentions about integrating mathematics teaching and learning ICTs in their classrooms

ICT in Africa: enabling a better life for all

Hierarchical linear models: applications and data analysis methods

Introducing ICT into schools in Rwanda: educational challenges and opportunities

How the ICT development level and usage influence student achievement in reading, mathematics, and science

Does computer use increase educational achievements? Student-level evidence from PISA

The impact of interactive smart boards on students' learning in secondary schools in Botswana: a students' perspective

Exploring teachers' use of technology in teaching and learning mathematics in KwaZulu-Natal schools

ICT transforming education in Africa

ICT in education statistics: shifting from regional reporting to global monitoring: progress made, challenges encountered, and the way forward

Does it compute? The relationship between educational technology and student achievement in mathematics

A manual for conducting analyses with data from TIMSS and PISA. Report prepared for UNESCO Institute for Statistics

Is students' computer use at home related to their mathematical performance at school?

An introduction to hierarchical linear modeling

Regression analysis of ICT impact factors on early adolescents' reading proficiency in five high-performing countries

How does ICT use influence students' achievements in math and science over time?

Acknowledgements This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. There are several HSRC staff who made significant contributions to putting together the data of this study. We thank the following individual for their assistance: Dr. Lolita Winnaar, senior research specialist at the Inclusive Economic Development research programme of the HSRC, provided the initial impetus for the study and nurtured it in many ways.

Author contributions CN conceptualised the study, designed the analysis, performed the analysis and writing of the manuscript. MM contributed to the conceptualisation of the study and writing of the manuscript.

The data that support the findings of this study are available in the International Association for the Evaluation of Educational Achievement data repository and can be accessed at https:// www. iea. nl/ studi es/ iea/ timss with reference number-TIMSS 2015. These data were derived from the following resources available in the public domain: TIMSS 2015 data at https:// www. iea. nl/ data-tools/ repos itory/ timss

The authors declare that they have no conflict of interest.

(2021) 1:224Page 19 of 21 224Ethical approval All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The TIMSS study has ethical approval in all participating countries.