key: cord-0687555-qjz1wwzm
authors: Alt, Prisca S.; Baumgart, Christian; Ueberschär, Olaf; Freiwald, Jürgen; Hoppe, Matthias W.
title: Validity of a Local Positioning System during Outdoor and Indoor Conditions for Team Sports
date: 2020-10-09
journal: Sensors (Basel)
DOI: 10.3390/s20205733
sha: 85c59e3c73fb2fcd794c4a66abd8d4b0dd11670a
doc_id: 687555
cord_uid: qjz1wwzm

This study aimed to compare the validity of a local positioning system (LPS) during outdoor and indoor conditions for team sports. The impact of different filtering techniques was also investigated. Five male team sport athletes (age: 27 ± 2 years; maximum oxygen uptake: 48.4 ± 5.1 mL/min/kg) performed 10 trials on a team sport-specific circuit on an artificial turf and in a sports hall. During the circuit, athletes wore two devices of a recent 20-Hz LPS. From the reported raw and differently filtered velocity data, distances covered during different walking, jogging, and sprinting sections within the circuit were computed for which the circuit was equipped with double-light timing gates as criterion measures. The validity was determined by comparing the known and measured distances via the relative typical error of estimate (TEE). The LPS validity for measuring distances covered was good to moderate during both environments (TEE: 0.9–7.1%), whereby the outdoor validity (TEE: 0.9–6.4%) was superior than indoor validity (TEE: 1.2–7.1%). During both environments, validity outcomes of an unknown manufacturer filter were superior (TEE: 0.9–6.2%) compared to those of a standard Butterworth filter (TEE: 0.9–6.4%) and to unprocessed raw data (TEE: 1.0–7.1%). Our findings show that the evaluated LPS can be considered as a good to moderately valid tracking technology to assess running-based movement patterns in team sports during outdoor and indoor conditions. However, outdoor was superior to indoor validity, and also impacted by the applied filtering technique. Our outcomes should be considered for practical purposes like match and training analyses in team sport environments.

Presently, player's physical tracking is indispensable in both outdoor and indoor team sports [1] [2] [3] . By the continuous monitoring of match and training activities, the training load [4] , regeneration process [5] , injury prevention [6] [7] [8] , and on-field rehabilitation can be optimized. During the past decade, the technological development occurred fast, so that several player-tracking technologies are available today. Whilst initially camera-based technology was used, global (GPS) and local (LPS) positioning systems have become standard technologies [2, 9] . However, comprehensive evaluations of both technologies are essential to allow a valid interpretation of the data acquired [9] [10] [11] .

In our study, five male team sport athletes (age: 27 ± 2 years; height: 1.77 ± 0.04 m; mass: 79.2 ± 2.2 kg; fat: 14.7 ± 3.7%; maximum oxygen uptake: 48.4 ± 5.1 mL/min/kg; 3-4 training sessions per week) took part. All athletes participated in team sports (American football: n = 1, basketball: n = 1, and soccer: n = 3) and competed on an adult amateur playing level. The athletes were informed of the purposes and potential risks of the study procedures and signed a written informed consent to participate. All procedures were pre-approved and accepted by the Ethics Committee of the local university (MS/JE 29.11.11) and were conducted in accordance with the Declaration of Helsinki.

All athletes performed 10 valid trials of a team sport-specific circuit during outdoor and indoor conditions, which were separated by one week. A trial was considered as valid, if the athletes had completed the circuit without disruptions and if there was no self-inflicted measurement error.

The measures took place on a dry artificial turf soccer field and a standard sports hall used for official handball competitions. The circuit included different walking, jogging, sprinting, and standing sections over an entire distance of 129.6 m, as described previously [9] . All sprinting sections were equipped with double-light timing gates (Werthner Sport Consulting, TDS, Linz, Austria) [35] as criterion measures. Thus, the criterion validity was determined here. During the circuit, the athletes wore artificial turf and indoor shoes during outdoor and indoor conditions, respectively, and two devices of one LPS between the scapulae in a custom-made sport shirt [36] . To investigate the validity, the known distances of the circuit were compared to the measured distances of the LPS. The capacity of the athletes to repeat the circuit during outdoor and indoor conditions was estimated by the timing gate measures, meaning that the test-retest reliability was quantified. Additionally, physiological responses were assessed by heart rate and ratings of perceived exertion measures. Figure 1 shows the design of the circuit and setup of the LPS.

Sensors 2020, 20, x FOR PEER REVIEW  3 of 11 completed the circuit without disruptions and if there was no self-inflicted measurement error. The measures took place on a dry artificial turf soccer field and a standard sports hall used for official handball competitions. The circuit included different walking, jogging, sprinting, and standing sections over an entire distance of 129.6 m, as described previously [9] . All sprinting sections were equipped with double-light timing gates (Werthner Sport Consulting, TDS, Linz, Austria) [35] as criterion measures. Thus, the criterion validity was determined here. During the circuit, the athletes wore artificial turf and indoor shoes during outdoor and indoor conditions, respectively, and two devices of one LPS between the scapulae in a custom-made sport shirt [36] . To investigate the validity, the known distances of the circuit were compared to the measured distances of the LPS. The capacity of the athletes to repeat the circuit during outdoor and indoor conditions was estimated by the timing gate measures, meaning that the test-retest reliability was quantified. Additionally, physiological responses were assessed by heart rate and ratings of perceived exertion measures. Figure 1 shows the design of the circuit and setup of the LPS. The particular sections that were used for determining the distances covered were numbered from 1 to 10 (in brackets) to allow a better assignment of the results provided in the tables and figures.

A recent 20-Hz LPS (KINEXON Precision Technologies, KINEXON ONE, version 1.0, Munich, Germany) [36] was used. The system consists of one base station and 12 antennas each positioned at four meters above the ground around the circuit (Figure 1 ). One technician from the manufacturer performed all installations and calibrations. The measurement principle of the system is as follows: The sensors worn by the athletes send continual signals via radio waves to the antennas, which forward them via a wide local area network to the base station. The latter transforms the received data into the x-and y-positions of the athletes [9] . The position data were exported from the proprietary software (KINEXON Precision Technologies, Kinexon Web Application, version 3.2.6, Munich, Germany [36] ) to custom-made spreadsheets involving macro-based calculations (Microsoft, Excel 2016, Redmond, WA, USA) for further data processing according to previous studies [9] : First, by numerical differentiation over time, the instantaneous speed data of the athletes were computed. Then, the speed data were passed through a second-order Butterworth low-pass filter with a 1-Hz cut-off frequency and two passes to minimize noise. From the filtered speed data and their integration over time, the distances covered during each section of interest within the circuit were computed. To detect the start and end of the walking, jogging, and sprinting sections, a speed threshold of 0.2 m/s was used. The end of each sprinting section was obtained from the timing gate information.

Since all athletes wore two sensors and performed 10 valid trials of the circuit during outdoor and indoor conditions, a total of 100 data files per condition were acquired. All data files were visually checked for measurement errors caused by poor signal strength or timing gate errors by two investigators, who did this independently of each other. Additionally, outliers were objectively defined as those values that were greater than the mean ± the two-fold pooled standard deviation [18] . A total of 20 and 11 data files were classified as outliers during outdoor and indoor conditions, respectively, and were removed from the statistical analyses. To investigate the impact of different filtering techniques, all finally included data files were also passed through an unknown filter of the LPS manufacturer, which is included in the company's proprietary software and used by the end consumers in practice. The unprocessed raw data were also considered.

At first, descriptive data were reported as means and standard deviations. Secondly, the relative typical error of estimate (TEE) in percent was calculated. The TEE was rated as good (0 to <5%), moderate (5 to <10%), or poor (≥10%) [7] . Differences in means were studied by Magnitude-Based Inferences. Therefore, the mean differences and their 90% confidence intervals were analyzed in relation to the smallest worthwhile differences (SWD), as described before [10] . The SWD was defined as the pooled standard deviation multiplied by 0.2 [10] . Then, the probabilities for the mean differences "truly" being higher than the associated SWDs were determined and qualitatively described using the following scale: <1%, most unlikely; 1 to <5%, very unlikely; 5 to <25%, unlikely; 25 to <75%, possibly; 75 to <95%, likely; 95 to <99%, very likely, and ≥99%, most likely. If the likelihoods for being both higher and lower were ≥5%, the differences were described as unclear. To also clarify the magnitudes, effect sizes according to Cohen's d were calculated. The effect sizes were interpreted accordingly: 0.0 to <0.2, trivial; 0.2 to <0.6, small; 0.6 to <1.2, medium; 1.2 to <2.0, large; 2.0 to <4.0, very large; and ≥4.0, extremely large. For all statistical analyses, pre-built spreadsheets (Microsoft, Excel 2016, Redmond, WA, USA) were used. Table 1 shows all descriptive data for the timing gate and physiological measures during outdoor and indoor conditions. Additionally, the results of the Magnitude-Based Inferences and corresponding effect sizes are reported. There were trivial to moderate differences between both conditions (unclear to very likely probabilities). Table 2 summarizes all descriptive data concerning the measured distances by the LPS during outdoor and indoor conditions. The peak speed and acceleration data during the two sprinting sections are also shown. All data are presented with respect to the two different filtering techniques and as raw data. Note: SD = Standard deviation; n = number; d = Cohen's d effect size; SWD = Smallest worthwhile difference; CI = Confidence interval, HR = Heart rate; RPE = Rating of perceived exertion. The asterisks *, **, ***, and **** indicate the probabilities that the effect is possibly (>75%), likely (>90%), very likely (>95.5%), and most likely (=100%) higher or lower than the SWD. The letter u indicates an unclear effect with probabilities of >5% that the effect is both higher and lower than the SWD. The numbers in the brackets present the section of measurement within the circuit ( Figure 1 ). Table 2 . Descriptive data (mean ± SD) of the local positioning system for determining the distances covered during outdoor and indoor conditions. The impacts of the different filtering techniques, and the outcomes of the raw data, are also shown. (9) Note: SD = Standard deviation; n = number; BW = Butterworth; COD = Change of direction. The numbers in the brackets present the section of measurement within the circuit (Figure 1 ). Table 3 displays the calculated relative TEEs according to the outdoor and indoor conditions, and also to the different filtering techniques. During both conditions, the TEEs ranged from good to moderate (TEE: 0.9-7.1%). The overall TEEs for the filtering techniques and raw data were all good (TEE: 1.8-2.9%). However, the manufacturer filter showed the smallest overall TEEs during both conditions. Figure 2 shows the results of the Magnitude-Based Inferences concerning the differences in the distances covered between the outdoor and indoor conditions. For that comparison, the data of the manufacturer filter were used due to its highest validity outcomes (Table 3 ). There were trivial to moderate differences between both conditions (unclear to most likely probabilities). Table 3 . Relative typical error of estimates (mean ± SD) of the local positioning system for determining the distances covered during outdoor and indoor conditions. The impacts of the different filtering techniques, and the outcomes of the raw data, are also shown.

Outdoor (n = 80) Indoor (n = 89) Note: SD = Standard deviation; n = number; BW = Butterworth; COD = Change of direction. The numbers in the brackets present the section of measurement within the circuit (Figure 1 ).

Sensors 2020, 20, x FOR PEER REVIEW 6 of 11 moderate (TEE: 0.9-7.1%). The overall TEEs for the filtering techniques and raw data were all good (TEE: 1.8-2.9%). However, the manufacturer filter showed the smallest overall TEEs during both conditions. Table 3 . Relative typical error of estimates (mean ± SD) of the local positioning system for determining the distances covered during outdoor and indoor conditions. The impacts of the different filtering techniques, and the outcomes of the raw data, are also shown. Note: SD = Standard deviation; n = number; BW = Butterworth; COD = Change of direction. The numbers in the brackets present the section of measurement within the circuit (Figure 1 ). Figure 2 shows the results of the Magnitude-Based Inferences concerning the differences in the distances covered between the outdoor and indoor conditions. For that comparison, the data of the manufacturer filter were used due to its highest validity outcomes (Table 3 ). There were trivial to moderate differences between both conditions (unclear to most likely probabilities).

Effects of indoor vs. outdoor condition on distances covered measured by the local positioning system. For that comparison, the data of the manufacturer filter were used due to its highest validity outcomes (Table 3) . Note: Each effect is shown as factor of the smallest worthwhile difference (SWD). The corresponding effect size thresholds for small (S; 1-fold), moderate (M; 3-fold), large (L; 6-fold), and very large effects (VL; 10-fold) are also shown. The asterisks *, **, ***, and **** indicate the probabilities that the effect is possibly (>75%), likely (>90%), very likely (>95.5%), and most likely (=100%) higher or lower than the SWD. The letter u indicates an unclear effect with Figure 2 . Effects of indoor vs. outdoor condition on distances covered measured by the local positioning system. For that comparison, the data of the manufacturer filter were used due to its highest validity outcomes (Table 3) . Note: Each effect is shown as factor of the smallest worthwhile difference (SWD). The corresponding effect size thresholds for small (S; 1-fold), moderate (M; 3-fold), large (L; 6-fold), and very large effects (VL; 10-fold) are also shown. The asterisks *, **, ***, and **** indicate the probabilities that the effect is possibly (>75%), likely (>90%), very likely (>95.5%), and most likely (=100%) higher or lower than the SWD. The letter u indicates an unclear effect with probabilities of >5% that the effect is both higher and lower than the SWD. The numbers in the brackets present the section of measurement within the circuit (Figure 1 ).

This study aimed to compare the validity of a LPS during outdoor and indoor conditions for team sports. The impact of different filtering techniques, namely that of a standard Butterworth and unknown manufacturer filter included in the company's proprietary software, was also investigated. Based on previous studies, it was hypothesized that LPS validity is superior during outdoor compared to indoor conditions [25] and that the filtering technique thereby has an impact. Our main findings were that the LPS validity for measuring distances covered in team sports was (i) good-to-moderate during both environments, whereby the outdoor was superior than indoor validity; and (ii) impacted by the filtering techniques, showing superior validity outcomes for the manufacturer filter compared to those for the standard Butterworth filter and to unprocessed raw data.

To allow comparisons of the LPS validity during outdoor and indoor conditions, a methodological prerequisite is that the athletes reproduce the movement patterns with the same effort [10, 37] .

Compared to a previous study [25] , a methodological strength of our study was that we have determined the capacity of the athletes to reproduce the circuit and also their physiological responses by timing gates, heart rate, and perceived exertion measures. Our data show only trivial to moderate differences between both environments (Table 1) . Potential explanations for these differences are beside technological and biological sources [25, 26] also the different ground surfaces of both environments. Since it is known that a hall floor has more grip than an artificial turf [38] , it is plausible that our athletes were slightly faster (up to small effect sizes) during indoor conditions (Table 1) . However, together with the physiological responses, our reliability findings overall demonstrate that our athletes were able to reproduce the movement patterns during both environments with a comparable effort.

Our first major finding was that the LPS validity for measuring distances covered in team sports was good to moderate during both environments (TEE: 0.9-7.1%), while the outdoor validity (TEE: 0.9-6.4%) was superior than indoor validity (TEE: 1.2-7.1%) ( Table 3 ). Our validity outcomes are supported by those of previous studies [2, 9, 11, 21, [25] [26] [27] [28] [29] [30] 34] . These studies evaluated the LPS validity predominantly during outdoor conditions for measuring different products as distances covered (TEE: 0.8-6.0%) [9, 25, 31] and further indicators with diverse statistical calculations allowing no direct comparison, as instantaneous speeds [27, 29, 30 ] and x-, y-positions [11, 27, 28, 30] . Our data also reinforce an important issue that applies not only to LPS [11, 21, 26, 29] , but also to GPS [14, 18, 26, 39] : The validity is compromised during accelerated runs over short distances [9, 11, 29] , as shown most clearly by our validity indicators over the 5-m sprinting distance (TEE: 4.1-7.1%) ( Table 3) . When taken together, our and previous findings show that LPS can be considered as a good to moderate valid technology to assess running-based movement patterns in team sports.

A new outcome of our study was that the LPS validity was superior during the outdoor (TEE: 0.9-6.4%) than indoor condition (TEE: 1.2-7.1%) ( Table 3) . To the best of our knowledge, there is only one previous study that has also compared the LPS validity during both environments [25] . Although the research designs differ in terms of the evaluated technologies, movement patterns, data processing, and statistical analyses, the main finding in both studies is similar: The overall error is approximately one percentage point higher during the indoor (previous study: 2.0-2.4%; our study: 2.5-2.9%) than the outdoor (previous study: 1.3-1.4%; our study: 1.8-2.2%) condition. Taking the evidence together, the results show that the LPS validity is negatively impacted by the indoor environment. The overall lower indoor validity can be explained by signal interference mainly due to reflection, which may result from construction materials like metal objects in sports halls [9, 25, 30] . To clarify this assumption, more research is needed. Thereby, and for practical considerations, the numerous different structural conditions of sports halls have to be considered.

The second main outcome of our study was that the LPS validity for measuring distances covered in team sports was impacted by the filtering techniques. In fact, during both environments, the validity outcomes of the manufacturer filter were superior (TEE: 0.9-6.2%; overall: 1.8-2.5%) compared to those of the standard Butterworth filter (TEE: 0.9-6.4%; overall: 2.7-2.8%) or unprocessed raw data (TEE: 1.0-7.1%; overall: 2.2-2.9%) ( Table 3 ). As known from GPS studies [35] , the filtering technique is a crucial step during data processing. Indeed, different filtering techniques lead up to very large differences in the apparent number of acceleration events performed during soccer matches [40] . This outcome is in line with our found impacts on peak acceleration/deceleration data ( Table 2) . In this context, the unphysiologically high peak acceleration/deceleration data of the unprocessed raw data appear noteworthy (Table 2) , which underlie the fundamental requirement to apply appropriate filtering techniques to the raw data before acceleration/deceleration data are computed [41] . With this in mind, there is still a surprising lack of research regarding the impact of filtering techniques on GPS and LPS validity. In a previous study, we showed that LPS was impacted by more noise than GPS (very large effect sizes), and also that the amount of noise was largest at the corners of the circuit close to the reference antennas [9] . Higher error rates of LPS data close to walls and corners have also been reported in further studies, and were related to undetected anchor nodes and multipath propagation [30, 42] . Thus, filtering techniques may be of particular importance for the LPS validity during outdoor and indoor condition, and require more research clearly. The underlying explanations for the different impacts of the filtering techniques found on our LPS validity remain unclear. While we have applied a standard Butterworth filter from the field of biomechanics [43] , the exact mathematical functioning and specifications of the used manufacturer filter are unfortunately unknown. The reason to investigate the impact anyway was that the filtering technique grounds on the best practice experience of the manufacturer and is included in the proprietary software used by the end consumers in daily practice. Thus, to progress the entire field of the player tracking technologies forward, we strongly encourage manufacturers to disclose their algorithms and filtering techniques [30, 35, 44] . In this context, it is also worth questioning, if raw data reported by proprietary software can been considered as "true" raw data, as conducted here, because it is likely that they have already been processed by further unknown filters working directly on the hardware level.

A potential limitation of our study is that we have used defined distances covered together with timing gates as a criterion measure. According to a previous validation study, there are three different validation levels: position, instant speed and acceleration, and from the latter aggregated data as distances covered [11] . Our study corresponds to the third level. To take also the validity of the position and underlying speed data into account, a camera-based reference system should have been used [11, 30] . The main reason for our approach was that camera-based systems allow to assess speed data only within relatively small areas, and thus are unable to investigate movement patterns over longer distances at maximal speeds that are also part of team sports. Additionally, and due to the standard application of the LPS evaluated here, for example during each competitive match in the German Handball-Bundesliga, we aimed to evaluate the technology in external valid conditions that take the entire playing fields of team sports as handball into account, including the corners being challenging for position detection [9, 27, 30, 42] , which is presently not possible by a camera-based approach. However, to allow a better comparison of the findings derived by future validation studies, accepted methodological standards have to be developed, as recently summarized in first guidelines [45] .

In conclusion, our study shows that the evaluated LPS can be considered as a good to moderately valid tracking technology to assess running-based movement patterns during outdoor and indoor conditions in team sports. However, it must also be concluded that the LPS validity was superior outdoor compared to indoor, and impacted by the applied filtering techniques, showing best validity outcomes for an unknown manufacturer filter. Our outcomes should be considered for practical purposes like match and training analyses in the team sport environment. 

Interpreting physical performance in professional soccer match-play: Should we be more pragmatic in our approach

Mechanical determinants of acceleration and maximal sprinting speed in highly trained young soccer players

Konditionelle Leistungsdiagnostik im Hochleistungsfußball-Vergangenheit

Effective injury forecasting in soccer with GPS training data and machine learning

Training load monitoring in team sports: A novel framework separating physiological and biomechanical load-adaptation pathways

Relationship between indicators of training load in soccer players

A comparison of methods to quantify the in-season training load of professional soccer players

The training-injury prevention paradox: Should athletes be training smarter and harder?

Validity and reliability of GPS and LPS for measuring distances covered and sprint mechanical properties in team sports

Progressive statistics for studies in sports medicine and exercise science

Validation of electronic performance and tracking systems EPTS under field conditions

The validity and reliability of global positioning systems in team sport: A brief review

Comparison of global positioning and computer-based tracking systems for measuring player movement distance during Australian football

The validity and reliability of a global positioning satellite system device to assess speed and repeated sprint ability (RSA) in athletes

Validity and reliability of GPS devices for measuring movement demands of team sports

Validity and reliability of GPS for measuring distance travelled in field-based team sports

The validity and reliability of GPS units for measuring distance in team sport specific running patterns

Accuracy and reliability of GPS devices for measurement of sports-specific movement patterns related to cricket, tennis, and field-based team sports

Concurrent validity and test-retest reliability of a global positioning system (GPS) and timing gates to assess sprint performance variables

Validity and reliability of GPS for measuring instantaneous velocity during acceleration, deceleration, and constant motion

Validity and reliability of a commercially available indoor tracking system to assess distance and time in court-based sports

Trends supporting the in-field use of wearable inertial sensors for sport performance evaluation: A systematic review

Estimating external loads and internal demands by positioning systems and innovative data processing approaches during intermittent running activities in team and racquet sports

Sprint diagnostic with GPS and inertial sensor fusion

Validity and reliability of a radio positioning system for tracking athletes in indoor and outdoor team sports

Soccer-specific accuracy and validity of the local position measurement (LPM) system

Accuracy of the LPM tracking system considering dynamic position changes

Design of an accuracy study for position detection in football

Measuring acceleration and deceleration in soccer-specific movements using a local position measurement (LPM) system

Validity of the Catapult ClearSky T6 local positioning system for team sports specific drills, in indoor conditions

The validity and reliability of a novel indoor player tracking system for use within wheelchair court sports

Accuracy and reliability of ocal positioning systems for measuring sport movement patterns in stadium-scale: A systematic review

Kinexon: KINEXON Stellt Hochpräzise Leistungsdaten für die EHF EUROs

Can positioning systems replace timing gates for measuring sprint time in ice hockey?

Unpacking the black box: Applications and considerations for using GPS devices in sport

Präzise Echtzeit-Lokalisierung Kombiniert mit Innovativen Analysen

Spreadsheets for analysis of validity and reliability

Sprint running performance monitoring: Methodological and practical considerations

Accuracy and reliability of GPS devices for measurement of movement patterns in confined spaces for court-based sports

Methodological considerations when quantifying high-intensity efforts in team sport using global positioning system technology

Variability of metabolic power data in elite soccer players during pre-season matches

Multimodal Localisation: Analysis, Algorithms and Experimental Evaluation

Biomechanics and Motor Control of Human Movement

Recommendations for assessment of the reliability, sensitivity, and validity of data provided by wearable sensors designed for monitoring physical activity

A Survey to Assess the Quality of the Data Obtained by Radio-Frequency Technologies and Microelectromechanical Systems to Measure External Workload and Collective Behavior Variables in Team Sports

The authors would like to thank Joana Brochhagen, Matthias Kühnemann, Sasha Javanmardi, Vadim Barnics, and Rene Prüßner for their assistance to collect the data.

The authors declare no conflict of interest.