Next Article in Journal
Promoting Environmental Justice through Integrated Mapping Approaches: The Map of Water Conflicts in Andalusia (Spain)
Next Article in Special Issue
Think Spatially With Game Engine
Previous Article in Journal
An OD Flow Clustering Method Based on Vector Constraints: A Case Study for Beijing Taxi Origin-Destination Data
Previous Article in Special Issue
Developing a Serious Game That Supports the Resolution of Social and Ecological Problems in the Toolset Environment of Cities: Skylines
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Behavioural Effects of Spatially Structured Scoring Systems in Location-Based Serious Games—A Case Study in the Context of OpenStreetMap

1
Spatial Modelling Lab, School of Spatial Planning, TU Dortmund University, August-Schmidt-Straße 10, 44227 Dortmund, Germany
2
GIScience Research Group, Institute of Geography, Heidelberg University, Im Neuenheimer Feld 368, 69120 Heidelberg, Germany
3
Metropolregion Rhein-Neckar GmbH, M1 4–5, 68161 Mannheim, Germany
4
3DGeo Research Group, Institute of Geography, Heidelberg University, Im Neuenheimer Feld 368, 69120 Heidelberg, Germany
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
ISPRS Int. J. Geo-Inf. 2020, 9(2), 129; https://0-doi-org.brum.beds.ac.uk/10.3390/ijgi9020129
Submission received: 29 December 2019 / Revised: 31 January 2020 / Accepted: 18 February 2020 / Published: 22 February 2020
(This article belongs to the Special Issue Gaming and Geospatial Information)

Abstract

:
Location-based games have become popular in recent years, with Pokémon Go and Ingress being two very prominent examples. Some location-based games, known as Serious Games, go beyond entertainment and serve additional purposes such as data collection. Such games are also found in the OpenStreetMap context and playfully enrich the project’s geodatabase. Examples include Kort and StreetComplete. This article examines the role of spatially structured scoring systems as a motivational element. It is analysed how spatial structure in scoring systems is correlated with changes observed in the game behaviour. For this purpose, our study included two groups of subjects who played a modified game based on StreetComplete in a real urban environment. One group played the game with a spatially structured scoring system and the other with a spatially random scoring system. We evaluated different indicators and analysed the players’ GPS trajectories. In addition, the players filled out questionnaires to investigate whether they had become aware of the scoring system they were playing. The results obtained show that players who are confronted with a spatially structured scoring system are more likely to be in areas with high scores, have a longer playing time, walk longer distances and are more willing to take detours. Furthermore, discrepancies between the perception of a possible system in the scoring system and corresponding actions were revealed. The results are informative for game design, but also for a better understanding of how players interact with their geographical context during location-based games.

1. Introduction

The ubiquitous deployment of mobile devices like smartphones equipped with positioning technology has made possible the proliferation of location-based games. Popular examples include Pokémon Go and Ingress, which conflate the physical and the digital sphere through augmented reality and the experience in real-world spaces. Location-based games have sparked interest in academic research in various fields, such as geography [1,2,3] and human-computer interaction [4,5,6]. Researchers thereby leverage digital games to investigate a range of complex mechanisms, including knowledge sharing [7], social collaboration [8], and negotiation processes in the digital realm [9]. Games are therefore not only mundane means of entertainment, but also offer ways to gain significant insights into behavioural, social, and cultural aspects that are relevant beyond the gaming context.
Some games go beyond mere entertainment in order to serve additional purposes. Those purposes can be as diverse as language learning [10,11,12], environmental and sustainability education [13,14,15], and online public participation [16,17,18]. Those types of games are referred to as ’serious games’ [5,19], and what makes them interesting in the research context and for GIScience, in particular, is their ability to attract and include ordinary citizens in research-related activities. The application Geograph, for instance, allows to upload photographs that are intended to provide a representative reflection of the landscapes of the British Isles. Those photographs are collected on a square kilometre grid. What makes Geograph different from other online photo sharing services like Flickr is that users are rewarded for contributing photos from grid cells that have not been sampled before [20]. The game element of a reward thus allows to control individual contribution patterns that might be completely different and skewed towards urbanised areas otherwise [21,22]. This way, it is possible to achieve a better coverage of the overall territory and to gain a more representative description of local geographies. Hence, the use of a reward system gamifies photo sharing, making it both an entertaining leisure activity for users and a useful data collection platform for academic research and other professional purposes.
Location-based serious games are also found in the OpenStreetMap (OSM) ecosystem. The OSM project allows volunteers to create and maintain a global geographic dataset by mapping features in accordance with a bottom-up and dynamic folksonomy [23]. Apps like Kort and StreetComplete are location-based serious games used to collect new data and to curate the existing OSM database. This way, serious games contribute to the collection of so-called Volunteered Geographic Information (VGI), a paradigm describing the contribution of non-professionals to the geographic knowledge of and about the world [24]. One important aspect in this context are potential data quality issues. On the one hand, many contributors to OSM are non-professionals in the sense of not being trained as cartographers. This argument implies that the quality of the data provided may be compromised. On the other hand, however, the contributors can well be considered experts of their own local whereabouts and home regions. In terms of Linus’s law, this latter argument leads to a possible improvement in data quality, as having many knowledgeable local contributors facilitates the remediation of data inconsistencies and errors [25]. Location-based serious games emphasise the latter aspect and are used to activate local knowledge in a targeted manner.
Location-based serious games give rise to questions about geospatial influences on players’ motivation. It is well-known that urban areas are represented more completely in OSM than rural, or, more generally, less popular areas [26,27]. Likewise, urban areas are often heterogeneous internally, since some places, such as popular or tourist areas, are mapped to a greater level of detail [20,28]. One reason for these effects is that contributors tend to map areas that are of particular subjective interest to them. Such so-called pet locations are areas that form part of the day-to-day activity spaces of OSM contributors [29]. Pet locations are therefore more likely to evoke a pride of place [30] and to thus motivate contributors to represent them on the rendered OSM map (or at least in the database). These aspects of motivation outlined are both geospatial in nature and related to playfulness and gamification. The spatial disparities mentioned describe spatial heterogeneity in data contribution patterns. In particular, intra-urban differences are related to the variations in the degree to which different geographical areas encourage mapping. Moreover, with OSM mapping being a leisure activity, pride of place can be seen as an incentive to compete with others’ mapped features. Similar arguments are found in the literature regarding location-based serious games. Aspects like geographic exploration [31,32] and succeeding in finding specific coordinates have been described as important spatial motivational factors. Geospatial factors are therefore important to the design of location-based games.
The research presented in this article focuses on the game element of scoring systems. These are used to reward players for completing in-game tasks, and are hence an element of gamification that has an impact on the motivation of players. In location-based serious games, players explore real-world and thus, geographical playing fields. Therefore, we assume that a systematic spatial pattern in scoring systems might be a relevant factor affecting the behaviour of players during the game. Our research describes a case study conducted in Heidelberg, Germany, and is based on a modified version of the game StreetComplete. Two groups of players were presented two different versions of the game, each featuring different scoring systems. One group played the game with a spatially clustered scoring system, whereas a control group was confronted with spatially randomised scores. The tasks to be solved were real OSM-related assignments. These were controlled for a comparable degree of difficulty in order to avoid any distorting effects external to the scoring systems used. We tested the hypothesis that the spatial structuring of a scoring system has a significant effect on player behaviour and motivation. In order to test this hypothesis, we assessed several indicators, all of which are related to motivational aspects of games. We further tracked the players’ GPS trajectories to investigate the geographical exploration of the playing field. In addition, the study was accompanied by questionnaires the subjects were asked to complete. This allowed us to gain additional insights into how the players experienced the game with one of the two scoring systems each. Note that in this study, we do not address how behavioural responses of players to spatial structure in scores interact with geographical features like different street layouts or the local building morphology. Instead, this study concerns the influence of spatial structure in comparison to the complete absence of a spatial pattern in scores. In addition to interesting findings regarding a relatively unexplored area of gamification, this study offers results that are of interest also for the targeted design of location-based games in a practical sense.

2. Literature Review

Games can be defined as “rule-based, formal systems […] in which different outcomes are assigned different values” ([33], p.35). These systems can be described as spatiotemporal spheres largely separate from everyday life, with their own internal logic, rules, objectives, virtual goods and other characteristics [34,35]. In summary, these characteristics are referred to as gameplay, which has to be considered holistically and is essential for the experienced enjoyment of a game [36]. All elements of gameplay are closely linked and mutually interrelated [37]. This work focuses on the motivating aspect of spatial patterns in scoring systems, one specific element of gameplay. The following subsections provide an overview of motivation in games in general, as well as of particularly geographic motivational factors.
It should be noted that the term motivation is not used consistently in the literature. Some authors used the term to refer to pre-game incentives that make a potential player play. Others, however, use motivation to refer to elements that keep players playing during a game, which is sometimes also referred to as engagement [38,39]. This distinction is seldom made explicit, and we therefore also use the term motivation to refer to both types of activations interchangeably in this work.

2.1. Motivation in Games

Motivations for playing games can be manifold: escape from daily routine, the creative act of building virtual worlds (e.g., cities), the competitive fighting of battles, the experience of high levels of interaction, or a relaxed atmosphere in which patterns and structures must be disclosed (e.g., solving puzzles) [40,41]. These types of motivations discriminate games from more linear forms of entertainment such as television or reading books [42]. Playing games is thereby considered an active engagement whereby players constantly have to make decisions [43]. Therefore, one central issue that makes motivational elements in games important is the constant confrontation of a player with conflicting goals. For example, players often have to weigh between safe options with lower rewards and riskier ones offering more lucrative benefits [44]. The resolution of such conflicts psychologically results in an important aspect of motivation in games: self-determination. According to self-determination theory, games with a high degree of self-determination are perceived as particularly motivating [45]. The theory of self-determination thereby consists of three components, each of which satisfies one psychological basic need: competence, autonomy and the feeling of social inclusion.
Solving challenges leads to experiences of competence and is central to many games. Challenges are usually embedded in an interactive narrative that adds a specific theme and makes the challenge seem more meaningful [37]. The game design should create a game experience tailored to the player’s competence. In this way, the game retains attention and keeps the player in the game [46]. When the level of difficulty of a game is optimally adjusted to the level of competence of the player, the player enters a so-called flow, a long period of concentrated engagement with the game [37,47]. In order to achieve this, it is necessary to communicate a clear game objective, to avoid distraction and to optimally couple both mental and physical challenges. However, the greatest influence on a player’s competence experience is feedback [48,49]. Feedback can be both informative and performance-enhancing in nature. In both cases, feedback leads to a positive reinforcement of the experienced competence when it is immediate, a mechanism known as operant conditioning [50,51].
In addition to the quest for challenges, the player’s autonomous coping with them is just as important for the motivation of a player. Players want to choose challenges or ways to solve them independently. In doing so, they want to make meaningful decisions that affect their success in the game and thus enable the experience of autonomy [49,52]. Players experience autonomy when their actions in a game are strongly aligned with their own intrinsic values and interests [49,52]. Often, a single choice in a game can be sufficient to generate a satisfactory level of autonomy experience [45,52]. In this sense, supportive feedback that regularly endorses the actions of players and confirms their autonomous decisions is an important design feature of successful games [53]. What reinforces this effect further is social embedding in the form of interaction with friends or other players. This interaction can take either a cooperative or competitive form [45]. The highest degree of social inclusion can be achieved through a cooperative team-oriented game mode, which also partly explains the current success of so-called Massively Multiplayer Online Role-Playing Games [42,52,54].

2.2. Geographic Motivational Factors

In contrast to other types of games, the players of location-based games move in real geographical space [55,56,57], so that the latter becomes an important game element [58]. The virtual world, which is created by a game in its own virtual space-time sphere, is now blended with the context of an actual physical environment. The player interacts with both simultaneously and thus, real actions influence the course of a game [59,60]. This blurring of two previously separate universes requires the consideration of a number of additional motivational factors.
One geographic factor that influences the motivation of players is the popularity of the playing field. It is known that players of location-based games, as well as OSM contributors, prefer urban playing fields, including tourist and popular areas [20,28]. The reason for this is not only the correlation of such areas with popularity, but also the often easier accessibility of the playing field, which emphasises the importance of the further embedding of the latter into its wider geographical context. In addition to this macro view, the local physical design of a playing field can also influence the motivation of players on a smaller scale. For example, OSM authors prefer to map features they consider either more popular or more relevant (e.g., traffic signs and pedestrian crossings), and this may well be the case for location-based serious games in the same OSM context [61]. Similarly, the salience and complexity of features influence the willingness of players to engage with them in location-based games [62], which, in turn, influences the level of detail at which they are captured or mapped.
An additional geographic motivating factor is the possibility of integrating a location-based game into everyday life. People interact with their own everyday activity spaces on a regular basis. Location-based games offer the possibility to experience the same familiar and everyday spaces in new ways. This can motivate some players to interact with their everyday environment in different ways than they are used to [31,59,60]. Likewise, the distributions of tasks or the ways in which scoring systems are used can be adapted to local conditions. Thus, the exploration of an area can be enriched by additional sensory experiences (e.g., tasks that require the perception of striking colours or the ringing of church bells) or the stronger examination of the history of a supposedly known place [56,63]. Such local adaptations create unique game experiences that have the potential to motivate players, especially when one considers that people conceptualise their everyday geographies differently [64,65,66,67,68,69]. At the same time, this focus on small-scale places can also limit the geographical reach of players, as playing in a very local environment means spending more time in a very confined space [63,70], which may affect the players’ geo-literacy if not compensated otherwise [71,72]. Time-wise, most games follow an asynchronous game mode [73]. This means that players can enter the game and the playing field at any time independently of other players, which makes it easier to integrate a game into everyday life [60].
Other motivating factors related to geographic aspects are those linked to the players’ ability and willingness to explore geographical areas. Many players of location-based games are classified as so-called explorers [74]. The majority of players, therefore, perceive the exploration of a geographical space as a rewarding, motivating element of location-based games with high intrinsic value [1,31,32,38,75,76]. In particular, the combination with high degrees of autonomy, as outlined above, is able to increase the motivational potential of extensive territorial exploration [60,63]. Similarly to the exploration of areas, many players also describe the discovery of hidden features at specified coordinates in a geocaching sense as motivating and satisfying, especially in combination with solving tasks adapted to local geographic conditions [31,77,78]. A side effect of playing that is also an effective motivating element is an increase in the range of movement and daily physical activity, which has positive health effects [79]. For the sake of completeness and overview, the following list includes further geographical factors influencing the motivation of players (without claiming completeness). These factors are important for the design of games but considered less relevant in the context of the study presented in this paper:
  • weather conditions [31,80],
  • time of day including related factors such as pedestrian traffic [81],
  • ambient stress exposure [82],
  • morphology of places and street networks (e.g., frequent dead ends) [83,84],
  • availability of landmarks for orientation and navigation [85,86],
  • environmental stress factors like air pollution [82,87].

3. Methodology

Our methodology uses the so-called triangulation, an approach to increase the trustworthiness of research results [31]. We observed the behaviour of the players during the game and additionally, checked the results obtained by questionnaires and analysed the GPS tracks recorded. In this way, we could identify indications of players’ awareness of the spatial structure in the scoring system. The following subsections describe the study’s methodological approach and the geographical, sociodemographic, and technical context.

3.1. Modified Game

The game we used in our experiment is based on the StreetComplete application. This application allows to collect OSM data in a playful way according to the typical crowdsourcing procedure of task definition, task execution and task solving [78]. The game StreetComplete uses very little jargon, making it accessible to a wide audience, including players without OSM experience. This is further facilitated by visual support for the players, for instance, by providing supporting images illustrating possible answers to the tasks presented (Figure 1). These design features reduce the risk of erroneous contributions and harmonise the otherwise often ambiguous and heterogeneous semantic classifications of OSM features resulting from the underlying folksonomy [88]. In terms of motivation and reward, StreetComplete is open-ended, meaning that players altruistically collect new or refine existing data. Still, one possible way in which players are rewarded is a counter of tasks solved, although this is a non-competitive leaderboard element of the game not visible to other players. For our experiment, the accessible design of the game is important as this reduces potential interferences that may arise from different prior experiences with OSM among our subjects. The game was modified in various ways in order to allow testing of our hypothesis. This is possible because the source code of StreetComplete is open source and hence available online (https://github.com/westnordost/StreetComplete).
One modified aspect are the tasks that were presented to the players. All tasks used are real tasks taken from the actual game StreetComplete. The subset of tasks we used meets the following criteria:
  • Simple tasks were preferred to complicated ones in order to minimise the risk of external distorting effects beyond the scoring system,
  • all tasks must be fully accessible to ensure that they can be solved throughout the game (e.g., indoor tasks are not included),
  • the tasks should be uniformly distributed across the map to avoid spatial bias from local clusters,
  • and the walking distance between tasks should be about 100 m, as pretests carried out by us have shown that this leads to the most neutral visual result on the map at all relevant zoom levels.
In order to compile a corresponding subset of tasks, we overlaid the tasks available from StreetComplete with a regular grid of 100 m in cell side length. The tasks closest to the grid nodes were taken into account for the game. For cases of equal distances, we preferred simple geometric elements such as points to more complex ones such as polygons. We also preferred simpler tasks such as binary yes/no questions over more complex free text input. This led to a useful distribution of tasks, but there is a slight discrepancy between the grid used and the topography of the playing field, which is unavoidable when using real tasks associated with real-world features. This selection procedure led to a set of 132 tasks overall that were used in the game.
Other modifications made to the game include disabling the upload of data to the OSM server and integrating a mechanism that prevents players from cheating. Since the game was played 40 times by different players sharing the same tasks, uploading data to the actual OSM database would have resulted in potentially incorrect or inconsistent contributions. This had to be avoided in order not to interfere negatively with the OSM project. More important in the light of our experiment is the anti-fraud feature. We have created a 50-m buffer around tasks to ensure that players must be near tasks to solve them. Otherwise, unmotivated subjects could have interfered with the results by solving tasks without visiting them. Such a distance-based filter can, of course, lead to frustration in certain situations. For example, if a player is asked to enter the number of floors of a building and could do so from a distance, this can lead to dissatisfaction with the game mode. In most cases, however, we believe that the mechanism will help to ensure the validity of the results obtained. Another modification made concerns the recording of GPS tracks during the game. We recorded GPS coordinates alongside the walking speed at 10-second intervals. These were stored into a database hosted on a server in real time.
All collected information was merged with a unique player ID into one data record. This includes the completed tasks and scores, the GPS tracks and the completed questionnaires (see Section 3.6). In order to make the records anonymous and to be able to reuse the same device, we used randomly generated Universally Unique Identifiers (UUIDs) instead of alternatives such as hardware-bound serial numbers. In practical applications like our experiments, the generated UUIDs are almost guaranteed to be unique [89].

3.2. Spatial Scoring System

Our experiment used two scoring systems. The first scoring system shows a strong spatial pattern in the form of spatial clustering, while the second system used is spatially random. The choice of a random pattern for comparison is based on the idea to eliminate all systematic spatial variation in the game played by the control group. Other configurations would have been possible too but would have represented hypotheses other than the ones we want to test in this paper. For instance, a uniform pattern without any local score variation would have been another interesting case with an extreme level of autocorrelation (i.e., with a a spatial autocorrelation of 1). The way we actually set up the scores, however, allows to investigate the influence of the spatial structure in comparison to a complete absence of the latter, which is exactly what we want to test. Both scoring systems used were generated from simultaneous spatial autoregressive (SAR) models [90] of the form
y = ρ V y + ε
where V is a matrix of pairwise spatial weights and ρ denotes the so-called spatial autoregressive parameter. The vector ε represents the residual errors. The transformation of the model into the evaluable so-called reduced form results in
y = ( I ρ V ) 1 ε
where I is the n × n identity matrix. The SAR generating operator ( I ρ V ) 1 performs matrix inversion to generate simultaneous autoregressive random variables and was used to generate the results we use in both scenarios of our experiment. The parameter ρ was used to control the degree of systematic spatial structuring in the resulting set of random variables. For the case of spatially structured scores, we adjusted ρ to 0.99, while ρ was set to 0.01 for the randomised variant. For the residual vector ε we drew normal variates from N ( 10 , 50 ) . The left multiplication of this column vector with the matrix of the autoregressive variables gives us raw values which are not yet scaled to a suitable and human readable range. We scaled the final scores to the interval [ 5 , 100 ] and rounded all the scores to five steps. Both scoring systems are shown in Figure 2. The map shown in Figure 2a shows that the clustered scoring system led to an alternating radial distribution arranged around the start point located in the centroid of the playing field. This arrangement guarantees that in principle, all clusters can be reached with similar effort. This way, the set-up generated supports our hypothesis testing by not favouring any particular part of the map systematically. One minor limitation caused by the local topography of the playing field, however, is that the high-score clusters can be reached slightly more easily from the start point coordinates. It is further of note to mention that the map view of the modified app does not reveal the scores to the players a priori. This is important to avoid visually affecting and distracting players, which could have distorted our hypothesis testing. Instead, players are presented the scores achieved only after solving tasks in the game.

3.3. Subjects

The experimental design of our study is based on the observation of actual players playing the two variants of StreetComplete under real conditions. We recruited 40 volunteers to act as test persons. Of these, 28 were geography students enrolled at Heidelberg University. The remaining 12 subjects also came from academic backgrounds and were therefore largely comparable with the students involved. All the subjects were either recruited via a student mailing list or by using personal contacts. The youngest participant was 19 years old, while the oldest participant was 41 years old. The average age was 27 years. In gender terms, 25 of our participants were male and 15 female. Overall, the group was relatively homogeneous in terms of demographics, educational level and technical knowledge. This is not only beneficial for the consistency of the results achieved. The characteristics also make our group of test persons representative of the OSM community, which is considered to be predominantly male, 20–40 years old and above average technically proficient [25,30,91]. The latter is important because it may allow the transfer of our results to other location-based serious games in the OSM ecosystem.
All the subjects were randomly assigned to one of two equally sized groups: a treatment group and a control group. This allocation was done using a Python script to avoid any potential subconscious subjectivity. The treatment group was exposed to the modified game equipped with the spatially structured, non-random scoring system as described in Section 3.2. In contrast, the control group was confronted with the spatially randomised arrangement of scores under ceteris paribus conditions.

3.4. Playing Field

The game was played on a real playing field in Heidelberg. The playing field comprises parts of three different urban neighbourhoods of the city: Bergheim, Weststadt and Altstadt (the Old Town). While Bergheim is dominated by a large historic university campus, the other two areas are distinguished by their respective dominant architectural styles. The western part of the city is dominated by Wilhelminian-style houses from around 1900, while the Old Town of Heidelberg is characterised by a uniform ensemble of Baroque architecture. Figure 3 illustrates the character of the playing field. What the three districts have in common is that they are all perceived as pleasant and offer a high quality of stay. This is an important feature for our study, because spatial heterogeneity in the attractiveness of places across the field could have led to a possible bias towards the more attractive areas. The entire area of the playing field is further similarly urban. Heterogeneity with respect to this characteristic might have impacted the internal attractiveness of the area as was described in Section 2.2. The division of our chosen area minimises this risk. The playing field is also more or less uniform with respect to the street network morphology. This ensures a fair distribution of the scores across the map for both low and high-value clusters, as well as similar attractiveness and exploration capability in all parts of the field.
The playing field covers an area of 1.3 square kilometres, which is close to the optimal size of 1.5 square kilometres recommended in previous studies [56] for a playing time of 30–60 min. A playing time of 30–60 min is considered suitable here, as this length does not exhaust the players and at the same time allows sufficient exploration of the playing field. All players started playing the game in a park called Schwanenteich (indicated as ’Start’ in the maps in Figure 2). This starting point is located near the centroid of the area and is about the same distance from all the attractive areas mentioned above. Like the balanced attractiveness of the entire area, the chosen starting point minimises the risk of spatial distortion in the direction of a single above-average attractive part of the playing field. The study was carried out during the semester break. This reduces the probability that students, in particular, might be burdened by routine follow-up activities and thus, less motivated to participate seriously. Further, all participants were advised to play the game for at least 20 min.

3.5. Indicators

In order to test the hypothesis of whether a spatially structured scoring system has an influence on gaming behaviour, meaningful indicators are required. We have identified a number of indicators that reflect different aspects of player motivation and behaviour during the game. These can be grouped into two classes.
One class of indicators we consider is indicative of the influence of spatial structure on the intrinsic and extrinsic properties of the game. Examples include the attractiveness of the tasks (intrinsic) and the general interest in playing location-based serious games (extrinsic). We hypothesise that the recognition of structures and thus of a meaningful underlying systematic leads to a strengthening of the positive (and reduction of negative) motivational characteristics. Indicators classified in this class include (top of Table 1): game duration, distance walked, average walking speed and number of tasks completed. To ensure comparability, we normalised the number of answers given and the distance walked over the game duration. In particular, the combination of these indicators is helpful to identify the effects we are interested in.
Another class of indicators that we evaluated is more directly linked to the geographical exploration of the playing field. The exploration behaviour allows us to draw conclusions about the potential of spatially structured scoring systems to guide players’ movements across the playing field. For example, players can consciously or unconsciously move towards clusters of high scores or actively avoid clusters of low scores by moving away from them. We tested these effects using (bottom of Table 1): the area and linearity (the ratio of the movement along the X and Y axes) of the standard deviation ellipses of the players of the visited locations (these should indicate the radius of interaction and the target orientation of the players), a detour factor (the ratio of the actual path to the shortest path, calculated with the OpenRouteService API (https://openrouteservice.org/) using the median coordinates as an additional waypoint to handle circle-shaped paths) and the mix of road types traversed (which represent the study of the diversity of the area). In this way, we covered a number of important aspects, allowing us to draw meaningful conclusions.

3.6. Questionnaire

Upon game completion, all the subjects were asked to complete a questionnaire (see Appendix A). This questionnaire consists of a combination of closed and partially open questions. The latter offer the possibility of writing an individual answer in addition to the existing answer options [92]. The individual questions do not appear coincidental in the questionnaire but are grouped into coherent thematic blocks.
The first section of the questionnaire mostly deals with the entertainment value and handling of the game. Although these questions have little relevance for the hypothesis of the investigation, they facilitate easy entry into the questionnaire through their direct relation to the game. More importantly, these initial questions leave the respondent unclear as to the objective of the investigation, which supports unbiased and truthful answers to the following questions. Furthermore, motivating factors and any difficulties that may have arisen are asked. The preset answer options are based on empirical studies on player motivation previously carried out [31,63,75,77].
The second section focuses on the player’s already existing experience with OSM and location-based games. These factors have a strong influence on the expectations of the players and the gaming experience [93,94]. In addition, some questions deal specifically with the scoring system. Among other things, it is asked whether the player is of the opinion that clearly defined areas with high or low scores were present and whether detours or longer walking distances have been considered acceptable for achieving higher scores. In addition, questions from this section of the questionnaire aim to better understand the spatial decision-making of the players.

4. Results and Discussion

We organised our results into three main subsections. The first part describes the differences between the two scoring systems tested with respect to overall global characteristics (i.e., the indicators introduced in Section 3.5). We then provide a localised overview of spatial variations in the movement patterns of both tested groups of players. A third section introduces results on the conscious awareness of the players regarding the presence of an underlying spatial scoring system.

4.1. Global Indicators

We assessed the indicators introduced in Section 3.5 for both groups playing the two versions of the game (Table 1). An interesting result is that most indicators point to a motivating effect of the spatial structure found in one of the used scoring systems. Players from the treatment group showed an average of 29% longer playing times than the players from the control group. Moreover, the same players were more likely to walk longer distances even after the normalisation over game duration. These results indicate an increased willingness to explore the playing field and the underlying geographical area more fully. At the same time, it was found that the players in the treatment group also moved more slowly, although this effect is rather weak. More relevant seems to be the larger average number of tasks solved by the treatment group. This result may be informative for a possible higher motivation to participate proactively in the location-based game if a certain, in this case, spatial, logic exists in the scoring system.
In addition to the indicators mentioned above, we also evaluated measures that include game characteristics more closely related to the geography of the playing field. The areas of the standard deviation ellipses calculated from the players’ GPS trajectories, however, did not differ substantially between the two groups tested. Both groups seem to have explored similarly large areas. Yet, the standard deviation ellipses give only a rough estimate of the areas explored. More revealing is the difference in the linearities and hence the shapes of the ellipses. The treatment group generated trajectories that led to more bulbous ellipses, indicating lateral movements and a more complete exploration of local areas. In contrast, the control group shows more directional ellipses that suggest a more linear exploration of the area. This result is further supported by the observation that the treatment group, on average, is more likely to take detours rather than direct routes. The detour factor is one higher for the treatment group, which means that the players in this group added the length of a full shortest path to the distance that would have been necessary to traverse the area. In addition, the treatment group also crossed a wider range of road types, further substantiating the results discussed in this paragraph.
The results presented above are important indications and thus support evidence for the possible effects of spatially structured scoring systems. Nevertheless, it is important to critically review their scope and validity. A problem that often occurs in studies such as the one presented here in which human subjects are asked to spend a certain amount of their time is a limited number of available test persons. The p-values given in Table 1 should therefore be treated with caution as the statistical power of the estimators is negatively influenced by our relatively small sample size [95]. In turn, this means that for larger experiments, the results should be even clearer than our results in terms of p-values, whereas our interpretation of the effect sizes might be a bit too optimistic. A low statistical power leads to a lower likelihood of discovering effects when they are actually present. The p-values given are therefore likely to be overestimated, which is an interesting observation given the considerable absolute differences that have been revealed. It is also important to consider the nature of the results presented. These are quantified correlations and not causal relationships. The results should therefore be considered as indicative, not confirmatory, in nature.
Taking into account not only the differences in mean values, but also other characteristics of the data distributions largely supports our above results. Figure 4 shows box plots and histograms for the game duration and detour factors for which the mean values differ significantly between the two groups tested. An important observation in the box plots is that both variables exhibit similar outlier behaviours for the control and treatment groups. This reinforces the validity of our results on these variables reported above since the mean differences are unlikely to be due to outliers. Another observation made in the box plots is that the median especially of the game duration variable is much higher for the treatment group. The absolute difference between the two medians is 9 min, which is close to the mean difference reported in Table 1, the latter being further validated as the medians are less susceptible to outlier effects. The histograms also show that in both cases, the distributions for the treatment group are concentrated further to the right, confirming and supporting the above results and interpretations. Similar findings can be made for the other, non-significant mean differences from Table 1, taking into account the associated distributions. The corresponding charts can be found in the Appendix B in Figure A1.

4.2. Local Movement Patterns

We studied the local movement patterns of the players to obtain more detailed insight into their use of the playing field. The maps in Figure 5 show clusters of the numbers of visits to tasks for both scenarios of the game. The clusters were generated using Getis-Ord G i * , a method that allows to reveal geographic concentrations in the extremes of a distribution [96,97]. In the maps presented, coldspots (i.e., concentrations of small values) indicate areas where visited and unvisited task locations are closely adjacent (unvisited tasks were not included in the cluster calculation). Although both maps show hotspots (i.e., accumulations of high values) in the centre of the field, the main difference between the results for the treatment group and those for the control group is that players from the latter group move more into areas with low values. This effect is most evident in the eastern part of the playing field. While there are a number of coldspots in that part of the map for the control group, the same area shows a large number of unvisited tasks for the treatment group. At the same time, the players of the treatment group visit more locations in the central parts, which spread out to the north and south. These are the more rewarding areas in this scenario, so it seems plausible to observe players from the treatment group visiting these parts of the playing field. What also stands out is that the players in the control group left 51 tasks unvisited whereas the players in the treatment group only left 43 tasks unvisited. These results indicate a possible motivating effect of the geographically clustered high scores.
The results described above are further backed up by the results of a bivariate spatial analysis of the task visits and the scores offered. We calculated the spatial correlation between the two variables using the bivariate local Moran’s I coefficient [98] calculated using the number of visits and their geographically surrounding scores. Figure 6 shows that for the treatment group, we find a very strong correlation between visits made and spatially surrounding scores. This is reflected in a large number of high–high links, that is, high numbers of visits found in areas with high scores at the same time. The corresponding global bivariate spatial correlation coefficient is 0.39 and was found to be highly significant. In contrast, there is no such spatial correlation for the control group, which has a non-significant global coefficient of 0.01 close to the expected value of this statistic. There are almost no high–high links, and the overall pattern of the different types of clustering seems to be more random than with the treatment group. These results support the findings from the hotspot clustering analysis presented above and also provide an indication of a possible correlation between gaming behavior and the underlying structure of the scoring system.
Our results concerning local movement patterns must be considered in the light of certain limitations. Using the same starting point for all subjects may have caused some spatial coincidence in the visits of tasks. We calculated the same bivariate local Moran’s I coefficient from above also for the numbers of visits of both versions of the game. After removing three outliers, the correlation is still 0.29, indicating a possible effect of our choice for the starting point. Future research should explore a more optimal configuration that takes account of both player behaviour and score clusters. Moreover, the large road just south of the starting point may have caused a larger number of subjects to initially move north instead of south. Nevertheless, we believe that our results, obtained with a reproducible method, provide evidence that will stimulate further research on the effects of spatially structured scoring systems.

4.3. Scoring System Awareness

The evaluation of the questionnaires and the players’ GPS tracks allows us to investigate the players’ in-game awareness of the existence of a structured scoring system. The visual inspection of the mapped trajectories (Figure 7) shows no obvious differences between the two groups tested. The players in the treatment group seem to have explored the southern part, which is located in one of the high score clusters, in more detail. In contrast, the trajectories of the players from the control group show a slightly more expansive, less coherent geometric pattern. However, no clear and systematic differences between the two groups can be deduced from looking at the trajectory maps and their geometric arrangements.
A closer look at the trajectories, taking into account the temporal aspects and the questionnaires, reveals a more differentiated picture. It turns out that 25% of the players from the treatment group show strong indications of at least subconscious perception of a systematic pattern in their played scoring system. The trajectories reveal that these players returned to high score clusters several times after leaving them, and only after they had previously solved at least four tasks within those clusters. The same players also stated in their questionnaires that they noticed a systematic pattern in their scores, although some of them suspected that this pattern was related to the social and cultural relevance of the areas (e.g., the university buildings in the northern central part of the playing field). This behaviour was not observed in the control group, which gives rise to the conjecture that more players from the treatment group became aware of an underlying system in the scores than from the control group.
The conjecture that players may have become aware of a system underlying the scores is further supported by a look at the questionnaires. Players from the control group frequently stated that they suspected they were playing a random system. The same players also said that this had led to a certain degree of frustration. Furthermore, twice as many players from the control group rated the number of points awarded for solving tasks as low, while players from the treatment group showed a more positive assessment of the scoring system (Figure 8a). With the exception of only two outliers, all players from the treatment group consistently evaluated their played scoring system in a positive light. In contrast, and with little overlap with the responses from the treatment group, the players from the control group stated the scores awarded were too low. These findings underline the importance of an understandable system in the game mode and add a geospatial component to previous results. However, it should be noted that not only players from the treatment group thought they had found a systematic pattern in the scores. Some players from the control group also speculated about possible systems in terms of the traffic significance of roads, the attribute completeness of OSM features, the geometric distance of a player from a task at the time of solving it, and even the speed at which the tasks were solved.
Another important outcome from the questionnaires is that 65% of all players stated that they would play the game even without any scoring system. This may be related to the fact that most of our subjects come from a geographic or spatial background, which reinforces their natural interest in geographic serious games. Looking at the responses to the respective question in more detail, however, reveals an important difference between the two tested groups (Figure 8b). The players from the control group show a certain degree of indifference towards the scores awarded. These players have indicated frequently that they would play the game also without any scoring system in place. The players from the treatment group, instead, show a much more balanced response behaviour on this question. The number of answers “yes” to the question is almost identical to the number of “no” answers. It seems that the positive experience of the scoring system played has had an influence on the mindset of players from the treatment group, making them less willing to play for completely altruistic reasons. The latter result is important for a better understanding of the potential long-term consequences of using spatially structured scoring systems, and hopefully motivates respective long-term studies. Overall, the results obtained reveal that only players from the treatment group show systematic and consistent behavior about the questionnaires and their actual movements as shown in the trajectories.

4.4. Synopsis

Our results reveal a number of relevant theoretical aspects. Some players stated that they have become aware of a systematically structured scoring system, even when this was actually not the case. Our triangulation approach allowed us to identify those players who recognised the underlying system and acted accordingly. This shows that there is a certain discrepancy between the perception of the structure of scoring systems and the actual control of actions through these systems, an aspect that deserves more attention in future research. Furthermore, our results show that the established player types as outlined in [74] may not be complete for the case of location-based games. Some of our subjects have shown characteristics of both achievers (players who try to maximise the number of points scored) and explorers (players who have a genuine interest in discovering the geography of the playing field). In contrast, some other players have shown a tendency to be what one might call path optimisers, as they tried to cross the field quickly and efficiently. For location-based games, therefore, a review of existing player categorisations might be necessary.
Our results complement the existing knowledge about the importance of comprehensible scoring systems. Scoring systems have the ability to stimulate and activate players and make them play longer [100]. They also serve as instruments for self-evaluation and comparison [101]. For games that require the development of decision strategies, it is important to what extent the players become aware of the functioning of the underlying scoring system [102]. This is the case in location-based serious games, where players must operate in a real, physical environment. Optimising scoring systems in such games requires a thorough knowledge of how scoring systems work. The results presented here contribute a spatial perspective that is relevant for the geographical context of location-based serious games. The knowledge gained will thus be valuable for game designers to better utilise spatial structure when designing comprehensible scoring systems.

5. Conclusions

In this article, empirical findings on the influence of spatially structured scoring systems on the behaviour of players of location-based serious games are presented. The study was conducted in a real urban environment in the city of Heidelberg in Germany. Two groups of players played two different versions of the game StreetComplete, one of which was equipped with a spatially structured scoring system. The other version included a random scoring system. The results obtained show that many players at least subconsciously adapted their playing behaviour to the presence and structure of a scoring system. Players from the treatment group tended to move more frequently to areas where high scores were accumulating. In contrast, players from the control group reported a certain level of frustration caused by a perceived randomness of the scoring system played. Players who were confronted with a spatially structured scoring system also showed a longer average playing time, walked longer distances and tended to take detours to explore the area more extensively. The evidence revealed in this study is a relevant addition to the knowledge about location-based serious games.
Some of the insights gained in this study may be applicable to games in contexts other than OSM. The so-called triangle of shared data sources presented in [103] shows that user-generated datasets like Wikipedia or the Citizen Science Project eBird share similar principles as the OpenStreetMap project. In the light of the present study, this is promising, as it could allow other researchers to apply our findings to the motivational aspects of other related types of datasets. In practical terms, this could be valuable to use our findings on the effects of spatial structure for targeted data collection, for example, to fill data gaps or to encourage users to react quickly in time-critical campaigns. In this sense, our results are particularly interesting for the use of spatial patterns in the personalisation of games, which further increases the motivation of players [104,105]. Overall, the results we achieved here are likely to be relevant also beyond the specific OSM context.

6. Future Research

Future research on the role of spatial structure in scoring systems should extend our approach to other cultural and geographical contexts. Our results are only valid for a Western and especially European context and are also limited by a certain local topography. It will be interesting to see how the results vary as the context conditions change. This includes systematically testing interactions between spatial structure in scores and geographical features of a playing field. Similarly, and as already critically noted, future studies should also vary the implementation of the spatial structure in scoring systems (e.g., in terms of the arrangement of the clusters and their size) as well as in terms of the placement of the starting points. This will allow to draw conclusions about possible arrangement and scaling effects in the recognition of applied systems. It should also be investigated to what extent the spatial structure in a scoring system can influence data quality, an aspect that is particularly important in the context of serious games. Another interesting research area that can be related to our results obtained here is the topic of formalising and operationalising place in a human-geographical sense. GIScience has recently begun to investigate this topic more comprehensively [66,69,106,107], and the motivational aspect of this study could also be informative to explanations of how motivating environments influence the perception and conceptualisation of places. Further, in order to overcome the issue of investigating rather small cohorts of players for pragmatic reasons, it would be very interesting to conflate gaming elements with event sampling and other in situ survey techniques [108]. This way, it might be possible to investigate larger groups of players through better integration of the game into everyday routines.

Author Contributions

Conceptualisation, Rene Westerholt, Heinrich Lorei and Bernhard Höfle; methodology, Rene Westerholt and Heinrich Lorei; software, Heinrich Lorei; validation, Heinrich Lorei; formal analysis, Heinrich Lorei; investigation, Rene Westerholt and Heinrich Lorei; resources, Heinrich Lorei; data curation, Heinrich Lorei; writing–original draft preparation, Rene Westerholt; writing–review and editing, Rene Westerholt, Bernhard Höfle and Heinrich Lorei; visualization, Heinrich Lorei and Rene Westerholt; supervision, Rene Westerholt and Bernhard Höfle; project administration, Rene Westerholt and Bernhard Höfle; funding acquisition, Rene Westerholt and Bernhard Höfle. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge financial support by Deutsche Forschungsgemeinschaft and Technische Universität Dortmund/TU Dortmund University within the funding programme Open Access Publishing.

Acknowledgments

We are grateful to Alexander Zipf (Heidelberg University) for valuable discussions that have led to an improvement of the study design. We would also like to thank all anonymous participants who took part in our study.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Ijgi 09 00129 i001Ijgi 09 00129 i002

Appendix B

Figure A1. Box plots of behavioural variables assessed for both tested groups. (a) Normalised distance walked; (b) Average walking speed; (c) Area of the standard deviational ellipse; (d) Linearity of the standard deviational ellipse; (e) Share of road types traversed; (f) Normalised number of tasks completed.
Figure A1. Box plots of behavioural variables assessed for both tested groups. (a) Normalised distance walked; (b) Average walking speed; (c) Area of the standard deviational ellipse; (d) Linearity of the standard deviational ellipse; (e) Share of road types traversed; (f) Normalised number of tasks completed.
Ijgi 09 00129 g0a1

References

  1. Scheider, S.; Kiefer, P. (Re-) Localization of Location-Based Games. In Geogames and Geoplay; Springer: Berlin, Germany, 2018; pp. 131–159. [Google Scholar]
  2. Gong, H.; Hassink, R.; Maus, G. What does Pokémon Go teach us about geography? Geogr. Helv. 2017, 72, 227–230. [Google Scholar] [CrossRef] [Green Version]
  3. Juhász, L.; Hochmair, H.H. Where to catch ‘em all?—A geographic analysis of Pokémon Go locations. Geo-Spat. Inf. Sci. 2017, 20, 241–251. [Google Scholar] [CrossRef]
  4. Avouris, N.; Sintoris, C.; Yiannoutsou, N. Design guidelines for location-based mobile games for learning. In Proceedings of the 17th ACM Conference on Interaction Design and Children, Patra, Greece, 4–5 November 2018; pp. 741–744. [Google Scholar]
  5. Laamarti, F.; Eid, M.; Saddik, A.E. An overview of serious games. Int. J. Comput. Games Technol. 2014, 2014, 11. [Google Scholar] [CrossRef]
  6. Chang, M.; Goodman, E. FIASCO: Game interface for location-based play. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, Cambridge, MA, USA, 1–4 August 2004; pp. 329–332. [Google Scholar]
  7. Mizuyama, H.; Yamaguchi, S.; Sato, M. A prediction market-based gamified approach to enhance knowledge sharing in organizations. Simul. Gaming 2019, 50, 572–597. [Google Scholar] [CrossRef]
  8. Meske, C.; Brockmann, T.; Wilms, K.; Stieglitz, S. Social collaboration and gamification. In Gamification; Springer: Berlin, Germany, 2017; pp. 93–109. [Google Scholar]
  9. Schmid, A.; Schoop, M. Inherent Game Characteristics of Electronic Negotiations. In Proceedings of the UK Academy for Information Systems Conference 2018 (UKAIS 2018), Oxford, UK, 19–21 March 2018. [Google Scholar]
  10. Chen, H.J.H.; Hsu, H.L. The impact of a serious game on vocabulary and content learning. Comput. Assisted Lang. Learn. 2019, 1–22. [Google Scholar] [CrossRef]
  11. Peterson, M. Computerized games and simulations in computer-assisted language learning: A meta-analysis of research. Simul. Gaming 2010, 41, 72–93. [Google Scholar] [CrossRef]
  12. Johnson, W.L. Serious use of a serious game for language learning. Front. Artif. Intell. Appl. 2007, 158, 67. [Google Scholar]
  13. Taillandier, F.; Adam, C. Games ready to use: A serious game for teaching natural risk management. Simul. Gaming 2018, 49, 441–470. [Google Scholar] [CrossRef]
  14. Castelletti, A.; Cominola, A.; Facchini, A.; Giuliani, M.; Fraternali, P.; Herrera, S.; Melenhorst, M.; Micheel, I.; Novak, J.; Pasini, C.; et al. Gamified approaches for Water Management Systems: An Overview. In Smart Water Grids: A Cyber-Physical Systems Approach; Taylor Francis CRC Press: Boca Raton, FL, USA, 2017; pp. 164–197. [Google Scholar]
  15. Madani, K.; Pierce, T.W.; Mirchi, A. Serious games on environmental management. Sustain. Cities Soc. 2017, 29, 1–11. [Google Scholar] [CrossRef] [Green Version]
  16. Poplin, A.; Vemuri, K. Spatial Game for Negotiations and Consensus Building in Urban Planning: YouPlaceIt! In Geogames and Geoplay; Springer: Berlin, Germany, 2018; pp. 63–90. [Google Scholar]
  17. Devisch, O.; Poplin, A.; Sofronie, S. The gamification of civic participation: Two experiments in improving the skills of citizens to reflect collectively on spatial issues. J. Urban Technol. 2016, 23, 81–102. [Google Scholar] [CrossRef]
  18. Poplin, A. Playful public participation in urban planning: A case study for online serious games. Comput. Environ. Urban Syst. 2012, 36, 195–206. [Google Scholar] [CrossRef]
  19. Abt, C.C. Serious Games; University Press of America: New York, NY, USA, 1987. [Google Scholar]
  20. Antoniou, V.; Schlieder, C. Participation patterns, VGI and gamification. In Proceedings of the AGILE 2014, Castellón, Spain, 3–6 June 2014; pp. 3–6. [Google Scholar]
  21. Jokar Arsanjani, J.; Bakillah, M. Understanding the potential relationship between the socio-economic variables and contributions to OpenStreetMap. Int. J. Digit. Earth 2015, 8, 861–876. [Google Scholar] [CrossRef]
  22. Budhathoki, N.R.; Haythornthwaite, C. Motivation for open collaboration: Crowd and community models and the case of OpenStreetMap. Am. Behav. Sci. 2013, 57, 548–575. [Google Scholar] [CrossRef]
  23. Mocnik, F.B.; Zipf, A.; Raifer, M. The OpenStreetMap folksonomy and its evolution. Geo-Spat. Inf. Sci. 2017, 20, 219–230. [Google Scholar] [CrossRef]
  24. Goodchild, M.F. Citizens as sensors: The world of volunteered geography. GeoJournal 2007, 69, 211–221. [Google Scholar] [CrossRef] [Green Version]
  25. Haklay, M.; Basiouka, S.; Antoniou, V.; Ather, A. How many volunteers does it take to map an area well? The validity of Linus’ law to volunteered geographic information. Cartogr. J. 2010, 47, 315–322. [Google Scholar] [CrossRef] [Green Version]
  26. Ma, D.; Sandberg, M.; Jiang, B. Characterizing the heterogeneity of the OpenStreetMap data and community. ISPRS Int. J. Geo-Inf. 2015, 4, 535–550. [Google Scholar] [CrossRef]
  27. Neis, P.; Zielstra, D. Recent developments and future trends in volunteered geographic information research: The case of OpenStreetMap. Future Internet 2014, 6, 76–106. [Google Scholar] [CrossRef] [Green Version]
  28. Zielstra, D.; Zipf, A. A comparative study of proprietary geodata and volunteered geographic information for Germany. In Proceedings of the 13th AGILE International Conference on Geographic Information Science, Guimarães, Portugal, 11–14 May 2010. [Google Scholar]
  29. Napolitano, M.; Mooney, P. MVP OSM: A tool to identify areas of high quality contributor activity in OpenStreetMap. Bull. Soc. Cartogr. 2012, 45, 10–18. [Google Scholar]
  30. Coleman, D.; Georgiadou, Y.; Labonte, J. Volunteered geographic information: The nature and motivation of produsers. Int. J. Spat. Data Infrastructures Res. 2009, 4, 332–358. [Google Scholar]
  31. Weber, J. Designing Engaging Experiences with Location-Based Augmented Reality Games for Urban Tourism Environments. Ph.D. Thesis, Bournemouth University, Bournemouth, UK, 2017. [Google Scholar]
  32. Harteveld, C. Triadic Game Design: Balancing Reality, Meaning and Play; Springer Science & Business Media: Berlin, Germany, 2011. [Google Scholar]
  33. Juul, J. The game, the player, the world: Looking for a heart of gameness. In Proceedings of the DiGRA International Conference, Utrecht, The Netherlands, 4–6 November 2003; pp. 30–45. [Google Scholar]
  34. Salen, K.; Zimmerman, E. Rules of Play: Game Design Fundamentals; MIT press: Cambridge, MA, USA, 2004. [Google Scholar]
  35. Huizinga, J. Homo Ludens: A Study of the Play-Element in Culture; Routledge & Kegan Paul: London, UK, 1944. [Google Scholar]
  36. Rodríguez-Pupo, L.; Casteleyn, S.; Granell, C. On metrics for location-aware games. ISPRS Int. J. Geo-Inf. 2017, 6, 299. [Google Scholar] [CrossRef] [Green Version]
  37. Schell, J. The Art of Game Design: A Book of Lenses; AK Peters/CRC Press: Boca Raton, FL, USA, 2019. [Google Scholar]
  38. Schoenau-Fog, H. The Player Engagement Process-An Exploration of Continuation Desire in Digital Games. In Proceedings of the 5th DiGRA International Conference, Utrecht, The Netherlands, 14–17 September 2011. [Google Scholar]
  39. Malone, T.W.; Lepper, M.R. Making Learning Fun: A Taxonomy of Intrinsic Motivations for Learning. In Aptitude, Learning, and Instruction; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 1987; Volume 3, pp. 223–253. [Google Scholar]
  40. Koster, R. Theory of Fun for Game Design; O’Reilly Media: Sebastopol, CA, USA, 2013. [Google Scholar]
  41. Yee, N. Motivations for play in online games. CyberPsychology Behav. 2006, 9, 772–775. [Google Scholar] [CrossRef] [PubMed]
  42. Stampfl, N.S. Die verspielte Gesellschaft: Gamification oder Leben im Zeitalter des Computerspiels; Heise Medien: Hannover, Germany, 2012. [Google Scholar]
  43. Bostan, B.; Tingoy, O. Game Design and Gamer Psychology. In Gamer Psychology and Behavior; Springer: Berlin, Germany, 2016; pp. 105–121. [Google Scholar]
  44. Hiwiller, Z. Players Making Decisions: Game Design Essentials and the Art of Understanding Your Players; New Riders: Berkeley, CA, USA, 2015. [Google Scholar]
  45. Deci, E.L.; Ryan, R.M. Overview of self-determination theory: An organismic dialectical perspective. In Handbook of Self-Determination Research; The University of Rochester Press: Rochester, NY, USA, 2002; pp. 3–33. [Google Scholar]
  46. Boswijk, A.; Thijssen, T.; Peelen, E. The Experience Economy: A New Perspective; Pearson Education: Upper Saddle River, NJ, USA, 2007. [Google Scholar]
  47. Csikszentmihalyi, M. Beyond Boredom and Anxiety; Jossey-Bass: San Francisco, CA, USA, 2000. [Google Scholar]
  48. Ryan, R.M.; Rigby, C.S.; Przybylski, A. The motivational pull of video games: A self-determination theory approach. Motiv. Emot. 2006, 30, 344–360. [Google Scholar] [CrossRef]
  49. Vansteenkiste, M.; Niemiec, C.P.; Soenens, B. The development of the five mini-theories of self-determination theory: An historical overview, emerging trends, and future directions. In The Decade Ahead: Theoretical Perspectives on Motivation and Achievement; Emerald Group Publishing Limited: Bingley, UK, 2010; pp. 105–165. [Google Scholar]
  50. Weiser, P.; Bucher, D.; Cellina, F.; De Luca, V. A Taxonomy of Motivational Affordances for Meaningful Gamified and Persuasive Technologies. In Proceedings of the 3rd International Conference on ICT for Sustainability (ICT4S), Copenhagen, Denmark, 7–9 September 2015; pp. 271–280. [Google Scholar]
  51. Skinner, B.F. Operant behavior. Am. Psychol. 1963, 18, 503. [Google Scholar] [CrossRef]
  52. Rigby, S.; Ryan, R.M. Glued to Games: How Video Games Draw us in and Hold us Spellbound: How Video Games Draw us in and Hold us Spellbound; AbC-CLIo: Santa Barbara, CA, USA, 2011. [Google Scholar]
  53. McGonigal, J. Reality Is Broken: Why Games Make us better and How They Can Change the World; Penguin: New York, NY, USA, 2011. [Google Scholar]
  54. Zichermann, G.; Cunningham, C. Gamification by Design: Implementing Game Mechanics in web and Mobile Apps; O’Reilly Media: Sebastopol, CA, USA, 2011. [Google Scholar]
  55. Schlatter, B.E.; Hurd, A.R. Geocaching: 21st-century hide-and-seek. J. Phys. Educ. Recreat. Danc. 2005, 76, 28–32. [Google Scholar] [CrossRef]
  56. Schlieder, C. Geogames Organizer’s Guide v1.0; Technical Report; Universität Bamberg: Bamberg, Germany, 2014. [Google Scholar]
  57. Duggan, E. Squaring the (magic) circle: A brief definition and history of pervasive games. In Playable Cities; Springer: Berlin, Germany, 2017; pp. 111–135. [Google Scholar]
  58. Schlieder, C.; Kiefer, P.; Matyas, S. Geogames: Designing location-based games from classic board games. IEEE Intell. Syst. 2006, 21, 40–46. [Google Scholar] [CrossRef]
  59. Mäyrä, F.; Lankoski, P. Play in a Mixed Reality: Alternative Approaches into Game Design. In Digital Cityscapes: Merging Digital and Urban Playspaces; de Souza e Silva, A., Sutko, D.M., Eds.; Peter Lang: New York, NY, USA, 2012; pp. 129–147. [Google Scholar]
  60. Matyas, S. Gemeinschaftliche Qualitätsgesicherte Erhebung und Semantische Integration von Raumbezogenen Daten; University of Bamberg Press: Bamberg, Germany, 2011; Volume 7. [Google Scholar]
  61. Davidovic, N.; Mooney, P.; Stoimenov, L. An analysis of tagging practices and patterns in urban areas in OpenStreetMap. In Proceedings of the AGILE 2016 Conference, Helsinki, Finland, 14–17 June 2016; pp. 14–17. [Google Scholar]
  62. Kaminske, V. Die räumliche Wahrnehmung: Grundlage für Geographie und Kartographie; Wissenschaftliche Buchgesellschaft: Darmstadt, Germany, 2012. [Google Scholar]
  63. Will, C. A Pattern Language for Designing Location-Based Games. Ph.D. Thesis, RWTH Aachen University, Aachen, Germany, 2013. [Google Scholar]
  64. Egenhofer, M.J.; Mark, D.M. Naive Geography. In International Conference on Spatial Information Theory; Springer: Berlin, Germany, 1995; pp. 1–15. [Google Scholar]
  65. Cresswell, T. Place: An introduction; John Wiley & Sons: Hoboken, NJ, USA, 2014. [Google Scholar]
  66. Westerholt, R.; Gröbe, M.; Zipf, A.; Burghardt, D. Towards the statistical analysis and visualization of places. In Proceedings of the 10th International Conference on Geographic Information Science (GIScience 2018), Melbourne, Australia, 28–31 August 2018. [Google Scholar]
  67. Westerholt, R.; Mocnik, F.B. Introduction to the PLATIAL’18 Workshop on Platial Analysis. In Proceedings of the 1st Workshop on Platial Analysis (PLATIAL’18), Heidelberg, Germany, 20–21 September 2018; pp. 1–5. [Google Scholar]
  68. Westerholt, R.; Mocnik, F.B. Introduction to the Second International Symposium on Platial Information Science. In Proceedings of the 2nd International Symposium on Platial Information Science (PLATIAL’19), Coventry, UK, 5–6 September 2019; pp. 1–3. [Google Scholar]
  69. Purves, R.S.; Winter, S.; Kuhn, W. Places in information science. J. Assoc. Inf. Sci. Technol. 2019. [Google Scholar] [CrossRef] [Green Version]
  70. Reid, J. Design for coincidence: Incorporating real world artifacts in location based games. DIMEA 2008, 8, 10–12. [Google Scholar]
  71. Nolan, R.E. Geo-literacy: How well adults understand the world in which they live. Adult Basic Educ. 2002, 12, 134–144. [Google Scholar]
  72. Galani, L. Geo-Literacy as the basis of the Building of Cultural Identity. Eur. J. Geogr. 2016, 7, 17–23. [Google Scholar]
  73. Huizenga, J.; Admiraal, W.; Akkerman, S.; Dam, G.T. Mobile game-based learning in secondary education: Engagement, motivation and learning in a mobile city game. J. Comput. Assist. Learn. 2009, 25, 332–344. [Google Scholar] [CrossRef]
  74. Bartle, R. Hearts, clubs, diamonds, spades: Players who suit MUDs. J. MUD Res. 1996, 1, 19. [Google Scholar]
  75. Bell, M.; Chalmers, M.; Barkhuus, L.; Hall, M.; Sherwood, S.; Tennent, P.; Brown, B.; Rowland, D.; Benford, S.; Capra, M.; et al. Interweaving mobile games with everyday life. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Montréal, QC, Canada, 22–27 April 2006; pp. 417–426. [Google Scholar]
  76. Hunicke, R.; LeBlanc, M.; Zubek, R. MDA: A formal approach to game design and game research. In Proceedings of the AAAI Workshop on Challenges in Game AI, San Jose, CA, USA, 25–26 July 2004; Volume 4, p. 1722. [Google Scholar]
  77. Fränti, P.; Mariescu-Istodor, R.; Sengupta, L. O-Mopsi: Mobile orienteering game for sightseeing, exercising, and education. ACM Trans. Multimed. Comput. Commun. Appl. 2017, 13, 56. [Google Scholar] [CrossRef]
  78. Celino, I.; Cerizza, D.; Contessa, S.; Corubolo, M.; Dell’Aglio, D.; Valle, E.; Fumeo, S.; Piccinini, F. Urbanopoly: Collection and quality assesment of geo-spatial linked data via a human computation game. In Proceedings of the 10th Semantic Web Challenge, Boston, MA, USA, 11–15 November 2012; pp. 148–163. [Google Scholar]
  79. Colley, A.; Thebault-Spieker, J.; Lin, A.Y.; Degraen, D.; Fischman, B.; Häkkilä, J.; Kuehl, K.; Nisi, V.; Nunes, N.J.; Wenig, N.; et al. The geography of Pokémon GO: Beneficial and problematic effects on places and movement. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, 6–11 May 2017; pp. 1179–1192. [Google Scholar]
  80. Winter, S.; Richter, K.F.; Baldwin, T.; Cavedon, L.; Stirling, L.; Duckham, M.; Kealy, A.; Rajabifard, A. Location-based mobile games for spatial knowledge acquisition. In Proceedings of the 2011 Workshop on Cognitive Engineering for Mobile GIS; CEUR-WS: Aachen, Germany, 2011. [Google Scholar]
  81. Carrigy, T.; Naliuka, K.; Paterson, N.; Haahr, M. Design and evaluation of player experience of a location-based mobile game. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, Reykjavik, Iceland, 16–20 October 2010; pp. 92–101. [Google Scholar]
  82. Knöll, M.; Neuheuser, K.; Vogt, J.; Rudolph-Cleff, A. Einflussfaktoren der gebauten Umwelt auf wahrgenommene Aufenthaltsqualität bei der Nutzung städtischer Räume. Umweltpsychologie 2014, 18, 84–102. [Google Scholar]
  83. Oliveira, V. Urban Morphology: An Introduction to the Study of the Physical Form of Cities; Springer International Publishing: Berlin, Germany, 2016. [Google Scholar]
  84. Bedö, V. Size and Shape of the Playing Field: Research Through Game Design Approach. In Playable Cities: The City as a Digital Playground; Nijholt, A., Ed.; Springer: Singapore, 2017; pp. 67–86. [Google Scholar]
  85. Bestgen, A.K.; Edler, D.; Kuchinke, L.; Dickmann, F. Analyzing the Effects of VGI-based Landmarks on Spatial Memory and Navigation Performance. KI - Künstliche Intell. 2017, 31, 179–183. [Google Scholar] [CrossRef]
  86. Richter, K.F.; Winter, S. Cognitive Aspects: How People Perceive, Memorize, Think and Talk about Landmarks. In Landmarks: GIScience for Intelligent Services; Springer International Publishing: Berlin, Germany, 2014; pp. 41–108. [Google Scholar]
  87. Engl, S.; Nacke, L.E. Contextual influences on mobile player experience—A game user experience model. Entertain. Comput. 2013, 4, 83–91. [Google Scholar] [CrossRef]
  88. Vandecasteele, A.; Devillers, R. Improving volunteered geographic information quality using a tag recommender system: The case of OpenStreetMap. In OpenStreetMap in GIScience; Springer: Berlin, Germany, 2015; pp. 59–80. [Google Scholar]
  89. Leach, P.J.; Mealling, M.; Salz, R. IETF RFC4122: A Universally Unique Identifier (UUID) URN Namespace; Standard, Internet Engineering Task Force: Fremont, CA, USA, 2005. [Google Scholar]
  90. LeSage, J. Spatial econometrics. In Handbook of Research Methods and Applications in Economic Geography; Edward Elgar Publishing: Cheltenham, UK, 2015. [Google Scholar]
  91. Klettner, S.; Schmidt, M.; Steinmann, R. Barrieren und Motivatoren von VGI-Projekten aus Gender-Perspektive. In Proceedings of the Geoinformationssysteme 2013: Beiträge zum 18. Münchner Fortbildungsseminar 2013, Munich, Germany, 8–11 April 2013; pp. 217–226. [Google Scholar]
  92. Mattissek, A.; Pfaffenbach, C.; Reuber, P. Methoden der empirischen Humangeographie; Westermann: Brunswick, Germany, 2013. [Google Scholar]
  93. Lehmann, L. Location-based Mobile Games: State of the Art and Future Challenges for Developing Location-Based Games for Mobile Devices; GRIN Verlag: Norderstedt, Germany, 2012. [Google Scholar]
  94. Jacob, J.T.P.N.; Coelho, A.F. Issues in the development of location-based games. Int. J. Comput. Games Technol. 2011, 2011. [Google Scholar] [CrossRef] [Green Version]
  95. Greenland, S.; Senn, S.J.; Rothman, K.J.; Carlin, J.B.; Poole, C.; Goodman, S.N.; Altman, D.G. Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. Eur. J. Epidemiol. 2016, 31, 337–350. [Google Scholar] [CrossRef] [Green Version]
  96. Getis, A.; Ord, J.K. The Analysis of Spatial Association by Use of Distance Statistics. Geogr. Anal. 1992, 24, 189–206. [Google Scholar] [CrossRef]
  97. Ord, J.K.; Getis, A. Local spatial autocorrelation statistics: Distributional issues and an application. Geogr. Anal. 1995, 27, 286–306. [Google Scholar] [CrossRef]
  98. Anselin, L.; Syabri, I.; Smirnov, O. Visualizing multivariate spatial correlation with dynamically linked windows. In Proceedings of the CSISS Workshop on New Tools for Spatial Data Analysis, Santa Barbara, CA, USA, 10–11 May 2002. [Google Scholar]
  99. Bodansky, E.; Gribov, A.; Pilouk, M. Smoothing and compression of lines obtained by raster-to-vector conversion. In Proceedings of the International Workshop on Graphics Recognition; Springer: Berlin, Germany, 2001; pp. 256–265. [Google Scholar]
  100. Adams, E.; Dormans, J. Game Mechanics: Advanced Game Design; New Riders: Indianapolis, IN, USA, 2012. [Google Scholar]
  101. Wang, H.; Sun, C.T. Game reward systems: Gaming experiences and social meanings. In Proceedings of the 2011 DiGRA International Conference, Hilversum, The Netherlands, 14–17 September 2011; Volume 114. [Google Scholar]
  102. Lee, C.I.; Chen, I.P.; Hsieh, C.M.; Liao, C.N. Design aspects of scoring systems in game. Art Des. Rev. 2016, 5, 26–43. [Google Scholar] [CrossRef] [Green Version]
  103. Mocnik, F.B.; Ludwig, C.; Grinberger, A.Y.; Jacobs, C.; Klonner, C.; Raifer, M. Shared Data Sources in the Geographical Domain—A Classification Schema and Corresponding Visualization Techniques. ISPRS Int. J. Geo-Inf. 2019, 8, 242. [Google Scholar] [CrossRef] [Green Version]
  104. Böckle, M.; Novak, J.; Bick, M. Towards adaptive gamification: A synthesis of current developments. In Proceedings of the 25th European Conference on Information Systems, Guimarães, Portugal, 5–10 June 2017; Association for Information Systems: Atlanta, GA, USA, 2017. [Google Scholar]
  105. Göbel, S.; Wendel, V. Personalization and adaptation. In Serious Games; Springer: Berlin, Germany, 2016; pp. 161–210. [Google Scholar]
  106. Acedo, A.; Johnson, P.A. Home range and habitat: Using platial characteristics to define urban areas from the bottom up. Trans. GIS 2019. [Google Scholar] [CrossRef]
  107. Westerholt, R. Methodological aspects of the spatial analysis of geosocial media feeds: From locations towards places. gis.Science 2019, 31, 65–76. [Google Scholar]
  108. Bluemke, M.; Resch, B.; Lechner, C.; Westerholt, R.; Kolb, J.P. Integrating geographic information into survey research: Current applications, challenges and future avenues. Surv. Res. Methods 2017, 11, 307–327. [Google Scholar]
Figure 1. The StreetComplete interface. (a) The map-based overview; (b) the menu for selecting preferred task categories; (c) an example of visual aid supporting the answering of tasks.
Figure 1. The StreetComplete interface. (a) The map-based overview; (b) the menu for selecting preferred task categories; (c) an example of visual aid supporting the answering of tasks.
Ijgi 09 00129 g001
Figure 2. Overview of the two scoring systems used. (a) Spatially random scores; (b) and spatially structured scores showing a clustering pattern.
Figure 2. Overview of the two scoring systems used. (a) Spatially random scores; (b) and spatially structured scores showing a clustering pattern.
Ijgi 09 00129 g002
Figure 3. Illustrations of typical scenes found on the playing field.
Figure 3. Illustrations of typical scenes found on the playing field.
Ijgi 09 00129 g003
Figure 4. Box plots and histograms of the variables showing significant differences in mean values for the two tested groups. (a) Game duration; (b) and detour factor. Purple colour represents the treatment group, while grey colour indicates the control group.
Figure 4. Box plots and histograms of the variables showing significant differences in mean values for the two tested groups. (a) Game duration; (b) and detour factor. Purple colour represents the treatment group, while grey colour indicates the control group.
Ijgi 09 00129 g004
Figure 5. High and low-value spatial clusters of task visits. (a) Spatially random setup; (b) and spatially structured setup.
Figure 5. High and low-value spatial clusters of task visits. (a) Spatially random setup; (b) and spatially structured setup.
Ijgi 09 00129 g005
Figure 6. Bivariate spatial relationship between the numbers of visits of task locations and their surrounding scores. (a) Spatially random setup; (b) and spatially structured setup.
Figure 6. Bivariate spatial relationship between the numbers of visits of task locations and their surrounding scores. (a) Spatially random setup; (b) and spatially structured setup.
Ijgi 09 00129 g006
Figure 7. Overview of the GPS trajectories of all players. The line segments of the tracks were smoothed for display using the Polynomial Approximation with Exponential Kernel (PAEK) method [99]. (a) Spatially random setup; (b) and spatially structured setup.
Figure 7. Overview of the GPS trajectories of all players. The line segments of the tracks were smoothed for display using the Polynomial Approximation with Exponential Kernel (PAEK) method [99]. (a) Spatially random setup; (b) and spatially structured setup.
Ijgi 09 00129 g007
Figure 8. Histograms of responses to two questionnaire questions. (a) Question about the appropriateness of the scores awarded; (b) Question about the subjects’ willingness to play the game without any scores. The purple bars represent the response of the treatment group and the grey bars represent the control group’s response, respectively.
Figure 8. Histograms of responses to two questionnaire questions. (a) Question about the appropriateness of the scores awarded; (b) Question about the subjects’ willingness to play the game without any scores. The purple bars represent the response of the treatment group and the grey bars represent the control group’s response, respectively.
Ijgi 09 00129 g008
Table 1. Comparison of average values for the tested indicators. The first four measures listed are indicators of intrinsic and extrinsic properties of the game. The second half of the table gives indicators of the geographical exploration of the playing field. Note: * and ** indicate statistically significant mean differences at α = 0.1 and α = 0.05 respectively. We tested for differences in means using the non-parametric Mann–Whitney U test with the exception of the tasks completed. The latter variable was tested by means of a Student t test instead following a Shapiro–Wilk test for normality.
Table 1. Comparison of average values for the tested indicators. The first four measures listed are indicators of intrinsic and extrinsic properties of the game. The second half of the table gives indicators of the geographical exploration of the playing field. Note: * and ** indicate statistically significant mean differences at α = 0.1 and α = 0.05 respectively. We tested for differences in means using the non-parametric Mann–Whitney U test with the exception of the tasks completed. The latter variable was tested by means of a Student t test instead following a Shapiro–Wilk test for normality.
IndicatorTreatment GroupControl Groupp-Value
Game duration (min)39.2030.300.02 **
Normalised distance walked (m)258719540.46
Average walking speed (m/s)0.920.990.40
Normalised number of tasks completed (min 1 )0.460.420.38
Area of std. dev. ellipse (m 2 )114,811102,4510.86
Linearity of std. dev. ellipse1.542.050.33
Detour factor5.024.040.09 *
Share of all possible road types (%)79720.29

Share and Cite

MDPI and ACS Style

Westerholt, R.; Lorei, H.; Höfle, B. Behavioural Effects of Spatially Structured Scoring Systems in Location-Based Serious Games—A Case Study in the Context of OpenStreetMap. ISPRS Int. J. Geo-Inf. 2020, 9, 129. https://0-doi-org.brum.beds.ac.uk/10.3390/ijgi9020129

AMA Style

Westerholt R, Lorei H, Höfle B. Behavioural Effects of Spatially Structured Scoring Systems in Location-Based Serious Games—A Case Study in the Context of OpenStreetMap. ISPRS International Journal of Geo-Information. 2020; 9(2):129. https://0-doi-org.brum.beds.ac.uk/10.3390/ijgi9020129

Chicago/Turabian Style

Westerholt, Rene, Heinrich Lorei, and Bernhard Höfle. 2020. "Behavioural Effects of Spatially Structured Scoring Systems in Location-Based Serious Games—A Case Study in the Context of OpenStreetMap" ISPRS International Journal of Geo-Information 9, no. 2: 129. https://0-doi-org.brum.beds.ac.uk/10.3390/ijgi9020129

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop