Connotea Users Introduction
Download 252.32 Kb.
|
- Navigate this page:
- Problem statement
- Literature review
- Research methods
| Cited As: Du, H., Chu, S.K.W., Gorman, G.E., & Siu, F.L.C. (in press). Academic social bookmarking: An empirical analysis of the Connotea users. Library & Information Science Research.
Academic social bookmarking: An empirical analysis of Connotea Users
When people explore the Internet, one of the challenges they face is remembering and retrieving items that they have previously found to be useful. A common approach to managing information found on the Web is the use of personal bookmarks stored on a user’s own computer (Lund, Hammond, Flack & Hannay, 2005; Millen, Feinberg & Kerr, 2005]. Recent research suggests that social bookmarking (SB) offers a more effective means of resolving the difficulty associated with web information discovery and management (Hotho, Jaschke, Schmitz & Stumme, 2006). SB refers to the common indexing of objects and resources, which enables online users to classify useful websites and create shared bookmarks of online resources (Storey, Cheng, Bull & Rigby, 2006), as well as discover resources from other people’s collections (Yanbe, Jatowt, Nakamura & Tanaka, 2007). By allowing users to categorize websites with the use of freely assigned (or controlled) keywords (“tags”), users are able to find and browse their own bookmarks easily (Godwin-Jones, 2006). User-generated tags may further be shared among all users in an SB website, thereby increasing socialization within the community (Goh, Chua, Lee & Razikin, 2009). These tags are also known as “social tags” or “folksonomies”. The term folksonomy comes from the words folk and taxonomy, and is used to describe the vocabulary used for creating and managing social tags (Dye, 2006). Social bookmarks may serve as individual reminders, shared lists, or collective resource libraries (Panke & Gaiser, 2009). With the increasing adoption of SB tools and services, it becomes important to understand users’ opinions and their perspectives regarding the use of SB.
Some SB sites, such as Connotea (www.Connotea.org) and CiteULike (www.citeulike.org), have been targeted specifically to academic audiences (Gordon-Murnane, 2006). Different user groups may have different bookmarking preferences and interaction patterns (Lin & Tsai, 2011; Niu & Hemminger, 2011), and so it is possible that academic SB users may have some bookmarking behaviors which distinguish them from general users. For instance, exploratory searches, characterized by less well defined inquiries that emphasize analytical strategies, are often employed by academic researchers (Marchionini, 2006). The popularity of SB services is associated with their potential for improving online information search, exploratory as well as fact-finding (Yanbe et al., 2007), and so one would expect academic users to be attracted by the exploratory search capabilities of SB systems. However, a recent study indicates that the numbers of visitors to connotea.org shows a decreasing trend. (Compete 2010). Such a decline in popularity highlights the urgency in understanding academic users’ bookmarking behaviors and their perceptions of bookmarking, so that SB tools can be designed to be more useful for academic audiences. Prior studies of SB have mainly looked at tag growth and entropy (Golder & Huberman, 2006; Kittur et al., 2007), tag choice (Sen et al., 2006), tag classification (Al-Khalifa & Davis, 2007), and discussions of the potential academic use of SB tools (Gordon-Murnane, 2006). While substantial research has explored the patterns and organization of tagging and bookmarking behavior of SB users, empirical evidence about how SB usage is affected by different types of users is yet to be explored. Few studies have tried to understand the motivations or incentives behind the behavior of user groups (e.g., Arakji, Benbunan-Fich & Koufaris, 2009), and even less is known about those whose purposes are of an academic or scientific nature. To address this apparent gap in knowledge, the current study collected academic users’ opinions and perspectives on the use of Connotea. The findings are expected to contribute to the understanding and further development of SB as a tool for information management in academic communities.
SB has gained increasing popularity possibly due to two distinguishing characteristics which enhance its social utility. The first characteristic is the use of tags created by users to organize bookmarks using labels that are meaningful to them (Millen, Yang, Whittaker & Feinberg, 2007). In contrast with the hierarchical and static nature of traditional taxonomies and classification systems, the organizational structure of the tagging used in SB services is emergent and dynamic. The other important characteristic is that bookmark collections typically become public information visible to other people, who may use them for their own purposes (Rader & Wash, 2008; Riddle, 2005). People can share their discoveries and retrieve related information from others who have similar interests (Mejias, 2005). It has been suggested that SB may be a potentially low-cost application for group information management (Grudin, 2006). SB systems provide support for search activities that range from simple “fact-finding” to more exploratory forms of search (Millen et al., 2007). One of the attractions of social tagging systems is that users require no specific skills to obtain the benefits of information organization (Jaschke, Hothos, Schmitz, Canter & Stumme, 2008). Research issues relating to SB can be categorized into five main topics as shown in Table 1. As SB systems allow users to use their own keywords for bookmark tagging, many researchers have been interested in examining tagging patterns. Tag growth and dynamics, tag choice and tag semantics are frequent foci for SB research. Golder and Huberman (2006) identified regularities in users’ frequency of tagging, their selection of tags and also their activities in SB websites. Factors affecting users’ choice of particular words for tagging were also explored. Similarly, Sen et al. (2006) observed that pre-existing tags affected the kinds of tags that were subsequently created by users. However, this observation was countered by Kipp (2006), who observed that tag selection was not a direct imitation of pre-existing tags, but rather an individual idiosyncratic process. [Insert Table 1 about here] Scholars such as Al-Khalifa and Davis (2007) have attempted to classify tags into meaningful semantics. Cattuto, Benz, Hotho and Stumme (2008) suggested relationships between user-created tags and introduced a method to measure such relationships. Sen et al., (2006) investigated the classification of tags, providing insights on tag choices. Redden (2010), Sun, Suryanto and Liu (2007) and Seki, Qin and Uehara (2010) focused on potential applications and future developments of SB tools, with the aim of improving current SB systems and developing more advanced ones with new features and broader applications. Based on participants’ bookmarking and peer interaction patterns in an SB system called “WeShare”, Lin and Tsai (2011) defined four types of user groups: lurkers (seldom performed collective information searching), actives (made more effort to manage their own bookmarks than to review the bookmarks created by others), quoters (made more effort to review others’ bookmarks than to create their own ones), and critics (focused on commenting the bookmarks shared from others). Research which looks at user perspectives and opinions directly is distinctly sparse when compared with indirect studies of user behavior as reflected in SB activity. This study is a contribution to that underexplored arena.
SB sites that have gained significant popularity include StumbleUpon, Delicious (formerly del.icio.us), Blinklist, CiteULike, and Connotea. A comparison of the number of visits among five popular academic SB systems (Compete, 2011) indicated that Connotea was the most widely-used in the year 2010 (see Figure 1). Connotea is designed to enable scholars to manage citations and scholarly articles (Rethlefsen, 2008). As with most SB systems, Connotea allows users to tag items, and a user's collection can be made public and shared among colleagues and workgroups across the world (Hammond et al., 2005; Rethlefsen, 2008). Connotea incorporates special functionalities targeted to managing references, such as the automatic collection of metadata. [Insert Figure 1 about here]
To examine perceptions of academic users with a range of familiarity with SB systems, three groups of participants were recruited: experienced users, users with a moderate level of experience, and novice users. Experienced users (Group I) were those who: (a) had created at least 100 bookmarks on the Connotea website, and (b) had made their emails public (e.g., through their bookmarks); thus allowing a means of contact for recruitment. Group I users were recruited from 101 potential participants that were identified on the Connotea website. Thirty-nine responses were collected, yielding a response rate of 38.6%. Moderately experienced users (Group II) included information management students in the University of Hong Kong (HKU) who had experiences using a SB system for group projects prior to their participation in this study. Out of 74 potential Group II participants, 48 responses were collected (65% response rate). Novice users (Group III) included part-time or full-time research assistants in HKU who had no previous experience of using any SB applications prior to participating in the research. Forty potential participants belonged to the last group were invited to register for an account on the Connotea website and use the SB tool for two months. After this period, participants were invited to respond to the online survey, and 32 responses were collected (80% response rate). All potential participants were invited by email to respond to an online survey, and informed consent was obtained from each who agreed to join the study. The research procedures were reviewed and approved by the Ethics Review Committee of the university. A total of 119 users, representing the three user groups, participated. Table 2 illustrates the academic background of all the participants in the study. [Insert Table 2 about here]
The online survey consisted of both close-ended and open-ended questions that investigated users’ bookmarking and tagging behaviors (Appendix A). These questions focused on (1) background of the participants and their habits in using SB systems, particularly Connotea; (2) their ratings of the utilities and features of Connotea; and (3) their opinions on the effectiveness of Connotea. Bookmarking frequency was measured using a 6-point ordinal rating scale with the following values: 1 (never), 2 (once a month or less), 3 (once every two weeks), 4 (once to twice a week), 5 (three to six times a week), and 6 (once daily or more). Participants’ perceptions of the utilities and policies of the SB system were examined using a 4-point Likert-type scale, where 1 referred to “strongly disagree” and 4 denoted “strongly agree”. A balanced 4-point Likert scale which eliminates a neutral mid-point has been shown to minimize social desirability bias and uncertainty in participants’ responses (Garland, 1991). Ratings of 1-2 were interpreted as negative responses and ratings of 3-4 as positive responses. Particular attention was directed towards the users’ perceptions of using the SB website for information discovery and management. Open-ended questions were also provided so that participants could further elaborate on their scale-type answers when needed. As a result, participants #25 (in Group I), #41 (in Group II), and #28 (in Group III), also provided further written comments in the survey. For those participants who had indicated their willingness to be interviewed, follow-up interviews were arranged to collect in-depth opinions concerning their experiences with using the SB services. Two participants from Group I, one from Group II, and three from Group III were interviewed in the follow-up investigation. Appendix B lists a summary of the open-ended answers and follow-up interview responses by academic participants in the three different groups.
The survey also provided a don’t know option for each question. A number of participants answered with this value for some questions, largely due to their unfamiliarity with the SB features (Figure 2). [Insert Figure 2 about here] These data points were excluded in the analysis. This treatment les to differences in sample size, and may have varying effects on the results. The percentage of don’t know answers in each question was calculated, and has been marked in Tables 4-10 in four different shades of gray for ease of reading. The darker the color in the results tables the higher the percentage of data points being removed from analysis because of the don’t know response and the greater the possible impact on the predictability of the results. Fortunately, the majority of the results in Tables 8, 9, and 10 have no shading. The greatest impacts appear in Table 4 (results for group I), Table 5 (results for the question “It is easy to use” for Group II and III), Table 6 (the result for the question “Using the search box with the choice Find Exact URL” for Group I), and Table 7 (the result of the question “It is useful for managing information in a group” for Group I).
Responses to the online survey were collected and analyzed using non-parametric tests. Descriptive statistics were used to measure central tendency and inferential statistics used the Kruskal-Wallis test to examine the differences in the responses of the three participant groups. Statistical significance was set at p < .05. Statistical analyses were done using SPSS 18.0. Responses to open-ended questions were summarized qualitatively.
Table 3 shows five kinds of bookmarking behaviors of the three groups of academic users. Creating bookmarks received the highest rating on average by all groups (Group I = 3.26, Group II = 2.63, and Group III = 2.53), while “copying bookmarks from other users” got the lowest mean rating (Group I = 1.68, Group II = 1.96, and Group III = 1.63). This result suggests that academic users in general are more likely to create their own bookmarks but less likely to use bookmarks created by others. In addition, experienced users (Group I) were found to have significantly higher frequency (once every two weeks) of creating bookmarks than the other two groups (once a month or less). [Insert Table 3 about here] Experienced users (Group I) created more tags per bookmark comparing to the other two groups (Figure 3). Over 20% of group I users created 4 or more tags per bookmark, but only a small portion (2.1%) of moderately experienced users (Group II) and no novice users (Group III) did so. A majority of Group I (65.5%) and Group II (59.6%) users created 2-3 tags per bookmark. However, Group III users tended to create much fewer tags: 63.3% of them created just 1 tag per bookmark and 36.7% of them created 2-3 tags per bookmark. Connotea policies require users to create at least one tag per bookmark, and it appears that most novice users comply with this minimum requirement without going further. [Insert Figure 3 about here] Academic users’ ratings (from 1 = strongly disagree to 4 = strongly agree') on the usefulness of tags and bookmarks are summarized in Table 4. Participants had generally positive perception about the seven utilities of tags/bookmarks, in which “use tags to find your own bookmarks” received the highest ratings of usefulness by all groups: Group I (M = 3.78), Group II (M = 3.17) and Group III (M = 3.07). In addition, experienced users (Group I) were found to give a significantly higher rating on this utility than the other two groups. “Form a group with friends or colleagues for sharing bookmarks” was rated the least useful by both Group I (M = 2.93) and Group II (M = 2.98) users. Novice users (Group III) rated this utility the second least useful (M = 2.80), and rated “using tags in sharing bookmarks with friends or colleagues” the least useful utility (M = 2.73). This finding suggests that academic users commonly do not share bookmarks with their friends or colleagues. [Insert Table 4 about here]
All groups of users perceived the automatic collection of bibliographic information to be useful and easy to use. However, some users commented on a limitation of the automatic collection of bibliographic information, noting that the SB website was sometimes inconsistent with the corresponding reference of an article, thus requiring additional time to correct the information manually (Tables 5 and 6). [Insert Tables 5 and 6 about here] Generally speaking, positive ratings of usefulness were given by the three groups of users on all eight types of the search functions. This indicates that participants perceived the various search functions useful in supporting information discovery. Significant difference among the three user groups was found only in their views regarding the usefulness of the “related users” function. While moderately experienced users regarded this function the least useful and novice users thought of it the second least useful, experienced users considered it the third most useful of the eight search functions. All three groups rated the function “using the search box with the choice My Library” the most useful search functions. This was consistent with the earlier finding that participants preferred using self-created bookmarks over copying bookmarks created by other users. Compared to the other types of search functions, finding information “through other users who have similar interests” also received relatively high ratings by both Group II and Group III users. Some users pointed out that this function could save time screening relevant information and bookmarks. Both Group I and Group III users rated the function “using the search box with the choice Find exact URL”, the least useful among the eight search functions, while Group II users rated “using Related users” the least useful.
The use of social bookmaking for personal and group information management was also examined (Table 7). It appears that all user groups found the SB website easy to use and useful in both personal and group information management. While no significant differences were found among the three groups, novice academic users (Group III) seemed to give higher ratings to the usefulness of SB for personal information management than for group information management. [Insert Table 7 about here]
Other SB features were found to be useful (Table 8). “Accessing references and bookmarks from any computer” was reported to be useful by the largest percentage of respondents, while “exporting references and bookmarks to Endnote or other desktop reference managers” was reported to be useful by the smallest percentage of participants. In addition, a majority of experienced users (Group I) found the automatic recognition and filling of references to be useful (68%). In contrast, fewer Group II (27.7%) and Group III (30%) users found this feature to be useful. [Insert Table 8 about here]
Table 9 shows the users’ overall perceptions of using SB websites compared with the traditional bookmarking methods on a dedicated computer. Significant differences were found among the three groups’ of users’ perceptions on using SB websites to save bookmarks instead of using traditional bookmarking methods. In particular, Group I users were found to have the highest ratings on this point (M = 3.81), while Group II (M = 3.02), and Group III (M = 2.76) users on average gave lower ratings. It was also reported that a majority (61.5%) of experienced users (Group I) eventually built a habit of managing useful websites through Connotea and other SB sites, while most Group II and Group III users still preferred using traditional bookmarking methods (see Table 10). [Insert Tables 9 and 10 about here]
The overall findings of the study indicate that academic users generally have positive perceptions of the usefulness and ease of using SB tools for information search and management. Similarly, many functions and bookmarking utilities offered by Connotea were rated positively. However, reported bookmarking use frequency appears to be low among the participants. The highest reported use frequency was “once every 2 weeks”, which was reported by experienced users mainly for creating bookmarks. On the other extreme, novice users reported copying bookmarks from others “once a month or less”. This indicates that while academic users believe that SB tools are quite useful and easy to use, their actual use of such services has not been so pervasive. The participants’ open-ended feedback suggests that while they generally have positive perceptions of SB, the perceived benefits do not outweigh the perceived costs. Group II participant #8 pointed out that users need to spend extra time and effort to become familiar with SB features. This could be the reason why many users were unwilling to switch to SB, which is a relatively new technology. Furthermore, the responses from the focus group study suggest that difficulties in accessing bookmarks may be one of the reasons for low bookmarking and tagging frequencies. Group I participant #30, for instance, mentioned that it was rather inconvenient, as the SB website requires you to log in to access saved bookmarks. A novice user (Group III participant #8) mistakenly perceived that when using SB tools, bookmarks can be saved only from the user’s own computer if the appropriate button is installed on the toolbar. Comparison across the three different user groups suggests that level of experience in using SB tools is related the use frequency. Responses about methods for managing useful websites suggested that more experienced academic users were more likely to prefer to use SB tools (including Connotea) than traditional methods (such as saving bookmarks on their local computers). Also, experienced users’ perceptions of the advantage of using tools like Connotea over traditional methods were found to be significantly higher than the other two groups. Compared to the experienced users, more intermediate and novice users bookmarked websites on their dedicated computers. These findings highlight the impact of exposure over time. Inexperienced users may not yet feel comfortable using SB tools and require more exposure to Connotea (or other similar SB tools) in order to gain familiarity. The focus group responses also show that less experienced users tended to return to traditional ways of managing websites and searching for information for personal information management or information search purposes, as they were more familiar with the functions and layouts (e.g., Group II participants #12 and #34). One of the advantages of SB as compared with the traditional ways of saving bookmarks is accessibility from any computer. This may be one of the main reasons why people use SB services, and was reported useful by nearly 80% of participants. Information discovery does not seem to be the main reason for participants to use Connotea. Higher rating goes to the use of Connotea for personal information management than for group purposes, particularly among novice academic users. The use of tags for respondents to find their own bookmarks and the use of search box with the choice “My Library” both received the highest ratings among a list of SB features and methods. The reported behavior of the participants was consistent with their preferences in personal information management in the survey. All three groups of academic users have higher frequencies in creating bookmarks and in using their self-created bookmarks than any other bookmarking behavior. According to Lin and Tsai’s classification (2011), these results suggest that most academic users are “active” users, who spend more effort on creating and managing their own bookmarks than using the bookmarks created by others. Similar preference for using personal collections of articles was also found in academic scientists (Niu & Hemminger, 2011). Such behavior may be explained by the nature of their work, which usually emphasizes originality and novelty. However, even in the present study, participants reported much lower frequencies of sharing bookmarks with their collaborators. This is contrary to the collaborative nature of SB, in which “sharing” or “social” capability has been described as a key feature (Golder & Huberman, 2006). The results also show that the usefulness of forming a group for sharing bookmarks on Connotea received the lowest ratings among all other common SB behaviors. According to Markus (1987) and Arakji et al. (2009), users with varied backgrounds and interests can bring more resources to the community to help ensure that there are enough resources available. However, Connotea was conceived particularly for researchers and scientists to share bookmarks and bibliographic information (Redden, 2010). This homogeneous user group may lead to the accumulation of resources which are limited in variety and scope, causing low frequencies in users’ reported bookmarking habits and sharing behavior. Some participants (e.g., Group II participant #22 and Group III participant #31) thought that SB could not gain popularity as quickly as, for instance, Facebook and Twitter because SB websites like Connotea cannot provide a real time connection to those who are not members of the community. Hence, even if users are eager to share information and findings with colleagues, their colleagues also need to users of the same system in order to do more than simply view. Several other participants (Group II participants #12, #22, #34, and Group III participant #31) had the same opinion – not many of their friends or colleagues used SB.
This is an exploratory study. The survey questionnaire was developed to investigate academic users’ general perceptions of SB systems, and their actual bookmarking behaviors. Participants were recruited from Connotea, an academically-oriented SB website, and so results may not all be generalizable to the SB systems, and especially not to non-academic SB systems. Future studies could consider recruiting participants from other academic SB sites or even to confirm the findings. Comparisons to similar research in non-academically oriented SB sites would be interesting. This study only analyzed user perceptions by groups and was mainly concerned about what questions. It might be interesting in future studies to also consider how users first became aware of the SB sites and why they have chosen to use certain sites.
|