Why social search won’t topple Google (anytime soon)

Disclaimer: I have been studying social search from an academic perspective for about a year. I’m sure that I’m not aware of all the “social search” solutions already available on the web and their possible implications as intimately as I probably should be.

However, in reflecting on the strengths and weaknesses of social search, I don’t think it’s going to “topple” Google anytime soon.

There are four important points to consider here: (1) why Google is good at what it does; (2) the drawbacks to Google search; (3) social search as a potential solution; and (4) the limitations of social search. I do believe that there is a place for socially-augmented search, but it will be as a supplement to, not a replacement for, Google.

Why Google is good at what it does

There is a huge advantage to Google search as it currently exists. Google scans and indexes vast amounts of information, catalogs it in databases, and provides quick and efficient mechanisms for retrieval. Your average Google search takes milliseconds to complete, which leaves plenty of time for you, the searcher, to review the result listings, synthesize the information, and possibly refine and iterate on your search. Think about it: Without search engines, all of our time would be spent searching for and retrieving information from a much smaller corpora (based on our very real human processing limitations). We would be left with little time to contemplate our search results. Google, as a “tool”, is a scaffold for the cognitive process of search. For social search to topple Google, it would need to provide a greater scaffold than Google already does.

Additionally, people are hooked on Google. (This point should not be taken lightly!) People are relying more and more on the web for their daily information needs. In support of this, the PEW Internet & American Life Project [14] recently found that broadband and dial-up users prefer using the Internet over friends and family for help in solving problems. Of course, this isn’t the case for all information needs; community networks are still preferred in certain circumstances (e.g., choosing a new bank, dealing with a spiritual crisis). However, when asked why these individuals prefer web search to asking friends and family, they report two main reasons. First, the web can provide them with information more quickly. Second, the content they receive may be more accurate (presuming that it comes from a larger pool of potentially unbiased and/or more authoritative sources). These are strong motivations for users to continue using the web (and Google) to satisfy their information needs. The PEW study’s conclusion is that social networks are still important sources of information, but that the Internet supplements and facilitates communication and information seeking. I expect the same with social search—that its power lies in its ability to supplement and augment our current search practices.

The drawbacks to Google search

However, there are limitations with our current search tools. The most notable drawback is that Google can’t always satisfy our information needs. This may occur for several reasons, perhaps because some inquiries aren’t well suited for a Google approach (Google deals best with facts, historical references, etc.) or because human search terms don’t match Google’s index terms (the human-system “vocabulary problem” [7]). Searchers who are unable to properly describe their search problem or whose query is not neatly addressed in the first page of hits may experience failures. It’s unclear at this point how frequently search failures occur. (Errors in accounting for this may always exist since people with difficult queries may be disinclined from even trying Google). On the other hand, Ed Chi & I have found that 87% of failed search reports were from informational queries, where the question was open-ended or the information need poorly defined. These searches are not likely to be addressed by simple facts present on the first page of search results, and would be expected to produce (occasional) failures with current search solutions.

Furthermore, “real world” searches extend across physical and digital media, include friends, family, and coworkers for support, and may even span several sessions, days, or weeks [2]. This has been observed in libraries and other physical settings [13, 15] and more recently in web search studies [5, 11]. A major drawback with current search tools is that they rarely capture (and address) the context and complexity of these types of searches. Simply put, Google is pretty dumb. It does what it does really well—indexing and retrieving data from large databases. But it does not know what room we’re in or what our surroundings are like; it does not know our recent activities; and it does not know who our friends are. I’m not advocating that we’d ever expect (or want) a search engine to become our personal assistant in this manner. Instead, I see Google’s drawbacks as an opportunity for social search.

Social search as a potential solution

The benefits of social search (on the web) are mostly theoretical at this point, although there is mounting evidence that social interactions provide critical support during search and problem solving. For example, people can provide solutions (advice, guidance, assistance) [1, 3, 8], pointers to databases or other people [3, 6], validation and legitimation of ideas [3, 5], and can serve as memory aids [9].

Plus, social interactions are useful for more than conveying knowledge or supplying certain facts. People can help with problem reformulation [3] and brainstorming [10]. “Guided participation” [12] is a process in which people co-construct knowledge in concert with peers in their community [4]. Social psychologists have recently found that social discussions facilitate subsequent cognitive performance [16]. These findings suggest that social interactions could naturally aid users in web search tasks, although we cannot predict how these interactions will play out in practice.

Several “flavors” of social search solutions already exist on the web, each with their own strengths and weaknesses. Some services are collective harvesters, presenting content based on popularity or emerging topics (Digg, OneRiot), or re-ranking search results based on user annotations (WikiaSearch, Google’s SearchWiki). These solutions, although available instantaneously, may lack relevance or validity since they are pooled from anonymous users across the web. Others try to connect searchers to experts (Yahoo! Answers, MetaFiler, Aardvark), providing personalized answers but at a serious cost (a time delay). Searching through social networks is another solution that has the potential to be both personalized and expedient. For example, a search in FriendFeed first returns content that your friends have shared with the system. Delver presents data shared by your social graph (elsewhere) intermixed with their search result listings. Undoubtedly Facebook and Google (who arguably have social graph data through Gmail contacts) are also considering solutions in this direction. While these solutions must require a lot of computing power (among other social smarts), I believe that a personalized social graph solution, if integrated with Google, will be the most successful in addressing real search problems.

Limitations of social search

One concern with these existing social search tools (and others) is that they aren’t quite the solution to the search problem yet. Do these services address real user needs? Is this the type of social support that will be most useful during difficult queries or failed search attempts? As this is yet to be determined, it’s worthwhile reviewing the current limitations of social search.

An obvious limitation is that information from social resources may not be as complete or thorough as information stored in large search engine databases. This is an issue of scale and scope. A social search only solution will lack either the scale or the scope that a Google search can provide. This criticism is not entirely a fair, however, if social inputs are used primarily to augment regular result listings, instead of replace them.

A narrower scale and scope may actually be advantageous by helping searchers in one of two ways. First, since we naturally seek information from other people directly, receiving suggestions of experts or friends to help with a certain problem may be quite useful. Second, socially-filtered data may be more trustworthy, especially if the filtered information comes from people you know.

On the other hand, a searcher may not have knowledgeable or available contacts for a given query. In these circumstances, passively receiving social recommendations may be a good solution. My current work is looking at the tradeoffs between asking friends directly for help and receiving somewhat anonymous replies from large social networks (a la social recommendations) during search and sensemaking tasks. These strategies provide complimentary support for searchers: While the latter may present a diverse set of views on a topic (establishing breadth), the former may help develop depth on individual topics.

Finally, social inputs won’t be the right solution for every user query. Certain questions are likely to be improved by social search (experience-, opinion-based, and tacit information), but others may be hindered. Open-ended, exploratory queries may benefit from social inputs, simple navigational ones may not [5]. To avoid cluttering the interface or cognitively overloading the user, an optimal solution would deliver social solutions appropriate to the target circumstance. Will this type of inference and personalization be possible with search tools?

Concluding remarks

On the whole, social search is still in its infancy. Even Google, which has been around for 10 years, continually tweaks its search algorithms. It’s naive to think that we will have truly viable, integrated social solutions to the search problem over night.

Unfortunately, current social search tools are fairly crude, presenting solutions to (more simple) algorithmic problems instead of to user problems. This is not to say that the work of social search engines is a easy, but rather that they may be working on the wrong questions. Very few current social tools integrate with Google (with a few exceptions, whose value has yet to be demonstrated: CloudLet and Qitera). Since it’s unlikely that users will rush to adopt new search tools at this point, an integrated, combined approach (Google + social) seems more practical.

Beyond this, we need to know more about how social inputs, interactions, and passive social recommendations can address user needs during search, to help focus targeted solutions to real problems. I believe that Google search will continue to be a part of this solution; I also believe that social search has the potential to supplement Google in powerful ways.

References

[1] Bandura, A. Social Cognitive Theory. In R. Vasta (Ed.), Annals of child development. Vol. 6. Six theories of child development (1989), 1-60.
[2] Churchill, E. Of candied herbs and happy babies: Seeking and searching on your own terms. Interactions 15, 6 (2008), 46-49.
[3] Cross, R., Rice, R.E., and Parker, A. Information seeking in social context: Structural influences and receipt of information benefits. IEEE Transactions on Systems, Man and Cybernetics — Part C 31, 4 (2001), 438-448.
[4] Edelson, D., Pea, R., & Gomez, L. Constructivism in the Collaboratory. In B. G. Wilson (Ed.), Constructivist learning environments: Case studies in instructional design. Englewood Cliffs, NJ: Educational Technology Publications (1996), 151-164.
[5] Evans, B.M. and Chi, E.H. Towards a model of understanding social search. Proc. CSCW’08, ACM Press (2008), 485-494.
[6] Fox, E.A., Hix, D., Nowell, L.T., Brueni, D.J., Wake, D.C., Heath, L.S., and Rao, D. Users, user interfaces, and objects–envison, a digital library. JASIS 44, 8 (1993), 480–491.
[7] Furnas, G.W., Landauer, T.K., Gomez, L.M., and Dumais, S.T. The Vocabulary-Problem in Human-System Communication. Comm. of the ACM 30, 11 (1987), 964-971.
[8] Hatch, T., and Gardner, H. Finding cognition in the classroom: An expanded view of human intelligence. In G. Salomon (Ed.), Distributed cognitions: Psychological and educational considerations. NY: Cambridge University Press (1993), 164-187.
[9] Karasavvidis, I. Distributed Cognition and Educational Practice. Journal of Iterative Learning Research 13, 1/2 (2002), 11-29.
[10] Kuhlthau, C.C. Inside the search process: Information seeking from the user’s perspective. JASIS 42, 5 (1991), 361–371.
[11] Morris, M.R. A survey of collaborative web search practices. Proc. CHI’08, ACM Press (2008), 1657-1660.
[12] Rogoff, B. Apprenticeship in thinking: Cognitive development in social context. New York: Oxford University Press (1990).
[13] Twidale, M.B., Nichols, D.M., and Paice, C.D. Browsing is a collaborative process. Information Processing and Management 33, 6 (1997), 761-783.
[14] Wells, A.T. and Rainie, L. The Internet as social ally. First Monday 13, 11 (2008), retrieved from: http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2198/2051.
[15] Wilson, T. On user studies and information needs. Journal of Documentation 37, 1 (1981), 3-15.
[16] Ybarra, O., Burnstein, E., Winkielman, P., Keller, M., Manis, M., Chan, E., and Rodrigues, J. Mental exercising through simple socializing: Social interaction promotes general cognitive functioning. Personality and Social Psychology Bulletin 34, 2 (2008), 248-259.

9 Comments

  1. # | 30 Jan 2009

    Very interesting post! (yet again :)

    Regarding: “combined approach (Google + social) seems more practical”

    We have started a little experiment with combination of Y! search and Delver Social search – Presenting social result only when we “think” it is needed.

    –> http://search.delver.com

    It will be great to hear get your feedback.

    – Moti
    http://blog.karmona.com

  2. # | 30 Jan 2009

    It is a social search morning! First I read your post, then my search alerts find two social search papers. Hope they are useful to you.

    Exploring Qualitative Sharing Practices of Social Metadata: Expanding the Attention Economy
    http://www.informaworld.com/smpp/content~content=a907447270~db=all

    Facebook as a social search engine and the implications for libraries in the twenty-first century
    http://www.emeraldinsight.com/10.1108/07378830810920888

  3. Ofer Egozi said:
    # | 30 Jan 2009

    This seems very much like an intro section to an upcoming paper – is it?… :-)

    You didn’t link a citation on the 87% finding (failed searches) – is there a paper you published with more details? I’d be very interested to read it. Some of what you mention is less related to social search, but rather to semantic search. So if I search for “papers arguing against social search”, I’d likely get lousy results, but that class will only get resolved by deeper NLP, the type that Powerset attempted to add. Surely, social and semantic aspects are where we’re headed, and each will solve a different set of today’s issues.

    You mentioned the “vocabulary problem” paper – you’re right (and it’s indeed on the semantic side) but that’s the more shallow problem. A deeper problem is not just that “car” should also match “vehicle”, but rather also one of (semantic) relatedness. When I search for “EU economy” I’d also like to see results such as “European Central Bank slashes interest rate”, even if they don’t include the original keywords. There is sufficient body of work there (my own thesis work is also on that field) to apply into current search as well, the main reason it doesn’t happen is again this difficulty in paradigm shift. People are so used to searching by keywords (and with most broad queries you anyway get enough results by keywords), that Google and Yahoo are worried of alienating users by providing concept-based, rather than keyword-based results…

    So yes indeed, not willing to change search paradigm easily is here to stay, and will also inhibit progress for a while. And you’re right – the best way to start is by gradually augmenting the current experience.

    Looking forward to more!

  4. brynn said:
    # | 30 Jan 2009

    @Ofer: This may very well be an intro to my dissertation proposal. For now, it was an exercise in synthesizing my thoughts :)

    I don’t know enough about the semantic search problem to comment here, although it could be a matter of perspective. Part of the reason traditional search fails is a poor semantic mapping of concepts to keywords, I’m sure. Would users not “get” concept-based results? That could be a testable hypothesis. I think of the “vocabulary problem” more as a user problem, though (and I could be wrong here). In some unpublished data (yes, no link yet), Ed & I see that a big problem for users is in knowing how to formulate the query. They sometimes don’t even know where to begin, which means they sometimes can’t produce any keywords. It seems like social resources could be especially useful here; would simply semantic or concept-based results do the same?

    The other issue that I brought up in the post is that social inputs may not be appropriate for all user queries. To address this problem, tools are going to have to get smarter about our context, motivations, and intentions. These seem like issues that will require user research to uncover rather than simply applying more tweaks to an algorithm.

    @Ofer and Moti: So search.delver.com is integrated Delver results with Yahoo results? I searched for ‘recipe yams’ (since I got some in my weekly product box), and saw the first hit was a blog post with an avatar next to it. I don’t know recognize the person or the name, but I assume he/she is in my network? Then the remaining results are Yahoo’s? Yes, this is definitely an interesting model, though I’d have to try it with more types of queries. It’s unfortunate still that I can’t get this experience directly through Yahoo.

    @fred: Thanks for the links! I hadn’t seen those articles yet!

  5. # | 30 Jan 2009

    Hi Brynn,

    I’ve always thought of Google’s PageRank as the ultimate social algorithm. (A page is ranked higher when more people vote for it by placing a link to it.) Of course, the “people” here are not web users, but webmasters, but that only narrows down the set of people who you’re getting your search recommendations from; not the fundamental nature of the ranking algorithm.

    How does this viewpoint supplement/coexist with your thoughts about social search and a pure non-social search engine?

  6. brynn said:
    # | 30 Jan 2009

    @Manas: PageRank definitely has social elements, from giving a higher weighting to pages with more links to the programmers/researchers who decide which features to include in their algorithm. The whole web is social in this sense.

    I see two issues still. One is that user needs are still not being met by existing solutions (however “social” or “unsocial” the algorithms may be). The other is that most of the social solutions that users do have access to today are in the style of collective harvesters. You’re right that Google’s search results are social in the sense that they are filtered by webmasters, but is that meaningful to you? I think it would be more meaningful is information were filtered through *your* social graph.

    This issue is related to how important trust will be in social search. One paper (albeit in the organizational learning literature) found that trust was important for open-ended searches maybe more so than for well-defined problems. If this is true on the web, then the massively pooled social data that are Google’s current results, hence lacking an element of trust, may not be useful for the majority of searches that are exploratory in nature. (Although I think having personalized social recommendations could help with well-defined search queries too.)

  7. mbernst said:
    # | 30 Jan 2009

    The term ’social’ here seems overloaded: are we talking at the scale of social networks or at the scale of crowd computing? It is true that the ’social’ in social psychology refers just as much to societies as it does to friends and family — but at the same time my experience with Digg doesn’t feel social in the same way as my experience with Facebook.

    I think you’re beating down the right track. What are the particular failure modes of current internet search, and which of these can be most successfully approached via social mechanisms? I agree with your point that early-phase information seeking tasks might be a great entrance point, since often this is where I don’t even know what my query should be yet. Often I find that asking a friend what I’m looking for gives me the terms to get started.

  8. robspiro said:
    # | 30 Jan 2009

    Great writeup! You’ve presented a lot of interesting ideas here.

    You rightly point out that “discussions” are a key component of social search — it’s not just about getting a piece of information, it’s about having an information exchange with a real person, that’s what makes it social. Sometimes you just want to have a conversation with someone who knows what they’re talking about, who shares your general taste… the best Social Search solutions will make that effortless and instant.

    And to correct the record about Aardvark a bit ;-)
    - Aardvark is real-time (works via IM chat)
    - Aardvark connects you to people with experience relevant to your question *in your network* (ie. friends and friends-of-friends) — so “experts” is a bit misleading.

    Looking forward to seeing where your research goes!

  9. halans said:
    # | 30 Jan 2009

    And then Google introduces an improved Profiles (together with your Gmail and Contacts and proximity with Latitude), and it all starts to come together, isn’t it?

5 Trackbacks

  1. [...] written previously about how social search won’t replace traditional search, how social relevancy rank can be used to deliver good results, and why the concept of social [...]

  2. [...] Personalmente,opino que la búsqueda social no sustituirá a la búsqueda tradicional, que un alto índice de relevancia social puede usarse para obtener buenos resultados de búsqueda, y que el concepto de búsqueda social supone una vuelta a un entorno familiar, y no hay nada que temer al respecto. Hoy hablaremos más específicamente sobre los tras “sabores” de búsqueda social que mejorarán la experiencia de búsqueda de los usuarios. [...]

  3. [...] written previously about how social search won’t replace traditional search, how social relevancy rank may be used to deliver good results, and why the concept of social [...]

  4. [...] I discovered when working on our Social Search paper. It has been argued before (one small example here) that Google’s PageRank algorithm is inherently social, as it aggregates information provided [...]

  5. [...] written previously about how social search won’t replace traditional search, how social relevancy rank may be used to deliver good results, and why the concept of social [...]

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*