Links and power: the political economy of linking on the Web.

ABSTRACT

Search engines like Google interpret links to a Web page as objective, peer-endorsed, and machine-readable signs of value. Links have become the currency of the Web. With this economic value they also have power, affecting accessibility and knowledge on the Web.

Links have always been fundamental to the Web. In the last few years their value has become regulated as search engines and other systems that find and define the structures of the Web increasingly index links and anchor text in addition to keywords and page content. In these projects, links are seen as objective, democratic, and machine-readable signs of value. There has been little or no critical discussion about this aspect of links, though link data is heavily used. This article discusses the implications and the power structures inherent in this relatively undocumented but influential change in the structuring of the World Wide Web and is an attempt to scan the field from a critical, humanist perspective.

TRACKING LINKS

A popular though clearly flawed assumption about the Web is that all its nodes are equally accessible. It is true that the Web has no formalized structure or centralized organization other than the rules of the mark-up and scripting languages we use to write and design Web sites. Even those rules are at times disputed: different browsers obey and interpret them in different ways. However, certain Web sites have always been more accessible than others.

In the first years of the Web, most surfers used human-compiled directories listing sites by topic, portals provided by Internet Service Providers (ISPs) and other commercial actors, and search engines that indexed keywords and text phrases in Web sites. After a while, the extensive commercialization and the growing public awareness that highly ranked search results could be bought reduced the credibility of these sites (Introna & Nissenbaum, 2000). Google drastically changed the search engine game by not simply counting keywords but using links as the primary method of determining the value and thereby the deserved visibility of a Web site. Today most search engines have followed Google's strategies and calculate the value of links. Indeed, almost any search engine you use today will use one of only three algorithms to power the search. The algorithm will belong to Google, to the Yahoo! Group (which recently gobbled up AlltheWeb, Altavista, and Inktomi), or to Teoma (Fabos, in press). So much for diversity.

So what was so new about Google's algorithm? Google indexes links between Web sites and interpret a link from A to B as an endorsement of B by A. Links can have different values. If A has a lot of links to it, and C has very few, then a link from A to B is worth more than a link from C to B. The value determined in this way is called a page's PageRank and determines its placement in search results (Brin & Page, 1998; Google, 2004; Marlow, 2001-2002). The PageRank is used in addition to conventional text indexing to generate highly accurate search results. Links can be analyzed more accurately and usefully than traffic or page views and have become both measures of success and dispensers of rank.

Links are increasingly being used in preference to content indexing, not only in search engines but, for instance, to identify communities of Web sites (Flake, Lawrence, Giles, & Coetzee, 2002), or, on a more local scale, to examine social networks and the transferral of memes between webloggers (Marlow, 2001-2002). Google is one of several companies that are developing a map of the Web that identifies connections among individuals, companies, organizations, and Web sites--a map that may prove priceless not only for improving search results but also for personalizing searches and, of course, ads. Sign up for Orkut, the Google-affiliated social networking system, and make all your social relationships machine-readable. Publish a Blogger.com weblog and use your Blogger account to comment on your friends' weblogs--Google owns Blogger and can access this information. Get a free Gmail email account, with half a gigabyte of storage: "don't sort; search," says Google, and now they not only serve you ads based on the content of your emails but they have your personal correspondence in their ever-growing databases.

The extension of search into social networks and personal publication and communication shows that knowledge about the relationships among content is becoming the prime real estate of the Web (Kottke, 2004). Social relationships are simplified in systems like Orkut and Friendster so that machines can process them. Similarly, links between Web sites are assumed to provide an objective measure of value and to be a sign of peer endorsement. This reductive view of links and its implications should be examined more closely.

AN ECONOMY OF LINKS

Links have a direct value on the Web and can be seen as a pseudomonetary unit. A Google search on currency of the Web shows that this is not a novel idea, though it is little theorized. Conventional thinking has assumed that linking from A to B takes value from B and adds value to A. Lawyers have complained that linking to another site's news items, for instance, may be a copyright violation, and companies have sued against those who link to their site (Kelly v Arriba Sort Corp., 1999). Though more sophisticated, Ted Nelson's (1982) concepts of transclusion and transcopyright belong to a similar paradigm where content is value and links are mere mechanics, an outside vehicle for the transmittal of content rather than the item of value itself. In its fully implemented state, transcopyright sees a link from A to B as A using something owned by B, which readers should pay for in the form of a micropayment. This makes perfect sense in a traditional, product-oriented economy where content is king. B manufactured a product that A's readers consumed and should therefore pay for. After Google, it makes no sense at all. The economy of links is not product oriented. It is service oriented, and the service is the link. The link is an action rather than an item, an event rather than a metaphor (Miles, 2001a).

When I link to B, I give B a link. That link translates into a precise (though undisclosed) value in Google's PageRank and in other indexing systems like Blogdex. The link has a clearer value to B than the content of B's page has to me or to my readers. I pay B for B's content with my link.

This instrumental view of links does not exclude its other qualities. Many people creating or following links on the Web link generously, carefully, or haphazardly but without thinking of the economy of links and their value. Some choose to ignore the mercantile qualities of links; many more are unaware of this aspect of links. Even links created solely to increase a page's placement in search engines may have or acquire other meanings or functions as well. This is the excess of the link, which can also be seen in relation to Bataille's concept of a general economy, an economy that is not driven by scarcity (Miles, 2001b). Yet even if we are unaware of or refuse to participate in the economy of links, the pervasiveness of link indexing and valuation in search engines and other mapping strategies makes it impossible to entirely avoid this new restricted economy.

Google has not published the most recent algorithms behind their search technology, but the basic system is more or less known (or surmised) by search engine optimizers and manipulators. One striking effect of the PageRank system is link drain. Each Web page passes on a percentage (85 percent in prototype, possibly the same now) of its own PageRank score to other pages it links to, and this percentage is shared equally between any pages it links to, whether they are on the same site as the first page or on other sites. In addition, PageRank allows feedback loops between pages, so a link from A to B gives B a higher rank, and a link back returns some of that score to A (Ridings, 2001). Some people believe that linking to certain sites, or participating in link farms, can reduce the anchor site's PageRank as well (Forum discussion, 2002). Rumors and theories abound at sites for Webmasters and search engine optimizers, based, for instance, on posts by an alleged Google employee calling himself "GoogleGuy," who repeatedly "advises webmasters to avoid 'linking to bad neighbourhoods'" (Sobek, 2004, PRO section). From this, and from the dreaded PageRank zero penalty sometimes incurred by sites that have dealt in the black market of linking, the priesthood of the search engine optimization world details theories of BadRank, an unofficial equivalent to PageRank. If you link to a site with high BadRank, this theory goes, your BadRank will increase (Sobek, 2004). Whether or not this is true, it is believed to be true by the devout, and these beliefs are integral to the ways in which we think about and use links.

If links are the currency of the Web, what is the exchange rate? Though links clearly have a value that is internally important on the Web, and that can have external real world implications (in sales for commercial sites and cultural capital and reputation for others), there is as yet no standardized exchange rate between links and real world currencies. Affiliate programs and banner ads could be seen as establishing an exchange market, but these are based on more than the presence of a link. Most banner ads pay only for click-throughs, and affiliate programs run by Amazon and others only pay when a link-follower makes a purchase. Though using Ebay as an exchange booth, as Everquest citizens do to sell their virtual treasure for real dollars, is only a gimmick as yet (Hiler, 2002b), this kind of sale and the sale of links rather than click-throughs in advertising could in time permit us to see links as an independent and real currency. As Castronova has demonstrated of the massive multiplayer online game Everquest, nontangible worlds can have real economies (Castronova, 2001).

Though open exchange of links for real world money is as yet infrequent, there is a black market for links. You can pay dollars or kroner or yen to buy links to your site from link farms, circles of sites with nothing but links. There is also a common law perception of link prostitution or link slutting: shamelessly selling one's integrity for links. Though these practices are not yet illegal in any nation state, they are in practice outlawed on the Web. If Google discovers such attempts to manipulate a site's PageRank, the site is penalized by being given a PageRank of zero. Due to Google's high level of control of access to Web sites, this is equivalent to exile.

The more common form of trade in this economy of links is barter exchange. Reciprocal linking and link exchange are common practices and are loosely organized as favors or more systematically in Web rings and blogrolling. Link slutting can be a consensual exchange of favors rather than a sale. "Link incest," or linking inside of a community, is encouraged and often automated in community sites such as LiveJournal, Xanga, and Blogspot. These informal exchanges and the prolific linking in certain looser communities, especially among weblogs, subvert Google's objective measurement of links (Hiler, 2002a).

POWER AND KNOWLEDGE

Links have value and they give power. Power and knowledge are intimately connected: "There is no power relation without the correlative constitution of a field of knowledge, nor any knowledge that does not presuppose and constitute at the same time power relations" (Foucault, 1977, p. 27). There is no moral high ground here where we can ignore the political economy of links and remain pure and clean, thinking only of the felicity of links, their usability or functionality or beauty. We are participants in this power structure whether we like it or not. We can criticize it, reflect upon it, approve of it, or try to subvert it. We must not ignore it. This standardization of links and their value will shape what the future finds. It defines what can be found. It defines knowledge.

REFERENCES

Brin, S., & Page, L. (1998). The anatomy, of a large-scale hypertextual Web search engine. Retrieved November 11, 2004, from http://www.db.stanford.edu/pub/papers/google.pdf.

Castronova, E. (2001 ). Virtual worlds: A first-hand account of market and society on the cyberian frontier (CESifo Working Paper no. 618) [Electronic version[. Retrieved November 11, 2004, from http://papers.ssrn.com/sol3/papers.cfm?abstract_id=294828.

Fabos, B. (in press). Search engine anatomy: The industry and its commercial structure. In K. Cushla & B. C. Bertram (Eds.), Cybraries. Mahwah, NJ: Erlbaum.

Flake, G. W., Lawrence, S., Giles, C. L., & Coetzee, F. M. (2002). Self-organization of the Web and identification of communities [Electronic version[. IEEE Computer, 35(3), 66-71.

Forum discussion. (2002). Linking--What's the big deal? WebmasterWorld.com. Retrieved November 17, 2004, from http://webmasterworld.com/forum12/349.htm.

Foucault, M. (1977). Discipline and punish: The birth of the prison. London: Tavistock.

Google. (2004). Oursearch: Google technology. Retrieved November 11, 2004, from http://google.com/technology/index.html.

Hiler, J. (2002a). Google loves blogs. Microcontent News [Electronic version]. Retrieved November 11, 2004, from http://www.microcontentnews.com/articles/googleblogs.htm.

Hiler, J. (2002b). Google time bomb. Microcontent News [Electronic version]. Retrieved November 11, 2004, from http://www.microcontentnews.com/articles/googlebombs.htm.

Introna, L., & Nissenbaum, H. (2000). Shaping the Web: Why the politics of search engines matters. Information Society, 16(3), 169-185.

Kelly v Arriba Soft Carp., 77 F. Supp., 2d 1116, 1121-23 (C.D. Cal 1999).

Kottke, J. (2004). GooOS, the Google operating system. Kottke.org. Retrieved November 11, 2004, from http://www.kottke.org/04/04/google-operating-system.

Marlow, C. (2001-2002). Software and project notes. Blogdex. Retrieved November 11, 2004, from http://blogdex.net/about.asp.

Miles, A. (2001a). Hypertext structure as the event of connection. In Proceedings of Hypertext 2001 (pp. 61-68). Arhus, Denmark: ACM Press.

Miles, A. (2001b). Realism and a general economy of the link force. Currents in Electronic Literacy, (5). Retrieved November 11, 2004, from http://www.cwrl.utexas.edu/currents/ fall01/miles/.

Nelson, T. (1982). Literary machines. Sausalito, CA: Mindful Press.

Ridings, C. (2001). PageRank explained. Retrieved November 11, 2004, from http://www.seomasters.com/news/idx/6/358/Google_News/article /The_Google_Page_Rank_explained.html.

Sobek, M. (2004). A survey of Google's PageRank. e-Factory.de. Retrieved November 11, 2004, from http://pr.efactory.de/.

Jill Walker, Department of Humanistic Informatics, University of Bergen, Postboks 7800, 5020 Bergen, Norway