Showing posts with label Citation data. Show all posts
Showing posts with label Citation data. Show all posts

Monday, March 21, 2016

Empty citations

In my paper on arguments in archaeology (Smith, Michael E.,  2015,  How can Archaeologists Make Better Arguments? The SAA Archaeological Record 15(4):18-23) I mention the problem of empty citations. A comment this weekend on Twitter got me to look again at the basic reference on empty citations:

Harzing, Anne-Wil
2002 Are our referencing errors undermining our scholarship and credibility? The case of expatriate failure rates. Journal of Organizational Behavior 23:127-148.

Harzing lists "12 guidelines for good academic referencing." I listed these in an earlier post in 2008. They bear repeating, so here they are:
  1. Reproduce the correct reference. This means get the details of the citation right.
  2. Refer to the correct publication. For example, do not cite Binford (1972) for something that was in fact said in Binford (1965).
  3. Do not use “empty” references. “Empty references do not contain any original data for the phenomenon under investigation, but strictly refer to other studies to substantiate their claim.”
  4. Use reliable sources.
  5. Use generalizable sources for generalized statements. In other words, don’t cite a single example as if it provided support for a more general phenomenon, and don’t cite a study of X artifacts at Y site as if it pertained to many more kinds of artifacts at many sites.
  6. Do not misrepresent the content of the reference.
  7. Make clear which statement references support. Don’t include a number of claims in one sentence, and then append a bunch of references.
  8. Do not copy someone else’s references.
  9. Do not cite out-of-date references. The point here is to avoid data and interpretations that have been discarded or superseded. Many archaeological data reports, of course, NEVER go out of date.
  10. Do not be impressed by top academic journals.
  11. Do not try to reconcile conflicting evidence.
  12.  Actively search for counter-evidence.
Harzing found that the greatest problems were caused by violations of guidelines 3, 4, 6, and 9. It is my subjective impression that in archaeology, guidelines 3, 4, 11 and 12 are particularly subject to violation. I will refrain from naming names here in order to avoid antagonizing people.

For a parallel study, published in New Scientist, see: “Scientists exposed as sloppy reporters”

I though I would give an example here. I'll leave out the names, to protect the guilty.

Scholar A publishes a book chapter (in 1994) that analyzing some information. This person then makes a claim about what ancient people in Mesoamerica were trying to do in certain circumstances. This claim has ABSOLUTELY NO empirical basis; it is a speculation based on the worst of flimsy evidence. It is based more on Scholar A's preconceived ideas than on evidence. But instead of framing this claim in hypothetical terms, it is presented as a simple statement of fact. I happen to know the data and research tradition well, and you are going to have to accept my claim that I am not misrepresenting the facts. Maybe I will reveal the original paper, but leave the empty citations anonymous.

Then archaeologists, who share Scholar A's preconceived ideas, start citing this chapter as supporting the idea about what ancient Mesoamericans were trying to do. This appears in at least 3 articles in Latin American Antiquity (between 2004 and 2011), it appears in four or five chapters of an edited volume published by a reputable press in 2005, and it appears again in an edited volume published in 2016, citing not only the original paper, but some of the earlier works citing the original paper. These are all empty citations:
Empty references are references that do not contain any original evidence for the phenomenon under investigation, but strictly refer to other studies to substantiate their claim. Other authors subsequently use these empty references to substantiate their claims rather than going back to cite the original source (Harzing 2002:130).
If you haven't read my paper on arguments, please take a look. And also take a look at Harzing. It is ridiculous that this practice is common in archaeology and Mesoamerican studies.

Harzing, Anne-Wil
    2002    Are Our Referencing Errors Undermining our Scholarship and Credibility? The Case of Expatriate Failure Rates. Journal of Organizational Behavior 23:127-148.

Sunday, February 8, 2015

23 thousand citations

My Endnote bibliography database has just passed 23,000 entries. The reference that pushed it over this level is:

Hillier, Bill
    1996    Space is the Machine: A Configurational Approach to Architecture. Cambridge University Press, New York.

I decided to do a quick, almost certainly inaccurate, list of the top ten authors in my Endnote database. There is not a way to do this easily in Endnote, so I just thought of authors I know I have cited a lot over the years, or whose work I follow, and recorded how many entries I have for them as author. I found these eleven with lots of entries:

Gary Feinman:        102 works in my database
William Sanders:      74
Kenneth Hirth:         73
Joyce Marcus            72
Tim Earle:                59
Richard Blanton:       58
Eduardo Matos:          58
Kent Flannery          54
Frances Berdan        53
George Cowgill       51
Charles Tilly             48
Robert Sampson       39

My Endnote database may be the single best marker of my scholarly identity. I am a bibliography nut, so any time I come across a work that I think might be relevant to my publishing or teaching I add it to the database. The worst thing a reviewer can do is to point out that I have missed some relevant sources. I love it when I find new references in a student paper. The first thing I usually look at in a new paper is the bibliography.

Here are a few informative ratios of numbers of works. The first three measure my scientific, materialist perspective (or perhaps more precisely, my dismissal of postmodern works):

Mario Bunge to Michel Foucault:  4.0  (16 works to 4)
Charles Tilly to Christopher Tilley:  5.3  (48 to 9)
Marvin Harris to Pierre Bourdieu:  2.4  (12 to 5)
Bruce Trigger  to Michael Dietler:  2.3  (34 to 15)

Or, within Mesoamerica:

William Sanders to Michael Coe:  2.6  (74 to 28)
Michel Graulich to David Carrasco:  1.8  (39 to 22)
Joyce Marcus to Rosemary Joyce:  1.9   (72 to 37)
Joyce Marcus to Arthur Joyce:  2.2  (72 to 33)

I don't want to attribute much value to these ratios. They depend on region (more for central Mexico than the Maya area), career length of the authors, personal networks, how closely an author's work relates to my own interests, and other factors. But still, the first batch clearly captures my theoretical and epistemological orientation, and the second captures this factor as well as some regional biases. (Speaking of Pierro Bourdieu, stay tuned for a post on the "anti-Bourdieu").


Friday, January 3, 2014

Why can't people cite me correctly?

We all like to be cited in print. I like to be cited. But recently I've come across a troubling number of citations of my work that attribute to me a position or claim that is the opposite of what I actually said. In the process they make me the poster child of the negative consequences of holding those (erroneous) positions. These are all in publications by good scholars who are not known for sloppy scholarship, so I find the errors puzzling. Here are three recent cases.

1. Just because I use the term "urban function" does not make me a functionalist in terms of social theory.

Joyce, Arthur A.  (2009)  Theorizing Urbanism in Ancient Mesoamerica. Ancient Mesoamerica 20:189-196.

Urban functions are activities and institutions located in cities that affect people and society in a broader hinterland. Another term for these might be impacts. If markets and merchants in a city impact the hinterland, then retail market exchange is an urban function. If ceremonies at a big urban temple are attended by rural people, or are seen to affect an entire polity, then religion is an urban function. I have published quite a bit about this. But does that make me a “functionalist”? Evidently so. “Michael Smith relies on a functionalist view of cities” (Joyce 2009:191). He had previously dismissed the bad old theoretical approaches to cities used by outdated archaeologists as “cultural evolutionist, functionalist, and elitist” (p. 189). Joyce uses the term “functionalist” in the first part of his paper is in terms to refer to the social theory of functionalism associated most strongly in anthropology with Malinowski and Radcliffe-Brown. Many of the new archaeologists had a functionalist view of social complexity, explicated and criticized very clearly by Brumfiel and Earle (1987) under the label of “adaptationist.” If you don’t know what I’m talking about, please read that paper.

In anthropology today, functionalism is usually portrayed as hopelessly out of date and only of value for the history of anthropology. The term “functionalist” and “functionalism” have never been used in relation to urban functions (in geography or other urban literature). So the fact I have published on urban functions in ancient cities, or that I’ve trumped their value in defining urbanism, has nothing to do with functionalist social theory. I don’t think I’ve ever espoused functionalist views. So why did Art Joyce brand me a “functionalist”? I have no idea.


2. It is bad enough to be cited as making a claim I never made, but then please don't attribute to me all of the negative consequences that come from making that erroneous claim.

McAnany, Patricia A.  (2013)  Artisans, Ikatz, and Statecraft: Provisioning Classic Maya Royal Courts. In Merchants, Markets, and Exchange in the Pre-Columbian World, edited by Kenneth G. Hirth and Joanne Pillsbury, pp. 229-254. Dumbarton Oaks, Washington, DC.

I’ve been reading this book carefully for a book review. Most of the chapters are very good and I found them interesting, glad that the book review forced me to read things I might otherwise be tempted to just skim over. But I got a rude surprise at the end of Tricia McAnany’s chapter, when I saw my 2004 ARA paper (Smith 2004) cited as the cause of a list of negative consequences for understanding Maya economies. Here is the quote:

“Likewise, categorizing Maya economies as noncommercial (Smith 2004) rules out the possibility of marketplace exchange before it can be explored, ignores the commercial intensity of tribute negotiation, and misses the historical dynamism of Maya exchange networks” (McAnany 2013, p. 246)

In my 2004 paper I present a continuum or scale of commercialization in ancient state economies, divided up into the following categories: uncommercialized, low commercialization, intermediate commercialization, and advanced precapitalist commercialization. I list the Classic Maya as an example of the “low commercialization” category. I did NOT call the Maya economy “noncommercial” or “uncommercialized.” So the first problem is that my published categorization of the Maya economy was misstated. But I am also listed as the poster child for a series of negative consequences that flow from failing to acknowledge some level of commercial exchange for the Maya. This is very frustrating, because I largely agree that “primitivising” the Maya economy (by denying commercial exchange) has negative consequences. But please don’t blame me for a position I didn’t take.


3. I don't view the main purpose of my archaeological research as validating prior historical categories.

Steere, Benjamin A. and Stephen A. Kowalewski  (2012)  Wealth Stratification in Ancient Mesoamerica. Social Evolution and History 11(1):20-48.

These authors present two approaches to studies of social stratification in ancient Mesoamerica. The good approach, which they follow, “is etic and offers inductive description of the social distribution of wealth” (p.20). The bad approach, which evidently means me, is “to identify legal or emic status positions as these may be defined by indigenous documents ... or by prior theory” (p.20). Archaeologists who follow this approach, “look for material patterns consistent with the historically named social categories (see, e.g., Smith et al. 1999). The archaeology then illustrates what is already known.” The problem with these statements is the same as for the McAnany case: I am cited as taking a position opposite to what is actually stated in the cited source, and in the process I am made the whipping boy for the negative consequences of that (erroneous) position.

Here is an outline of Smith et al (1999).
1.      Describe houses we excavated at Yautepec.
2.      Compare their forms to other Aztec houses known from archaeology and ethnohistory.
3.      Present the sizes of the Yautepec houses in a table and graph.
4.      Discuss briefly some of the theoretical and comparative literature linking house size to wealth.

We did NOT begin with Aztec emic categories, and such categories did NOT structure the fieldwork or the analysis of the data. And even if we had followed this kind of procedure, it would be hard to claim that “archaeology then illustrates what is already known” because no one knew much about Aztec house size prior to my excavations at Yautepec and other Morelos sites; such information is not found in the documentary record. But we didn’t structure the paper this way.

What really steams me about this mischaracterization of my work is that it claims my archaeological interpretations are limited to validating the historical record, and are thus structured by that record. But one of the methodological contributions I like to think I have made to the discipline lies precisely in this area of how archaeology and ethnohistory should be compared and related to one another. My basic position is that the archaeological record needs to be analyzed independently of documents so as to avoid bias, and thus detailed comparisons of archaeology and ethnohistory, or joint models, should only be done after each record has been analyzed independently. For my methodological contributions to this theme, please check these works: (Smith 1987a; Smith 1987b; Smith 1992a; Smith 1992b; Smith 1993). After 1993 I didn’t harp on this theme as much, but it certainly informs all of my Aztec research since then (e.g., Smith 2008; Smith 2012; Smith, and Berdan 2003). So it really bothers me when it is suggested, in error, that one of my papers violates my own methodological precepts. Arghhhhhhhhh.

I’m somewhat puzzled by these errors, and I will refrain from trying to figure out why they were made. These are all good scholars whose work I read and admire. But for some reason, I am cited as the bad guy in their straw-man arguments. Perhaps being cited in error is better than not being cited at all. As they say, “There is no such thing as bad publicity.” But still, I’d much rather be cited for what I really say.


Brumfiel, Elizabeth M. and Timothy K. Earle  (1987)  Specialization, Exchange, and Complex Societies: An Introduction. In Specialization, Exchange, and Complex Societies, edited by Elizabeth M. Brumfiel and Timothy K. Earle, pp. 1-9. Cambridge University Press, New York.
Smith, Michael E.  (1987a)  Archaeology and the Aztec Economy: The Social Scientific Use of Archaeological Data. Social Science History 11:237-259.
Smith, Michael E.  (1987b)  The Expansion of the Aztec Empire: A Case Study in the Correlation of Diachronic Archaeological and Ethnohistorical Data. American Antiquity 52:37-54.
Smith, Michael E.  (1992a)  Braudel's Temporal Rhythms and Chronology Theory in Archaeology. In Annales, Archaeology, and Ethnohistory, edited by A. Bernard Knapp, pp. 23-34. Cambridge University Press, New York.
Smith, Michael E.  (1992b)  Rhythms of Change in Postclassic Central Mexico: Archaeology, Ethnohistory, and the Braudellian Model. In Annales, Archaeology, and Ethnohistory, edited by A. Bernard Knapp, pp. 51-74. Cambridge University Press, New York.
Smith, Michael E.  (1993)  Houses and the Settlement Hierarchy in Late Postclassic Morelos: A Comparison of Archaeology and Ethnohistory. In Prehispanic Domestic Units in Western Mesoamerica: Studies of the Household, Compound, and Residence, edited by Robert S. Santley and Kenneth G. Hirth, pp. 191-206. CRC Press, Boca Raton.
Smith, Michael E.  (2004)  The Archaeology of Ancient State Economies. Annual Review of Anthropology 33:73-102.
Smith, Michael E.  (2008)  Aztec City-State Capitals. University Press of Florida, Gainesville.
Smith, Michael E.  (2012)  The Aztecs. 3rd ed. Blackwell Publishers, Oxford.
Smith, Michael E. and Frances F. Berdan (editors)  (2003)  The Postclassic Mesoamerican World. University of Utah Press, Salt Lake City.
Smith, Michael E., Cynthia Heath-Smith and Lisa Montiel  (1999)  Excavations of Aztec Urban Houses at Yautepec, Mexico. Latin American Antiquity 10:133-150.


Monday, February 13, 2012

Coercive citations

Suppose you had submitted a paper to a journal ("Journal-X") and you got this message from the editor: "You only cite Journal-X once. Consequently, we kindly ask you to add references of articles published in Journal-X to your present article." Would you comply? This is known as "coercive citation," something I had never heard of until I read the latest issue of Science:

Wilhite, Allen W. and Eric A. Fong  (2012)  Coercive Citation in Academic Publishing. Science 335:542-543.

It seems that this practice is rampant in the fields of business research. These authors did a thorough study with lots of interviews with authors and studies of journals in several fields. At least some authors in every field considered (social sciences and business) reported attempts a coercive citation, but there was considerable variation. They took economics journals as the standard for regression analysis, and found that contributors to journals in marketing, management, finance, and information systems were 15 to 20% more likely to have been coerced like this. Contributors to journals in sociology and psychology were 5 to 10% LESS likely to have been coerced.

Why does this happen? So that journals can increase their impact factor. One interesting finding: authors in the business fields don't generally think this is quite such a bad practice, whereas authors in psychology and sociology were really outraged about this. I'm sure archaeologists would also be outraged. We can whine and complain about archaeology journals, but at least they aren't engaging in coercive citations (at least I have never encountered any evidence of this).

Sunday, November 7, 2010

Markets, hierarchy, community, and some strange citation patterns

I’ve been thinking about rationality lately. What is rationality? Why do people behave rationally in some circumstances but not others? When is it rational to cooperate? When and why do people cooperate with one another? These, of course, are questions at the center of a very active and prolific research effort today that cuts across economics, evolution, anthropology, psychology, and even archaeology. But that’s not directly what I want to talk about; I am puzzled by the citation differences between two authors who published useful frameworks for thinking about some of these things.

In 1980 economic historian Peter Temin published a paper called “Modes of Behavior” (Temin 1980). He identified three of these modes: instrumental behavior; customary behavior; and command behavior. He then defined three institutional structures: hierarchy; market; and community. Temin presented a 3 x 3 matrix to show that some combinations are stable (e.g., customary behavior in community settings; or instrumental behavior in markets), and other combinations produce pressures for institutional change (e.g., command behavior in markets favors institutional change from markets to hierarchy). I have found this a useful way to think about markets, rationality (“instrumental” behavior), community, and the like.

Ten years later, anthropologist Alan Fiske published a book and an article on “elementary forms of sociality” (Fiske 1991, 1992). He now calls this realm “relational models theory” (see his website, http://www.sscnet.ucla.edu/anthro/faculty/fiske/). Fiske identifies four types of sociality: communal sharing, authority ranking, equality matching, and market pricing. He argues that all human social interactions can be analyzed in terms of these four elementary models. This is also a useful way to think about human behavior, rationality, etc.

To me, these two schemes are quite similar. Fiske’s is more nuanced in terms of cross-cultural variation in behavior, while Temin’s has a stronger economic and institutional emphasis, but both serve to put rational behavior in its place. That is, some behavior is based on rational calculation but other behavior is not; and some settings encourage or require rational behavior, while other settings do not. The next time you hear a simplistic economic argument about analyzing all behavior as rationally motivated, or a simplistic culturalist argument about the worthlessness of rational choice models, take a look at Temin and/or Fiske.

Now for the strange citation patterns. According to Google Scholar, Fiske’s book has been cited 581 times and his article 726 times. But Temin’s paper has been cited only 7 times (twice by Temin himself in his papers on the Roman economy). What’s going on here? The two schemes are parallel, and one would think that scholars citing one would cite the other. But it seems that disciplinary citation patterns have prevented this. Most economists, particularly in 1980, probably did not want to hear Temin’s argument. They were wedded to the narrow rationality model, and he just complicated things with non-rational behavior and institutions. Fiske’s work, on the other hand, was picked up by cognitive psychology and psychological anthropology, and there is now a substantial body of work that has grown out of his original insight (see his website). Writers on rationality and cooperation today typically cite Fiske but not Temin (Bowles 1998; Henrich and al. 2005).

So what are the lessons here? For one thing, it matters where you publish a paper. Also, disciplines differ in their citation patterns. With Google scholar today, though, it is harder to justify limiting one’s citations to a narrow realm. So, WHY AREN’T ARCHAEOLOGISTS CITING THESE PAPERS? Have we managed to figure out ancient rationality, cooperation and such on our own, so that we don’t need to cite works like this? (sarcastic remark deleted here). I don’t think so.

Fiske, Alan P.
1991    Structures of Social Life: The Four Elementary Forms of Human Relations: Communal Sharing, Authority Ranking, Equality Matching, Market Pricing. The Free Press, New York.

1992    The Four Elementary Forms of Sociality: Framework for a Unified Theory of Social Relations. Psychological Review 99:689-723.

Temin, Peter
1980    Modes of Behavior. Journal of Economic Behavior and Organization 1:175-195.

Bowles, Samuel
1998    Endogenous Preferences: The Cultural Consequences of Markets and Other Economic Institutions. Journal of Economic Literature 36:75-111.

Henrich, Joseph and et al.
2005    "Economic Man" in Cross-Cultural Perspective: Behavioral Experiments in 15 Small-Scale Societies. Behavioral and Brain Sciences 28:795-855.

Tuesday, June 29, 2010

Journal Impact Factors

The "impact factor" of a journal is a measure of the frequency which an average article in the journal is cited within a specified period of time. Obviously higher impact journals are "better" than lower impact journals in their visibility and their overall professional influence. The problem with this and similar measures is in the measurement. The data are produced by Thomson Reuters, an organization whose database includes only a small number of archaeology journals. So if most of our journals are not included in the calculations, how useful is this measure? Also, the calculations do not include citations in books and book chapters, which seriously disadvantages the humanities in comparison with the sciences. This largely explains why, within anthropology, physical anthropology journals have much higher impact scores than journals in cultural anthropology (with archaeology in between).  If you want to read more about impact factors, I'll put some citations below.

Anyway, what prompted this posting is an email I just received from Elsevier about how the impact factors of their archaeology journals are going up. I guess this is a good thing. I have long thought that archaeology journals have low impact factors (compared to journals in the sciences, for example). But look at the information below from Elsevier. Wow, archaeology trumps the history and philosophy of physics in journal impact measures! (Notice that Elsevier did NOT include any science journals for comparison).

Your should take these and other citation data with a grain of salt. If you want to read up on the topic, see the references below.

Elsevier logo. spacer e-mail header image.
LATEST IMPACT FACTORS

spacer
Dear Michael E. Smith,

The latest impact factors* for Elsevier's Arts and Humanities journals have just been released and highlights include...
journal cover image
2008 Impact Factor
WAS
1.779
2009 Impact Factor
NOW
1.847
impact factor bar-chart
journal cover image
2008 Impact Factor
WAS
1.121
2009 Impact Factor
NOW
1.667
impact factor bar-chart
journal cover image
2008 Impact Factor
WAS
0.562
2009 Impact Factor
NOW
0.783
impact factor bar-chart
journal cover image
2008 Impact Factor
WAS
0.178
2009 Impact Factor
NOW
0.424
impact factor bar-chart
Endeavour
0.154 0.16





Hicks, Diana
1999    The difficulty of achieving full coverage of international social science literature and the bibliometric consequences. Scientometrics 44:193-215.

Leydesdorff, Loet
2007    Caveats for the Use of Citation Indicators in Resesarch and Journal Evaluations. Journal of the American Society for Information Science and Technology 59:278-287.

Nederhof, Anton J.
2006    Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review. Scientometrics 66:81-100.

Nehlo, L.I. and K. Yang
n.d.    A New Era in Citation and Bibliometric Analyses: Web of Science, Scopus, and Googld Scholar. Journal of the American Society for Information Science and Technology in press.

Saturday, June 26, 2010

The Open Access Citation Advantage

I just read an especially clear and concise discussion of the Open Access citation advantage. This is from Colin Smith's blog, Open Research Online:

"For those unfamiliar with this, based on the (quite reasonable) assumptions that:

1) a proportion of researchers do not have access to all published research that is relevant to them;
2) the problem would be otherwise addressed by unavailable research being freely available online; and
3) some of these articles would be relevant, and thus citable…

the expectation is that published research made openly accessible online will carry a “citation advantage”. In other words, by publishing or archiving research in an open access manner, the chances of one’s work being cited improves."

If you want to look at this in more detail, Alma Swan reviews the published research on the OA citation advantage here (and the evidence is overwhelmingly in favor of the existence of the citation advantage, contra some skeptics) :

Swan, Alma
2010 The Open Access Citation Advantage: Studies and Results to Date (draft version). Technical Report. School of Electronics & Computer Science, University of Southampton, Southampton.


A very important point to bring away from this is that the citation advantage does not require waiting until all journals are published as open access ("gold OA"). Rather, it happens when authors self-archive their peer-reviewed publications, either in an institutional repository or in another fashion ("green OA").

If you do not already self-archive your publications, you should do one of these (and if you don't publish your work, I'm not sure why you are reading this blog):
  • If your university or institution has an institutional repository, sign up and start using it. I can't do this, since ASU does not have such a repository.
  • Sign up with Academia.edu and post your papers there. Yes, I know, the interface for posting paper is clunky and inefficient, but it works. And Academia.edu has EXCELLENT coverage in Google searches. I do this, but with only a few papers.
  • Sign up with Selected Works by Berkeley Electronic Press and post your papers there. I do this too, partly as an experiment; but the interface and download statistics are great.
  • Get space on your institution's server, make your own webpage, and post your papers. This is where I post everything (well, almost everything).
  • Get space on a commercial server (even Facebook will work, I think) and post your papers.
It does not take much time, and it will improve your citation levels and make colleagues (like me) happy.

Monday, November 30, 2009

Track your citation data with "Tenurometer" (maybe)

According to "Tenurometer," a new site that provides citation data for researchers, my publications are more widely cited than those of Colin Renfew or Kent Flannery! Wow, what an ego-boost! Closer examination, however suggests that I am being attributed publications by many authors named "ME Smith," in many disciplines. Oh well. I wonder if I can fool my dean with these "data." Tenurometer uses citation data from Google Scholar. When searching for my own publications on Tenurometer, I can isolate them without much difficulty (using search terms, and then manually weeding out papers from other ME Smiths). But when the program constructs comparisons within disciplines, it must take ALL the ME Smith papers. When my citation data seemed too high, I added Renfrew and Flannery, and found that I was ahead of those guys! Oh well, my proper place in the citations hierarchy should be quite a bit lower.

If you want to try this program, here is part of the email that I got through Steven Harnad's Open Access listserv:

Dear colleagues,

Please forgive the wide distribution of this announcement. We write to introduce a new social tool to facilitate citation analysis and help evaluate the impact of an author's publications:

http://tenurometer.indiana.edu/

Tenurometer provides a smart interface to make Google Scholar more powerful, convenient, and easy to use. Unlike Publish or Perish, Tenurometer is not a standalone application; it is a browser extension, so it can be used on any computer with a Firefox browser.

There is a twist. By using Tenurometer you help tag authors and contribute to a social database of annotations, associating authors, papers, and disciplines. We plan to make this data publicly available for research purposes. All you do is use Tenurometer for your own purposes, and submit one or more discipline tags when you query.

Statistics from the annotations are available on the Tenurometer website.