Showing posts with label Journals. Show all posts
Showing posts with label Journals. Show all posts

Tuesday, April 4, 2017

Social media attack to blog post to journal article

figure from my paper
My paper, "Social Science and Archaeological Enquiry", was just released, online, by the journal Antiquity (last week, I think). It is volume 91 (356), pp. 520 - 528. You can find a copy here.   This is without a doubt the strangest journey to publication of any of my papers, so maybe it is worth telling. I have the Grateful Dead on in the background, which helps. The story begins with my attendance at a talk on the "new materiality" by Rosemary Joyce at the University of Colorado Department of Anthropology in late January or early February, 2016. I did not like the lecture, and I made some snide remarks about it in this blog, here.

The new materiality: Vacuous or just incomprehensible?

Looking back, I was perhaps a bit harsh in my tone, bordering on rudeness. Some students from UCB posted some critical remarks about my post on their departmental Facebook page.

You can see some of the posts from the Boulder group here.

I fired back and posted some more remarks on my blog. I was taken to task by the department chairman, in a rather rude ad hominen post, for shooting my mouth off without restraint, rather like a small child. You can find all this pretty easily if you are interested (note: it is not very interesting...). Nearly all of the criticisms from Boulder suggested that my speech was not valued. I was insulting; I was trying to spoil their special lecture; I should not say such nasty things about their distinguished visitor. Many people came along and liked their critical posts. I became a pariah to UCB Anthropology-Facebook. But not a word about the intellectual content of the lecture or my reaction to it.

I was dismayed, insulted, and demoralized by my first social-media hazing event. The comments to some of my blog posts discuss some of these issues. But to me, the key issues were--and are--scientific and intellectual. I found the whole approach of Rosemary Joyce's talk to be anti-scientific and thus detrimental to the advance of the kind of archaeology I advocate in this blog. I was particularly incensed at her argument that fields like archaeology had to choose between the humanities and the natural sciences. She claimed that, given the inadequacies of natural science, we should choose to follow the humanities. This is so wrong-headed, it drove me nuts.

My reactions led to me create a series of posts that clarified my views of science, social science, and the place of archaeology. Writing these helped me clarify my own views of the topic, and try to put them into a framework that would be clear to other archaeologists (ever wonder why i blog? This is a primary reason - it helps me clarify my thoughts).

Science, Social science, and archaeology: Where do we stand?

Pascal Boyer's view of science, social science, and the humanities

Why is it important to strive for a more scientific archaeology?

Why is a scientific archaeology so hard to achieve?

((you can get to the later posts from the first one))

After this whole event had died down, it occurred to me that I should present these ideas in a larger venue, in a streamlined and more efficient context. Why had no one called the postprocessualists to task for their outdated and inaccurate views of positivism and science? Why haven't scientifically-minded archaeologists shot back at the epistemological hogwash? So I sent off a short piece to Antiquity, and they accepted it. I was a bit nervous, wondering if it was entirely proper to put ideas from a blog post into a journal article. But this was not at all a literal re-doing of the blog. The basic message was the same, though. I came across the paper on archaeological theory by Julian Thomas, and found that none of the work I do - theoretical or empirical - would fit under his definition of "archaeological theory." So I contrasted it with the list of different approaches to archaeological theory given by Jarvie and  Zamora-Bomilla. I also continued some of the themes from my paper on archaeological arguments.

So the path of this article was:

- attended a talk I did not like
- wrote a snarky blog post about it
- was attacked on social media
- sharpened my thinking in a series of blog posts
- condensed and sharpened the ideas further for a journal paper

So, I figured that it was time for another blog post (this one). Perhaps I should give a bad lecture on the whole affair and complete the circle. Or maybe I should shut up and concentrate my efforts on publications, not blogs.

To quote my favorite rock band, "What a long strange trip its been....."

References:

Jarvie, Ian and Jesús Zamora-Bomilla (editors)
2011 Sage Handbook of the Philosophy of the Social Sciences. Sage, New York.

Smith, Michael E.
2015 How Can Archaeologists Make Better Arguments? The SAA Archaeological Record 15 (4): 18-23.

2017 Social Science and Archaeological Inquiry. Antiquity 91: 520-528.

Thomas, Julian
2015 The Future of Archaeological Theory. Antiquity 89: 1287-1296.






Monday, January 23, 2017

Have we gotten out of the crisis in Latin American book reviews?

I have always been a big fan of book reviews. When I get a new journal, I may scan the article titles first, but I almost always read the book reviews before the articles. Book reviews are an important part of quality control in scholarly disciplines where books are prominent (as in archaeology). In the past I have blogged about the book review crisis in Latin American archaeology: See my posts in:

2008,  2009,  2011

For a decade, very few books were being reviewed in the main journal, Latin American Antiquity. The major Mesoamerican journal, Ancient Mesoamerica, doesn't published book reviews at all! But now, book reviews are trending up in quantity. I thought there were more reviews in LAA over the past year, so I counted them up. Here are the data, starting in 1997.


These figures paint a bleak picture of the decline of quality control in Latin American archaeology starting around 2004. But after six years of almost no reviews (average of one--count, 'em--1 per issue!), things are trending up in 2016.

Book reviews are important for many reasons. First, they get out the news about new publications. Second, a good book review is a gem of a short essay on the topic of the book. Because I try to keep up with urban research at some level in many different disciplines, I use book reviews to help guide my reading. And third, book reviews give an indication of the quality of the book. Bad books are called out, and good books are praised. I recently had to give a quick judgment on the quality and influence of a book in a field far from my own (NOT Latin American archaeology!). I was able to find four book reviews easily, and they gave me the information I needed.

Let's hope this trend at Latin American Antiquity continues! Perhaps Ancient Mesoamerican might be persuaded to begin reviewing books. When I have suggested this at the board meetings, the response has been, "Fine, if you want to organize it, go ahead," hardly an enthusiastic promise of support.

If you are asked to review a book, please do it. If you would like to see more book reviews, contact the relevant journal editors and let them know. Our field has need of all the quality control we can get, and book reviews should be a major part of our collective strategy of disciplinary improvement.

Tuesday, November 8, 2016

Problems with authors who publish books but not articles

Do you ever get annoyed when reading book-length studies and the author feels justified in ignoring the scholarly literature on the topic? I have found this to be the case with a number of authors. If they would publish in journals, they would be forced to cite other studies on the topic and contextualize their work within the scholarly literature. But because they are publishing a book (and the editors/press don't seem to care), they feel free to write what they like, and other studies of the topic be damned. I think this practice is harmful to scholarship.

Here is a portion of a book review I published a number of years ago. I've anonymized it, since my goal here is not to dump on Dr. X. But it does express my frustrations with this particular book, something I have seen in other book-authors who do not publish journal articles:


I am in agreement with X’s overall goals and approach. This type of revisionist history, in which political explanations are applied to phenomena previously interpreted in particularistic and ideological terms, is welcome. Nevertheless, I am uncomfortable with many of X’ specific arguments, largely because I am unable to assess their strengths and weaknesses. In part this is owing to his style of scholarship. X identifies an important and unresolved issue, summarizes what the primary historical sources say, discusses the pros and cons of alternative interpretations of the data, and then states his preference. His exposition sounds logical and convincing but because he does not cite the relevant secondary literature, one would never know that a given topic is the subject of considerable published scholarship and debate among specialists, many of whom draw on data and methods not presented by X.  Scholars Y and Z, for example, have made fundamental contributions to the topics covered by X, but he does not cite the relevant publications  This failure does not make X’s arguments wrong, but the reader is prevented from evaluating them within the context of contemporary scholarship.

 I am also disappointed by X’s treatment of archaeological data. He presents incorrect dates (which support his interpretations) for several key buildings, including the New Fire temple on Mount Huixachtecatl and the twin-temple pyramids of Tenayuca and Teopanzolco. Contrary to X’s assertions, these latter temples are dated quite firmly to the Early Aztec period (several centuries before the Aztec empire) and thus cannot possibly have had the imperial significance attributed to them by his model. X’s book is an intriguing study with a fresh theoretical approach and many promising interpretations of Aztec history, time and calendars. However, to be assessed properly, X’s interpretations must be debated within the community of scholars working on these issues so that the strength of his arguments can be evaluated. 

Give me a series of journal articles any day. Or, if you write a book, please be scholarly and complete about it, even if it is not subject to peer review.

Saturday, October 29, 2016

Anonymity ain't what it used to be

(NOTE: I just found that this post was sitting around, not submitted. So here it is)

Sometimes scholarly anonymity is not upheld by journals, even if they promise this. A while ago I reviewed a manuscript for Journal A (I am being anonymous here to protect the guilty). The paper in question had a lot of problems and I did not recommend publication. Recently I saw that the paper (presumably a heavily revised version) had been published in Journal B. Then a colleague emailed me with some remarks on the paper, and made an offhand remark that I must have seen the paper and provided help or comments to the authors. But I don't know the authors and had never communicated with them! I checked the paper, and I was indeed thanked in the acknowledgements for my comments. I went back to my original review and confirmed that I had indeed submitted it anonymously (sometimes I sign my reviews, and sometimes not; when I DO sign a review, I make it very clear that I do not want to remain anonymous).

I contacted the editors of Journal A, who did not know what had happened. I contacted the lead author, who sent along a copy of my review. It was the review I had submitted to the journal, but an extra line had been added at the top: "Reviewer: Michael Smith." This was supposed to be a single-blind review system (that is, the names of the authors are known to the reviewers, but the names of the reviewers are not supposed to be revealed to the authors). Hmmmmmmmm. I was pretty angry at the journal, and slightly miffed at the authors. I think the authors should have contacted me, acknowledged that they saw my review, and ask if they minded if they cited me in the acknowledgements. That might have led to a more lengthy correspondence, and perhaps a more beneficial use of my advice to them. But this is a minor point. Another consideration is that the authors (presumably) used my review to improve the paper, so I am happy to have contributed in that sense.



I started off my career, back in pre-email days, writing reviews on university letterhead, a BIG mistake! One time a publisher asked me to review a couple of chapters from a new textbook (by a colleague I knew pretty well) and promised me anonymity. I thought the chapters left a lot to be desired and said so. The next time I talked to the author, they thanked me for my "frank" review. "How did you know it was me?" I asked. Well, it seems the publisher had covered up my signature but not the university letterhead! I was teaching at Loyola University of Chicago, and I was the only archaeologist on the faculty. It was pretty clear to the author that I must have written the review. That was when I switched to writing reviews on a separate sheet with no identifying marks. That seemed to work, until now.

So, what is the lesson here? Although I often feel that anonymity should be avoided in the interests of collegiality and collaboration, it does have its uses. If a journal claims to use blind peer reviewing, then they should adhere to their standards and not compromise them. And if you are writing a review and really want to remain anonymous, consider the reputation of the journal and its editor. You can always contact the editor to mention your concern about anonymity; that might reduce the chances of slippage as in my case today.

For more information about anonymity in peer review (in relation to double-blind reviewing), see my older post on this. Both of those older posts have some bibliographic citations on types of peer review and their implications.

From: PhD Comics

Thursday, October 20, 2016

Should you consider a 3-article dissertation?

The three-article format for dissertations is becoming more common in archaeology. In my proposal-writing class we cover some professional issues, and students were interested in discussing the 3-article dissertation. I am not an expert here, but I did supervise creation of a policy and guidelines for the three-article thesis in my unit, and I am sitting on committees where students have chosen this option. I found a nice blog post (from 2014) on The Thesis Whisperer, "Thesis by publications? You're joking, right?" (guest post by earth scientist David Alexander). The (many) comments on that post contain many good insights and ideas, and I'll quote a bunch of them below.


First, here is a brief summary of our requirements (in SHESC) for a three-article dissertation:
  • The dissertation will consists of an introductory chapter, three article-chapters, a conclusion, and a single bibliography.
  • The paper must be considered publishable by the committee. This includes evaluation of the appropriateness of the target journal.
  • If the student has gathered a significant amount of data that will not go into an article, then the data should be presented in an appendix to the dissertation 
  •  

 Advantages

  • Divides the thesis into manageable sections
  • Less of a big push at the end to get the thesis done
  • Professional critique and feedback at an early stage
  • Articles improve one’s CV, and gives you a head start on publishing from the thesis.

 Here are some positive quotes from the comments on the Thesis Whisperer blog post"


For mine, the greatest advantage is that I now don’t have to sit down and write publications associated with my thesis.
It would be fairly hard for examiners to say that your research is crap when it has already been peer reviewed. 
What this discussion raises for me, or reminds me of, is that too often PhD students spend so much time on this one research project that they end up having narrowed their vision of the field that they are in. In addition, their actual amount and breadth of experience with research methodology is quite brief, because the research methods utilised and analysis of data/results is limited in scope.   I would argue that a PhD by publication can not only be rigorous, due to the peer review process, whether internal or external, but it also likely demands that the student demonstrate a variety of research skills across a number of research studies.   The PhD by publication is much closer to the real life work of a career academic, where quantity of publications is a ‘fact of life.'

Disadvantages:



  • The format may not fit all dissertation topics
  • Can be looked down on by humanities-oriented scholars or disciplines
  • Can be looked down on by older, more traditional scholars
  • Can be a big delay if all of the articles must be PUBLISHED before the Ph.D. is granted.
  • The dissertation is less useful as a doorstop.

Here are some negative quotes from comments on the Thesis Whisperer post:"


I could imagine that a paper could possibly be produced from the lit review or maybe the discussion chapter from the end, but I can’t imagine how a chapter about theory, methodology or findings could function as a stand-alone paper??
I was strongly advised against it as the monograph plus 1 or 2 article is still the expected norm within English departments. I asked the same question, PhD by publication or PhD as monograph, at a conference a few months later where three scholars in my field (from UK, Australia and USA) gave a seminar for post grads on the job market, and was virtually scoffed at for even suggesting that a PhD by publication was a possibility in English.
I was incredibly surprised at the range of (often strongly voiced) opinions that academics and university administrators, as well as PhD students, have on the issue of PhD by publication. I’ve seen people having angry, loud arguments (particularly in the social sciences) about whether a PhD publication is a positive development for the academy.    I think the reason for the divergent opinions is that this issue goes to the very heart of what we think scholarship should be about. The monograph model suggests that good scholarship should be based on an ability to produce an in-depth, book length analysis of a given issue, whereas the publication model tends to correlate more closely to existing research evaluation frameworks, which value large numbers of papers more highly than other forms of research output (such as books).

So, here are some things to consider in making a decision about whether the three-article dissertation is right for you:

  • Check your university regulations. Some British institutions (based on the comments on the Thesis Whisperer post) require the three articles to be completely published before the thesis is accepted (obviously a potentially dangerous source of delay). Some institutions promote this form of dissertation, others try to restrict it. Check your options.
  • Is your archaeology more science- or humanities-oriented. The 3-article dissertation is definitely a development in the sciences, and it is more widely accepted in scientific disciplines. Humanities-oriented archaeologists, perhaps Classicists, who have spent their whole career on one type of building in one time period may be less likely to approve of the 3-article format. If you have such people on your committee, or if you intend to apply for jobs in programs consisting of such scholars, you may want to go with the traditional dissertation format.

Theses nailed to the wall in Uppsala
I wonder what they think about 3-article dissertations in Sweden, where they still nail their theses to the wall.