Monday, December 4, 2017

Check your (taxonomic) biases at the door

Many of us like to believe that we are conceptually-oriented researchers; our particular study organism(s) are just means to an end, the end goal being to answer broad questions about how evolution or ecology works. But our citation patterns suggest otherwise. We are more likely to read, and hence more likely to cite, papers about organisms of direct relevance to our own work. That results in some unfortunate conceptual balkanization. Case in point: I’m writing an Annual Reviews paper on (non)parallel evolution, with several co-authors. Collectively, we have all studied sticklebacks (though we have some other study organisms in our history). So we tried very hard to diversify our citations (taxonomically; I must admit I haven’t gone through and checked the gender of first authors, for instance).
            In one section of the manuscript we discuss Langerhans and Dewitt’s 2004 AmericanNaturalist paper on Shared and Unique Features of EvolutionaryDiversification.  In that paper’s appendix they lay out a multivariate statistical approach to measure the extent to which evolution has occurred in parallel across multiple replicates, or in a unique direction in each replicate. That’s a very useful approach, that is very conceptually general and widely applicable (hence its great fit to The American Naturalist). So, I wanted to find a plant paper that cited this article, to use as an example illustrating their analytical approach. The problem is, I found only three plant papers out of the 200 that cited Langerhans and Dewitt (2004) according to Web of Science (as of December 1 2017). That’s 1.5%.  On the other hand, I noticed a suspicious number of fish citations. So I went back and noted down the taxonomic focus of each of the 200 papers citing their article (a few were reviews that had no particular taxonomic focus, so I didn’t tally those). Here’s the breakdown (sorted by # of citations):

Taxonomic group
Subgroup
# citations to L&D 2004
Fish
      TOTAL:
118

Poeciliid
42

Stickleback
30

Centrarchid
6

Cichild
5

Salmonid
5

Other
30
Reptiles
    TOTAL:
8

Lizards
6

Turtles
1

Snakes
1
Amphibians
 TOTAL:
3

Salamanders
2

Frogs
1
Insects

6
Plants

3
Isopods

3
Mammals

2
Arachnids

1
Birds

1
Gastropods

6
The really striking thing here is how taxonomically biased this is. The single genus Gasterosteus has five times as many studies citing L&D than all studies of insects, which collectively are of course at least as diverse as stickleback, and possibly even as important from a practical standpoint.
            Why is this widely-applied method being effectively ignored by the vast majority of researchers? I think the answer is pretty simple: because the original paper was applying their method to study fish evolution, fish evolutionary biologists were more likely to read it. Worryingly, this suggests that when we publish a new method, we might reach the largest audience if we omit application of the method to any one taxon (or, if we apply it to many diverse taxa). Equally worringly, it suggests to me that because of our inherent taxonomic biases we are missing the boat on many important ideas and methods.
            The other hypothesis of course is that parallel evolution may be an exceptionally hot topic among fish biologists, especially stickleback- and Poeciliid-researchers. Bandwagons happen. We tried really hard in our Annual Review manuscript to branch out and cite studies involving something other than stickleback. That’s hard both because this is the system we are collectively most familiar with, and because this is such a great parallel-evolution system that many of the leading studies on the topic use this organism.

            There’s not an easy solution to this, other than to check our biases at the door: when writing, and when reading, ask yourself how diverse your citations (or paper choices) are. Try to step out of your comfort zone, read something about an organism you know nothing about, at least once a week if not more often. You’ll learn a lot of biology in the process, and maybe get some new ideas that help you step out of your taxonomic box.

A 25-year quest for the Holy Grail of evolutionary biology

When I started my postdoc in 1998, I think it is safe to say that the Holy Grail (or maybe Rosetta Stone) for many evolutionary biologists w...