tag:blogger.com,1999:blog-4456348657596914237.post5538207337613677026..comments2024-03-28T08:16:02.178-04:00Comments on Eco-Evo Evo-Eco: A Narcissist Index (n-index) for academicsBen Hallerhttp://www.blogger.com/profile/17875404974157070805noreply@blogger.comBlogger21125tag:blogger.com,1999:blog-4456348657596914237.post-71048167357771695672016-08-03T10:57:19.887-04:002016-08-03T10:57:19.887-04:00While I agree that journal self-citation sometimes...While I agree that journal self-citation sometimes reflects a dishonest journal strategy, this number would be very hard to interpret because more specialist journals would naturally have fairly high self-citation rates, while more generalist journals would have lower rates (e.g., J Veg Sci vs TREE). Also, journals with strict citation limits are likely to have a different profile to those with unlimited citations and longer maximum page counts (e.g., Science vs BBS).Lisahttps://www.blogger.com/profile/06599864653038062578noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-52876125344162635232016-01-28T00:41:29.394-05:002016-01-28T00:41:29.394-05:00Interesting indeed - and I suppose to be expected ...Interesting indeed - and I suppose to be expected (and decried?). I will have to look to see if they corrected for the important covariates - total number of papers and academic "age"Andrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-51410308979917056802016-01-26T12:34:19.076-05:002016-01-26T12:34:19.076-05:00Missing from this is a discussion of how gender in...Missing from this is a discussion of how gender influences the n-index. See http://www.the-scientist.com/?articles.view/articleNo/39450/title/Self-Citation-Gender-Gap/Anonymoushttps://www.blogger.com/profile/03794588963182390223noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-88648562326224779942016-01-23T10:45:03.273-05:002016-01-23T10:45:03.273-05:00I agree that having lots of collaborators would be...I agree that having lots of collaborators would be a likely contributor. Of course, I suppose the other way to do it would be to simply calculate citations and h-index and so on excluding self citations (I realize others have said this). I expect rankings (or whatever) would be the same with as without.Andrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-17699066014412784742016-01-23T09:07:12.986-05:002016-01-23T09:07:12.986-05:00An addendum - A few comments that arose from Twitt...An addendum - A few comments that arose from Twitter. Caleb Hasler suggested that N index could be driven up by having MANY co-authors (which I do... I collaborate with engineers, lawyers, social scientists, etc plus lots of biologist from many institutions). I also continue to think about Google Scholar - where I have 12000 cites. I suspect that if my N index were to be calculated using those data it would be much lower. Most of the 5000+ of my cites that appear in GS that are not in WOS are in theses, govt tech reports, book chapters, env consulting reports, etc - i.e., because I do applied work, my "influence" is not well measured by WOS. It would be great if the bibliometric analytical tools in GS could be expanded. <br /><br />PS - I am no advocating FOR self-citation BUT a high N index does not necessarily mean that someone is willy-nilly citing their own work egregiously. I DO see those papers as an Editor and reviewer... and I call people out on it.Steven Cookehttps://www.blogger.com/profile/04101740065136883970noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-8455305033725482792016-01-22T20:49:01.526-05:002016-01-22T20:49:01.526-05:00So - I am the author of a thought-piece in the jou...So - I am the author of a thought-piece in the journal Ideas in Ecology and Evolution where I (along with co-author Mike Donaldson) whether self-citation is a form of narcissism or an indicator of a cohesive and productive research program. It can go either way depending on a variety of factors - some within the control of the author and some beyond their control. <br /><br />Not surprisingly, the blog post caught my attention - indeed, I caught wind of it from a random post on Facebook written by Hendry as he was working on he blog entry. I was certainly interested to see where I stood... However, it took some time for me to reconcile two OCRID accts and then harmonize it with WOS. Today they became "synced" and I was able to see how I fared. I am pleased to report that I crushed Hendry - scoring an impressive N score of 0.36 - that is, 36% of my WOS citations are from me or a paper on which I am a co-author. A few other numbers - I have 420 papers that WOS tracks. I scored by 1st peer reviewed paper in 1999 which gives me an academic age of 17. According to WOS, I have 7458 total citations (over 12,000 in Google Scholar) of which 4746 are from papers I have not authored while 2712 represent self-citations. Some of you reading this may be surprised by such a number and begin to "judge" me... I was not overly surprised. Before I state why, I should first note that as an editor and mentor I call people out on egregious self-citation quite regularly. I am a fan of historic papers and also a total publication nerd, trolling journals for papers that are "in press". I impress upon my students the importance of giving credit where credit is due, reading widely, and recognizing that there is much great work that occurs outside of North America (i.e., concepts transcend geography). <br /><br />I consider my N-score to be a product of a few things… 1) I engage in LOTS of synthesis/lit review/perspective articles and not surprisingly they are in topical areas where I have significant research activity (e.g., recreational fisheries, conservation physiology, biotelemetry and biologging). This is partly because I like doing so and (in my apparently narcissistic mind) I am good at it. I also like to build teams and frequently get my grad students and PDFs to work together and loop in whomever in the world I think is the BEST collaborator on a given topic. I am really proud of these syntheses as they serve as rallying points for reflection and progress. 2) Related to 1, we have a number of themes in our lab where we devote much of our research activity. We build upon our own work as we move forward. That does NOT mean we avoid or exclude work by others… it simply means that one thesis (set of pubs) leads to some answers and more questions which we then build upon with next student. This is what we have done with our work on Pacific salmon migration and centrarchid parental care as good examples. Some of these topical research areas are ones where our lab has taken leadership role in defining – e.g., Conservation Physiology – now a “named” discipline with the same-named journal. 3) The volume of papers we produce (which is a function of meaningful and engaged collaboration and having a talented and rather large team of students and post docs with a culture of writing and SciComm) consistent with these themes leads to more opportunities for self-citation. <br /><br />I should note that although I am proud of all of my papers, I don't have any of those "home run" 5000 citation papers. My most cited paper is a TREE synthesis on Biotelemetry and it has been cited around 500 times according to Google Scholar. A SINGLE home run paper would drive down ones N index in a big way. Someone with a few, well cited papers would inherently have a very low N-score while someone with lots of pubs and steady citations but no "5000 citation home run" papers would be more likely to have a high N score - or at least that is a testable hypothesis.<br /><br />Steven Cooke - www.FECPL.ca Steven Cookehttps://www.blogger.com/profile/04101740065136883970noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-8246368755362001962016-01-17T19:45:46.712-05:002016-01-17T19:45:46.712-05:00Indeed. Many potential explanations - some narciss...Indeed. Many potential explanations - some narcissistic (or at least self-promoting), some not. Andrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-20106116824862495982016-01-17T16:59:11.787-05:002016-01-17T16:59:11.787-05:00One potential (charitable) explanation for the cor...One potential (charitable) explanation for the correlation with "scientific age" might be something related to how a researcher builds a program.<br /><br />As an edge case, imagine a Ph.D. student writes a cohesive dissertation, such that each chapter builds upon the last. When publishing, each chapter would have to cite (at least) the one before it. Inflating the n-index dramatically given that they're new papers with fewer citations. Continuing on, early in one's career, it might make sense to cite your earlier work because you're directly building upon it.<br /><br />Another potential charitable explanation: Science becoming more specialized, so that newer folks are working in a smaller subdiscipline, resulting in more self-citations because there aren't that many other people in their tiny niche.Jonhttps://www.blogger.com/profile/13728872012920505418noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-26162746079559142682016-01-16T16:27:07.227-05:002016-01-16T16:27:07.227-05:00Self-citations in web of science seem to include a...Self-citations in web of science seem to include all of your coauthors. If, in a paper you are not on, they cite a paper both you and they are on, that paper will be considered a self citation in your count - I think.<br /><br />I do agree that huge collaborations are ephasized now.Andrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-56288511695672901582016-01-16T15:52:17.775-05:002016-01-16T15:52:17.775-05:00Regarding journal self-citation, my friend Philip ...Regarding journal self-citation, my friend Philip Cohen has done some interesting digging on this in his field (sociology). Check this out: https://familyinequality.wordpress.com/2015/11/30/journal-self-citation-practices-revealed/Ben Hallerhttps://www.blogger.com/profile/17875404974157070805noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-85102770506630721432016-01-16T15:49:06.790-05:002016-01-16T15:49:06.790-05:00Ah, I see, the 61% R2 is for total citations versu...Ah, I see, the 61% R2 is for total citations versus scientific age. But the effect size of scientific age on n-index still looks quite large to me (albeit with a smaller R2 than I thought – i.e. there are other things causing a lot of variance too); as I observed above, those with an age of 10 have a (fit-predicted) n-index about twice as high as those with an age of 50! Of course the effect of scientific age on h-index and total citations is large, since those metrics would both be expected to naturally rise over time if a scientist simply maintained constant behavior; nothing surprising about that. If a scientist maintained constant behavior, it is less obvious that one would expect a large effect of scientific age on n-index (although Stephen Heard's explanation above would account for a small effect, at least). It still seems to me that there is a large effect here in need of an explanation, and that a cultural shift in science, as I propose above, is a very plausible hypothesis. No?Ben Hallerhttps://www.blogger.com/profile/17875404974157070805noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-4400738678642871352016-01-16T13:59:33.829-05:002016-01-16T13:59:33.829-05:00A self-citation corrected journal impact factor wo...A self-citation corrected journal impact factor would be great but could reflect a "cohesive and sustained publication program"Andrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-83131370300160868812016-01-16T13:56:04.074-05:002016-01-16T13:56:04.074-05:00This is interesting. I would also be curious to se...This is interesting. I would also be curious to see what measures of in- vs. out-of-network citations look like; in other words what fraction of someone's recent citations are from outside the network of people they've collaborated with (defined by coauthorship) in some relevant time frame. The rise in importance of networking to scientific impact in the last few decades (necessitated by the rise of big data and evidenced by large collaborations overtaking the lone-wolf geniuses as the most common authors of major breakthroughs) seems more pronounced to me (at least anecdotally) than the rise of narcissistic self-citation. Matt B.https://www.blogger.com/profile/17219684693207967442noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-86550949424420684262016-01-16T13:54:59.162-05:002016-01-16T13:54:59.162-05:00Ben.
The huge r2 is for total citations versus ag...Ben.<br /><br />The huge r2 is for total citations versus age. The correlation of n-index and age is much lower. What I am saying is that n-index is much less effected by age than is h-index and total citationsAndrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-41048484561829548182016-01-16T13:12:59.253-05:002016-01-16T13:12:59.253-05:00Dan- this would actually be interesting if calcula...Dan- this would actually be interesting if calculated over time for different journals. For instance, I have heard rumors that in the early 2000s certain high profile eco/evo journals sent emails a suggested list of referenes to add to a paper, all of which were previously published in that journal. They were intentionally asking authors to self cite the journal. This type of analysis might be able to confirm or deny the generality of those rumors. <br /><br />Colin AverillAnonymoushttps://www.blogger.com/profile/05113517654115524356noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-32807454903044530822016-01-16T12:54:51.007-05:002016-01-16T12:54:51.007-05:00This analysis confirms what we all knew, that Rowa...This analysis confirms what we all knew, that Rowan Barrett is an exceptionally modest & excellent scientist.<br /><br />What about applying this idea to journals as well. In addition to their impact factor, calculate a metric of how much that IF entails self-citations / external citations. That detects journals that disproportionately self-cite, typically as a strategy to inflate their own IF.Dan Bolnickhttps://www.blogger.com/profile/05181664810897127126noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-11440668048330191992016-01-16T10:20:52.704-05:002016-01-16T10:20:52.704-05:00Doesn't look that weak – your plot above shows...Doesn't look that weak – your plot above shows that n-index for scientific age 10 is about twice the n-index for scientific age 50, and you report an R2 of 61.2%. That seems like quite a large effect to me!Ben Hallerhttps://www.blogger.com/profile/17875404974157070805noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-2461943459195094252016-01-16T10:16:44.094-05:002016-01-16T10:16:44.094-05:00Yeah, but it is a pretty weak correlation. In fact...Yeah, but it is a pretty weak correlation. In fact, self citation seems to have very little impact on things like total citations and h-index.Andrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-41395047608512370912016-01-16T10:15:35.323-05:002016-01-16T10:15:35.323-05:00Approximately 5% - right in the middle of the pack...Approximately 5% - right in the middle of the pack, including for residuals from age and a bit low for residuals from total citations. You need to cite yourself more.Andrew Hendryhttps://www.blogger.com/profile/03653724437118653645noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-40849515470873943202016-01-16T10:06:43.921-05:002016-01-16T10:06:43.921-05:00Re: the correlation with scientific age, my hypoth...Re: the correlation with scientific age, my hypothesis would be that science is much more competitive now than it used to be (competition for funding, for tenure-track positions, for, well, everything), and that as a result, self-promotion is both more necessary and more culturally acceptable than it used to be. At the same time, I suspect this has also caused the epidemic of "imposter syndrome" among younger scientists. So according to this hypothesis, your strong negative correlation between scientific age and n-index is a sign of a sickness at the heart of modern science...Ben Hallerhttps://www.blogger.com/profile/17875404974157070805noreply@blogger.comtag:blogger.com,1999:blog-4456348657596914237.post-77682193867383918232016-01-16T09:56:51.020-05:002016-01-16T09:56:51.020-05:00Andrew - this is awesome. Wish I'd been there ...Andrew - this is awesome. Wish I'd been there to take part in this discussion.<br /><br />One reason the n-index falls with scientific age is probably that it should also fall with paper age. I can self-cite my paper long before it's published, because I know it's coming out. Anyone else has to see it published, and only THEN insert it into a MS which will have a lag before publication. Call this the head-start effect. (Widespread preprint server use should weaken this effect, but not remove it). Early in my career, by definition ALL my papers were young, and had a strong head-start effect; now that I'm (cough) not young, this effect averaged over my total citations is trivial.<br /><br />I haven't calculated my own n-index only because UNB has discontinued WoS. I speculate it's high because I do self-cite, although oddly for somewhat the reverse reason you mention. It's not so much that I have a "cohesive and sustained" research programme; more that I have a not-very-cohesive programme, but I want to show that there are connections that might not be obvious at first glance! But I'll test that, whenever I can convince someone who still has WoS to calculate my n-index for me (hint hint hint)...Stephen Heardhttps://www.blogger.com/profile/01447261122370883924noreply@blogger.com