Discussion: View Thread

  • 1.  Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-13-2024 10:30

    Hi Statistical Consulting Section,

    I have been asked to discuss potentially being a paid statistical reviewer for a journal. I am an independent consultant and have been asked about what I would charge.

    Does anyone have experience being a paid statistical reviewer?

    If so, what pay structure do you use, hourly or per review and why? If hourly is it your normal hourly rate?

    If you don't mind (can reply to me privately) sharing what you charge?

    What do you like and not like about being a statistical reviewer? What is your motivation to do it? And are there things to look out for. I tend to be very thorough when asked to review a paper I am either an author or performed the statistics for so worried about my inclination to spend too much time vs my compensation.

    Thanks for any advice!



    ------------------------------
    Deborah Keys
    Consulant and Owner
    Kaleidoscope Statistics, LLC
    ------------------------------


  • 2.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-13-2024 11:08

    Hi Deborah,

    I am a statistical reviewer and statistical editor for different medical journals. As a statistical reviewer, I'm paid per review ($75) and this was set by the journal. For the editor role, I am paid an annually honorarium (also set by journal) that works out to $100-125 per article. With this pay structure I aim to spend a max of 3 hours on a given article.

    I like being a statistical reviewer because I think I am helping improve the quality of research in our journals and (I hope) educating authors on appropriate reporting. The things I like less are time constraints for medical journals (2 weeks sometimes), and often the statistical review is requested after initial review, so I feel a bit of time pressure. On the flip side, I do get papers that should not have even made it to me because there are many issues beyond the analytical approach.

    To be efficient, the one journal I review for has a check list of statsitical/design issues (made by our statistical reviewers themselves) that helps me focus. So, I recommend creating your own checklist (I can send you a link to ours too) that is appropriate for the journal scope. This keeps me from spending too long on the review. Also, in my reviews, if the same error is made several times in manuscript (e.g. no confidence intervals reported) I will be make "overall" statement instead of comments for each line/instance. That saves some time as well. Finally, check for BIG problems first (e.g. inappropriate design/statistical tests).

    Hope this helps, feel free to reach out directly if you have any other questions!

    Terrie



    ------------------------------
    Terrie Vasilopoulos, PhD
    Research Associate Professor
    Departments of Anesthesiology and Orthopaedic Surgery & Sports Medicine
    College of Medicine, University of Florida, Gainesvile, Florida
    ------------------------------



  • 3.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-13-2024 15:30

    That's the first time I have heard of anyone getting paid to review an article(s). I've been reviewing for a top oncology journal for a loooong time without compensation($). They did send me a very nice glass art object with my name and years of reviewing inscribed- and I thanked them for that. I do have enough background in economics to quote Milton Friedman (he won the Nobel) that "there's no such thing as a free lunch". So I am donating/volunteering unpaid labor.  The journal requires authors to declare conflicts of interest. As long as the journal stated "reviewers receive an honorarium", or similar, I would not have a concern.  The journal also has an option to submit to a website (i forget the name) a confirmation that I reviewed. I understood that to be of importance for those in academia to add to their CV. I'll be interested to hear  the experiences of other section members.



    ------------------------------
    Chris Barker, Ph.D.
    Past Chair
    Statistical Consulting Section
    Consultant and
    Adjunct Associate Professor of Biostatistics
    www.barkerstats.com


    ---
    "In composition you have all the time you want to decide what to say in 15 seconds, in improvisation you have 15 seconds."
    -Steve Lacy
    ------------------------------



  • 4.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-13-2024 15:43

    Hi Chris,

    I will clarify that for the one journal I referred to, only the statistical reviewers are paid reviewers and we have a set pool of reviewers for which I had to apply and was vetted by the statistical editor. We're assigned for reviews by the editor (cannot be requested by authors); the general, solicited reviewers (mostly MDs) for this journal are still volunteer. Solicited reviews I do for other journals are unpaid. My honorarium as a statistical editor for another journal is a little different situation since I also have other duties and there are only two of us who perform statistical reviews for that journal.

    Best,

    Terrie



    ------------------------------
    Terrie Vasilopoulos, PhD
    Research Associate Professor
    Departments of Anesthesiology and Orthopaedic Surgery & Sports Medicine
    College of Medicine, University of Florida, Gainesvile, Florida
    ------------------------------



  • 5.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-14-2024 08:35

    It is fine to get paid, but most universities require permission for outside employment for each job we do. It can be a tedious process.  It is simpler to ask for a donation to your department.



    ------------------------------
    Jonathan Shuster
    ------------------------------



  • 6.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-14-2024 14:05
    Thanks everyone for the replies so far. 

    I don't want to seem too mercenary and would love to be able to help hopefully improve the quality of published statistical analyses and reporting. But I am coming from the perspective of a solo private practice consultant rather than an academic. So any un- or under-paid time I spend is directly taking away from my time for paid work which pays all my bills like health insurance and my three kids college tuitions. So this is a different perspective.

    Best,
    Deborah






  • 7.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-14-2024 15:09

    The simplest answer would be request your standard hourly rate.

    As  economists (might) say, you could base your rate on the "indirect costs"., those being the value time with your family etc. Assuming you can put a dollar $ value on those indirect costs. One could (try to) estimate the indirect cost to be the rate for hiring someone to take care of your family.  Sometimes economists (In health economics for pharma )  will put dollar $ values on the indirect costs. That's not necessarily easy (Once upon  a time I took a lot of graduate economics courses and later worked with and for economists in a pharma health economics department. I learned something about how economists think).  

     an excellent and actual example of "including the indirect costs" are the pharmacoeconomic models for alzheimers drugs, it is typical to include the indirect costs /charges for "caregivers" to the patient. Something an economist can do. Despite my background I have no advice how to do that .in your situation

    for example this AJMC economics policy article talks about the indirect costs and more generally 'societal costs"  for Alzheimers. 

    https://www.ajmc.com/view/the-economic-and-societal-burden-of-alzheimer-disease-managed-care-considerations

    and in Pharma (I realize you're not in a pharma situation) it starts to be illegal to pay external experts, consultants at substantially higher than the 'market rate". 

     also what is your estimate of the amount of time to read and review an article?

    One medical journal where I am a reviewer asks how much time (hours) was required to  complete the review in categories like 1-2, 2-3 hours. 

    And a (never to be named and very talented) statistician-colleague with bargaining power has (he states) explained his standard rate to a client "i don't work for charity". :) My limited personal experience, only say that at your farewell to a potential client who is looking for free statistical advice.



    ------------------------------
    Chris Barker, Ph.D.
    Past Chair
    Statistical Consulting Section
    Consultant and
    Adjunct Associate Professor of Biostatistics
    www.barkerstats.com


    ---
    "In composition you have all the time you want to decide what to say in 15 seconds, in improvisation you have 15 seconds."
    -Steve Lacy
    ------------------------------



  • 8.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-15-2024 11:57

    Responding to Chris's suggestion to request your standard hourly rate, something you might consider is having two hourly rates, depending on the type of client. I do occasional outside consulting (that has been approved by my University) and have one rate for companies and lawyers and another rate for non-profits (and very occasionally do pro-bono work too). For small projects I estimate the work and hours up front to come up with a defined total cost (and also well-defined outcomes).

    If you want to know my rates, I can share with you separately, but I'll note that the one rate that was mentioned in this thread ($75 for up to three hours) is closer to my pro-bono rate than my non-profit rate. For a private practice consultant, I hope you're thinking higher than that -- and I wouldn't think you at all mercenary for asking a rate corresponding with your skills and abilities. For those of us in academia, doing things like this is part of our "service," which is expected as part of our job -- it's not expected as part of yours in the same way.



    ------------------------------
    Aaron Rendahl, Ph.D.
    Associate Professor of Statistics and Informatics
    College of Veterinary Medicine, University of Minnesota
    ------------------------------



  • 9.  RE: Contract Fee-for-Service Journal Statistical Reviewer

    Posted 08-15-2024 12:24

    For those who wonder about what an hourly rate should be, the Spring 2006 issue of the newsletter for the Statistical Consulting Section listed an average of $130 per hour. Adjust this upwards if you have more experience, live on either coast, or have a PhD. Factor in inflation as well. 2006 is like ancient history. Someone needs to update that survey!

    I currently charge $180 per hour, but only $100 per hour for graduate students seeking help on their dissertations. I was a poor graduate student once.

    I do some work where the client offers a different rate (usually a flat rate), and I am fine with anything reasonable.

    I do very little pro bono work. I have found that I am unhappy with the quality of the work when I am done, but also unwilling to spend the time needed to bring it up to snuff. When I do something for free, it is because it increases my visibility, not because it is for a good cause. I'd rather give money to a charity than to work for free for a charity.

    Everyone is welcome to approach this differently, of course, but keep in mind that if you sell your time at a rate that is excessively low, you are hurting other consultants who want (or need) to charge a more reasonable rate. It is better for the profession as a whole if you don't accept work at $50 per hour.



    ------------------------------
    Stephen Simon, blog.pmean.com
    Independent Statistical Consultant
    P. Mean Consulting
    ------------------------------