I sometimes have trouble communicating with consulting clients about my level of expertise (or proficiency, competence, etc.) in a specific statistical area. Have others experienced this? Do you have ideas about how to convey this to clients?
Those are my main questions, but I'll elaborate below.
This problem arises most often when a new prospective client and I discuss my potential contributions to their project. My conception of statistical expertise seems to differ markedly from some clients' conceptions, and sometimes this discrepancy impedes our communication about how likely I am to help.
For example, last year a prospective client contacted me about a project involving structural equation modeling (SEM). I told him that I consider myself competent with routine SEM applications but not an "expert," and I described my experience with SEM and related latent-variable techniques (e.g., graduate courses, consulting on several projects) as well as my background in statistics. He didn't hire me, saying he instead wanted an "expert" in SEM. That exchange left me wondering about his criteria for an expert, how he'd find one among available consultants, and how he thought hiring an expert would change his consulting experience.
I've experienced other examples that I won't describe. In some I was hired and in others I wasn't, and clients' assessment of my relevant expertise has probably varied from markedly underestimating it to markedly overestimating it.
Here are a few questions to stimulate discussion about what expertise means to statistical consultants and their clients:
1. How do clients assess a potential consultant's expertise relevant to their project? Do they accept the consultant's word at face value (e.g., from a website description), consider specific credentials or experience (e.g., course work, teaching, consulting, methodological publications), or other information?
2. How much do clients consider expertise beyond the specific technique(s) they're interested in, such as expertise in related methods, statistics more generally, or consulting? For instance, if Consultant A has run 200 survival analyses and Consultant B has never worked with survival analysis, Consultant B might still be a better consultant on a survival-analysis project if she's a better statistician and consultant in general.
3. In what ways do clients think their consulting experience will depend on the consultant's expertise in their focal technique(s)? How well can they judge what level of expertise is desirable for their particular project? What costs or tradeoffs are they willing to accept for hiring someone with more (vs. less) expertise?
4. Would a standard scale of expertise be useful in discussions with prospective clients? For instance, this might consist of about 5 levels, each with a number or label (e.g., unfamiliar, novice, competent, proficient, expert) and a description of that level's criteria or characteristics. A generic version is probably more feasible than numerous versions for specific statistical methods. Here are non-statistics examples:
http://hr.od.nih.gov/workingatnih/competencies/proficiencyscale.htm http://en.wikipedia.org/wiki/Dreyfus_model_of_skill_acquisition Cheers,
Adam
-------------------------------------------
Adam Hafdahl
Owner & Principal Consultant
ARCH Statistical Consulting, LLC
-------------------------------------------