writing advice – caveat emptor

jo-san-diego-ZO_tXe8Tinw-unsplash.jpg

Advice. Loads of it. Coming out of our ears.  And on every possible topic, including research and writing.

Advice needs readers. But we readers also need to be, as Ernest Hemingway put it, “crap detectors”. Howard Rheingold has worked up this idea, using Hemingway’s terminology. Rheingold has developed a little protocol that can be used to check out how much faith you should put in online information. This is his Crap Test:

Currency

    • How recent is this information?
    • If viewing on a website, how recently was the site updated?

Reliability

    • What supporting information is available?
    • Is this source mainly opinion? Is it highly one-sided?
    • Does the source use outside references, or does it self-reference (an example of circular reporting)?

Authority

    • Who is the author?
    • What are the author’s credentials?
    • Where was this published?
    • Is this sponsored information?
    • What kind of advertisements are on the page, if any?

Purpose/Point of View

    • Is this fact, opinion, or opinion presented as fact?
    • Does this information appear biased?
    • Do you feel like the creator or author is trying to sell you something?

Now, I think that there are some additional and different questions you might want to ask if you are looking at advice about doctoral education, research and writing advice.  (And you might also want to junk some of those that Rheingold proposes.)

I’ve made a start on a reworked Rheingold crap test – a test for writing and research advice for PhDers.

So – here goes Patter’s doctoral research and writing crap test.

Credibility

    • Who is the author?
    • Do they have a background in the subject they are writing about – are they either formally trained in the area or they have been systematically researching it?
    • Do they have professional knowledges they are drawing on? What?  Where?
    • Are their cvs available? Can you trace them to a reputable employer, an ORCID number or a publisher?) (And yes, I’m very happy if you want to apply this test to me in the first instance! Make a start here with my google citations.)

Reliable and trustworthy

    • Does the advice giver situate their work in the research on writing and doctoral education? Do they offer strategies that are well grounded in research and practice?
    • Do they offer a one-best solution – or do they recognise the diversity of disciplines, pathways and possibilities? Do they offer the same solution for all situations?
    • Is their advice primarily designed to sell you a service?  (That is, it only gives you a teensy teensy snippet of information, stops before it gets to the useful bit and then tells you to buy a package or service. If the advice giver is self employed you need to check the person out, go back to credibility.)

Authority

    • Do peers recognise this advice-giving author’s work?
    • Is their research available? Are they well published?
    • Is advice all that the person does? Do they teach what they are advising on? Do they edit a journal? Run a learning or research support service? Supervise and examine? Have they done any of this in the past? (See credibility)
    • Do they overclaim – if this is a shared story of experience (that is, n=1) , is this acknowledged?

Position

    • What discipline(s) are they working from and with?
    • What traditions are they working in? Is what they say necessarily  going to be applicable?
    • What is their stance on knowledge, writing and research – is it the same or different from yours?

There you go. A beginning crap test to apply to writing and PhD advice. Caveat emptor.

Well, yes I’ve left things out, it’s a start. What else would you add?

P.S. And here is another rubric to check out.

Photo by Jo San Diego on Unsplash

About pat thomson

Pat Thomson is Professor of Education in the School of Education, The University of Nottingham, UK
This entry was posted in academic writing, advice, crap detection, Howard Rheingold, poor advice and tagged , , . Bookmark the permalink.

2 Responses to writing advice – caveat emptor

  1. Jo says:

    I found this helpful and thought-provoking, not just as a taker of advice, but as a giver. I’m a technical and developmental editor, so suggesting revisions is what I do most of the day, most days. Because of the way my department is structured, there’s basically no one checking my work, and it’s dangerously easy to stray into giving advice based on my gut feelings or what “seems right” to me. I like the idea of using your and Rheingold’s Crap Tests to make sure the advice I’m giving is based on experience, research, or facts that I can point to, and to be transparent with my advisees about how I know what I claim to know. Thank you for this!

    Like

  2. sherranclarence says:

    This is a useful checklist/crap test – there is so much out there and it can be really hard for a student starting out or even in the middle of things to know what’s solid and useful and what’s not.

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s