Key Skill: The ability to evaluate both the information retrieved, the process used to retrieve it and to recognise when possibly irrelevant, preexisting patterns affect our thinking process
Figure 1: Image generated using Copilot from prompt: "Image of Thinking".
Let’s imagine that you have found an information source using the conceptualisation technique just described. You are very confident in the process that you have used to retrieve the information, but you must now turn your attention to the source itself. Rather than taking the source at face value and not question what you see, you could take some time to think about what you have. You evaluate it. When your tutors say things like ‘you need to be more critical and less descriptive’, they are inviting you to engage with material critically (Neville, 2009, p. 36). The evaluation of evidence is part of critical thinking, and there are several ways that you can do this with the evidence that you are considering using in the work that you do (Neville, 2009, p. 38):
Agree with a point of view: but provide evidence ‘why’ you agree in the context of your own work.
Reject a point of view: but provide evidence ‘why’ you have rejected it in the context of your own work.
Concede to a point of view: you may agree that a point of view has its positive points, but you think that the viewpoint does not quite fit for your purpose—but you must provide evidence ‘why’ it does not fit in the context of your own work.
Propose a new point of view or reformulate an existing one: use evidence to demonstrate why you have done this in the context of your own work.
Reconcile two points of view: your job is to evaluate the differences between viewpoints and to develop a response that brings together both viewpoints in the context of your own work.
Now, these five elements are obviously very useful, but some additional tools may be helpful to enable to agree, reject, concede, propose, or reconcile. To evaluate information further, you are now going to learn about a technique that asks five pertinent questions. They add purpose to your information evaluation.
The idea is to ask each of these questions about the information source you have found—perhaps a book, a journal article, a blog post, an online news article. The questions are: what, where, when, who, and why? Whilst these questions are undoubtedly useful, you will see that the context of the information that you are evaluating—and your intended use of it—are guiding principles that you should consider when asking questions about sources. But you will also see below how important it is to use each of these questions with an understanding of how biases can affect the decision-making process.
The idea is to ask each of these questions about the information source you have found—perhaps a book, a journal article, a blog post, an online news article. The questions are: what, where, when, who, and why? Whilst these questions are undoubtedly useful, you will see that the context of the information that you are evaluating—and your intended use of it—are guiding principles that you should consider when asking questions about sources. But you will also see below how important it is to use each of these questions with an understanding of how biases can affect the decision-making process.
What: you must first understand what the main point of the piece of information that you are evaluating is. Once you have understood what the purpose of the work is—or its argument—you will be in a better position to, for example, agree or disagree with the work. You can also extend the question slightly and ask so what does this mean for me and for my research, essay, or beliefs? In other words, you are asking yourself what benefit the information source under investigation can bring to your work.
Example: Let’s imagine that you are writing about tourism in Scotland and its impact upon local communities. You have found several journal articles that appear to be what you want, but you are struggling to process the information. Reading the abstract, introduction, and conclusion of journal articles can be an extremely effective way of understanding what the purpose of the source is (Subramanyam, 2013). White et al. (2024), for example, have recently written about a new coastal driving route in Scotland. Their abstract reveals their argument to be about how tourism shapes the nature of communities in terms of the environment and housing and how long-term tourism policies must engage with the views of local communities. So, what does this mean for you? Well, if you are writing about the impact of tourism on communities, then you may decide to use this paper to back up your own ideas. You may even decide to concede to some of White et al.’s (2024) findings but provide evidence from your own data to propose a new idea or a new interpretation of their work.
Watch out for bias: when summarising the work of another, it is important not to employ the confirmation bias. This is when we actively look for opinions that agree with our own viewpoints. To demonstrate critical thinking, you must explore alternative viewpoints that seek to explain the same topic that you are currently exploring and for which you may already hold strong opinions (Hanscomb, 2023, p. 31).
Where: the place where information you want to use appears is of great importance. Often your academics will request that you draw from specific types of publications, for example, journal articles or academic texts. These will appear on publishers’ websites and, as we have already seen, will be available from resources like Library Search and Google Scholar. Depending on the context and type of research you undertake, though, you may sometimes want to include information from other sources: for example, websites, blog posts, online archives, or video archives. Much of this information will be available on the internet, and you must always question the source of that information (Grix and Watkins, 2010, p. 53). Domain names like .ac.uk and .edu are generally well regarded as these denote educational institutions. Domains like .gov and .org.uk also indicate that you are looking at a government website or a non-profit organization like a Royal College. But where you look will often come down to your information needs.
Example: Where information appears will often mean different things for different students. Let’s use the example of a political speech by Keir Starmer. If I were a politics student, I might use the official record of parliamentary debates called Hansard as a reference. I would be ill advised to reference Starmer’s speech that is included in the Instagram feed of a celebrity influencer. However, if I were a student interested in the transmission of Starmer’s speech into popular culture, then the Instagram feed would interest me.
Watch out for bias: be careful not to rule out academic sources just because they are not from ‘top’ institutions or journals with the highest impact. Research cannot be categorised like this for many different reasons, and organisations like DORA have responded to this type of thinking.
When: the publication date of a piece of information may matter to different students for different reasons. Your assignment briefs may even specify that your assessors want you to use research that is no more than, for example, five years old. A strict date condition like this is common for healthcare students because they most likely want the latest medical evidence for patient care. Students of the Arts and Humanities, though, may well seek out historical information to inform their own historical studies. Remember that these students may still want to use the latest research to reflect the current state of thinking about a topic and its critical approaches. Critical thinking requires you to make these kinds of decisions for yourself in the work you do. There is no absolute method; it is all about the context of your need (McMillan and Weyers, 2013, p. 127).
Example: Let’s take a book about the planet Mars that was published in 1920. A student who is interested in an up-to-date account of the Martian atmosphere should not use this book because the scientific knowledge it contains will no longer be accurate. But a student who is interested in the history of scientific knowledge about Mars will most likely want to read this book.
Who: knowing who the creator/researcher of the content you are working with can matter a great deal. It is crucial that you use credible academic sources in your work. These sources will often be the works of scholars and professionals in a particular field. However, just because an author of, for example, a journal article is an academic or scholar does not mean that you must take at face value everything they write: you do have the right to think critically about everyone’s work and to reach your own conclusions (McMillan and Weyers, 2013, p. 124). The peer-review process does a good job in maintaining high academic standards, but the research and publication process can be messy. It is still possible for factual inaccuracies, flawed methodologies, or misinterpreted sources to appear in published works (Bartley and Liesegang, 2015). The nature of digital information, too, means that you will come across information sources whose authors’ credentials are less easy to identify.
Example: Let’s use an extreme example to make a point. You find a journal article that provides evidence for the effectiveness of a particular type of solar panel. The paper reaches sound scientific conclusions, but you realise that the author also owns part of the company that they are discussing. Does this change the scientific content? Probably not, but it does invite you to ask questions about potential biases of the author and of the overall intention of the research article. Here is another example, you read a newspaper article in which the author Dr. Richard Kant explains that eating garlic is an excellent treatment for the common cold. Upon investigation, you discover that Dr. Richard Kant got his PhD in English Literature. Now, garlic may well be useful for the common cold, but knowing that Richard Kant is not a medical doctor should raise questions.
Watch out for bias: be careful not to fall into the trap of discounting someone else’s work because of internalised bias about the professional or academic status of another. Always try to assess the argument and not the person presenting the argument (Hanscomb, 2023, p. 43).
Why: is a question that you might want to ask when thinking critically about the work of another. Why requires you to think about the existence and purpose of information sources and why the author may have created them—the author’s motivations and aims. True, it is impossible to get inside someone’s head to understand their thought processes, but you can at least look for clues in the work that they have produced (Price, 2023, p. 34). For example, is the author trying to sell you something or persuade you to adopt their viewpoint or a particular way of looking at a problem, a situation, or a theory; is the language formal or informal: does the ‘tone’ of the resource provide a clue?
Example: Cartoonists have long used their artwork to comment upon the political realities of their generations; in recent memory Boris Johnson has proven particularly fruitful for them (Hendin, 2022).1 It is perhaps easy to see why visual artists like cartoonist create the works they do, but it is less easy when thinking critically about resources like journal articles and newspaper stories. A useful way to try to understand the purpose of a resource is to ask each of the questions about which you have just learned: what is the work about, where was it written, when was it written, and who wrote it.
Watch out for bias: The first thing to watch out for is the author’s biases. A cartoonist of a particular political viewpoint will likely reflect that in their art, and the same is true of research. In this context, bias is not a bad thing: it is a natural reflection of how someone feels about something. However, if the creator of the content’s purpose was to argue for a particular viewpoint or present one side of the argument, then does the content—no matter how accomplished—reflect the entire research context? When thinking critically, you must be aware of biases when considering the purpose of a resource. You must also be conscious of your own bias in your own interpretative processes that may prevent you from thinking critically about ‘the why’ of a resource’s existence (see the next section Logical Reasoning).
You have just learnt about a method of evaluation that uses the question words what, where, when, who, and why but other methods exist—each with their own strengths and weaknesses (Sye and Statton, 2023). You are free to choose which method works best for you, but the core message is always the same: incorporate some form of questioning when you evaluate information so that you can respond to it critically rather than just describing what others say.
RADAR – This method stands for Relevance, Authority, Date, Appearance, and Reason for Writing. Its original conception was for website evaluation, but its method is applicable to all information sources (Mandalios, 2013).
CRAAP – This method stands for Currency, Relevance, Authority, Accuracy, and Purpose. Its method is applicable to all sources of information (Blakeslee, 2004).
CASP Checklists - Healthcare students will be familiar with the CASP checklists. These incorporate much of the ‘what, where, when, and who’ methodology—but with a healthcare focus. They concentrate on, for example, systematic reviews, randomised-controlled trials, and cohort studies.
References
Bartley, G. B. and Liesegang, T. J. (2015) ‘Just Because It’s Published Doesn’t Meant It’s Perfect’, Ophthalmology, 122(10), p. 1958-1959.
Blakeslee, S. (2004) ‘The CRAAP Test’, LOEX Quarterly, 31(3), pp. 6-7, Available at: https://commons.emich.edu/loexquarterly/vol31/iss3/4 (Accessed 21 January 2025).
Copilot (2025) Image of thinking [Digital Art], response to Steven Bembridge, 28 March 2025.
Grix, J. and Watkins, G. (2010) Information Skills: Finding and Using the Right Resources. London: Palgrave.
Hanscomb, S. (2023) Critical Thinking: the Basics. Second edition. Abingdon, Oxon: Routledge.
Hendin, R. (2022) ‘‘Boris was cartoon gold’: the UK’s top cartoonists on drawing Boris Johnson’, The Guardian, 31 July. Available at: https://www.theguardian.com/politics/2022/jul/31/boris-cartoon-gold-cartoonists-drawing-boris-johnson-best-chris-riddell-martin-rowson-ralph-steadman (Accessed: 1 April 2025).
Mandalios, J. (2013) ‘RADAR: an approach for helping students evaluate internet sources’, Journal of Information Science, 39(4), pp. 470-478. Available at: https://doi.org/10.1177%2F0165551513478889
McMillan, K. and Weyers, J. (2013) How to Improve Your Critical Thinking & Reflective Skills. Harlow: Pearson.
Neville, C. (2009) How to Improve your Assignment Results. Maidenhead: Open University Press.
Price, B. (2024) Critical Thinking and Writing in Nursing. 6th Edition. Available at: https://read.kortext.com/reader/epub/2536879 (Accessed: 31 March 2025).
Subramanyam, R. V. (2013) ‘Art of reading a journal article: methodically and effectively’, Journal of Oral and Maxillofacial Pathology, 17(1), pp. 65-70. Available at: https://doi.org/10.4103/0973-029X.110733
Sye, D. and Statton, D. (2023) ‘Tools, tests, and checklists: the evolution and future of source evaluation frameworks’, Journal of New Librarianship, 8(1), pp. 76-100. Available at: https://doi.org/10.33011/newlibs/13/9
White, E., van Melik, R. and Bendle, J. (2024) ‘Perceived Impacts of Tourism on Community Identity: Perspectives of Two Scottish Highland Communities’, Tourism planning & development, 21(6), pp. 917–939. Available at: https://doi.org/10.1080/21568316.2024.2398465