from The National Searching Guidance Working Group.

Introduction

This guidance is intended for knowledge and library services (KLS) staff tasked with searching the evidence on behalf of NHS staff.  See also the full introduction.

Refer to the additonal information in Quick links.

Step 1 - read this section first

The following sections apply to all searches. Read this and then click the blue button for the type of search you're doing. 

Planning

Check you have enough information

However you receive the request for a search - in-person, over the phone or via email – check you have enough information before you begin:

Do you understand the question enough, or what is being sought?

  • are the parameters and limits of the search clear?
  • do you have a date-range or specific patient population to search within?
  • does your requester want human and animal results?
  • does your requester want results from all languages, or just English?
  • would your requester like to see conference abstracts amongst the results, or not?
  • what does your requester NOT want?
  • what is your requester’s deadline?

Elicit key terms and synonyms from the requester; can they give you 1 or 2 clear sentences that describe what they are looking for, or even a PICO breakdown?

Establish if there are any key papers your requester already knows about, to guide and inform your search.

If your requester provides useful papers they have already found, have a look at the way they are indexed and check what synonyms etc. they use that you could introduce to your search strategy.

Such papers may also serve as a test set against which to check the strategy, and may also be used in a prospective citation search in Google Scholar or similar.

Does your requester have an idea of how many results they would expect you to find? How many would they like to receive?

Format

Do you know what format(s) the requester would like to receive results in? Some library services will use local report templates to present results, or will provide search reports using an evidence search tracking system like KnowledgeShare or CISS, in which case some of these questions may be superfluous:

  • would they like a list of titles/abstracts with hyperlinks to the full text in an email?
  • would they prefer results in a  document format that they can then edit?
  • wouold they prefer the results in .ris file format so that results can be loaded into reference management software?
  • do they may want their results in several formats

See Sarah Rudd and colleagues’ “Evidence Searching Process Map” in the supplement for an alternative method.

Other considerations

If you think you will need further clarification on any aspect, contact the requester before you start. It can be good to establish a dialogue.

Record within your local evidence search tracking system (KnowledgeShare, or CISS, or whatever method you use), that YOU are undertaking the search.

Check your evidence search tracking system or your local repository of evidence searches, to see if:

  • there has been an identical or similar search for your topic previously.
  • an identical search was conducted recently which you can send to the requester, or rerun the search?
  • a similar search was conducted a while ago, which you can utilise the strategy for your current task?

Try to identify the sources you will use before you start searching; agree these with the requester if you can.

Execution

Familiarisation

Do not be afraid to contact the requester with any queries that may arise when you are searching.

Be sure to keep a record of the search strategies you use. Record any assumptions you have made about the search topic also.

Whatever kind of search you are undertaking, broadly follow the steps of this validated guidance, to help ensure you are searching thoroughly:

Even though these examples are intended for full-blown systematic review searches, they can still provide useful guidance for more casual searches.

If you are unfamiliar with the topic, a broad background search using sources such as Google and Wikipedia to familiarise yourself with it.

You will of course need to be mindful of the quality and provenance of the information you see (check references in Wikipedia entries, for instance).

Scoping search

Try a quick scoping search to get a sense of what is out there, to help find keywords and potentially useful evidence.

This could be:

  • a quick Google search perhaps entering your requester’s question or topic almost verbatim (copying and pasting it word-for-word)
  • entering a few key terms into the Trip Database or Pubmed
  • a quick search of the NHS Knowledge and Library Hub
  • searching across all databases in one of the provider interfaces simultaneously without specifying any field to search or by title field only

The latter should retrieve only relevant articles that will be indexed with useful terms you can use in your search strategy, as well as variant terms, synonyms etc.

Searching the evidence

Take a top-down approach to searching the evidence, unless advised otherwise within this document, looking for:

  • high tier evidence (like reviews in The Cochrane Library)
  • entries in clinical decision suport tools: BMJ Best Practice, UpToDate (££), DynaMed (££) or Visual Dx (££)
  • primary research (in Medline and other bibliographic databases via the provider interfaces).

If you can find recent high tier evidence this may preclude searching for primary research yourself.

However, in most cases you will need to continue searching to retrieve the most current research.

See high tier evidence sources in the glossary and "High tier evidence sources" in "Quick links" for more information.

Formulate a search strategy, using PICO or another framework if appropriate, to identify the key concepts in the search.

Find natural language terms for each key concept, including rough/exact synonyms. Consider the following:

Variant terms

What we commonly call cancer could also be known as carcinoma, tumour/tumor, neoplasm etc.

Terminology

Differences in US and UK English terminology and spellings, i.e. physiotherapy (UK) vs “physical therapy” (US); or hemorrhage (US) vs haemorrhage (UK).

Wildcards

Using wildcard truncation to retrieve results where different permutations of a word’s root are used, i.e. cancer* retrieves results featuring the terms cancers, cancerous, etc.

Adjacency

Adjacency operators: these vary depending on the interface, but allow you to specify if you want to retrieve results where terms appear NEXT to each other or NEAR to each other.

In the Cochrane Library, for instance, searching for air NEXT pollution retrieves any results where those 2 words appear next to each other, while air NEAR/3 pollution retrieves results where those two words appear within 3 words of each other (in any order).

Phrase searching

Some interfaces perform phrase searching automatically, but most require you enter terms in inverted commas/speech marks to retrieve only the results where your terms appear in the exact order you have specified.

Searching the Cochrane library for “testicular cancer” will only return results where that exact two-word phrase is used, while searching for those terms without the inverted commas retrieves any and all results where those two words appear, but not necessarily together.

Subject headings

For each key concept, find relevant subject headings (including floating subheadings) using your scoping search findings and the “map to thesaurus” function in database interfaces.

How you do this will vary slightly depending on the interface you are using, so check the local help available within the interface.

Check the “scope notes” by subject headings where available, to ensure that the term means what you think it means. These explanations may provide you with more synonyms to introduce to your search strategy too.

Explode subject heading searches wherever possible, to include potentially relevant articles indexed with narrower subject headings.

Include all subheadings within your subject heading searches unless your topic clearly indicates using specific ones.

Boolean operators

Use OR operator to combine synonymous searches to ensure the sensitivity of your search, increase your yield and ensure you are not missing any relevant results.

Use the AND operator to combine the separate concepts in your search, to decrease your yield, increase the specificity of your search and ensure you are returning only results relevant to you.

Search strategy

Adopt a sensitive/broad/inclusive approach to the search, at least initially; you do not want to miss anything important. You can adjust the specificity/sensitivity as you go.

Be wary of using the “major” focus when using subject headings as this may exclude relevant results.

Try and avoid using the NOT operator as this may exclude potentially relevant results from your search's yield.

Screen results for relevance, “sense checking” as you go to see if what you are retrieving is in the right area. Iterate your search strategy if necessary.

Adapt your strategy for other databases and sources. Note that subject headings used in a database will be specific to that database.

Keywords and natural language search elements can be copied and pasted, but subject headings should be searched for afresh.

Add limits to your search as agreed with the requester – but consider if limits by date, language, document type and other parameters etc. are justifiable.

Try a prospective citation search of key articles that you have found or that your requester has provided by searching for them by title in a citation index like Scopus (££), if you have access. 

You can do this in PubMed or Google Scholar, checking their “cited by” or “citations” entries, though neither of these is 100% comprehensive.

Citation searching can help you uncover papers that you may otherwise have missed. It is also a test of the rigour of your search: if your search strategy is robust you should retrieve all the papers that the key articles have been cited by. If you have not, consider why not and go back to the drawing board if required.

Most searches will require, or are improved with, an advanced Google search, which can retrieve guidance and policies from NHS Trusts and Integrated Care Boards (ICBs, formerly Clinical Commissioning Groups, CCGs) and other sources, as well as grey literature.

Looking beyond bibliographic databases for grey literature is especially important when searching for evidence around health inequalities, owing to underrepresentation of some groups in the literature.

It can be difficult to judge the quality of Google results, so an advanced Google search using limits will allow you to search within trusted organisations only.

For more help with formulating search strategies and using searching techniques, please see General Help or Troubleshooting.

Thames Valley, Wessex and South West healthcare librarians’ guidance The Literature Search Process: Guidance for NHS Researchers.

E-Learning for Healthcare: How to Search the Literature Effectively.

If you are struggling to create a search strategy or have other searching related queries you can always send an email to one of the mailing lists, where colleagues will be able to help: see mailing list enquiries.

Results

If you are uncertain whether your search is along the right lines or not, send the search strategy and a sample of the results to your requester and ask them if they have any suggestions or comments.

To prompt a quick response you can state that you will do no more on the search until you hear back.

Collate your results

For help collating your results in provider interfaces, and exporting them to reference management software for deduplication, see "Reference management software” in Quick links.

Deduplicate and evaluate

For guidance on deduplicating results in the specific reference management software you are using, "Reference management software” in "Quick links"..

Evaluate your results: Screen them by title/abstract and delete any obviously irrelevant ones. Err on the side of caution and if you are unsure of the relevance of a result, do not delete.

Presenting your results

Present your search results to the requester in the agreed format(s) and within the agreed deadline. Do not be afraid to negotiate an extension if one is required.

Consider accessibility when choosing between Word or pdf formats to present your results, as pdfs have to be specially formatted to be accessible, whereas most Word docs are more accessible via screen readers.

Use, or create, templates for your reports and communications with the requester, to save yourself time and ensure consistency. KnowledgeShare does this automatically.

Use your service’s branding and signpost other library services wherever possible in all your communications with the requester.

If you are producing a report and not just sending a file of deduplicated results to your requester, compile your results with abstracts and full text links wherever possible (instructing the requester how to access the full text via NHS OpenAthens).

Consider categorising the results, you could group review articles together before primary research, for instance.

KnowledgeShare reports automatically produce a table of contents (titles only list) at the start of the document, include full text links, and allow you to categorise and reorder results.

Alternatively, if you are using Refworks, the “HEE’s KLS Evidence Search” institutional output style mimics the presentation of HDAS reports, minus their table of contents, see "Reference management software" in Quick links..

If time allows, can you create a summary and/or synthesis of findings and present this at the front of your report?

Check with your requester if this is required and note this is NOT appropriate for systematic review searches.

Aim to identify key results (or passages within results) you have retrieved, highlight review articles or guidelines, and/or point out historically significant papers. Can you provide an evidence level to each result, if possible?

Consider sending the full text of key results, if you can do this within copyright restrictions.

In your report, arrange the results according to your requester’s stated preference.

Where none is stated, follow your summary or synthesis with synopses of the evidence in this order, arranged in reverse-date order:

  • clinical decision support tools or other sources
  • international or national guidelines
  • other high tier evidence
  • lower-tier/primary research evidence

If there is recent locally produced primary research on your topic available, consider presenting this first and foremost as it may be more valuable to your requester than older high tier evidence from elsewhere (a recent clinical trial from the UK or Europe may be more useful to a British requester than an older review article of American studies in some instances, for example).

Alternatively, arrange results by themes/categories based on the results of your search – consider what would be most helpful to your requester.

Describe your searching methodology in your report, or along with your results, and include your search strategies in full.

Report any assumptions you have made when interpreting the research question and compiling the results.

Include a disclaimer with your results. KnowledgeShare automatically includes the following in its reports:

“We hope that you find the evidence search service useful. Whilst care has been taken in the selection of the materials included in this evidence search, the Library and Knowledge Service is not responsible for the content or the accuracy of the enclosed research information.

Accordingly, whilst every endeavour has been undertaken to execute a comprehensive search of the evidence, the Library and Knowledge Service is not and will not be held responsible or liable for any omissions to pertinent research information not included as part of the results of the enclosed evidence search.

Requesters are welcome to discuss the evidence search findings with the librarian responsible for executing the search. We welcome suggestions on additional search strategies / use of other information resources for further exploration.

You must not use the results of this search for commercial purposes. Any usage or reproduction of the search output should acknowledge the Library and Knowledge Service that produced it.”

Include a copyright/acknowledgement notice. KnowledgeShare automatically includes the following in its reports:

“Please acknowledge this work in any resulting paper or presentation as: Evidence search: "[evidence search title]". [Your name]. [Date of search]. [Your city, your country]: [Your library’s name].”

Record on KnowledgeShare, or CISS, or whatever local evidence search tracking system you use, that you have completed the search.

Add the report you produced, or the results you sent to the user, to your local system, so other users can retrieve them if needed.

Systematically request, and record, feedback or evaluation from the requester, especially on the impact your search report has.

Where there is a discrepancy between the general advice given in this step 1 and the specific advice in step 2, follow the the specific advice.

These instructions represent best practice, but time pressures and competing priorities may prevent you from following every step to-the-letter.

Your search topic may not require you to search every resource outlined in the specific advice.

Other information

Introduction and credits.

Reference management software.

Troubleshooting.

Supplement: sample search summaries and responses.

 

Join the KLS Search and Training Forums (London, South East and South West) workspace on FutureNHS to download the PDF version of the guidance and to participate in this community of practice.