No evidence, weak evidence or it is only partially applicable
Consider the 'direction of travel' of the evidence available. Make a tentative recommendation and develop a 'consideration' that explains why weak or partially applicable evidence has been used.
Consider evidence from practice (see below).
Only evidence of a similar type and quality is available and the findings conflict (inconsistent or mixed evidence)
Consider the reasons for conflict. For example, if this is because different groups of people might respond differently to an intervention or programme, consider making recommendations for specific groups.
Identify studies that are most applicable to the target population and setting and, where appropriate, use them as a basis for recommendations.
Evidence not directly applicable to the target population (for example, it covers a different age group)
Consider the degree to which the findings can be extrapolated to the target population. For example, this may be possible if it is high quality evidence drawn from a largely similar but different population group.
Evidence conflicts with existing government policy or NICE guidance
Consider the reason(s) for conflict. For example, was the policy or guidance evidence-based? Has the evidence changed substantially since the policy or guidance was developed? Were the goals or intentions of the policy or guidance different?
The CPHE project team may be able to discuss the conflict(s) with the relevant policy guidance team, as necessary, to help resolve this issue. However, be mindful that this latest NICE guidance might directly inform changes in government policy or supersede previous NICE guidance.
Limited information on cost effectiveness
For recommendations that are likely to have a significant resource impact,
consider using economic modelling to develop an estimate of cost effectiveness.
Unclear how to make best use of the different types of evidence from practice (including evidence provided by committee members, expert witnesses, stakeholders and the target population)
Consider how evidence from practice can help answer the key questions.
Consider what weight should be given to evidence from practice compared to evidence from the NICE evidence reviews.
Consider how evidence from practice can:
1) support the NICE evidence reviews of effectiveness and cost effectiveness and
2) address gaps in the evidence on effectiveness and cost effectiveness.
Consider whether it is possible to record the conclusions drawn from practice in a consistent and transparent way. Specifically, can the conclusions be developed into evidence statements and discussed in the considerations section of the guidance?
As soon as members have discussed the findings of a NICE evidence review (or any expert testimony), the PHAC should start drafting recommendations. This is an iterative process; the recommendations are likely to be revised on a number of occasions before the wording is finalised.
First, the PHAC should decide what they want to recommend and which sectors (including which professionals in those sectors) should act on the recommendations. (As an example, the recommendations could be aimed at practitioners in the NHS, schools, workplaces or local authorities.)
In the early stages, it can be helpful to work in small groups, supported by the CPHE project team and using sample templates. It may also help if the CPHE project team develops a first draft of the recommendations as a starting point for discussion, based on the PHAC's initial deliberations as a group. However they are developed, the CPHE project team should ensure the draft recommendations are clearly linked to evidence statements.
Between the PHAC meetings, the nuances of the words can be refined via email discussions among members (again, supported by the CPHE project team). (See The NICE public health guidance development process third edition 2012, for terms of reference and the standing orders that define quoracy for advisory committees.)
The recommendations may be prioritised (see section 7.8 ).
Where evidence on effectiveness or cost effectiveness is lacking or conflicting, the PHAC may decide that further research should be a condition for implementation.
Decisions can be made using a variety of approaches: discussion, informal or formal consensus or formal voting (for example, in instances when members disagree). The proceedings should be recorded and a clear statement made about the factors that have been considered and the methods used to achieve consensus. This ensures the process is as transparent as possible.
A summary of the generic and specific issues considered and the key deliberations should be given in the 'Considerations' section of the guidance (see section 7.5 ).
Writing the recommendations is 1 of the most important and difficult steps in developing guidance. Great care should be taken. Each recommendation should answer the reader's main question: 'What does this mean for me?' In addition, it should clearly specify the intervention or action to be taken (what, how often and for how long?) and the context or circumstances (where and when?).
The wording must be concise and unambiguous so that the target audience knows what to do in practice and the public know what is being recommended. The CPHE project team should ensure that the PHAC is supplied with a copy of the booklet 'Writing for NICE'.
The recommendations are grouped under 3 main headings as below.
All those who will be affected by the recommendation. This may include:
individuals
communities or families
larger population groups defined by a range of factors (for example, by age, gender, ethnicity, setting).
The professionals and others who should take action, these may be:
practitioners
commissioners
policy makers
researchers.
They may be subdivided by sector and setting, for example:
other public sector bodies (government, government agencies and local government, arm's length bodies, armed forces, prisons, police service, education)
private and voluntary organisations (large, medium and small).
They may refer to specific job titles, such as:
Ensure those taking action are listed by type of organisation or by job title, do not mix organisations and job titles in the same list.
Actions should be as specific as possible, although how prescriptive they are will be decided on a case-by-case basis and will depend on the evidence available. They may cover:
strategy, policy and planning
service management and delivery
individual practice
research priorities.
Each recommendation should:
Stand alone and be understood without reference to supporting material (supporting information can be included in the 'Considerations' section of the guidance or as part of the implementation materials).
Be as specific as possible about the action and who should take it (the ability to check whether it is being implemented properly [audit] should be considered when finalising the wording).
Only contain 1 main action in each bullet point.
Provide a clear link to the supporting evidence statements and evidence reviews, preferably with a numeric reference (to review number and evidence statement number).
Avoid, wherever possible, terminology and jargon – where this is not possible, it needs to be clearly defined and unambiguous (NICE can advise on this and also give you a copy of the 'Writing for NICE' guide).
Avoid trade names. Any reference to products (for example, pedometers) and services (for example, slimming clubs) should be made in general terms to avoid giving the impression that NICE endorses a particular brand.
Avoid implying that interventions or actions should be 'done' to people (that is, use 'offer' and 'discuss' rather than 'prescribe' or 'give', also avoid 'subjects' and 'cases' – use 'people', 'patients', 'clients' or 'service users' instead).
Avoid labelling people (that is, don't describe someone as a 'drug user' or 'smoker', use instead, 'someone who takes drugs or who smokes').
Acknowledge the role of individuals, service users, clients or members of the public who are directly affected by the recommendations or the organisations that represent them in any decision-making.
Include cross-references to recommendations from other NICE guidance to avoid the need to repeat information. It should be clear where the recommendations come from (refer to the guidance template for instructions). Recommendations from other NICE guidance or NHS policy can be quoted verbatim (as appropriate).
Recommendations from other (non-NICE) guidance should not be quoted verbatim.
NICE's public health recommendations are not graded, but the PHAC's view of how important they are should be clear from the wording (see table 7.2). The importance of a recommendation should not necessarily reflect the strength of the evidence available to support it. Other important factors (for example, ethics, principles, potential outcomes and equality issues) all need to be considered by the PHAC (see sections 7.2.1 to 7.2.11 ).
Table 7.2 Reflecting the strength of recommendations
|
|
Actions that must be taken | Use 'must' only if the recommendation links to enforceable legislation (such as health and safety regulations), or there will be serious repercussions if the recommendation is not followed. In such a case, a clear rationale for using 'must' should be set out and discussed with the CPHE director. |
Actions that should be taken | Use this type of wording if the action will do more good than harm and is likely to be cost effective. Word recommendations of this type as direct instructions using verbs such as 'offer', 'assess', 'refer'. If these recommendations refer to all people and situations (where the evidence is clear and uncontested) they should be worded, 'always do this'. They can include caveats (where the evidence is less clear or mixed) such as, 'do this when'. (from [Public health guidance, NICE 2011]): Commissioners, organisers and planners of national, mass-media skin cancer prevention campaigns should:
|
Actions that could be taken | Use this type of wording if the action is effective or cost effective, but other options may be similarly effective or cost effective. Or the choice of action (or the decision whether to act at all) is likely to vary depending on the client's values and preferences. Word recommendations of this type as direct instructions (if possible), but add 'consider' or 'could'– for example, 'consider referring'. (from [Public health guidance, NICE 2007]): Identify individuals at high risk of STIs using their sexual history. Opportunities for risk assessment may arise during consultations on contraception, pregnancy or abortion, and when carrying out a cervical smear test, offering an STI test or providing travel immunisation. Risk assessment also be carried out during routine care or when a new patient registers. In exceptional circumstances, the committee or group may consider making 'only in research' recommendations. |
Actions that should not be taken | State explicitly if a particular action should not be carried out or should be stopped (because, for example, it is ineffective or not cost effective). (from [Public health guidance, NICE 2008]): If a smoker's attempt to quit is unsuccessful using NRT, varenicline or bupropion, offer a repeat prescription within 6 months, unless special circumstances have hampered the person's initial attempt to stop smoking, when it may be reasonable to try again sooner. |
The public health guidance issued by NICE will take 2 formats:
The guidance: Available online in web format, the NICE guidance lists all the recommendations, with details of how they were developed and evidence statements. It contains clear links to other NICE products to support the implementation of the recommendation.
NICE pathways: NICE pathways are a practical online resource for healthcare professionals to use on a day-to-day basis. A pathway presents recommendations from the guidance in a set of interactive topic-based diagrams. It contains all the recommendations from and links to related NICE guidance and other NICE products (for example, relevant quality standards and implementation tools).
Once the PHAC has agreed the content of the guidance and draft recommendations have been constructed, a stakeholder consultation is conducted on the full draft guidance. The stakeholder consultation is described in The NICE public health guidance development process (third edition 2012). Stakeholders will review and comment on the full draft guidance. Registered stakeholders normally include professional organisations and statutory agencies representing practitioners, as well as voluntary organisations run by, or representing the interests of, the target populations. The CPHE project team should prepare a summary of stakeholder responses.
In addition to stakeholder consultation, draft recommendations may, on occasion, be tested with key groups of practitioners or policy makers. This activity is referred to as 'Fieldwork'. Fieldwork is carried out on an exceptional basis for public health guidance in new or sensitive areas, and not as a matter of routine on all guidance. Often, particularly for those topics where there is already related NICE guidance, fieldwork findings add little to the insights generated by the consultation with stakeholders. Nevertheless, for areas where NICE does not yet have good links with key practitioners and stakeholder groups it can be a valuable part of the process. Exceptions would include occasions when NICE develops public health guidance in a new or (scientifically or politically) controversial topic area. For an exception to be made, the CPHE team will need to put the case for fieldwork to the centre director for approval.
During fieldwork, the draft recommendations are tested with policy makers, commissioners and practitioners to see how easy they are to implement. Appendix M provides a detailed overview of the fieldwork methods and process.
If fieldwork has been conducted (see appendix M ), a summary of the information collected and any key implications for the recommendations are presented as a fieldwork report to the PHAC.
The CPHE project team may also occasionally commission separate work to test out the draft recommendations directly with the target population (see chapter 3 for details).
The PHAC meets to review the evidence in light of stakeholder responses, revise the recommendations (if necessary) and finalise the guidance. It uses the following documents:
summary of stakeholder responses to the guidance consultation
summary of how stakeholder responses impact on the draft recommendations (as necessary)
report on direct consultation with the target population (if conducted)
equality and diversity assessment carried out on the draft recommendations (see section 7.7 )
fieldwork report (if applicable) including any impact on the draft recommendations.
If it appears from the consultation (or fieldwork) that professionals or others (as appropriate) do not endorse a recommendation, the PHAC should consider:
the possible reason(s) (for example, they may have concerns over training issues or capacity)
whether to amend the recommendation or associated recommendations to support implementation.
The 'Considerations' section of the guidance should clearly illustrate the range of issues the PHAC has considered in developing the recommendations. It should also make explicit the criteria used to create and prioritise them.
This section can be developed using the issues and documents listed in section 7.2 , the minutes from all its meetings (including any subgroup meetings) and records of any email discussions.
The following information may be included:
How the evidence statements were developed into recommendations – such as detail on the decisions made in relation to issues raised in table 7.1 and, in particular, on the strength and applicability of the evidence available.
How recommendations were prioritised – for example, whether this was based on the strength of evidence or policy imperatives.
The rationale for making recommendations that do not answer the key questions in the scope.
The rationale for making recommendations where there is a lack of evidence of effectiveness or cost effectiveness.
How evidence from practice was defined and the relative weight it was given compared to the evidence of effectiveness or cost effectiveness.
Testimony from expert witnesses.
Key facts for example, in relation to legislation, policy, funding and organisational issues.
Issues outside the remit of the guidance – to re-emphasise them.
Evidence not considered due to its quality or focus or due to time constraints.
The 'Considerations' section should not include any text that could be construed as a recommendation. However, where considerations correspond directly with groups of recommendations they should be grouped under the same sub-headings.
The considerations section may be used to point out where the PHAC would have liked to have made a recommendation but felt that there was insufficient evidence or lack of a rationale for doing so.
The following 2 questions should be addressed when assessing recommendations in line with equality and diversity legislation:
Does the guidance avoid unlawful discrimination?
Are there ways in which the guidance could better promote equality?
Equality issues are considered during the standard guidance development process and it is likely that many will have been considered during the PHAC's deliberations. These should be recorded in the 'Considerations' section of the guidance. (Where a direction suggested by the evidence has been altered in the interests of promoting equality, this should also be recorded.)
Recommendations should be formally assessed against equality considerations after the draft guidance has been issued for consultation. The findings should be considered by the PHAC when it reviews stakeholder comments (and fieldwork, if applicable).
To avoid unlawful discrimination, 4 issues are considered:
whether specific groups may be denied access to an intervention
whether specific groups will, in practice, find it more or less easy to access the intervention
whether any assessment needed to access the intervention will make it more or less difficult for specific groups to gain access
whether any features make it impossible or unreasonably difficult for people with disabilities to access the intervention.
In addition, the assessment checks whether stakeholders have raised any areas of possible discrimination.
Ideally, opportunities to promote equality will have been maximised during development of the draft recommendations. Nevertheless, after the consultation the PHAC should reconsider the draft recommendations specifically from this perspective: would, for example, changes to the wording (or the deletion of a recommendation or inclusion of new ones) further promote equality?
Suggested changes to the recommendations should be recorded and presented to the PHAC, together with stakeholder comments (and fieldwork, if applicable) on the draft guidance. Decisions on these issues should also be noted in the minutes of the relevant committee meetings.
Research recommendations provide an opportunity to highlight how the public health evidence base can be improved. More important, they ensure CPHE has access to the best possible evidence when the relevant guidance is being revised.
Research recommendations are a set of specific questions that aim to gather new evidence or strengthen the existing knowledge base, where it was previously equivocal. Recommendations to conduct both primary and secondary research (for example, systematic reviews) can be made.
The recommendations are drawn from a broader set of 'gaps in the evidence' and areas for further research that should be listed in an appendix to the guidance. These may have arisen out of the original evidence reviews or through general discussion at meetings.
This section provides a framework for formulating and prioritising research recommendations.
There will probably be a large number of potential research recommendations. They can cover questions about effectiveness, implementation, acceptability, feasibility and costs.
Each research recommendation should be formulated as 1 question or as a set of closely related questions. It should consider the importance of issues relating to equality and diversity (for example, gender, ethnicity and people with special needs) and take into account the criteria set out in table 7.3 Each recommendation should also be evaluated and prioritised according to these criteria and this information should be presented as an appendix.
Only high-priority research recommendations should be included in the guidance.
The PHACs should develop a maximum of 6 research recommendations. A research recommendation has 2 components: a well-formulated, answerable question (see below) and where appropriate a statement about the importance of the recommended research (see table 7.4).
It should comprise a question with explanatory text of not more than 150 words. See below for an example from Brief interventions and referral for smoking cessation in primary care and other settings (Public health guidance, NICE 2006).
Which brief interventions are most cost effective for increasing smoking cessation among lower socioeconomic and vulnerable groups?
Smoking remains the leading cause of preventable morbidity and premature mortality in England, causing an estimated annual average of 86,500 deaths between 1998 and 2002. There is a clear social class gradient in smoking and it accounts for over half of the difference in risk of premature death between social classes. Smoking prevalence remains worryingly high in some groups. Vulnerable groups in society are the groups most likely to bear the burden of ill health and have the fewest resources with which to cope.
Alternatively, it may take the form of a recommendation that will answer: 'who should take action?' (for example, the Medical Research Council); and 'what action should they take?' (for example, to ensure certain outcome measures are used in studies that it funds in a particular topic area). If more than 1 organisation and 1 action is involved, these should be broken down into a bullet point list under the 2 headings.
Table 7.3 Checklist for formulating research questions about interventions using the population, intervention, comparison and outcome (PICO) model
PICO is a widely used mnemonic summarising the 4 major components of a research question about an intervention: patient (population), intervention, comparison and outcome (see table below).
Population or problem | What is the primary problem, disease or condition you are interested in? What are the most important characteristics of the population to be studied?
|
Intervention or indicator | Which main intervention are you considering? What determinants of risk are important?
|
Comparison or control | What is the main alternative(s) or control to compare with the intervention?
|
Outcome | What will the researcher need to measure, improve, influence or accomplish? What intervention outcomes should be measured?
|
The PHAC should draft a paragraph explaining the need for research following the process set out in the NICE research recommendations process and methods guide to ensure that: the process of developing the research recommendations is robust, transparent and that significant research priorities are identified
The NICE research recommendations process and methods guide describes a step-by-step approach to identifying uncertainties, formulating research recommendations and research questions, prioritising them and communicating them to the NICE Research and Development (R&D) team and researchers and funders.
Table 7.4 Research priorities
1. Relevance to NICE | How would the research change future NICE guidance? |
2. Importance to the population | What would be the impact of any new or amended guidance? (For example, on quality of life, morbidity or disease prevalence, severity or mortality). |
3. Relevance to the NHS and the public sector | What would be the impact of any new or amended guidance – on the NHS and the public sector? (For example, financial advantages, effect on staff, impact on strategic planning or service delivery). |
4. National priorities | Is the question relevant to a national public health priority area (such as 2012 or [Department of Health DH 2011])? Specify the relevant document. |
5. Lack of evidence | How much research has been carried out in this area? What are the problems, if any, with previous research? Provide details of any previous systematic review. |
6. Feasibility | Can it be carried out in a realistic timescale and at an acceptable cost? |
7. Other comments | Mention any other important issues, such as potential funders, or the outcome of previous attempts to address this issue. However, remember that this is not a research protocol. |
All proposed research recommendations should be included in the draft guidance that is made available for stakeholder consultation. Following consultation, the PHAC will take account of any concerns raised by stakeholders and they will be amended as appropriate. Draft research recommendations will be finalised post consultation. All the research recommendations contained in the guidance are added to a database on the NICE website. Those classed as high priority are highlighted. High-priority research recommendations are put through a second prioritisation process at NICE.
Important research recommendations that fall outside the scope of the guidance are communicated to research and development funders such as:
National Institute for Health Research (NIHR) Public Health Research Programme
NIHR Health Technology Assessment Programme
NIHR Health Services and Delivery Research Programme
Medical Research Council (MRC)
Economic and Social Research Council (ESRC)
DH Policy Research Programme (PRP).
Research recommendations should aim to address any gaps in the evidence base in relation to the groups identified in the Equality Act (2010 ) (or groups who are particularly disadvantaged with respect to the topic under consideration).
Glasziou P, Del Mar C, Salisbury J (2003) Evidence-based medicine workbook. London: British Medical Journal Books
Kelly MP,Moore TA (2012) The judgement process in evidence-based medicine and health technology assessment . Social Theory and Health, 10:1-19.i:10.1057/sth.2011.21
Michie S, Johnston M (2004) Changing clinical behaviour by making guidelines specific. British Medical Journal 328: 343–5
Research recommendation manual , National Institute for Clinical Excellence (2011)
Public health: ethical issues . London: Nuffield Council on Bioethics (2007)
Sackett DL, Straus SE, Richardson WS (2000) Evidence-based medicine: how to practice and teach EBM. Edinburgh: Churchill Livingstone
Schunemann HJ, Best D, Vist G et al. (2003) Letters, numbers, symbols and words: how to communicate grades of evidence and recommendations. Canadian Medical Association Journal 169: 677–80
Scottish Intercollegiate Guidelines Network (2002) SIGN 50. A guideline developer's handbook. Edinburgh: Scottish Intercollegiate Guidelines Network
Tannahill A (2008) Beyond evidence – to ethics: a decision making framework for health promotion, public health and health improvement. Health Promotion International 23 (4): 380–90
Weightman A, Ellis S, Cullum A et al. (2005) Grading evidence and recommendations for public health interventions: developing and piloting a framework. London: Health Development Agency
[ 9 ] Nuffield Council on Bioethics (2007) Public health: ethical issues . London: Nuffield Council on Bioethics.
An official website of the United States government
The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .
Weixiong zhang.
Department of Computer Science and Engineering, Department of Genetics, Washington University in St. Louis, St. Louis, Missouri, United States of America
The importance of writing well can never be overstated for a successful professional career, and the ability to write solid papers is an essential trait of a productive researcher. Writing and publishing a paper has its own life cycle; properly following a course of action and avoiding missteps can be vital to the overall success not only of a paper but of the underlying research as well. Here, we offer ten simple rules for writing and publishing research papers.
As a caveat, this essay is not about the mechanics of composing a paper, much of which has been covered elsewhere, e.g., [1] , [2] . Rather, it is about the principles and attitude that can help guide the process of writing in particular and research in general. In this regard, some of the discussion will complement, extend, and refine some advice given in early articles of this Ten Simple Rules series of PLOS Computational Biology [3] – [8] .
Never separate writing a paper from the underlying research. After all, writing and research are integral parts of the overall enterprise. Therefore, design a project with an ultimate paper firmly in mind. Include an outline of the paper in the initial project design documents to help form the research objectives, determine the logical flow of the experiments, and organize the materials and data to be used. Furthermore, use writing as a tool to reassess the overall project, reevaluate the logic of the experiments, and examine the validity of the results during the research. As a result, the overall research may need to be adjusted, the project design may be revised, new methods may be devised, and new data may be collected. The process of research and writing may be repeated if necessary.
It is often the case that more than one hypothesis or objective may be tackled in one project. It is also not uncommon that the data and results gathered for one objective can serve additional purposes. A decision on having one or more papers needs to be made, and the decision will be affected by various factors. Regardless of the validity of these factors, the overriding consideration must be the potential impact that the paper may have on the research subject and field. Therefore, the significance, completeness, and coherence of the results presented as a whole should be the principal guide for selecting the story to tell, the hypothesis to focus upon, and materials to include in the paper, as well as the yardstick for measuring the quality of the paper. By this metric, less is more , i.e., fewer but more significant papers serve both the research community and one's career better than more papers of less significance.
Deciding on an angle of the story to focus upon is the next hurdle to jump at the initial stage of the writing. The results from a computational study of a biological problem can often be presented to biologists, computational scientists, or both; deciding what story to tell and from what angle to pitch the main idea is important. This issue translates to choosing a target audience, as well as an appropriate journal, to cast the main messages to. This is critical for determining the organization of the paper and the level of detail of the story, so as to write the paper with the audience in mind. Indeed, writing a paper for biologists in general is different from writing for specialists in computational biology.
The foundation of “lively” writing for smooth reading is a sound and clear logic underlying the story of the paper. Although experiments may be carried out independently, the result from one experiment may form premises and/or provide supporting data for the next experiment. The experiments and results, therefore, must be presented in a logical order. In order to make the writing an easy process to follow, this logical flow should be determined before any other writing strategy or tactic is exercised. This logical order can also help you avoid discussing the same issue or presenting the same argument in multiple places in the paper, which may dilute the readers' attention.
An effective tactic to help develop a sound logical flow is to imaginatively create a set of figures and tables, which will ultimately be developed from experimental results, and order them in a logical way based on the information flow through the experiments. In other words, the figures and tables alone can tell the story without consulting additional material. If all or some of these figures and tables are included in the final manuscript, make every effort to make them self-contained (see Rule 5 below), a favorable feature for the paper to have. In addition, these figures and tables, as well as the threading logical flow, may be used to direct or organize research activities, reinforcing Rule 1.
Completeness is a cornerstone for a research paper, following Rule 2. This cornerstone needs to be set in both content and presentation. First, important and relevant aspects of a hypothesis pursued in the research should be discussed with detailed supporting data. If the page limit is an issue, focus on one or two main aspects with sufficient details in the main text and leave the rest to online supporting materials. As a reminder, be sure to keep the details of all experiments (e.g., parameters of the experiments and versions of software) for revision, post-publication correspondence, or importantly, reproducibility of the results. Second, don't simply state what results are presented in figures and tables, which makes the writing repetitive because they are self-contained (see below), but rather, interpret them with insights to the underlying story to be told (typically in the results section) and discuss their implication (typically in the discussion section).
Third, make the whole paper self-contained. Introduce an adequate amount of background and introductory material for the right audience (following Rule 3). A statistical test, e.g., hypergeometric tests for enrichment of a subset of objects, may be obvious to statisticians or computational biologists but may be foreign to others, so providing a sufficient amount of background is the key for delivery of the material. When an uncommon term is used, give a definition besides a reference to it. Fourth, try to avoid “making your readers do the arithmetic” [9] , i.e., be clear enough so that the readers don't have to make any inference from the presented data. If such results need to be discussed, make them explicit even though they may be readily derived from other data. Fifth, figures and tables are essential components of a paper, each of which must be included for a good reason; make each of them self-contained with all required information clearly specified in the legend to guide interpretation of the data presented.
This is a caveat to Rule 5 and is singled out to emphasize its importance. Being thorough is not a license to writing that is unnecessarily descriptive, repetitive, or lengthy. Rather, on the contrary, “simplicity is the ultimate sophistication” [10] . Overly elaborate writing is distracting and boring and places a burden on the readers. In contrast, the delivery of a message is more rigorous if the writing is precise and concise. One excellent example is Watson and Crick's Nobel-Prize-winning paper on the DNA double helix structure [11] —it is only two pages long!
A complete draft of a paper requires a lot of work, so it pays to go the extra mile to polish it to facilitate enjoyable reading. A paper presented as a piece of art will give referees a positive initial impression of your passion toward the research and the quality of the work, which will work in your favor in the reviewing process. Therefore, concentrate on spelling, grammar, usage, and a “lively” writing style that avoids successions of simple, boring, declarative sentences. Have an authoritative dictionary with a thesaurus and a style manual, e.g., [1] , handy and use them relentlessly. Also pay attention to small details in presentation, such as paragraph indentation, page margins, and fonts. If you are not a native speaker of the language the paper is written in, make sure to have a native speaker go over the final draft to ensure correctness and accuracy of the language used.
A complete manuscript typically requires many rounds of revision. Taking a correct attitude during revision is critical to the resolution of most problems in the writing. Be objective and honest about your work and do not exaggerate or belittle the significance of the results and the elegance of the methods developed. After working long and hard, you are an expert on the problem you studied, and you are the best referee of your own work, after all . Therefore, inspect the research and the paper in the context of the state of the art.
When revising a draft, purge yourself out of the picture and leave your passion for your work aside. To be concrete, put yourself completely in the shoes of a referee and scrutinize all the pieces—the significance of the work, the logic of the story, the correctness of the results and conclusions, the organization of the paper, and the presentation of the materials. In practice, you may put a draft aside for a day or two—try to forget about it completely—and then come back to it fresh, consider it as if it were someone else's writing, and read it through while trying to poke holes in the story and writing. In this process, extract the meaning literally from the language as written and do not try to use your own view to interpret or extrapolate from what was written. Don't be afraid to throw away pieces of your writing and start over from scratch if they do not pass this “not-yourself” test. This can be painful, but the final manuscript will be more logically sound and better organized.
It is wise to anticipate the possible questions and critiques the referees may raise and preemptively address their concerns before submission. To do so, collect feedback and critiques from others, e.g., colleagues and collaborators. Discuss your work with them and get their opinions, suggestions, and comments. A talk at a lab meeting or a departmental seminar will also help rectify potential issues that need to be addressed. If you are a graduate student, running the paper and results through the thesis committee may be effective to iron out possible problems.
When a submission is rejected or poorly reviewed, don't be offended and don't take it personally. Be aware that the referees spent their time on the paper, which they might have otherwise devoted to their own research, so they are doing you a favor and helping you shape the paper to be more accessible to the targeted audience. Therefore, consider the referees as your collaborators and treat the reviews with respect. This attitude can improve the quality of your paper and research.
Read and examine the reviews objectively—the principles set in Rule 8 apply here as well. Often a criticism was raised because one of the aspects of a hypothesis was not adequately studied, or an important result from previous research was not mentioned or not consistent with yours. If a critique is about the robustness of a method used or the validity of a result, often the research needs to be redone or more data need to be collected. If you believe the referee has misunderstood a particular point, check the writing. It is often the case that improper wording or presentation misled the referee. If that's the case, revise the writing thoroughly. Don't argue without supporting data. Don't submit the paper elsewhere without additional work. This can only temporally mitigate the issue, you will not be happy with the paper in the long run, and this may hurt your reputation.
Finally, keep in mind that writing is personal, and it takes a lot of practice to find one's style. What works and what does not work vary from person to person. Undoubtedly, dedicated practice will help produce stronger papers with long-lasting impact.
Thanks to Sharlee Climer, Richard Korf, and Kevin Zhang for critical reading of the manuscript.
The author received no specific funding for this article.
How to write an executive summary on ethics in the workplace, how to properly format for an interoffice memo.
Writing a recommendation report usually involves describing a situation, evaluating possible alternatives and proposing a solution to a problem. The final report should include clear, precise and evidence-based fndings and recommendations. Whether you’re writing a project, performance or risk assessment, clearly stating the facts makes it easier for others to reach a decision based on your research.
A comprehensive recommendation report typically includes a table of contents, executive summary, data acquisition methodology, options and conclusions. You can download a business recommendation template or create your own document or presentation format. Additionally, you can provide attachments with details or include links to websites with relevant information. Select a format that is best suited to the type of report you are writing.
The goal of the recommendation report is to outline helpful recommendations that can fulfill a need or resolve a vexing problem, according to the University of Arkansas . When writing a recommendation report, start by clearly stating what you’re evaluating. This sets the tone. For example, if you need to create a report on absenteeism at your company, start by listing statistics about the problem. Then add commentary about its impact. For example, absenteeism might lead to decreased productivity, missed deadlines and lowered customer satisfaction.
In your recommendation, you need to define the methodology used to collect data. For example, you might create an online survey, conduct focus groups, complete interviews or read literature on the subject. This activity helps you find out what other people think about the topic and what actions they may be taking based on their own experiences. For example, you might discover that employees at your company may miss work repeatedly due to caregiver obligations, poor health or transportation problems. Analyze the situation thoroughly before drawing any conclusions. For instance, you can use analysis techniques such as drawing a fishbone diagram to determine the root cause of the problem.
After you lay out the problem, you may go on to suggest viable solutions, as explained by professor T. Miles at West Virginia University. In writing research recommendations, recall what factors should be considered For example, when writing a recommendation report about employee development needs, list options for developing professional skills, such as effective communication, negotiation and decision making. Your recommendation report may also include details about past interventions and results.
Summarize your findings from your research using concise charts, lists and diagrams. This makes it easier for your superiors to interpret your recommendation and draw their own conclusions. For example, you may find that employees fail to recognize the impact of their absenteeism. Promoting awareness can increase attendance and maintain appropriate coverage.
Your recommendations should have specific, measurable and achievable actions defined. They should also be realistic and time constrained. A recommendation might suggest design, distribution and display by the end of the month of posters in the workplace that highlight incentives and punishments, for instance.
How to make a report cover letter, how to write a memo of transmittal, how to handle being reprimanded at work, differences between short-term & long-term projects, how to cite an attachment in a business letter, how to suggest an idea in the workplace, how to maintain objectivity in a performance appraisal, how to write a due diligence report, how to write a report to the boss, most popular.
Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.
Once you’ve identified your area of interest, sorted through and analyzed the literature to identify the problem you’d like to address, and developed both a purpose and a question; the next step is to design your study. This chapter will provide a basic overview of the considerations any researcher must think about as they design a research study.
Chapter 2: Learning Objectives
As you work to identify the best approach to identify an answer to your research question, you will be able to:
As you work to determine which approach you will consider in order to best answer your question, you’ll need to consider how to address both the conceptual and operational components of your inquiry. As we discussed in Chapter 1; theory often informs practice (deductive approaches). Theory is often discussed in terms of abstract, or immeasurable, constructs. Because of the ambiguous nature of theory, it is important to conceptualize the parameters of your investigation. Conceptualizing is the process of defining what is or is not included in your description of a specific construct.
Understanding Theoretical and Contextual Framework
You may consider the theoretical or contextual framework for your study as the ‘lens’ through which you want your reader to view the work from. That is, this is your opportunity frame their experience with this information through your educated perspective on the material.
How Will You Determine the Subjective Aspects of Your Work?
Consider exploring one’s motivation to advance their education:
Operationalization is the process of defining concepts or constructs in a measurable way. As you dive into the ‘HOW’ you will go about your research, you will need to understand the terminology related to study design
As we discussed in Chapter 1, there are several kinds of Variables. As a reminder, a variable is an objective and measurable representation of a theoretical construct. An independent variable is a variable which causes an effect on the dependent, or outcome variable. Note that there may be more than one independent variable in your study. Therefore, the dependent variable is the variable which you are measuring as an effect of an intervention or influence; you can think of this as the outcome variable. Identifying at least these two variables is an essential first step in designing your study. This is because how you explore the relationship between your effect (independent variable) and outcome (dependent variable) with help guide your methodology. Other variables to consider include mediating variables , which are variables that are explained by both the independent and dependent variables. Moderating variables influence the relationship between the independent and dependent variables and control variables which may have an impact on the dependent variable but does not help to explain the dependent variable.
Assigning Dependent and Independent Variables
You would like to determine the relationship between weight and tidal volume:
You would like to determine whether the number of hours spent in clinical training influences post training test scores :
Identifying and assigning the dependent and independent variable(s) is one of the most important research activities as this will help guide you toward the type of information you’ll be collecting and what you will do with that information. However, as you consider both the outcome (dependent) variable and the impact (independent) variable, it is also important to consider what other variables may influence the relationship between these two primary variables.
There are very few instances wherein you can control EVERY variable. However, it is your job as a researcher to plan for, acknowledge, and attempt to address anything that may influence the results you present.
levels of measurement can be thought of as values within each variable. For example, traditionally, the variable ‘Gender’ had two values: male or female. The modern variable of ‘Gender’ may have several values which are used to delineate each potential designation within the variable. Each value represents a specific designation of measure.
Values of measures may be considered quantitative (numeric); in our example of traditional gender you may assign a numeric (quantitative) value to male and female as either ‘1’ and ‘2’, respectively. Values may also be assigned non-numerically; meaning they are qualitative. It is important to note that if you want to analyze non-numeric data, it must be coded first.
Understanding and Assigning Value
You may create a question asking respondents to rank their agreement with a statement on a scale ranging from strongly disagree to strongly agree. Although qualitative in nature, we can assign a numeric value to each level of measurement as a ‘code’.
By doing this, we can explore relationships between the attributes and variables using quantitative statistical methods.
One of the most important aspects of operationalizing a theoretical construct is to determine the level(s) of measurement. This is done by assessing the types of variables and values:
Example of a Nominal Variable
You would like to collect information about the gender (variable) of individuals participating in your study. Your level of measures may be:
You may then assign these measures a numeric value:
Example of an Ordinal Variable
You provide a scale of agreement for respondents to indicate their level of agreement with the use of a current policy within the hospital:
Note: Those who strongly disagree with the use of this policy disapprove MORE than do those who disagree; however, there is no quantifiable value for how much more.
Example of an Interval Variable
You classify the ages of the participants in your study:
NOTE: 35 is 5 more than 30. The quantifiable ‘how much more’ is what distinguishes age as an interval variable.
Example of a Ratio Variable
You are doing a pre and post bronchodilator treatment trial for a new drug. You must establish baseline heart rate in your treatment group:
Identification of variable and values is essential to a successful project. Not only will doing this early in the process allow you to predict factors that may affect your research question, but it will also guide you toward the type of data you will collect and determine what kind of statistical analyses you will likely be performing in order to understand and present the results of your work.
Scales are used to glean insight into a situation or phenomenon and can be used to help quantify information that would otherwise be difficult to understand or convey. Although there are several types of scales used by researchers, we’ll focus on the two of the most common:
Sampling is the statistical process of selecting a subset (called a “sample”) of a population of interest for purposes of making observations and statistical inferences about that population. We cannot study entire populations because of feasibility and cost constraints, and hence, we must select a representative sample from the population of interest for observation and analysis. It is extremely important to choose a sample that is truly representative of the population so that the inferences derived from the sample can be generalized back to the population of interest. Probability sampling is a technique in which every unit in the population has a chance (non-zero probability) of being selected in the sample, and this chance can be accurately determined. An example of probability sampling is simple random sampling wherein you include ALL possible participants in a population and utilize a method to randomly select a sample that is representative of that population. Nonprobability Sampling is a sampling technique in which some units of the population have zero chance of selection or where the probability of selection cannot be accurately determined. Typically, units are selected based on certain non-random criteria, such as quota or convenience. Because selection is non-random, nonprobability sampling does not allow the estimation of sampling errors, and may be subjected to a sampling bias. Therefore, information from a sample cannot be generalized back to the population. An example of nonprobability sampling is utilizing a convenience sample of participants due to your close proximity or access to them.
When you measure a certain observation from a given unit, such as a person’s response to a Likert-scaled item, that observation is called a response. In other words, a response is a measurement value provided by a sampled unit. Each respondent will give you different responses to different items in an instrument. Responses from different respondents to the same item or observation can be graphed into a frequency distribution based on their frequency of occurrences. For a large number of responses in a sample, this frequency distribution tends to resemble a bell-shaped curve called a normal distribution, which can be used to estimate overall characteristics of the entire sample, such as sample mean (average of all observations in a sample) or standard deviation (variability or spread of observations in a sample). These sample estimates are called sample statistics (a “statistic” is a value that is estimated from observed data). Populations also have means and standard deviations that could be obtained if we could sample the entire population. However, since the entire population can never be sampled, population characteristics are always unknown, and are called population parameters (and not “statistic” because they are not statistically estimated from data). Sample statistics may differ from population parameters if the sample is not perfectly representative of the population; the difference between the two is called sampling error. Theoretically, if we could gradually increase the sample size so that the sample approaches closer and closer to the population, then sampling error will decrease and a sample statistic will increasingly approximate the corresponding population parameter.
If a sample is truly representative of the population, then the estimated sample statistics should be identical to corresponding theoretical population parameters. How do we know if the sample statistics are at least reasonably close to the population parameters? Here, we need to understand the concept of a sampling distribution . Imagine that you took three different random samples from a given population, as shown below, and for each sample, you derived sample statistics such as sample mean and standard deviation. If each random sample was truly representative of the population, then your three sample means from the three random samples will be identical (and equal to the population parameter), and the variability in sample means will be zero. But this is extremely unlikely, given that each random sample will likely constitute a different subset of the population, and hence, their means may be slightly different from each other. However, you can take these three sample means and plot a frequency histogram of sample means. If the number of such samples increases from three to 10 to 100, the frequency histogram becomes a sampling distribution. Hence, a sampling distribution is a frequency distribution of a sample statistic (like sample mean) from a set of samples, while the commonly referenced frequency distribution is the distribution of a response (observation) from a single sample. Just like a frequency distribution, the sampling distribution will also tend to have more sample statistics clustered around the mean (which presumably is an estimate of a population parameter), with fewer values scattered around the mean. With an infinitely large number of samples, this distribution will approach a normal distribution. The variability or spread of a sample statistic in a sampling distribution (i.e., the standard deviation of a sampling statistic) is called its standard error. In contrast, the term standard deviation is reserved for variability of an observed response from a single sample.
The mean value of a sample statistic in a sampling distribution is presumed to be an estimate of the unknown population parameter. Based on the spread of this sampling distribution (i.e., based on standard error), it is also possible to estimate confidence intervals for that prediction population parameter. Confidence interval is the estimated probability that a population parameter lies within a specific interval of sample statistic values. All normal distributions tend to follow a 68-95-99 percent rule (see below), which says that over 68% of the cases in the distribution lie within one standard deviation of the mean value (μ 1σ), over 95% of the cases in the distribution lie within two standard deviations of the mean (μ 2σ), and over 99% of the cases in the distribution lie within three standard deviations of the mean value (μ 3σ). Since a sampling distribution with an infinite number of samples will approach a normal distribution, the same 68-95-99 rule applies, and it can be said that:
A sample is “biased” (i.e., not representative of the population) if its sampling distribution cannot be estimated or if the sampling distribution violates the 68-95-99 percent rule. As an aside, note that in most regression analysis where we examine the significance of regression coefficients with p<0.05, we are attempting to see if the sampling statistic (regression coefficient) predicts the corresponding population parameter (true effect size) with a 95% confidence interval. Interestingly, the “six sigma” standard attempts to identify manufacturing defects outside the 99% confidence interval or six standard deviations (standard deviation is represented using the Greek letter sigma), representing significance testing at p<0.01.
There are many different approaches to research. The list provided here is not exhaustive by any means; rather, this is a brief list of the most common approaches you may identify as you review the literature related to your interest.
Experimental research is typically performed in a controlled environment so that the researcher can manipulate an independent variable and measure the outcome (dependent variable) between a group of subjects who received the manipulated variable (intervention) and a group of subjects who did not receive the intervention. This type of design typically adheres to the scientific method in order to test a hypothesis. A hypothesis is a proposed explanation for a phenomenon and serves as the starting point for the investigation. You may see a hypothesis indicated as (H O ), also called the null hypothesis. This is to differentiate it from an alternative hypothesis (H 1 or H A ), which is any hypothesis other than the null.
Development of the Hypothesis
There are two types of hypotheses, the null (HO) and an alternative (H 1 or H A )
NOTE: Accepting the null hypothesis would mean that your data confirm that there is no difference. Rejecting the null would mean that your data indicated that there is a significant difference in patient outcomes for these groups; therefore, rejecting the null means accepting an alternative hypothesis.
Randomized Experimental : Participants are randomly assigned to either a treatment (intervention) or a control group. Typically, the treatment group receives an intervention (independent variable) and the outcome of each group is considered dependent variables and compared for effect. Independent variables in this case are considered active in that this variable can be manipulated.
Example of Randomized Experimental Approach
You would like to assess outcomes as they relate to the post delivery resuscitation of very low birthweight infants in the delivery room. You have decided that one group will receive direct intubation and surfactant (intervention group) in the delivery room and the other will receive the standard care of CPAP (control group). Participants will be randomly assigned to groups and as a bonus, the assignment to groups will be blinded. You will then compare the difference between participants in each group regarding need for oxygen at 36 weeks adjusted gestational age.
Quasi Experimental : Similar to the randomized experimental approach aside from the random assignment. In quasi-experimental approaches, participants are NOT randomly assigned; however, one group does receive an intervention while the control group does not and outcomes are still compared. The independent variable is also active.
Example of Quasi Experimental Approach
You would like to assess outcomes as they relate to the post delivery resuscitation of very low birthweight infants in the delivery room. You have decided that one group will receive direct intubation and surfactant (intervention group) in the delivery room and the other will receive the standard care of CPAP (control group). Participants will be assigned to groups based on administration of maternal steroids. You will then compare the difference between participants in each group regarding need for oxygen at 36 weeks adjusted gestational age.
Non-experimental approaches include a wide variety of approaches; therefore, it is difficult to list them all in a succinct way here. However, it is safe to say that a study approach is considered non-experimental when there lacks intentional manipulation of the independent variable.
Comparative approach : Groups are compared to reveal differences in outcome (dependent variable). Groups are typically formed based on independent variables that cannot be manipulated but are important to the study. This type of independent variable is known as an attribute independent variable. In this approach there are a few categories (2-4 levels) of attribute independent variables that are then compared.
Example of Comparative Approach
You would like to investigate the perceptions of first and second year student-instructor engagement and student learning and instructor motivation in the clinical environment.
Associational or Correlational approach : Two or more variables for the same group of participants are explored for relationships. Independent variables are also attributive in this approach; meaning, they can be manipulated to impact the dependent variable. Variables included in this approach are typically continuous or have at least five ordered categories.
Example of Associational or Correlational Approach
You would like to conduct a study to better understand practitioner attitudes about the future of the profession.
Descriptive research : Projects which only gather data which can be described, not inferred. That is, results and data collected cannot be inferred back to the population nor can comparisons or associations be made. Many qualitative studies are considered descriptive. This is done by considering only one variable at a time and there is no independent variable.
Example of Descriptive Research
You would like to describe the development of a protocol to implement high flow nasal cannula as an intermediate therapy for acute respiratory failure to be used in the Emergency Department at your institution. You plan to compare rates of intubation before and after implementation of the protocol.
It is important to note that it is possible to have more than one approach in one research project. This is because the approach selected is specific to the question that has been asked. If there is more than one question asked, it is reasonable to assume that more than one approach may be used.
There are a few areas of research that although fit under the category of non-experimental; do not quite fit within the classifications presented here. Two of these areas are quality improvement (QI) projects and protocol development.
Quality improvement (QI) projects: The purpose of a QI project is to evaluate the performance of systems, processes, or practices to determine whether either function or operational improvements are needed. Using tools such as the SQUIRE explanation and elaboration guidelines , is extremely helpful in developing, conducting, and analyzing a thorough and impactful QI project.
The SQUIRE guidelines focus on the following four questions:
These four questions are then expanded upon to help develop the systematic approach to your inquiry and presentation of your findings. An extended investigation of this method is covered in Chapter 6.
Protocol Development
Before we dig too deep into the development of protocols, a clarification needs to be made regarding vocabulary relating to projects of this nature. Although frequently used interchangeably, the terms protocol and guideline are not synonymous. A protocol is described as an official procedure or system of rules governing a process. A guideline is a suggested course of action, policy, or conduct. In healthcare, this is an important distinction; a protocol is a course of action to which treatment must follow without deviation whereas a guideline, although firmly rooted in evidence, allows for deviation based on best judgment of a clinician or presentation of a specific case. Through a research lens, this distinction is important because the process by which these two objectives are realized are very different. The complete process for the development of guidelines which are generalizable beyond a specific situation is best outlined by the World Health Organization Handbook
The development of both guidelines often involves a team of people who are charged with first evaluating the existing evidence and then contributing an interpretation of that evidence toward the consensus of best practice. This is why guidelines are typically issued by federal or state agencies or professional organization. Protocols are generally less generalizable due to contextual constraints. However, even organizational protocols are not developed by a single individual. This does not mean, however, that you cannot begin the process of developing a guideline or protocol for your organization on you own; rather, it is important to frame the work you contribute as the foundation upon which a group can work toward the consensus of best practice. Typically, this initial work is referred to as a narrative review. A narrative review can be described as a broad perspective on a topic which may or may not be impacted by bias. This type of review differs from a systematic review in that it is understood that a narrative review may not encompass all relevant literature on a relevant topic as might a systematic review. Another note; the development of both guidelines and protocols is often an iterative process requiring several cycles of evaluation and revision. A systematic review is described as exhaustive review of the literature relevant to a specific topic. In addition to being exhaustive, a systematic review includes methodology which is both explicit and reproducible to select, evaluate, and synthesize ALL available evidence. A meta-analysis is a systematic approach to evaluating the data from independent studies of the same subject to evaluate overall trends. Often, a meta-analysis is part of a systematic review.
As we’ve discussed, there are several factors which will guide your approach selection. Emphasis should be placed on the development of your purpose and problem statements as well as your research question. Ambiguity in these areas may cause some confusion as you begin to consider what approach you will take to answer your question. Here we will work to narrow the scope of your approach using a systematic process and answering a few specific questions:
Step 1: Outlining your general purpose
Understanding the overarching goal of your study will help direct the rest of your approach. Here, you will ask yourself “What am I trying to do?”.
Step 2: Identifying your general approach
Earlier we discussed the difference between experimental and non-experimental approaches. As we mentioned, these are two broad categories of approaches. Your general purpose will determine which of these two general approaches you take. The determination here will point you toward a more focused, or specific, approach.
Step 3: Narrowing down your specific purpose
Now that you’ve decided what the general purpose and approach, you can begin to really narrow down the ‘how’ of your research. I find that this is best done by again asking yourself what you are really trying to do. Now that you understand the boundaries of your purpose and approach, you can work to understand the fine points about what types of interactions between variables you’re looking to explore and determine.
Step 4 : Selecting your specific approach
As you can see, there are specific words you should pay attention to when you’re describing your purpose. Given these key words, like ‘determine causality’, or ‘compare groups’, you’ll have a bit more direction as to what approach is most appropriate to identify the best answer to your question. Once we know what it is we really want to do with the information we’re planning to gather (variables), we can select an approach. Selecting your specific approach
Key Takeaways
There are several important concepts presented in this chapter:
Crawford, L.M., Burkholder, G.J., Cox, K.A. (2020). Writing the Research Proposal. In G.J. Burkholder, K.A Cox, L.M. Crawford, and J.H. Hitchcock (Eds.), Research design and methods: An applied guide for the scholar-practitioner (pp. 309-334). Sage Publications
Gliner, J.A., Morgan, G.A., & Leech, N.L. (2017). Research methods in applied settings: An integrated approach to design and analysis. Routledge
Defining a construct through your lens as a researcher. How you are choosing to describe the boundaries associated with your work
A measurable representation of an abstract construct
A variable that can explain another variable. A variable which may be manipulated (active) or describes (attribute) to affect an outcome
The variable which is measured as an outcome and is affected by the independent variable(s)
Variables that are explained by both the independent and dependent variables
Influence the relationship between the independent and dependent variable
A variable which has an impact on the dependent variable, but does not explain the outcome (dependent variable)
values within each variable.
The assignment of a number to an attribute to describe a variable
Variable with two or more layers but without a specific order
A variable which has a specific rank order but no specificity between the ranks
Rank ordered variable with specified intervals between ranks
Has a true zero within the scale against which it is measured
A tool, or measure, used to quantify material that may be difficult to do so otherwise
Nominal scale with two potential outcomes
Used to measure ordinal data with a ranking system
Method of selecting a subset of the population to study.
Method of sampling wherein potential for sampling is equally likely for the entire population
Method of sampling where in the likelihood of being selected into a sample is not equal across the population
Visual representation of how a sample falls around a mean
A proposed explanation for the observed phenomenon
A form of experimental study design were participants are randomly assigned to either an intervention or control group
A form of experimental design involving both intervention and control groups but lacks randomization
Groups of participants are compared to identify differences in outcome
Two or more variables for the SAME group of participants are explored for relationships
Research projects wherein data gathered and described, but no relationships are inferred
A subset of nonexperimental research wherein the performance of systems, processes, or practices are evaluated for either efficiency or effectiveness
An official procedure or system
A suggested course of action
A broad perspective on a topic, typically from the perspective of a single author
An exhaustive review of literature relevant to a specific topic; typically performed by a group of people
Systematic approach to evaluating data from independent studies on a topic to evaluate or identify trends
Research performed in a controlled environment in which a researcher can manipulate an independent variable and measure a dependent variable (outcome)
Broad category of research approaches which lack the manipulation of an independent variable
Practical Research: A Basic Guide to Planning, Doing, and Writing Copyright © by megankoster. All Rights Reserved.
The format of a literature review may vary from discipline to discipline and from assignment to assignment. However, a literature review must do these things:
Remember! A literature review is not a list describing or summarizing one piece of literature after another.
Try and avoid starting every paragraph with the name of a researcher or the title of the work. Rather, try organizing the literature review into sections that present themes or identify trends, including relevant theories. You are not trying to list all the material published on a topic, but to synthesize and evaluate it according to the guiding concept of your thesis or research question.
Report ADA Problems with Library Services and Resources
Run a free plagiarism check in 10 minutes, generate accurate citations for free.
Published on October 30, 2022 by Jack Caulfield . Revised on April 13, 2023.
The content of the conclusion varies depending on whether your paper presents the results of original empirical research or constructs an argument through engagement with sources .
Upload your document to correct all your mistakes in minutes
Step 1: restate the problem, step 2: sum up the paper, step 3: discuss the implications, research paper conclusion examples, frequently asked questions about research paper conclusions.
The first task of your conclusion is to remind the reader of your research problem . You will have discussed this problem in depth throughout the body, but now the point is to zoom back out from the details to the bigger picture.
While you are restating a problem you’ve already introduced, you should avoid phrasing it identically to how it appeared in the introduction . Ideally, you’ll find a novel way to circle back to the problem from the more detailed ideas discussed in the body.
For example, an argumentative paper advocating new measures to reduce the environmental impact of agriculture might restate its problem as follows:
Meanwhile, an empirical paper studying the relationship of Instagram use with body image issues might present its problem like this:
Avoid starting your conclusion with phrases like “In conclusion” or “To conclude,” as this can come across as too obvious and make your writing seem unsophisticated. The content and placement of your conclusion should make its function clear without the need for additional signposting.
Professional editors proofread and edit your paper by focusing on:
See an example
Having zoomed back in on the problem, it’s time to summarize how the body of the paper went about addressing it, and what conclusions this approach led to.
Depending on the nature of your research paper, this might mean restating your thesis and arguments, or summarizing your overall findings.
In an argumentative paper, you will have presented a thesis statement in your introduction, expressing the overall claim your paper argues for. In the conclusion, you should restate the thesis and show how it has been developed through the body of the paper.
Briefly summarize the key arguments made in the body, showing how each of them contributes to proving your thesis. You may also mention any counterarguments you addressed, emphasizing why your thesis holds up against them, particularly if your argument is a controversial one.
Don’t go into the details of your evidence or present new ideas; focus on outlining in broad strokes the argument you have made.
In an empirical paper, this is the time to summarize your key findings. Don’t go into great detail here (you will have presented your in-depth results and discussion already), but do clearly express the answers to the research questions you investigated.
Describe your main findings, even if they weren’t necessarily the ones you expected or hoped for, and explain the overall conclusion they led you to.
Having summed up your key arguments or findings, the conclusion ends by considering the broader implications of your research. This means expressing the key takeaways, practical or theoretical, from your paper—often in the form of a call for action or suggestions for future research.
An argumentative paper generally ends with a strong closing statement. In the case of a practical argument, make a call for action: What actions do you think should be taken by the people or organizations concerned in response to your argument?
If your topic is more theoretical and unsuitable for a call for action, your closing statement should express the significance of your argument—for example, in proposing a new understanding of a topic or laying the groundwork for future research.
In a more empirical paper, you can close by either making recommendations for practice (for example, in clinical or policy papers), or suggesting directions for future research.
Whatever the scope of your own research, there will always be room for further investigation of related topics, and you’ll often discover new questions and problems during the research process .
Finish your paper on a forward-looking note by suggesting how you or other researchers might build on this topic in the future and address any limitations of the current paper.
Full examples of research paper conclusions are shown in the tabs below: one for an argumentative paper, the other for an empirical paper.
While the role of cattle in climate change is by now common knowledge, countries like the Netherlands continually fail to confront this issue with the urgency it deserves. The evidence is clear: To create a truly futureproof agricultural sector, Dutch farmers must be incentivized to transition from livestock farming to sustainable vegetable farming. As well as dramatically lowering emissions, plant-based agriculture, if approached in the right way, can produce more food with less land, providing opportunities for nature regeneration areas that will themselves contribute to climate targets. Although this approach would have economic ramifications, from a long-term perspective, it would represent a significant step towards a more sustainable and resilient national economy. Transitioning to sustainable vegetable farming will make the Netherlands greener and healthier, setting an example for other European governments. Farmers, policymakers, and consumers must focus on the future, not just on their own short-term interests, and work to implement this transition now.
As social media becomes increasingly central to young people’s everyday lives, it is important to understand how different platforms affect their developing self-conception. By testing the effect of daily Instagram use among teenage girls, this study established that highly visual social media does indeed have a significant effect on body image concerns, with a strong correlation between the amount of time spent on the platform and participants’ self-reported dissatisfaction with their appearance. However, the strength of this effect was moderated by pre-test self-esteem ratings: Participants with higher self-esteem were less likely to experience an increase in body image concerns after using Instagram. This suggests that, while Instagram does impact body image, it is also important to consider the wider social and psychological context in which this usage occurs: Teenagers who are already predisposed to self-esteem issues may be at greater risk of experiencing negative effects. Future research into Instagram and other highly visual social media should focus on establishing a clearer picture of how self-esteem and related constructs influence young people’s experiences of these platforms. Furthermore, while this experiment measured Instagram usage in terms of time spent on the platform, observational studies are required to gain more insight into different patterns of usage—to investigate, for instance, whether active posting is associated with different effects than passive consumption of social media content.
If you’re unsure about the conclusion, it can be helpful to ask a friend or fellow student to read your conclusion and summarize the main takeaways.
You can also get an expert to proofread and feedback your paper with a paper editing service .
The conclusion of a research paper has several key elements you should make sure to include:
No, it’s not appropriate to present new arguments or evidence in the conclusion . While you might be tempted to save a striking argument for last, research papers follow a more formal structure than this.
All your findings and arguments should be presented in the body of the text (more specifically in the results and discussion sections if you are following a scientific structure). The conclusion is meant to summarize and reflect on the evidence and arguments you have already presented, not introduce new ones.
If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.
Caulfield, J. (2023, April 13). Writing a Research Paper Conclusion | Step-by-Step Guide. Scribbr. Retrieved July 4, 2024, from https://www.scribbr.com/research-paper/research-paper-conclusion/
Other students also liked, writing a research paper introduction | step-by-step guide, how to create a structured research paper outline | example, checklist: writing a great research paper, get unlimited documents corrected.
✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts
COMMENTS
Recommendations for future research should be: Concrete and specific. Supported with a clear rationale. Directly connected to your research. Overall, strive to highlight ways other researchers can reproduce or replicate your results to draw further conclusions, and suggest different directions that future research can take, if applicable.
Here are some steps to consider when writing research recommendations: ... research instruments, data analysis methods, or other relevant factors. Justify recommendations: Justify why each recommendation is being made and how it will help to address the research question or objective. It is important to provide a clear rationale for each ...
Here is a step-wise guide to build your understanding on the development of research recommendations. 1. Understand the Research Question: Understand the research question and objectives before writing recommendations. Also, ensure that your recommendations are relevant and directly address the goals of the study. 2.
Recommendation in research : The current study can be interpreted as a first step in the research on differentiated instructions. However, the results of this study should be treated with caution as the selected participants were more willing to make changes in their teaching models, limiting the generalizability of the model.
3. Your recommendations should be as succinct as possible, and start with an action verb (create, establish, fund, facilitate, coordinate, etc.). Consider using a "SMART" format (Specific, Measurable, Attainable, Realistic, Timely). 4. Your recommendations should be communicated clearly and effectively, using language that is
Initially, group members interpreted E differently. Some viewed it as the supporting evidence for a research recommendation and others as the suggested study type for a research recommendation. After discussion, we agreed that E should be used to refer to the amount and quality of research supporting the recommendation.
How to formulate research recommendations. "More research is needed" is a conclusion that fits most systematic reviews. But authors need to be more specific about what exactly is required. Long awaited reports of new research, systematic reviews, and clinical guidelines are too often a disappointing anticlimax for those wishing to use them ...
The proceedings should be recorded and a clear statement made about the factors that have been considered and the methods used to achieve consensus. ... 7.3 Format and wording of recommendations. Writing the recommendations is 1 of the most important and difficult steps in developing guidance. ... All proposed research recommendations should be ...
You can begin writing the introductory section of the report as soon as you have decided on the general approach your study will follow. You don't have to wait until you have determined all the details of the method. 2. You can write the method section of the report before you have analyzed the data.
A good research question is essential to guide your research paper, dissertation, or thesis. All research questions should be: Focused on a single problem or issue. Researchable using primary and/or secondary sources. Feasible to answer within the timeframe and practical constraints. Specific enough to answer thoroughly.
The topic must at least be: interesting to you (ideally, you should have come across a series of recent papers related to your line of work that call for a critical summary), an important aspect of the field (so that many readers will be interested in the review and there will be enough material to write it), and.
Here, we offer ten simple rules for writing and publishing research papers. As a caveat, this essay is not about the mechanics of composing a paper, much of which has been covered elsewhere, e.g., , . Rather, it is about the principles and attitude that can help guide the process of writing in particular and research in general.
This article provides an overview of writing for publication in peer-reviewed journals. While the main focus is on writing a research article, it also provides guidance on factors influencing journal selection, including journal scope, intended audience for the findings, open access requirements, and journal citation metrics.
Develop a thesis statement. Create a research paper outline. Write a first draft of the research paper. Write the introduction. Write a compelling body of text. Write the conclusion. The second draft. The revision process. Research paper checklist.
When choosing sources, note that scholarly articles and books are considered appropriate for academic use, while other types of sources require further evaluation. When evaluating research to use in an academic paper or professional documents, consider the following criteria and apply the C.R.A.A.P.O. test.
A recommendation report identifies possible ways of meeting a business need or solving a complex problem. In writing research recommendations, know what factors should be considered. Data should drive the process starting with research and culminating in recommendations supported by facts.
Dr. Mark A. Baron Division of Educational Administration University of South Dakota Guidelines for Writing Research Proposals and Dissertations. The following information presents guidelines for preparing and writing research papers and reports, including theses and dissertations. While these guidelines are generally applicable, specific format ...
As we've discussed, there are several factors which will guide your approach selection. Emphasis should be placed on the development of your purpose and problem statements as well as your research question. Ambiguity in these areas may cause some confusion as you begin to consider what approach you will take to answer your question.
However, a literature review must do these things: Be organized around and related directly to the thesis or research question you are developing. Synthesize results into a summary of what is and is not known. Identify problematic areas or areas of controversy in the literature. Formulate questions or issues that need further research.
Table of contents. Step 1: Restate the problem. Step 2: Sum up the paper. Step 3: Discuss the implications. Research paper conclusion examples. Frequently asked questions about research paper conclusions.
Recommendations are any additional guidelines you want others to follow while carrying out future research. These are based on what you have learned or on potential future activities that you might be interested in. Further explanation. Recommendations should begin with an action verb, be one sentence long, and be concise (create, establish ...