Trawling through the latest health advice cannot only be utterly overwhelming but incredibly tempting at leading you down rabbit holes of over generalised and quite frankly, false claims! Here we look into what makes a more trustworthy information source.
At MindStudio, we use the biopsychosocial model that understands the importance of integrating a person's biological, psychological and social needs. As you would imagine, this approach could involve many different health and wellness suggestions and interventions. Understanding the latest evidence base and critically appraising our approach as a healthcare provider and as individuals is crucial to our integrity.
There is so much information out there these days and so many changing claims to the newest health fad that it is hard to know your arse from your elbow. Navigating the world of health information can be overwhelming, especially when determining which sources, studies and articles are reliable. Whether you’re reading about a new diet trend, a breakthrough supplement, or a longevity hack, understanding how to assess the quality of the information can be really important. Here’s a simple guide to help you evaluate empirical data and research studies effectively.
Quantitative Studies involve numerical data and statistical analysis. They often seek to find patterns, test hypotheses, and make predictions. Examples include clinical trials, cohort studies, and case-control studies.
Qualitative Studies focus on understanding human behaviour and the reasons that govern such behaviour. They are descriptive and involve non-numerical data like interviews, observations, and written documents. Examples include ethnographic studies, phenomenological studies, and grounded theory studies.
1. Clear Research Question or Hypothesis
• The study should have a clear and focused research question or hypothesis. This sets the stage for the research and determines the direction of the study.
2. Well-Designed Methodology
• Quantitative Studies: Look for studies with a robust design, such as randomised controlled trials (RCTs) or well-conducted cohort studies. RCTs are often considered the gold standard because they minimise bias.
• Qualitative Studies: The methodology should be appropriate for the research question. Methods like in-depth interviews, participant observations, and focus groups should be clearly described.
3. Sample Size and Selection
• Quantitative: A larger sample size generally increases the reliability of the results. The sample should be representative of the population being studied.
• Qualitative: The sample should sufficiently reach data saturation (no new information is being discovered). The selection process should be well-defined and appropriate for the research question.
4. Data Collection and Analysis
• The process for collecting and analysing data should be transparent and rigorous.
• Quantitative: Look for detailed descriptions of how data was collected and analysed, including statistical methods.
• Qualitative: Check for thorough documentation of how data was gathered, coded, and interpreted.
5. Peer Review and Publication
• Studies published in reputable, peer-reviewed journals have undergone scrutiny by experts in the field, which typically ensures a higher quality of research.
6. Conflicts of Interest and Funding Sources
• Disclosures about funding sources and potential conflicts of interest are crucial. Research funded by organisations with a vested interest in the results may be biased.
When reading health articles, consider the following:
1. Source Credibility
• Prefer articles from reputable sources such as high-quality research journals with rigorous peer reviews, a reputable editorial board, diverse perspectives and ethical standards.
2. Author Qualifications
• Check the credentials of the author(s). Experts in the field or journalists with a history of accurate health reporting are more reliable.
3. References and Citations
• High-quality articles should reference scientific studies and sources. Cross-check these references to ensure they are from reputable, peer-reviewed journals.
4. Balanced Reporting
• Be wary of articles that make extraordinary and generalised claims without supporting evidence. Reliable articles present both strengths and limitations of the research and avoid sensationalism.
5. Publication Date
• Health information evolves rapidly. Ensure that the information is current and reflects the latest research findings.
1. Lack of Peer Review
• Studies that haven’t been peer-reviewed may not have been critically evaluated by experts in the field.
2. Small Sample Sizes
• Studies with very small sample sizes may not provide reliable results that are generalisable to larger populations.
3. Conflicts of Interest
• Research funded by parties with a stake in the outcomes (e.g., pharmaceutical companies, food industry) should be viewed with caution, especially if conflicts are not disclosed.
4. Overgeneralisation of Results
• Be cautious of studies that make broad claims based on limited or specific data.
5. Unsupported Claims
• Avoid articles that make health recommendations or conclusions without citing credible scientific evidence.
Assessing the quality of empirical data and research studies doesn’t require a scientific background; it just needs a bit of time, critical thinking and attention to detail. Don't just accept information, ensure you know how to analyse it, how it applies to you and even how it feels when you read it. Be mindful you are not looking for another quick fix. By understanding the basics of study design, recognising credible sources, and being aware of potential biases, you can make more informed decisions about your health and the health information you consume. Remember, high-quality studies are transparent, well-documented, and conducted without conflicts of interest, ensuring that the findings are reliable and valuable.
