← Về thư mục
📄 / / profiles / r-and-d / raw_evidence / scientific-agent-skills / skills / scientific-critical-thinking / references / scientific_method.md

Scientific Method Core Principles

Fundamental Principles

1. Empiricism

2. Falsifiability (Popper's Criterion)

3. Reproducibility

4. Parsimony (Occam's Razor)

5. Systematic Observation

The Scientific Process

1. Question Formation

2. Literature Review

3. Hypothesis Development

4. Experimental Design

5. Data Collection

6. Analysis

7. Interpretation

8. Communication

Critical Evaluation Criteria

When Reviewing Scientific Work, Ask:

Validity Questions: - Does the study measure what it claims to measure? - Are the methods appropriate for the research question? - Were controls adequate? - Could confounding variables explain the results?

Reliability Questions: - Are measurements consistent? - Would the study produce similar results if repeated? - Are inter-rater reliability and measurement precision reported?

Generalizability Questions: - Is the sample representative of the target population? - Are the conditions realistic or artificial? - Do the results apply beyond the specific context?

Statistical Questions: - Is the sample size adequate for the analysis? - Are the statistical tests appropriate? - Are effect sizes reported alongside p-values? - Were multiple comparisons corrected?

Logical Questions: - Do the conclusions follow from the data? - Are alternative explanations considered? - Are causal claims supported by the study design? - Are limitations acknowledged?

Red Flags in Scientific Claims

  1. Cherry-picking data - Highlighting only supporting evidence
  2. Moving goalposts - Changing predictions after seeing results
  3. Ad hoc hypotheses - Adding explanations to rescue a failed prediction
  4. Appeal to authority - "Expert X says" without evidence
  5. Anecdotal evidence - Relying on personal stories over systematic data
  6. Correlation implies causation - Confusing association with causality
  7. Post hoc rationalization - Explaining results after the fact without prediction
  8. Ignoring base rates - Not considering prior probability
  9. Confirmation bias - Seeking only evidence that supports beliefs
  10. Publication bias - Only positive results get published

Standards for Causal Inference

Bradford Hill Criteria (adapted)

  1. Strength - Strong associations are more likely causal
  2. Consistency - Repeated observations by different researchers
  3. Specificity - Specific outcomes from specific causes
  4. Temporality - Cause precedes effect (essential)
  5. Biological gradient - Dose-response relationship
  6. Plausibility - Coherent with existing knowledge
  7. Coherence - Consistent with other evidence
  8. Experiment - Experimental evidence supports causation
  9. Analogy - Similar cause-effect relationships exist

Establishing Causation Requires:

Peer Review and Scientific Consensus

Understanding Peer Review

Scientific Consensus

Open Science Principles

Transparency Practices

Why Transparency Matters