What are the challenges of interpreting data, reports, and media coverage surrounding the COVID-19 pandemic? This white paper provides some examples of challenges that researchers face when working to answer key questions related to COVID-19, illustrates the ways that a variety of seemingly reasonable assumptions can lead to widely divergent conclusions, and presents key constructs for those invested in becoming more informed and critical consumers of COVID-19 research.