The librarians at Curtin University have developed an excellent page on critical appraisal of studies, which can be found here.
The Centre for Evidence-Based Medicine (CEBM) also has tools to help with critical appraisal.
You can find more information about "assessing the quality of a body of evidence" in Finding What Works in Health Care, from Eden et al. (Start with page 166.)
Photo by Olu Eletu