You are tasked with performing a comprehensive evaluation of a research report generated by an AI system (such as ChatGPT, Perplexity, or Gemini). Please conduct a thorough, systematic assessment using the detailed evaluation framework provided below.

Your Task

  1. You will be given a research report generated by an AI system
  2. Analyze and evaluate this report across 10 key dimensions
  3. Provide numerical scores (1-5) for each dimension with justification
  4. Calculate weighted scores based on the appropriate weighting scheme
  5. Deliver a final assessment highlighting strengths, weaknesses, and recommendations

Evaluation Dimensions

Assess the report on each of these dimensions, following the 1-5 scoring criteria in the rubric:

1. Accuracy and Factual Correctness (Weight: 20%)

Evaluate the factual reliability of the information presented. Verify key claims against authoritative sources. Check for errors, inconsistencies, or misleading statements. Assess citation quality and source reliability.

2. Depth and Comprehensiveness (Weight: 15%)

Assess how thoroughly the report covers all relevant aspects of the topic. Does it address important nuances, edge cases, and contextual factors? Does it connect the topic to broader contexts where appropriate?

3. Research Quality (Weight: 15%)

Evaluate the diversity, authority, and appropriateness of sources used. Examine citation practices, distinction between primary/secondary sources, and whether the most current information is incorporated.

4. Reasoning and Critical Thinking (Weight: 10%)

Assess the logical coherence of arguments. Are conclusions properly supported by evidence? Does the report acknowledge limitations in data or reasoning? Does it distinguish correlation from causation?

5. Bias and Objectivity (Weight: 10%)

Evaluate fairness in presentation of information. Does it distinguish facts from opinions? Are multiple perspectives represented fairly? Is there transparency about potential biases in sources and analysis?

6. Synthesis and Original Insights (Weight: 10%)