Potential issues and suggested solutions
The methods used to search for relevant sources/data is not described [Criterion A]
In the early part of the essay make sure there is information about the strategy used to search for publications and data. What search engine / key terms / websites were used.
The criteria used to select sources/data for inclusion are not described. [Criterion A]
In the early part of the essay make sure there is information about the criteria that were applied are described and justified.
The essay is descriptive [Criteria B and C]
This can happen when there is not a well-defined research question and when the essay is simply a review of literature or a presentation of ideas on a topic. This problem can be avoided by ensuring that there is a clearly defined research question, that variables are clearly identified, and that the selection of literature and data is designed to address this question. There can then be a clear line of argument linking the data and the findings to the original question. It may be necessary to amend the research question. It is also helpful to define a theoretical background and refer to it.
Ensure that the essay is based on data derived from the sources and that the variables defined in the research question can be addressed. The essay should go beyond simply re-presenting the data and should involve processing steps that the candidate has applied. The data can then be subject to processing steps that address the research question (calculations, comparisons, graphical analysis, statistical analysis).
There is no data analysis. [Criterion C]
If statistical analysis is used, students should ensure that a clear explanation of its application is included.
The sources accessed are too complex to understand or to critically evaluate. [Criteria A, B and C]
Only sources that are easily understood should be used. This applies to both the findings and the methods used. Sources that require extensive descriptive accounts and precise technical language in order for the data to be understood should be avoided.
The sources accessed require extensive use of complex and topic-specific terminology. [Criterion B]
Avoid topics and research that require extensive use of complex terminology; this can result in a “cut and pasted” type of essay, which includes little input from the student. When precise subject specific or topic specific terminology is needed make sure it is well explained and used judiciously.
There is no critical evaluation of the methods used to obtain and select data [Criterion C]
An essay based on secondary data should provide two levels of critical evaluation. On the one hand the methods used be the researchers to collect the data reported in the sources can be critically evaluated. However, this is often difficult to do, especially if the candidate is unfamiliar with those methods or if they are very complex. In addition, there should be a critical evaluation of the methods used to find and select sources to be included in the essay. Has the search been extensive enough? Is it possible that important perspectives were overlooked? Are the sources all reliable and up to date? Have any of the sources been criticized by other researchers? Is there any potential for bias in the selection process?
