Table 5

List of coded criticisms and definitions

CriticismExamplesAssessments identified in
Estimates were substantially higher than comparable independent estimates

  • Results are compared with independent estimates and found to suggest higher levels of ITT.

 1 37 41 44–47 54–63 65–67 69–75 77–80
Criticism of collection methodology

  • Data collection method is inappropriate/unsuitable including: data collection process requires later manufacturer involvement to identify counterfeits.

    • Measurements are defined incorrectly and/or different types of duty-not-paid products are not distinguished between during the data collection process.

    • Data collection process does not lead to a representative sample, meaning results are not generalisable.

    • Data collection process is not transparent.

 1 37 41 44–48 54–58 60–63 65 66 68–71 75–80
Criticism of analytical method

  • Analytical method is inappropriate/unsuitable including:

    • Does not account for non-response rates or sampling error.

    • Analysis contains errors or mistakes that may influence its estimates.

    • There is insufficient cross-validation to support findings.

    • Analysis process is not transparent.

 1 44 46–48 54 55 57 59–61 65 66 68–71 74 75 78–80
Poor presentation of results

  • Results are not presented adequately (eg, in a range or with CIs).

  • Results are presented in a misleading manner.

  • There are problems with study’s glossary/definitions.

  • Methodological limitations are not discussed.

  • Biased representation of existing literature.

 1 37 44 46 48 54 55 57 58 60 66 67 70 71 73–76 78–80
Funding is a conflict of interest

  • Tobacco industry funding represents a conflict of interest.

 37 44 46 48 54 62 73–77 80
Author/s do not take responsibility for findings

  • Authors openly distance themselves from the findings, eg, there is a disclaimer about using the results at your own risk.

 54 57 60 68 71 75 78 80
Not peer-reviewed

  • No reference to a peer-review process.

 37 54 75
Research contributes nothing of value

  • The research findings contribute nothing new or worthwhile to the pool of research on illicit trade.

 55 74 80
Funding is not acknowledged

  • No acknowledgement of funding sources.

 54