Expert report review
Footwear and toolmark conclusion scales: what do identification, probably made and inconclusive mean in the examiner's report?
A footwear report can end with one of seven conclusions under the SWGTREAD standard of 2013 or one of six under the Department of Justice language of 2020. A toolmark report from a DOJ laboratory has three. Each word on these scales has a written definition, and the definitions limit what the examiner may say in court. A review of the opposing report starts by matching the conclusion to the scale the laboratory used.

What is a conclusion scale in a footwear, tire or toolmark report?
A fixed list of permitted conclusions, each with a written definition and stated criteria. The examiner picks one level, and the report has to show the observations that meet the criteria for that level.
Impression examiners compare a questioned mark from the scene with a known item: a shoe, a tire or a tool. They do not report a free-form opinion. Laboratories adopt a scale, and the report states which level the comparison reached. The level carries a meaning set in advance, so a jury or a judge can compare the words in the report with the published definition.
Two documents govern most footwear and tire reports in the United States. The Scientific Working Group for Shoeprint and Tire Tread Evidence (SWGTREAD) published the Range of Conclusions Standard for Footwear and Tire Impression Examinations in March 2013. The Department of Justice issued the Uniform Language for Testimony and Reports for the Forensic Footwear Discipline, effective August 15, 2020, for its own laboratories. Toolmark reports from DOJ laboratories follow the Uniform Language for Testimony and Reports for the Forensic Firearms/Toolmarks Discipline, Pattern Examination, effective August 16, 2023.
State and local laboratories choose their own scale. Their procedures manual names it. A reviewer asks for that manual with the case file, because the same words can carry different definitions in two laboratories.
What are the seven levels of the SWGTREAD scale?
Lacks sufficient detail, exclusion, indications of non-association, limited association of class characteristics, association of class characteristics, high degree of association, and identification. Each level lists the characteristics that must be present.
Identification is "the highest degree of association expressed by a footwear and tire impression examiner." The questioned impression and the known item "share agreement of class and randomly acquired characteristics" of sufficient quality and quantity, and the standard treats another item being the source as "a practical impossibility."
High degree of association requires correspondence in design, physical size and general wear, plus either wear that is unusual by its location, degree and orientation, or one or more randomly acquired characteristics. The standard states that the quality or quantity of those features was "insufficient for an identification." Other shoes or tires remain possible sources only if they show the same wear or randomly acquired characteristics.
Association of class characteristics requires that design and physical size correspond. The opinion at this level is that the known item "is a possible source of the questioned impression," and every other item with the same class characteristics stays in the population of possible sources. Limited association of class characteristics is weaker: some class characteristics agree, but limiting factors such as insufficient detail, lack of scale, distortion or a long time between the occurrence and the recovery of the footwear prevent a stronger association.
At the other end, exclusion is "the highest degree of non-association," based on sufficient differences in class or randomly acquired characteristics. Indications of non-association means dissimilarities were seen but the details were not clear enough for an exclusion. Lacks sufficient detail covers two cases: no comparison was possible, or a comparison was made and the questioned impression had too little detail for a meaningful conclusion. The standard notes that this result applies only to the item examined.
How does the DOJ footwear language word the same conclusions?
It uses six conclusions: source identification, inclusion based on class and randomly acquired characteristics, inclusion based on class characteristics, inconclusive, support for exclusion and source exclusion.
Under the 2020 DOJ document, source identification is "an examiner's conclusion that the known footwear item made the questioned impression." Inclusion based on class and randomly acquired characteristics means the known item "probably made the questioned impression." Inclusion based on class characteristics means the known item "could have made the questioned impression."
Inconclusive means "no determination can be reached" as to whether the known item could or could not have made the impression. Support for exclusion means the item "probably did not make the questioned impression," and source exclusion means it did not make it.
The DOJ scale has no separate level for limited association and no level named high degree of association. A SWGTREAD report that ends at high degree of association and a DOJ report that ends at inclusion based on class and randomly acquired characteristics both stop short of identification, and both rest on randomly acquired characteristics. The reviewer reads the definitions side by side before treating the two as equal.
Why does a DOJ toolmark report have only three conclusions?
The 2023 DOJ firearms and toolmarks language permits only source identification, source exclusion and inconclusive. There is no probable or possible level between them.
Source identification is "an examiner's conclusion that two toolmarks originated from the same source." The definition requires that all observed class characteristics agree and that the examiner "would not expect to find that same combination of individual characteristics repeated in another source."
Inconclusive means all observed class characteristics agree, but the quality or quantity of corresponding individual characteristics is insufficient to identify or exclude. The DOJ text defines inconclusive as one of the permitted conclusions and does not call it an error.
For the defense, the inconclusive definition matters in two ways. A report that says the tool "cannot be eliminated" or that the marks are "consistent with" the tool uses words outside the DOJ scale, and the reviewer asks which level they correspond to. A report that reaches inconclusive has stated that class characteristics agree, so the reviewer checks how many tools of the same make and type share those class characteristics.
What wording may a DOJ examiner not use in a report or in testimony?
The footwear and toolmark documents bar claims of uniqueness, individualization, exclusion of all other sources, infallibility, unsupported statistics, career counts as proof of accuracy and reasonable scientific certainty.
Both DOJ documents contain a section of qualifications and limitations. Under the footwear text an examiner shall not assert that a source identification or exclusion is based on the "uniqueness" of an item, shall not use the terms "individualize" or "individualization," and shall not assert that the known item made the impression "to the exclusion of all other footwear items."
The examiner also shall not assert that examinations "are infallible or have a zero error rate," shall not give a statistic or numerical degree of probability "except when based on relevant and appropriate data," and shall not cite the number of examinations performed in a career as a direct measure of accuracy.
The last limit concerns certainty. The examiner shall not assert that the item made the impression with "absolute or 100% certainty" and shall not use "reasonable degree of scientific certainty" or similar phrases, unless a judge or applicable law requires it. The toolmark document repeats each of these limits for toolmarks.
A reviewer compares these lists with the report, the bench notes and, where available, earlier testimony of the same examiner. A phrase from the banned list is a fact the attorney can put to the examiner in cross-examination or in a motion to limit testimony.
What must accompany a conclusion that the shoe probably made or could have made the impression?
Under the DOJ footwear language, either inclusion conclusion must come with an explanation that other footwear with indistinguishable characteristics could also have made the impression.
The DOJ footwear text states that an examiner shall not provide either of the two inclusion conclusions "unless he or she also explains that there may be other footwear items with characteristics that are indistinguishable from the known footwear item that could have also made the questioned impression."
The reviewer checks whether that explanation appears in the report itself or only in the bench notes. A report that says the shoe "probably made" the print without the explanation departs from the DOJ text. For a report from a laboratory outside DOJ, the reviewer checks the laboratory's own manual for a comparable rule.
For a class-level conclusion the reviewer also asks how common the design and size are. SWGTREAD states that at the association of class characteristics level all footwear with the same class characteristics stays in the population of possible sources. The report should say whether the examiner had any data on how many shoes of that design and size were made or sold.
Do different examiners reach the same conclusion on the same mark?
Not always. A 2022 study of 84 footwear examiners found 0.2 percent erroneous identifications and 6.0 percent erroneous exclusions, and a 1999 survey of 23 experts found wide spread on two casework prints.
Hicklin and co-authors published the study in Forensic Science International, volume 339, in 2022. In it, 84 practicing footwear examiners each conducted up to 100 comparisons, for a total of 6,610. Forty percent of responses were definitive conclusions, identification or exclusion. Of the conclusions, 0.2 percent were erroneous identifications and 6.0 percent were erroneous exclusions. The authors reported that most erroneous identifications came from a single participant and that examiners were inconsistent in judging whether an impression was suitable for comparison.
The same study reported that rates of correct definitive conclusions "are directly associated with the quality of the questioned impression." For a review, this links the conclusion level to the photographs: a strong conclusion on a partial or distorted print needs an explanation in the case file.
An earlier survey by Shor and Weisner, published in the Journal of Forensic Sciences in 1999, asked 23 experts to compare two sets of shoeprints taken in actual cases; the experts worked in seven laboratories in six countries. Ten responses fell in the inconclusive and possible range, and the rest in the probable, highly probable and identification range. The authors chose these cases because the original examiners had disagreed.
How does the wording of the conclusion matter under Rule 702?
Rule 702, as amended in 2023, requires the proponent to show the court that it is more likely than not that the opinion applies the method reliably to the case. A conclusion stronger than the scale permits invites that challenge.
Federal Rule of Evidence 702 lets a qualified expert testify if the proponent shows the court that it is more likely than not that the testimony will help the trier of fact, rests on sufficient facts or data, is the product of reliable principles and methods, and applies them reliably to the facts of the case. Subsection (d) addresses the application: the opinion must reliably apply the method to the case.
A conclusion scale is part of the method. If the laboratory's scale defines identification by agreement in class and randomly acquired characteristics of sufficient quality and quantity, the reviewer checks whether the bench notes record those characteristics. If the report states identification and the notes list only design and size, the conclusion sits above what the recorded observations support under the laboratory's own definitions.
In federal civil cases, Rule 26(a)(2)(B) requires a retained expert's report to contain a complete statement of all opinions, their basis and reasons, and the facts or data considered. In criminal cases, discovery of the examiner's file follows the criminal rules and the court's orders, and the reviewer lists the items the review needs.
What does a reviewer check in the conclusion of the opposing report?
The scale the laboratory used, the level reached, the observations recorded for that level, the required explanations, the banned phrases, the quality of the questioned mark and the verification record.
The reviewer works from the report, the bench notes, the photographs with scales and the laboratory manual. The checks follow a fixed order so that each finding is tied to a page and a rule.
- The reviewer identifies the scale named in the laboratory manual and the version in force on the date of the examination.
- The reviewer matches the words of the conclusion with one level of that scale and notes any wording outside it.
- The reviewer lists the class characteristics and randomly acquired characteristics recorded in the notes and compares them with the criteria for the level.
- The reviewer checks for the explanation that other items with indistinguishable characteristics could have made the impression, where the scale requires it.
- The reviewer checks the report and earlier testimony for banned terms such as individualization, zero error rate or reasonable scientific certainty.
- The reviewer assesses the photographs of the questioned mark for scale, distortion and detail, since the 2022 study tied correct conclusions to impression quality.
- The reviewer checks whether a second examiner verified the conclusion, whether the verification was blind and who performed it.
What does IAE do when the opposing report states a footwear, tire or toolmark conclusion?
IAE reviews the opposing examiner's report and case file in US criminal defense and cargo loss cases, including the conclusion wording and verification record. The review takes up to 5 business days, or 48 hours on rush.
The IAE review of impression and toolmark reports covers footwear, tire and toolmark reports: documentation, class and subclass marks, test marks, verification and the wording of the conclusion against the DOJ limits. The review checks the case file against the standard for that kind of mark, and each point is linked to a page of the report or the bench notes and to a standard, a DOJ rule or a ruling.
IAE confirms the questions with the client before work starts. The secretariat confirms receipt the same day, and IAE then confirms the format, the cost, the deadline and the specialist from its registry. The client approves the candidate and the CV before work starts.
Every specialist is a member of the public IAE registry, verified by Member ID or QR code, and confirms in the document that he or she has no interest in the outcome. Materials are not passed to third parties without the client's consent. The court weighs a review with the other evidence, and neither IAE nor the reviewer guarantees the outcome. IAE is not a law firm and does not advise on case strategy.
Sources
- SWGTREAD, Range of Conclusions Standard for Footwear and Tire Impression Examinations, 03/2013 (NIST)
- U.S. Department of Justice, Uniform Language for Testimony and Reports for the Forensic Footwear Discipline, effective 8.15.20
- U.S. Department of Justice, Uniform Language for Testimony and Reports for the Forensic Firearms/Toolmarks Discipline, Pattern Examination, effective 8.16.23
- Hicklin R. A. et al. Accuracy, reproducibility, and repeatability of forensic footwear examiner decisions. Forensic Science International 339 (2022) (Noblis)
- Hicklin R. A. et al. Accuracy, reproducibility, and repeatability of forensic footwear examiner decisions, 2022 (National Institute of Justice)
- Shor Y., Weisner S. Survey on the conclusions drawn on the same footwear marks obtained in actual cases by several experts throughout the world. Journal of Forensic Sciences 44(2), 1999, 380-384 (NCJRS abstract)
- Federal Rules of Evidence, Rule 702, Testimony by Expert Witnesses (LII, Cornell Law School)
- Federal Rules of Civil Procedure, Rule 26 (LII, Cornell Law School)
Read also
All articles
Can the prosecution use a toolmark or footwear report without calling the examiner who did the comparison?
A toolmark or footwear report rests on a comparison that a particular examiner made, and the case file can show who else made test marks, verified
Contextual bias in footwear and toolmark examinations: what was the examiner told, and what does a reviewer check?
A footwear or toolmark examiner who knows that the suspect confessed, has a record or was linked by other evidence has received information
Who can review a toolmark or footwear examiner's report, and what qualifies an impression examiner?
A review of a toolmark or footwear report is written by an examiner trained and certified in the same discipline as the opposing opinions. Rule 702Expert report review
Ready to discuss your case?
Send the materials: the secretariat will confirm the format, cost, deadline and the specialist within one business day.

