Expert report review

Who can review a toolmark or footwear examiner's report, and what qualifies an impression examiner?

A review of a toolmark or footwear report is written by an examiner trained and certified in the same discipline as the opposing opinions. Rule 702 sets the legal test, and published guidelines give the content: a training program of 18 to 30 months for firearm and toolmark examiners in the SWGGUN document, two years of casework in the 2006 minimum qualifications, and separate AFTE and IAI certifications with written and practical examinations.

A blank certificate folder lies beside a plaster shoe cast and a metal tool, a reviewer seen from behind.

Who can review the opposing toolmark or footwear report?

An examiner whose training, casework and certification cover the same kind of mark as the opposing opinions. AFTE certifies firearm and toolmark examination separately, and IAI has a separate footwear certification, so the discipline on the reviewer's record matters.

The Association of Firearm and Tool Mark Examiners (AFTE) offers three certifications: Firearm Evidence Examination and Identification, Toolmark Evidence Examination and Identification, and Gunshot Residue Evidence Examination and Identification. Applicants may pursue any or all three. A firearm certification alone does not show testing in toolmarks on a lock cylinder or a pry mark on a door.

The International Association for Identification (IAI) certifies footwear examiners on its own track. Its definition of a footwear examiner is "an individual employed full time in forensic science" whose duties include analysis, comparison and written opinions; crime scene collection does not count as footwear examination experience.

A reviewer who will testify faces the same questions as the opposing examiner. The review is only as strong as the reviewer's record in the discipline it discusses, and counsel should read the reviewer's CV with the same care as the opponent's.

What does Rule 702 require of an impression or toolmark examiner?

Qualification by knowledge, skill, experience, training or education, and proof by the proponent, more likely than not, that the opinion rests on sufficient facts or data and reliably applies reliable methods to the case.

Under Rule 702 of the Federal Rules of Evidence, a witness qualified as an expert by knowledge, skill, experience, training or education may give an opinion if the proponent shows the court that it is more likely than not that the testimony will help the trier of fact, rests on sufficient facts or data, is the product of reliable principles and methods, and applies those methods reliably to the facts.

The committee note to the 2000 amendment accepts experience as a basis: nothing in the amendment suggests that experience alone "may not provide a sufficient foundation for expert testimony." A witness who relies mainly on experience must explain how it leads to the conclusion, why it is a sufficient basis and "how that experience is reliably applied to the facts." A toolmark or footwear examiner who relies on years of casework must give that explanation.

The 2023 committee note adds that forensic experts "should avoid assertions of absolute or one hundred percent certainty" if the methodology is subjective and potentially subject to error. An examiner's qualifications do not license wording that the method cannot support.

What training do published guidelines call for in firearm and toolmark examination?

The SWGGUN document describes an 18 to 30 month training program with competency tests, mock cases, oral boards and moot courts, recommends a bachelor's degree in a natural or physical science, and calls for 20 hours of yearly continuing education.

The Scientific Working Group for Firearms and Toolmarks (SWGGUN), a group of firearm and toolmark experts established by the FBI, published "Systemic Requirements/Recommendations for the Forensic Firearm and Toolmark Laboratory." It states that "a quality training program will typically take between 18 and 30 months," led by a training officer, and lists 15 training modules. "Successful completion of competency tests is necessary to satisfy the requirements of a particular module," and trainees pass mock cases, oral boards and moot courts before certification. Qualified examiners "are to be afforded a minimum of 20 hours annually to pursue continuing education." The document says its requirements are not enforceable but strongly encouraged.

A separate document, Minimum Qualifications for Experienced Firearm and Toolmark Examiners, adopted on April 20, 2006, sets the floor for an experienced examiner: a "Bachelor's degree in a natural/physical science from an accredited academic institution," successful completion of a training program, competency in casework, which the hiring agency measures, and "two years of firearm/toolmark casework experience." In lieu of a degree, the hiring agency may use other experience equivalencies.

Employers set their own terms within this frame. The State of Wisconsin classification specification for its firearm and toolmark examiner series, effective July 14, 2002 and modified February 10, 2013, states that "the qualifications required for these positions will be determined at the time of recruitment."

What do the footwear and tire guidelines require?

The SWGTREAD guide of March 2006 accepts a bachelor's degree, or less education with more forensic experience, recommends a science degree, and requires training with competency examinations, moot court and supervised casework.

The Guide for Minimum Qualifications and Training for a Forensic Footwear and/or Tire Tread Examiner, issued by the Scientific Working Group for Shoeprint and Tire Tread Evidence (SWGTREAD) in March 2006, lists three education paths in section 5.2.1: a bachelor's degree from an accredited college or university; an associate's degree or 60 semester hours plus two years of job-related forensic experience; or a high school diploma plus four years of job-related forensic experience. A note to that section says a bachelor's degree in a physical or natural science is "recommended" as the minimum.

Section 6.1.1 requires examinations, written tests, oral tests and practical exercises, to measure the trainee's knowledge. Section 6.2 requires training time "adequate to insure competency in all topic areas," and the topics include court testimony with moot court (6.2.14) and supervised casework (6.2.15). Section 6.1.2 requires training records covering the bibliography, examinations, case statistics, outside training and research.

Those records are what a reviewer asks for. A footwear examiner who cannot produce a training record, or whose record shows no supervised casework, has a qualification gap that the guide itself defines.

What does AFTE certification require?

AFTE membership in good standing, training equivalent to the two-year course in the AFTE Training Manual, a baccalaureate degree, five years of experience, and passing written and practical examinations. Certificants recertify every five years.

Under the AFTE Certification Policies and Procedures, regular, distinguished, emeritus and provisional members in good standing are eligible if they meet the requirements. Applicants need training and experience equivalent to the two-year course of study in the AFTE Training Manual and three years of paid experience as an examiner after a competency test and laboratory authorization, for five years in total. A baccalaureate degree from an accredited institution is required; "possession of a baccalaureate degree in any subject will meet the basic requirement."

The written examination, administered online by the National Forensic Science Technology Center, consists of "100 multiple choice questions, with a time limit of three hours," and the passing score is 70 percent. Each practical examination has two parts and "is designed to take a total of approximately eight hours." The practical for an area can be taken only after the written examination for that area is passed, and a failed component requires a six-month wait.

Certificates are valid for five years: "In order to maintain their certification, certificants must recertify every five years." Failure to meet annual proficiency reporting or a missed recertification deadline can lead to suspension. A reviewer who sees TM-AFTE on a CV can check the area, the date and whether the certificate is current.

What does IAI footwear certification require?

A degree with two years of full-time footwear casework, or more years with less education, a training program, two endorsements, a written test at 80 percent and three practical cases without an erroneous inclusion or exclusion.

The IAI footwear requirements state that "an applicant must possess a Bachelor's Degree plus two years of full time experience as a footwear examiner." An associate degree or 60 semester hours requires three years of experience, and a high school diploma four years. The applicant "must have satisfactorily completed a training program in the examination of footwear evidence," which should follow the SWGTREAD guideline. Two letters of endorsement are required.

The written test must be passed with "a minimum score of 80%," and applicants have two hours to complete it. The practical problems "shall consist of the evaluation and comparison of a minimum of three (3) separate cases with no erroneous inclusions or exclusions," returned within 60 days. A failed written test means a six-month wait; a practical failed because of an erroneous inclusion or exclusion means a one-year wait.

The IAI practical test is pass or fail on errors. A reviewer can ask whether the opposing examiner holds the certification and, if not, whether the examiner has passed any comparable test of footwear comparisons with known answers.

What must the prosecution disclose about its toolmark or footwear examiner?

A complete statement of all opinions with their bases and reasons, the examiner's qualifications with publications from the previous 10 years, and the cases with testimony in the previous 4 years. The examiner must approve and sign the disclosure.

Rule 16(a)(1)(G)(iii) of the Federal Rules of Criminal Procedure requires "a complete statement of all opinions that the government will elicit from the witness in its case-in-chief," "the bases and reasons for them," "the witness's qualifications, including a list of all publications authored in the previous 10 years," and a list of the cases in which, during the previous 4 years, the witness testified as an expert at trial or by deposition.

Under Rule 16(a)(1)(G)(v), "the witness must approve and sign the disclosure," unless the government explains why it could not obtain the signature through reasonable efforts or has already provided a signed report containing all the opinions. Rule 16(b)(1)(C)(iii) applies the same content to an expert the defense will call.

The disclosure tells the reviewer where to start: which certifications to verify, which prior cases to look up, and whether the qualifications listed cover the kind of mark in the case.

How does a reviewer test the opposing examiner's qualifications against the report?

By matching each opinion to the examiner's discipline, training record, casework and current certification, and by checking that the report does not use the examiner's caseload as proof that the conclusion is right.

The first check is the discipline. A firearm examiner offering an opinion on a pry mark, or a footwear examiner offering an opinion on a tire track, should show training and casework in that kind of mark. The AFTE certification areas and the separate SWGTREAD and SWGGUN documents draw the lines.

The second check is the record. The SWGTREAD guide requires training records with examinations and case statistics; the SWGGUN document describes competency tests for each module; AFTE certification lapses without recertification every five years. A reviewer asks for the training record, the competency test results and the certification dates.

The third check is the wording. The Department of Justice ULTR documents for toolmark fracture examination and other disciplines let an examiner cite the number of examinations performed to describe qualifications or experience, but not as a direct measure of the accuracy of a conclusion. A report or testimony that says a conclusion is right because the examiner has done thousands of comparisons crosses that line.

What should the reviewer's own record show?

The same things the reviewer checks in the opponent: education, a completed training program in the discipline, casework years, certification with its current dates, prior testimony and publications, and no interest in the outcome.

A defense reviewer who testifies in a federal criminal case discloses the opinions, their bases, qualifications with publications from 10 years and prior testimony from 4 years under Rule 16(b)(1)(C)(iii). In a civil case over a seal or a lock, Rule 26(a)(2)(B) of the Federal Rules of Civil Procedure requires the same lists and a statement of compensation.

The published guidelines give the reviewer's own checklist. A reviewer whose training followed the SWGTREAD or SWGGUN program, who holds a current IAI or AFTE certification in the area, and whose casework covers the kind of mark in the report gives the court a record it can measure against the opposing examiner's.

Where the reviewer's background differs, for example years in a state laboratory without certification, the CV should say so plainly and show the training record and competency tests that took the place of certification.

Who prepares a review of a toolmark or footwear report at IAE?

A member of the public IAE registry with the relevant specialization who passed the council's attestation under the published Criteria Matrix. The client approves the candidate and the CV before work starts; the review takes up to 5 business days.

The review checks the opposing case file against the standard for that kind of mark. For a footwear report it checks whether the examiner analyzed the questioned print before the known shoe, documented class characteristics and characteristics of use, and recorded the conclusion, as ANSI/ASB Standard 137 (2023) requires. For a toolmark report it checks whether the case file records the verification and who performed it.

Registry members include professors, doctors of science and holders of international certifications. Within one business day of the request IAE confirms the format, the cost, the deadline and the specialist, and the client sees the candidate and the CV before work starts, so the reviewer's qualifications can be compared with the opposing examiner's in advance. The Member ID or QR code in the document opens the specialist's category, specialization, attestation date and record status. Cases with tight deadlines have a 48-hour rush.

The specialist confirms in the document that he or she has no interest in the outcome of the case. Materials are not passed to third parties without the client's consent. IAE is not a law firm and does not advise on case strategy. The court weighs a review with the other evidence, and neither IAE nor the reviewer guarantees the outcome.

Sources

Read also

All articles

Expert report review

Ready to discuss your case?

Send the materials: the secretariat will confirm the format, cost, deadline and the specialist within one business day.

Expertise request

Received

Cost and timeline estimate

WorkReview of an opinion
TimelineUp to 5 business days
ExpertIAE registry member