Expert report review

The opposing audio expert examined a copy, not the original file: what does a reviewer check?

A disputed recording can reach the examiner as a file forwarded through a messenger, a phone app export or a disc copy instead of the file the recorder first wrote. SWGDE treats a transcoded or re-encoded version as not an original, and some tests cannot be run on it. A reviewer reads the opposing report to find out which file was examined, what the copy could and could not show, and whether the conclusion stays within those limits.

Hands compare a voice recorder in a clear sleeve with a loose memory card on a wooden desk

What counts as the original of a digital recording?

SWGDE defines the original recording as the first manifestation of sound in a recoverable stored format. A transcoded or re-encoded version is not an original; a verified duplicate of the original media may be examined.

The Scientific Working Group on Digital Evidence published Best Practices for Digital Audio Authentication, document 15-a-001, version 1.3, on September 20, 2018. Its terminology section defines the original recording as the first manifestation of sound in a recoverable stored format. The discussion that follows says the first removable instance of the original data should be protected from modification and hashed if possible. SWGDE uses the term first removable for either an original or duplicate recording that is transferrable, can be hashed, is write-protectable, or the physical media itself. To transcode, in SWGDE's definition, is to convert a multimedia file between encoding schemes.

The Federal Rules of Evidence use their own terms. Under Rule 1001(d) an original of a recording is the recording itself or any counterpart intended to have the same effect by the person who executed or issued it, and for electronically stored information an original is any printout or other output readable by sight, if it is accurate. Under Rule 1001(e) a duplicate is a counterpart produced by a mechanical, photographic, chemical, electronic or other equivalent process or technique that accurately reproduces the original. The advisory committee note speaks of copies produced by methods possessing an accuracy which virtually eliminates the possibility of error.

The two vocabularies answer different questions. The evidence rules decide whether a copy may be offered to prove what was said. SWGDE tells an examiner what can be learned about how the recording was made and whether it was altered. A file that passes the first test can still be the wrong object for the second.

Why does it matter whether the examiner had the original file?

Because conversion removes evidence. SWGDE says that a decoded PCM copy of an encoded original may still hold useful information, but file format analysis regarding the original format becomes impossible.

Section 3.1 of SWGDE 15-a-001 states: "Transcoded or re-encoded versions of an original recording are not original recordings." The same section says that a decoded PCM waveform copy of an encoded original may still contain useful information relevant to authenticity analysis, and that file format analysis regarding the original format becomes impossible.

Section 4.4.2 describes file structure analysis: the examiner looks at the header metadata, the recorded content, multiplexed metadata and any footer data, and compares the results with exemplar recordings from the submitted recorder or other test recordings. A program that saves a new file writes its own header. On a copy the examiner compares the recorder's exemplars with a file the recorder never produced. Listening and waveform review remain possible, so a report on a copy can still describe what is heard and where the signal changes.

For open formats such as WMA and MP3, which most playback and editing software supports, section 4.4.2.1 says it should be mandatory to supply the purportedly original file and perform digital data analysis on the metadata. Section 3.1 tells the examiner to ask whether the submitted exhibit is the purported original recording and, if not, to request it, together with items such as the recording equipment and exemplar data or recordings.

Douglas S. Lacey of BEK TEK LLC wrote in a letter of September 24, 2015 to David J. Leviss of O'Melveny & Myers LLP that copies converted to other file formats or encoding schemes, in their entirety or as compilations of edited segments, "cannot be scientifically authenticated." The letter defines an original recording as one that exists in the native format of the recording device. The letter is posted on the website of the Democratic members of the House Committee on Oversight.

How can the reviewer tell from the report which file was examined?

From the description of the evidence in the report: file name, format, size, duration, source, hash value and the chain of custody between the device and the laboratory. A report without hash values leaves open which file the examiner had.

SWGDE's worked example in Appendix A records the steps for a submitted disc: a hash created for the disc, bit-stream images produced with one placed in archive with the evidence and the other used as the working copy, and the evidence file hashed. Section 4.7 adds that, if necessary and possible, the examiner produces a verified bit-stream copy of non-removable memory before testing a device. A report that follows this practice lets anyone confirm later that the file in court is the file in the laboratory.

Rule 26(a)(2)(B)(ii) of the Federal Rules of Civil Procedure requires a retained expert's report to state the facts or data considered in forming the opinions, and Rule 26(a)(2)(B)(iii) requires the exhibits that will be used to summarize or support them. For an audio report the facts or data include the questioned file itself, its source and any exemplar recordings.

The reviewer writes down what the report says about the file and what it leaves out. A file named after a messenger's naming pattern, a format that the recording device does not produce, a creation date after the date of the events, or a duration different from the one in the transcript is a sign that the examiner had a copy. Where the report is silent, Rule 705 lets the other side require the expert to disclose the underlying facts or data on cross-examination.

Will a federal court admit a copy of the recording?

Under Rule 1003 a duplicate is admissible to the same extent as the original unless a genuine question is raised about the original's authenticity or the circumstances make it unfair to admit the duplicate.

The advisory committee note to Rule 1003 explains that when only the accuracy of the contents matters, a counterpart produced by an accurate method is as good as the original. Among its authorities it cites Johns v. United States, 323 F.2d 421 (5th Cir. 1963), where an accurate tape recording made from a wire recording was admitted, and United States v. Alexander, 326 F.2d 736 (4th Cir. 1964), for the point that the original may be needed when only part of it is reproduced and the rest is needed for cross-examination.

House Report No. 93-650, quoted on the same page, says the committee expected courts to be liberal in deciding that a genuine question of authenticity exists. A review that documents why the copy cannot answer the authenticity question gives counsel the facts for that argument.

Admission and authentication are separate steps. Rule 901(a) requires the proponent to produce evidence sufficient to support a finding that the item is what the proponent claims it is. Rule 901(b)(9) lists, as one way to do so, evidence describing a process or system and showing that it produces an accurate result. A chain of exports and conversions is such a process, and each step in it is a fact the proponent may have to prove.

How do you get the native file and the recording device?

By a Rule 34 request that names the recording, asks for it in its native form with metadata, and asks to inspect the phone or recorder as a tangible thing. The response is due within 30 days after service.

Rule 34(a)(1)(A) covers documents and electronically stored information, and the rule lists sound recordings, images and other data or data compilations stored in any medium among them. Rule 34(a)(1)(B) covers any designated tangible things in the responding party's possession, custody or control. A phone or a digital recorder falls under the second category.

Under Rule 34(b)(1)(C) the request may specify the form or forms in which electronically stored information is to be produced. Under Rule 34(b)(2)(D) the responding party may object to a requested form and must then state the form it intends to use. If the request specifies no form, Rule 34(b)(2)(E)(ii) permits production in a form in which the information is ordinarily maintained or in a reasonably usable form, and Rule 34(b)(2)(E)(iii) says a party need not produce the same information in more than one form. A request that does not name the native format can therefore be answered with a converted copy.

SWGDE warns about the device itself. Section 3.3 tells the examiner to obtain permission from the necessary parties before testing a device and to warn that such testing risks changing the state of that device, and section 4.7 calls for a verified bit-stream copy of non-removable memory first, if necessary and possible. If the purported original device is not available, section 4.4.2 tells the examiner to use a device of the same make and model for test recordings.

What if the original file no longer exists?

SWGDE permits examination of a verified duplicate of the original media when the original is not obtainable. In court, Rule 1004 admits other evidence of content in listed cases, and Rule 37(e) governs lost electronically stored information.

Section 3.1 of SWGDE 15-a-001 notes that in some circumstances the original is not obtainable or no longer exists, and then a verified duplicate of the original media may be used for examination. A duplicate verified by hash against the original media differs from a messenger copy that no one can trace back to the device.

Rule 1004 provides that an original is not required and other evidence of the content of a recording is admissible if all the originals are lost or destroyed, and not by the proponent acting in bad faith; if an original cannot be obtained by any available judicial process; if the party against whom the original would be offered had control of it, was put on notice that it would be a subject of proof and fails to produce it; or if the recording is not closely related to a controlling issue.

Rule 37(e) of the Federal Rules of Civil Procedure applies when electronically stored information that should have been preserved in the anticipation or conduct of litigation is lost because a party failed to take reasonable steps to preserve it and it cannot be restored or replaced through additional discovery. On finding prejudice, the court may order measures no greater than necessary to cure it. Only on finding intent to deprive another party of the information's use may the court presume the information was unfavorable, instruct the jury that it may or must so presume, or dismiss the action or enter a default judgment.

What conclusions can an examiner draw from a copy?

SWGDE lists three results for an authenticity examination: consistent with an original, inconclusive, and inconsistent with an original, stated without absolutes. The reviewer checks whether the chosen result rests on tests that a copy permits.

Section 5.2 of SWGDE 15-a-001 names the three possible results. Section 5.2.1 begins: "No scientific inquiry, including those in forensics, produce a result of absolute certainty," and says conclusions on authenticity should not be stated in terms of absolutes. A report that calls a transcoded file consistent with an original contradicts section 3.1, which says such versions are not original recordings. The reviewer quotes both passages next to the report's conclusion.

A copy also changes what a negative finding means. When a report says no signs of editing were found, the reviewer asks which tests were run. If the format and metadata tests were impossible, the finding rests on listening and signal analysis alone, and the report should say so. SWGDE section 4.1 reads: "Not all tests will be applicable in each case, nor shall any single analysis be relied upon solely."

Rule 702, as amended in 2023, lets an expert testify only if the proponent shows the court that it is more likely than not that the testimony is based on sufficient facts or data and that the opinion applies reliable principles and methods reliably to the facts of the case. The 2023 committee note says each expert opinion must stay within the bounds of what can be concluded from a reliable application of the expert's basis and methodology.

What should the opposing examiner be asked about the file?

Where the file came from, who converted it and how, whether the examiner asked for the original or the device, which tests were run on the copy and which could not be run, and what counsel told the examiner.

Rule 26(b)(4)(A) lets a party depose any expert whose opinions may be presented at trial, and when a report is required, the deposition may be conducted only after the report is provided. Under Rule 26(b)(4)(E)(i) the party seeking the deposition pays the expert a reasonable fee for the time spent responding, unless manifest injustice would result. The examination proceeds as it would at trial under the Federal Rules of Evidence, except Rules 103 and 615 (Rule 30(c)(1)), and unless otherwise stipulated or ordered it is limited to 1 day of 7 hours (Rule 30(d)(1)).

Communications between counsel and the examiner are protected by Rule 26(b)(4)(C) except to the extent they relate to compensation, identify facts or data that counsel provided and the expert considered, or identify assumptions that counsel provided and the expert relied on. A file sent by counsel is such a fact, and an instruction to treat that file as the original is such an assumption.

  • Which file did you receive, from whom, on what date and by what means?
  • What hash value did you record on receipt, and with which algorithm?
  • Did you ask for the original file or the recording device, and what answer did you get?
  • Which format does the recording device produce, and which format did you examine?
  • Which of your tests depend on the original file format and metadata, and were they run?
  • What were you told about the recording before you started, and by whom?

Can the copy problem support a rebuttal report or a motion to exclude?

Yes, when the opinion goes beyond what the copy can support. A rebuttal report is due 30 days after the other side's disclosure, and a Rule 702 motion tests the basis and the application of the method.

Under Rule 26(a)(2)(D)(ii), absent a stipulation or a court order, evidence intended solely to contradict or rebut evidence on the same subject matter is due within 30 days after the other party's disclosure. Under Rule 37(c)(1) a party that fails to disclose as Rule 26(a) or (e) requires may not use that information or witness on a motion, at a hearing or at trial, unless the failure was substantially justified or is harmless. A rebuttal confined to the file the opposing examiner used and the tests that file allowed stays on the same subject.

The 2023 committee note to Rule 702 says many courts had held that the sufficiency of an expert's basis and the application of the method are questions of weight, and calls those rulings an incorrect application of Rules 702 and 104(a). The 2000 note lists, among the factors courts consider, whether the expert has adequately accounted for obvious alternative explanations.

For an audio report made on a copy, the obvious alternative explanation is the conversion itself. A discontinuity, a change in background noise or an unusual header value can come from the program that re-saved the file. An examiner who reads such a feature as an edit, without ruling out the conversion as its source, has not accounted for that alternative, and the reviewer writes this down with the page of the report.

What does IAE do when the opposing audio examiner worked on a copy?

An IAE examiner reviews the opposing audio report for US cases: which file the examiner received and its hash, which tests were run and documented, and whether the conclusion stays within the method. Up to 5 business days.

The IAE review of the opposing forensic audio report is for a party facing the other side's examiner on whether a recording was edited, whose voice is on it or what was said. The reviewer checks which file the examiner received, which tests were run and documented, whether the voice exemplars were comparable and whether the conclusion stays within the method. Each point in the review is tied to a page of the opposing report and to a rule, a standard or a court decision.

For the review, IAE asks for the questioned recording in its native form with metadata, the hash values the opposing examiner recorded, any exemplar recordings and the examiner's documentation of each test. Because the reviewer needs the native file before the analysis starts, the document request goes out early. The review can support a rebuttal report and a Rule 702 motion; the decision on either belongs to the attorney and the court.

The client sends the opposing report and the case materials and describes what to check. The secretariat confirms receipt the same day, and within one business day IAE confirms the format, the cost, the deadline and the specialist from its registry. The client approves the candidate and the CV before work starts. The signed PDF is issued in up to 5 business days after the format and cost are confirmed, and a 48-hour rush is available for tight deadlines.

Specialists are members of the public IAE registry and passed the council's attestation under the published Criteria Matrix; the Member ID or QR code in the document opens the specialist's record. The specialist confirms in the document that he or she has no interest in the outcome, and materials are not passed to third parties without the client's consent. A review is evidence the court weighs with the other materials; neither IAE nor the reviewer guarantees the outcome, and IAE is not a law firm.

Sources

Read also

All articles

Expert report review

Ready to discuss your case?

Send the materials: the secretariat will confirm the format, cost, deadline and the specialist within one business day.

Expertise request

Received

Cost and timeline estimate

WorkReview of an opinion
TimelineUp to 5 business days
ExpertIAE registry member