ICASSP-96 - US DoD Selection of the 2400 bps Standard
Criteria for the DOD 2400 BPS Vocoder Selection Process
M.A. Kohler
U.S. Department of Defense, 9800 Savage Road, Ft. Meade, MD 20755 USA
Philip LaFollette
ARCON Corporation, 260 Bear Hill Road, Waltham, Massachusetts USA
Matthew R. Bielefeld
MITRE Corporation, McLean Virginia 22102 USA
ABSTRACT
Use of vocoder competitions remains a prevalent method for selecting a candidate algorithm for low bit rate voice coding applications. Without proper safeguards in the evaluation process, the final selection may be perceived as biased or unfair. This paper describes the evaluation process that was used by the DOD for the selection of a new 2400 bps standard. Specific attention was aimed at creating an evaluation environment such that each candidate received equitable treatment. This paper describes the structure of the evaluation team, the roles and responsibilities of its components, the information that was available for evaluation, and the equations and weights that were used to develop an overall Figure of Merit (FOM) for each candidate.
Download This Paper in PostScript Format (337KB)
