ESPnet2 pretrained model, Shinji Watanabe/librispeech_asr_train_asr_transformer_e18_raw_bpe_sp_valid.acc.best, fs=16k, lang=en
Shinji Watanabe · Zenodo (CERN European Organization for Nuclear Research) · 2020
This model was trained by Shinji Watanabe using librispeech recipe in espnet. Python API See https://github.com/espnet/espnet_model_zoo Evaluate in the recipe git clone https://github.com/espnet/espnet cd espnet git checkout fca1edc18f8235c1de13925147519e6ecd03ec96 pip install -e . cd egs2/librispeech/asr1 ./run.sh --skip_data_prep false --skip_train true --download_model Shinji Watanabe/librispeech_asr_train_asr_transformer_e18_raw_bpe_sp_valid.acc.best Results # RESULTS ## Environments - date: `Tue Jul 21 07:58:39 EDT 2020` - python version: `3.7.3 (default, Mar 27 2019, 22:11:17) [GCC 7.3.0]` - espnet version: `espnet 0.8.0` - pytorch version: `pytorch 1.4.0` - Git hash: `75db853dd26a40d3d4dd979b2ff2457fbbb0cd69` - Commit date: `Mon Jul 20 10:49:12 2020 -0400` ## asr_train_asr_transformer_e18_raw_bpe_sp ### WER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_dev_clean_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2703|54402|97.9|1.8|0.2|0.2|2.3|28.2| |decode_dev_clean_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2703|54402|97.9|1.9|0.2|0.3|2.4|29.5| |decode_dev_other_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2864|50948|94.6|4.7|0.7|0.7|6.0|46.6| |decode_dev_other_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2864|50948|94.4|5.0|0.5|0.8|6.3|47.5| |decode_test_clean_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2620|52576|97.7|2.0|0.3|0.3|2.6|30.4| |decode_test_clean_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2620|52576|97.7|2.0|0.2|0.3|2.6|30.1| |decode_test_other_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2939|52343|94.5|4.8|0.7|0.7|6.2|49.7| |decode_test_other_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2939|52343|94.3|5.1|0.6|0.8|6.5|50.3| ### CER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_dev_clean_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2703|288456|99.3|0.3|0.3|0.2|0.9|28.2| |decode_dev_clean_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2703|288456|99.3|0.4|0.3|0.2|0.9|29.5| |decode_dev_other_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2864|265951|97.7|1.2|1.1|0.6|2.9|46.6| |decode_dev_other_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2864|265951|97.7|1.3|1.0|0.8|3.0|47.5| |decode_test_clean_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2620|281530|99.3|0.3|0.4|0.3|1.0|30.4| |decode_test_clean_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2620|281530|99.4|0.3|0.3|0.3|0.9|30.1| |decode_test_other_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2939|272758|97.8|1.1|1.1|0.7|2.9|49.7| |decode_test_other_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2939|272758|97.9|1.2|0.9|0.8|2.9|50.3| ### TER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_dev_clean_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2703|69307|97.2|1.8|1.0|0.4|3.2|28.2| |decode_dev_clean_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2703|69307|97.2|1.9|1.0|0.5|3.3|29.5| |decode_dev_other_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2864|64239|93.3|4.4|2.2|1.2|7.9|46.6| |decode_dev_other_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2864|64239|93.2|4.9|1.9|1.5|8.3|47.5| |decode_test_clean_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2620|66712|97.0|1.9|1.1|0.4|3.3|30.4| |decode_test_clean_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2620|66712|97.1|1.9|1.0|0.5|3.3|30.1| |decode_test_other_decode_asr_beam_size20_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2939|66329|93.1|4.5|2.4|1.0|7.9|49.7| |decode_test_other_decode_asr_beam_size5_lm_train_lm_adam_bpe_valid.loss.best_asr_model_valid.acc.best|2939|66329|93.1|4.8|2.1|1.4|8.3|50.3| ASR config config: conf/tuning/train_asr_transformer_e18.yaml print_config: false log_level: INFO dry_run: false iterator_type: sequence output_dir: exp/asr_train_asr_transformer_e18_raw_bpe_sp ngpu: 1 seed: 0 num_workers: 1 num_att_plot: 3 dist_backend: nccl dist_init_method: env:// dist_world_size: 4 dist_rank: 3 local_rank: 3 dist_master_addr: localhost dist_master_port: 33643 dist_launcher: null multiprocessing_distributed: true cudnn_enabled: true cudnn_benchmark: false cudnn_deterministic: true collect_stats: false write_collected_feats: false max_epoch: 100 patience: null val_scheduler_criterion: - valid - loss early_stopping_criterion: - valid - loss - min best_model_criterion: - - valid - acc - max keep_nbest_models: 10 grad_clip: 5.0 grad_noise: false accum_grad: 6 no_forward_run: false resume: true train_dtype: float32 log_interval: null pretrain_path: [] pretrain_key: [] num_iters_per_epoch: null batch_size: 20 valid_batch_size: null batch_bins: 15000000 valid_batch_bins: null train_shape_file: - exp/asr_stats_raw_sp/train/speech_shape - exp/asr_stats_raw_sp/train/text_shape.bpe valid_shape_file: - exp/asr_stats_raw_sp/valid/speech_shape - exp/asr_stats_raw_sp/valid/text_shape.bpe batch_type: numel valid_batch_type: null fold_length: - 80000 - 150 sort_in_batch: descending sort_batch: descending multiple_iterator: false chunk_length: 500 chunk_shift_ratio: 0.5 num_cache_chunks: 1024 train_data_path_and_name_and_type: - - dump/raw/train_960_sp/wav.scp - speech - sound - - dump/raw/train_960_sp/text - text - text valid_data_path_and_name_and_type: - - dump/raw/dev/wav.scp - speech - sound - - dump/raw/dev/text - text - text allow_variable_data_keys: false max_cache_size: 0.0 valid_max_cache_size: null optim: adam optim_conf: lr: 0.002 scheduler: warmuplr scheduler_conf: warmup_steps: 25000 token_list: - - - "\u2581EXCLAIM" - "\u2581OPPORTUNITIES" - "\u2581REMEDY" - "\u2581DEFENSE" - "\u2581ETERNITY" - "\u2581SKULL" - "\u2581PLEADED" - "\u2581INSTINCTIVELY" - "\u2581SLAUGHTER" - "\u2581RATIONAL" - "\u2581PULSE" - "\u2581PARALLEL" - "\u2581SCOUNDREL" - "\u2581PRUDENCE" - "\u2581PROBABILITY" - "\u2581DERIVED" - "\u2581MONSTROUS" - "\u2581POTATOES" - "\u2581IMPRESSIVE" - "\u2581DAINTY" - "\u2581SULTAN" - "\u2581CARPENTER" - "\u2581INNUMERABLE" - "\u2581INVITE" - "\u2581CIRCULAT" - "\u2581ELOQUENCE" - "\u2581DISCIPLE" - "\u2581ATTIRE" - "\u2581OBSTINATE" - "\u2581STREAK" - "\u2581WOLVES" - "\u2581GRINNED" - "\u2581ORCHARD" - "\u2581JAPANESE" - "\u2581ANNUAL" - "\u2581SHAWL" - "\u2581PACIFIC" - "\u2581VEHICLE" - "\u2581APOSTLE" - "\u2581CONGREGATION" - "\u2581AMAZING" - "\u2581OCCURRENCE" - "\u2581CONFERENCE" - "\u2581MIXTURE" - "\u2581EXAMINING" - "\u2581SAUCE" - "\u2581ADMIRING" - "\u2581AMBASSADOR" - "\u2581DEVICE" - "\u2581INCAPABLE" - "\u2581WHEREUPON" - "\u2581IMPERFECT" - "\u2581PERCEPTION" - "\u2581LOUNG" - "\u2581VACANT" - "\u2581EXCURSION" - "\u2581DISCOURAGE" - "\u2581FANTASTIC" - "\u2581REBELLION" - "\u2581CONVINCE" - "\u2581DEFIANCE" - "\u2581CONNECT" - "\u2581EMPHASIS" - "\u2581MEXICO" - "\u2581OPPONENT" - "\u2581DETERMINE" - "\u2581MANUSCRIPT" - "\u2581INCESSANT" - "\u2581BRONZE" - "\u2581COURTEOUS" - "\u2581COFFIN" - "\u2581CONSTRUCTION" - "\u2581BLUNDER" - "\u2581SENATE" - "\u2581CIRCUM" - "\u2581DANIEL" - "\u2581ELOQUENT" - "\u2581QUIVERING" - "\u2581VIGIL" - "\u2581HAZARD" - "\u2581UNWORTHY" - "\u2581TAB" - "\u2581ILLUSION" - "\u2581AGITATED" - "\u2581CHAMPION" - "\u2581DIMINISH" - "\u2581STUMP" - "\u2581CONFIDE" - "\u2581PHILADELPHIA" - "\u2581DOUGLAS" - "\u2581BUMP" - "\u2581COMMERCE" - "\u2581FACULTY" - "\u2581CONFEDERATE" - "\u2581EMBARRASSMENT" - "\u2581EXPLORE" - "\u2581MAGGIE" - "\u2581PHILOSOPHIC" - "\u2581ADMINISTRATION" - "\u2581HEADQUARTERS" - "\u2581SOLUTION" - "\u2581REFRAIN" - "\u2581ELDEST" - "\u2581FORMIDABLE" - "\u2581VERANDA" - "\u2581DISMAL" - "\u2581ESTHER" - "\u2581PRUDENT" - "\u2581BLAZING" - "\u2581RESOLVE" - "\u2581ELSIE" - "\u2581TURKEY" - "\u2581DECREE" - "\u2581CONVERSE" - "\u2581GRAVITY" - "\u2581MIRTH" - "\u2581RESEMBLANCE" - "\u2581GULF" - "\u2581SHRUB" - "\u2581EXHIBITION" - "\u2581AUSTRALIA" - "\u2581ELEANOR" - "\u2581UNCOMMON" - "\u2581RACHEL" - "\u2581TOMORROW" - "\u2581INJUSTICE" - "\u2581WISTFUL" - "\u2581WREATH" - "\u2581DISDAIN" - "\u2581CRUMB" - "\u2581CLINGING" - "\u2581COMMEND" - "\u2581SUPERSTITION" - "\u2581CRISIS" - "\u2581MAXIM" - "\u2581DESIRABLE" - "\u2581GIGANTIC" - "\u2581JUNGLE" - "\u2581DIGNIFIED" - "\u2581INVALID" - "\u2581UNNECESSARY" - "\u2581SUBLIME" - "\u2581PLOUGH" - "\u2581SUFFICE" - "\u2581BUNK" - "\u2581LUNCHEON" - "\u2581DRAUGHT" - "\u2581COLONY" - "\u2581PARLOUR" - "\u2581TERRIFIED" - "\u2581LOATH" - "\u2581SIGNIFICANCE" - "\u2581EXTENSIVE" - "\u2581HORACE" - "\u2581SERENE" - "\u2581CHEESE" - "\u2581PRECEDING" - "\u2581LEVI" - "\u2581INVARIABLY" - "\u2581OBSERVING" - "\u2581EARLIEST" - "\u2581WHEAT" - "\u2581DEMOCRAT" - "\u2581YOURSELVES" - "\u2581FEMININE" - "\u2581ARTIFICIAL" - "\u2581IDIOT" - "\u2581TORRENT" - "\u2581CONVICT" - "\u2581CONSUME" - "\u2581EMBROIDER" - "\u2581CONQUEST" - "\u2581CALCULATED" - "\u2581HAPPIER" - "\u2581DECAY" - "\u2581LITERALLY" - "\u2581RADIANT" - ENNI - "\u2581AMAZED" - "\u2581SPLIT" - "\u2581SUPPOSING" - "\u2581CANADA" - "\u2581PAVEMENT" - "\u2581ANTHONY" - "\u2581BULK" - "\u2581MEDIUM" - "\u2581MAURICE" -