Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

loss diverged to nan when training vits with fp16 option enabled. #4236

Closed
ariacat3366 opened this issue Apr 4, 2022 · 2 comments · Fixed by #4356
Closed

loss diverged to nan when training vits with fp16 option enabled. #4236

ariacat3366 opened this issue Apr 4, 2022 · 2 comments · Fixed by #4356
Labels
Bug bug should be fixed ESPnet2 TTS Text-to-speech Wontfix Want to fix

Comments

@ariacat3366
Copy link

I trained VITS using the original dataset with the fp16 option enabled (--use_amp true), but after turning the training around for a few days, the loss values diverged to NAN in the process.
I think the exception handling when values outside the range of fp16 is not working properly.
I did not see this error when the fp16 option was not enabled for the same data set.
@ariacat3366 ariacat3366 added the Bug bug should be fixed label Apr 4, 2022
@kan-bayashi kan-bayashi added Wontfix Want to fix TTS Text-to-speech ESPnet2 labels Apr 11, 2022
@kan-bayashi
Copy link
Member

Thank you for your report. Actually, I have not tried fp16 setting so much.
Do you have any comments about doubtful points?

@ariacat3366
Copy link
Author

To be honest, the learning process was going well until the middle of the program, so I am not sure what exactly is wrong.
jaywalnut310/vits#15
jaywalnut310/vits#48
These are the official implementations, and a bug was reported here as well, where learning was not possible or loss was NaN when fp16 was enabled.

In my case, I modified espnet's VITS implementation slightly based on the PR, to be able to learn... but I don't know how it effect to result.
jaywalnut310/vits#34

kan-bayashi added a commit to kan-bayashi/espnet that referenced this issue May 11, 2022
@kan-bayashi
fixed mixed_precision NaN (espnet#4236)
2be9ddc
@kan-bayashi kan-bayashi mentioned this issue May 11, 2022
Merged
chintu619 added a commit to chintu619/espnet that referenced this issue May 31, 2022
@chintu619
Squashed commit of the following:
c7c7b00 
commit 047d0c4
Merge: 9396ed3 bfe7bca
Author: Shinji Watanabe <[email protected]>
Date:   Thu May 19 09:50:02 2022 -0400

    Merge pull request espnet#4378 from akreal/fix-check_short_utt

    Fix minimum input length for Conv2dSubsampling2 in check_short_utt

commit bfe7bca
Author: Pavel Denisov <[email protected]>
Date:   Thu May 19 13:41:59 2022 +0200

    Fix minimum input length for Conv2dSubsampling2 in check_short_utt

commit 9396ed3
Merge: c54b585 e047156
Author: Naoyuki Kamo <[email protected]>
Date:   Thu May 19 14:50:56 2022 +0900

    Merge pull request espnet#4376 from kamo-naoyuki/libsndfile

    Remove the restriction for libsndfile version

commit c54b585
Merge: 9ca49ca 8846560
Author: Tomoki Hayashi <[email protected]>
Date:   Thu May 19 12:29:02 2022 +0900

    Merge pull request espnet#4374 from YosukeHiguchi/master

    Minor fixes for the intermediate loss usage and Mask-CTC decoding

commit e047156
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 19 10:11:08 2022 +0900

    remove version restiction for libsndfile

commit 9ca49ca
Merge: b008ac7 2952c3b
Author: Naoyuki Kamo <[email protected]>
Date:   Thu May 19 09:38:33 2022 +0900

    Merge pull request espnet#4375 from espnet/kamo-naoyuki-patch-1

    Update .mergify.yml

commit 8846560
Author: Yosuke Higuchi <[email protected]>
Date:   Thu May 19 07:05:29 2022 +0900

    fix for test

commit 2952c3b
Author: Naoyuki Kamo <[email protected]>
Date:   Thu May 19 06:59:02 2022 +0900

    Update .mergify.yml

commit b008ac7
Merge: 3c96908 4203c9c
Author: Naoyuki Kamo <[email protected]>
Date:   Thu May 19 06:32:44 2022 +0900

    Merge pull request espnet#4372 from kamo-naoyuki/isort

    Add isort checking to the CI tests

commit 4de7aa5
Author: Yosuke Higuchi <[email protected]>
Date:   Thu May 19 06:19:20 2022 +0900

    fix for test

commit 9c83ddb
Author: Yosuke Higuchi <[email protected]>
Date:   Thu May 19 05:05:01 2022 +0900

    support gpu decoding for mask-ctc

commit 49100e4
Author: Yosuke Higuchi <[email protected]>
Date:   Thu May 19 05:03:29 2022 +0900

    fix bug for returning intermediate states

commit 4203c9c
Author: kamo-naoyuki <[email protected]>
Date:   Wed May 18 17:47:22 2022 +0900

    apply isort

commit d0f2eac
Author: kamo-naoyuki <[email protected]>
Date:   Wed May 18 17:46:47 2022 +0900

    modified for isort options

commit 8f73b73
Author: kamo-naoyuki <[email protected]>
Date:   Wed May 18 16:38:34 2022 +0900

    apply black

commit 6974dd4
Author: kamo-naoyuki <[email protected]>
Date:   Wed May 18 16:35:15 2022 +0900

    Add descriptions for isort

commit 24c3676
Author: kamo-naoyuki <[email protected]>
Date:   Wed May 18 16:16:53 2022 +0900

    Apply isort

commit 3c96908
Merge: c173c30 aa5d6ff
Author: Jiatong <[email protected]>
Date:   Tue May 17 18:00:40 2022 -0700

    Merge pull request espnet#4341 from chintu619/st_bugfix

    bug fixes in ST recipes

commit c173c30
Merge: e0e0620 d38188c
Author: Naoyuki Kamo <[email protected]>
Date:   Tue May 17 15:20:31 2022 +0900

    Merge pull request espnet#4371 from espnet/kamo-naoyuki-patch-1

    Update .mergify.yml

commit d38188c
Author: Naoyuki Kamo <[email protected]>
Date:   Tue May 17 13:43:40 2022 +0900

    Update .mergify.yml

commit e0e0620
Merge: df053b8 2cfbbd3
Author: Tomoki Hayashi <[email protected]>
Date:   Tue May 17 13:01:02 2022 +0900

    Merge pull request espnet#4369 from kan-bayashi/minor_fix_jets

commit 2cfbbd3
Author: kan-bayashi <[email protected]>
Date:   Tue May 17 11:06:00 2022 +0900

    updated jets test

commit 17ab774
Author: kan-bayashi <[email protected]>
Date:   Tue May 17 11:05:52 2022 +0900

    updated README

commit 6ec8c27
Author: kan-bayashi <[email protected]>
Date:   Tue May 17 09:25:41 2022 +0900

    updated README

commit b1e6c75
Author: kan-bayashi <[email protected]>
Date:   Tue May 17 09:19:54 2022 +0900

    shorten jets test

commit df053b8
Merge: afa8f8e 5aa543a
Author: Tomoki Hayashi <[email protected]>
Date:   Tue May 17 08:13:36 2022 +0900

    Merge pull request espnet#4364 from imdanboy/master

    add e2e tts model: JETS

commit 5aa543a
Author: Tomoki Hayashi <[email protected]>
Date:   Mon May 16 21:13:30 2022 +0900

    minor fix of docstrings and comments

commit a82e78d
Author: imdanboy <[email protected]>
Date:   Fri May 13 22:28:31 2022 +0900

    JETS; e2e tts model

commit afa8f8e
Merge: fffb344 cd77501
Author: Shinji Watanabe <[email protected]>
Date:   Fri May 13 17:36:30 2022 -0400

    Merge pull request espnet#4349 from pyf98/quantization

    Add quantization in ESPnet2 for asr inference

commit fffb344
Merge: f840b81 5331890
Author: Naoyuki Kamo <[email protected]>
Date:   Fri May 13 20:36:39 2022 +0900

    Merge pull request espnet#4361 from espnet/kamo-naoyuki-patch-1

    Update README.md

commit aa5d6ff
Author: Chaitanya Narisetty <[email protected]>
Date:   Fri May 13 05:15:32 2022 -0400

    fix lm tag names

commit 3cac7bb
Author: Chaitanya Narisetty <[email protected]>
Date:   Fri May 13 05:07:55 2022 -0400

    resolve conflicts and fix lm_train filenames

commit ea44663
Author: Chaitanya Narisetty <[email protected]>
Date:   Fri May 13 04:43:18 2022 -0400

    review suggested changes

commit 650c733
Merge: 6d1bd3a f840b81
Author: Chaitanya Narisetty <[email protected]>
Date:   Fri May 13 03:18:08 2022 -0400

    Merge branch 'espnet_master' into st_bugfix

commit 5331890
Author: Naoyuki Kamo <[email protected]>
Date:   Fri May 13 13:15:40 2022 +0900

    Update README.md

commit f840b81
Merge: 1b12410 9cfd6af
Author: Naoyuki Kamo <[email protected]>
Date:   Fri May 13 13:13:34 2022 +0900

    Merge pull request espnet#4348 from kamo-naoyuki/1.11.0

    Add pytorch=1.10.2 and 1.11.0 to ci configurations

commit 9cfd6af
Author: kamo-naoyuki <[email protected]>
Date:   Fri May 13 09:58:04 2022 +0900

    fix

commit 2625be7
Author: kamo-naoyuki <[email protected]>
Date:   Fri May 13 03:46:24 2022 +0900

    remove warning

commit 9a2001f
Author: kamo-naoyuki <[email protected]>
Date:   Fri May 13 03:44:11 2022 +0900

    fix for pytorch1.11 (+= became inplace op)

commit 5518b6b
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 22:04:42 2022 +0900

    fix import order

commit 98689a5
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 21:17:35 2022 +0900

    change to show the error logs when jobs are failed

commit bb0d0aa
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 20:40:39 2022 +0900

    fix code style

commit 934b161
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 20:33:58 2022 +0900

    change to show the error logs when jobs are failed

commit 5c474b9
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 20:20:18 2022 +0900

    remove verbosity options

commit 005aad1
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 20:04:57 2022 +0900

    fix

commit 5c4b966
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 19:36:11 2022 +0900

    remove tests for python=3.10.0 temporary

commit 809ac37
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 19:27:20 2022 +0900

    fix

commit 86186b7
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 19:10:18 2022 +0900

    add installation for packaging

commit 8fbac77
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 18:59:17 2022 +0900

    fix

commit b0050d9
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 18:56:52 2022 +0900

    fix

commit 6e9035d
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 18:32:33 2022 +0900

    fix

commit 1c344a9
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 18:25:35 2022 +0900

    change LooseVersion to parse

commit f899a05
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 18:09:33 2022 +0900

    fix

commit 7d52422
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 18:09:15 2022 +0900

    fix

commit b7cfdd9
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 18:05:41 2022 +0900

    Change LooseVersion to parse

commit d234b9a
Author: kamo-naoyuki <[email protected]>
Date:   Thu May 12 17:10:40 2022 +0900

    fix

commit 1b12410
Merge: 39bae01 52c238d
Author: Shinji Watanabe <[email protected]>
Date:   Wed May 11 13:00:13 2022 -0400

    Merge pull request espnet#4352 from espnetUser/master

    Add unit test to streaming ASR inference

commit 52c238d
Author: espnetUser <[email protected]>
Date:   Wed May 11 16:10:04 2022 +0200

    Applied black formating to test_asr_inference.py for PR

commit 87c7573
Author: espnetUser <[email protected]>
Date:   Wed May 11 15:43:01 2022 +0200

    Update asr_inference_streaming.py

    Fix CI error on mismatch in Tensor dtypes

commit 39bae01
Merge: dd24d7d 71f3c88
Author: Tomoki Hayashi <[email protected]>
Date:   Wed May 11 17:53:04 2022 +0900

    Merge pull request espnet#4355 from kan-bayashi/fix_lid_in_gan_tts

commit dd24d7d
Merge: 2dde773 f7b3905
Author: Tomoki Hayashi <[email protected]>
Date:   Wed May 11 17:52:09 2022 +0900

    Merge pull request espnet#4206 from WeiGodHorse/master

commit 2dde773
Merge: beb3360 ec7e2b0
Author: Tomoki Hayashi <[email protected]>
Date:   Wed May 11 16:27:55 2022 +0900

    Merge pull request espnet#4356 from kan-bayashi/fix_mixed_precision_vits

    fix loss = NaN in VITS with mixed precision

commit 7a590cc
Author: espnetUser <[email protected]>
Date:   Wed May 11 09:25:03 2022 +0200

    Applied black formating to test_asr_inference.py for PR

commit ec7e2b0
Author: kan-bayashi <[email protected]>
Date:   Wed May 11 14:48:36 2022 +0900

    fixed black

commit 2be9ddc
Author: kan-bayashi <[email protected]>
Date:   Wed May 11 14:28:05 2022 +0900

    fixed mixed_precision NaN (espnet#4236)

commit 71f3c88
Author: kan-bayashi <[email protected]>
Date:   Wed May 11 13:39:59 2022 +0900

    fixed optional data names for TTS

commit ee57ff9
Author: espnetUser <[email protected]>
Date:   Tue May 10 22:37:18 2022 +0200

    Update asr_inference_streaming.py

    Fix dtype CI error

commit 272d5d0
Author: espnetUser <[email protected]>
Date:   Tue May 10 21:52:21 2022 +0200

    Update test_asr_inference.py

    Remove streaming=true parameter

commit c96e0d7
Author: espnetUser <[email protected]>
Date:   Tue May 10 21:25:57 2022 +0200

    Aplied black formating to test_asr_inference.py for PR

commit cd77501
Author: Yifan Peng <[email protected]>
Date:   Tue May 10 12:02:07 2022 -0400

    fix error for rnn encoders flatten_parameters

commit 3aafdb9
Author: espnetUser <[email protected]>
Date:   Tue May 10 17:05:48 2022 +0200

    Update asr_inference_streaming.py

    Bugfix in streaming inference espnet#4216

commit 61b5013
Author: espnetUser <[email protected]>
Date:   Tue May 10 16:58:14 2022 +0200

    Update test_asr_inference.py

    Added edge test case for streaming asr unit test and increased execution time out

commit 052dd60
Author: Yifan Peng <[email protected]>
Date:   Mon May 9 23:27:41 2022 -0400

    fix ci

commit 06e2a7a
Author: Yifan Peng <[email protected]>
Date:   Mon May 9 23:10:14 2022 -0400

    apply black

commit a48423f
Author: Yifan Peng <[email protected]>
Date:   Mon May 9 22:59:57 2022 -0400

    add test for espnet2 quantization

commit acb24c8
Author: Yifan Peng <[email protected]>
Date:   Mon May 9 22:59:39 2022 -0400

    add quantization to asr_inference

commit b98fc86
Author: kamo-naoyuki <[email protected]>
Date:   Tue May 10 11:52:27 2022 +0900

    fix

commit 3428f03
Merge: 4ff2ce1 beb3360
Author: Naoyuki Kamo <[email protected]>
Date:   Tue May 10 11:42:23 2022 +0900

    Merge branch 'master' into 1.11.0

commit 4ff2ce1
Author: kamo-naoyuki <[email protected]>
Date:   Tue May 10 11:34:31 2022 +0900

    add pytorch=1.10.1, 1.11.0 to ci configurations

commit beb3360
Merge: 537f9b6 79cda74
Author: Shinji Watanabe <[email protected]>
Date:   Mon May 9 16:27:37 2022 -0400

    Merge pull request espnet#4347 from YosukeHiguchi/espnet2_maskctc2

    Minor fix for Mask-CTC forward function

commit 79cda74
Author: Yosuke Higuchi <[email protected]>
Date:   Mon May 9 22:43:29 2022 +0900

    add kwargs in forward argument

commit 537f9b6
Merge: 793b999 9e8e753
Author: Shinji Watanabe <[email protected]>
Date:   Sun May 8 17:34:55 2022 -0400

    Merge pull request espnet#4343 from Emrys365/complex_support

    Fix a bug in stats aggregation when PITSolver is used

commit 9e8e753
Author: Wangyou Zhang <[email protected]>
Date:   Sat May 7 13:16:35 2022 +0800

    Apply black

commit 5ea4e08
Author: Wangyou Zhang <[email protected]>
Date:   Sat May 7 12:05:49 2022 +0800

    Fix a bug in stats aggregation when PITSolver is used

commit 6d1bd3a
Merge: eb6dc2d 793b999
Author: Chaitanya Narisetty <[email protected]>
Date:   Fri May 6 10:51:14 2022 -0400

    Merge branch 'espnet:master' into st_bugfix

commit eb6dc2d
Author: Chaitanya Narisetty <[email protected]>
Date:   Fri May 6 10:08:19 2022 -0400

    typo fix

commit 8c56ee8
Author: Chaitanya Narisetty <[email protected]>
Date:   Fri May 6 08:59:26 2022 -0400

    bug fixes in ST recipes

    * Change sampling frequency in `fbank.conf` and `pitch.conf` in Covost2 recipe
    * In `run.sh`, if language is low resource, then have more speed perturbations. Fix typos for test sets
    * In `st.sh`
      * fix directory naming issues to avoid replacement for different language pairs
      * Replace `>>` with `>` to replace previous inference results
      * Fix removing of empty text in stage 4
      * When removing utterance-ID in `ref.trn.org` or `hyp.trn.org`, the current implementation removes all words in parenthesis instead of removing just the utterance-ID from the end of each line. Fixed this by changing `perl -pe 's/\([^\)]+\)//g;'` to `perl -pe 's/\([^\)]+\)$//g;'`

commit f7b3905
Author: 魏宪豪 <[email protected]>
Date:   Fri May 6 20:18:05 2022 +0800

    change a test file to conform new pypinyin package

commit b83128f
Author: 魏宪豪 <[email protected]>
Date:   Fri May 6 17:54:20 2022 +0800

    Fix missing punctuation

commit 931fd22
Author: 魏宪豪 <[email protected]>
Date:   Fri May 6 16:54:31 2022 +0800

    reformat

commit 793b999
Merge: 4f41a1a 6d06728
Author: Shinji Watanabe <[email protected]>
Date:   Thu May 5 21:54:27 2022 -0400

    Merge pull request espnet#4330 from pyf98/show_translation_result

    Update show_translation_result.sh to show all decoding results under the given exp directory

commit 4f41a1a
Merge: a49cc60 f0d7cc2
Author: Shinji Watanabe <[email protected]>
Date:   Thu May 5 21:53:10 2022 -0400

    Merge pull request espnet#4329 from roshansh-cmu/wandb

    Wandb Minor Fix for Model Resume

commit a49cc60
Merge: de624ed 21fba33
Author: Shinji Watanabe <[email protected]>
Date:   Thu May 5 21:51:43 2022 -0400

    Merge pull request espnet#4338 from espnet/ftshijt-patch-1

    Fix typo

commit 21fba33
Author: Jiatong <[email protected]>
Date:   Thu May 5 21:25:10 2022 -0400

    Fix typo

commit de624ed
Merge: b757b89 fe28800
Author: Shinji Watanabe <[email protected]>
Date:   Thu May 5 16:10:44 2022 -0400

    Merge pull request espnet#4332 from simpleoier/chime6

    add chime6 recipe

commit c504336
Merge: 50269e8 b757b89
Author: 魏宪豪 <[email protected]>
Date:   Wed May 4 21:58:43 2022 +0800

    Merge remote-tracking branch 'upstream/master'

commit fe28800
Author: simpleoier <[email protected]>
Date:   Tue May 3 17:51:36 2022 -0400

    add egs2/chime6/asr1 recipe

commit 6d06728
Author: Yifan Peng <[email protected]>
Date:   Sat Apr 30 20:53:52 2022 -0400

    fix ci

commit 72333a8
Author: Yifan Peng <[email protected]>
Date:   Sat Apr 30 20:34:06 2022 -0400

    fix ci

commit f15e6ad
Author: Yifan Peng <[email protected]>
Date:   Sat Apr 30 18:54:37 2022 -0400

    quote expansion

commit f6731cd
Author: Yifan Peng <[email protected]>
Date:   Sat Apr 30 18:43:49 2022 -0400

    update mt.sh

commit 552060a
Author: Yifan Peng <[email protected]>
Date:   Sat Apr 30 18:41:41 2022 -0400

    update show translation result

commit f0d7cc2
Author: Roshan S Sharma <[email protected]>
Date:   Fri Apr 29 20:57:18 2022 -0400

    Delete resnet.py

commit 79c071e
Author: roshansh-cmu <[email protected]>
Date:   Fri Apr 29 20:54:37 2022 -0400

    Wandb minor fix for model resume

commit ffe7c58
Merge: 835033c b757b89
Author: Roshan S Sharma <[email protected]>
Date:   Fri Apr 29 20:45:47 2022 -0400

    Merge branch 'espnet:master' into master

commit b757b89
Merge: 930b380 664414c
Author: Tomoki Hayashi <[email protected]>
Date:   Fri Apr 29 16:11:56 2022 +0900

    Merge pull request espnet#4320 from cadia-lvl/add-progress-bar

commit 930b380
Merge: 2a48371 de81cf9
Author: Shinji Watanabe <[email protected]>
Date:   Thu Apr 28 16:30:34 2022 -0400

    Merge pull request espnet#4316 from simpleoier/enh_s2t

    add egs2/chime4/enh_asr1 recipe and results

commit de81cf9
Author: simpleoier <[email protected]>
Date:   Thu Apr 28 11:54:10 2022 -0400

    update egs2/chime4/enh_asr1/README.md and related enh1, asr1 configs.

commit 664414c
Author: kan-bayashi <[email protected]>
Date:   Thu Apr 28 21:31:45 2022 +0900

    fixed flake8

commit 2a48371
Merge: 72c1d8f 5a91782
Author: Shinji Watanabe <[email protected]>
Date:   Thu Apr 28 07:40:31 2022 -0400

    Merge pull request espnet#4243 from D-Keqi/master

    Add streaming ST/SLU

commit 72c1d8f
Merge: b7f0a5a 406656c
Author: Shinji Watanabe <[email protected]>
Date:   Thu Apr 28 07:37:23 2022 -0400

    Merge pull request espnet#4110 from earthmanylf/dpclanddan

    Merge Deep Clustering and Deep Attractor Network to enh separator

commit b7f0a5a
Merge: 44971ff 2d950f9
Author: Shinji Watanabe <[email protected]>
Date:   Thu Apr 28 07:33:11 2022 -0400

    Merge pull request espnet#4328 from Emrys365/egs2_aishell4

    Rename egs2/clarity21/enh_2021 to egs2/clarity21/enh1

commit 2d950f9
Author: Wangyou Zhang <[email protected]>
Date:   Thu Apr 28 16:58:26 2022 +0800

    Rename egs2/clarity21/enh_2021/

commit 2b66331
Author: simpleoier <[email protected]>
Date:   Thu Apr 28 00:59:22 2022 -0400

    fix small bugs and add CHiME4 enh_asr1 recipe & results

commit 406656c
Author: earthmanylf <[email protected]>
Date:   Thu Apr 28 11:10:11 2022 +0800

    Add custom name in __init__ in tf_domain.py; Merge test_dpcl_loss.py to test_tf_domain.py

commit 5a91782
Author: D-Keqi <[email protected]>
Date:   Thu Apr 28 10:31:29 2022 +0800

    use the another st_inference

commit 9e4bb7f
Author: D-Keqi <[email protected]>
Date:   Thu Apr 28 10:13:59 2022 +0800

    fix conflict

commit 21d2ac6
Merge: b801ddc 44971ff
Author: D-Keqi <[email protected]>
Date:   Thu Apr 28 10:12:15 2022 +0800

    Merge pull request espnet#17 from espnet/master

    merge the latest espnet

commit b801ddc
Author: D-Keqi <[email protected]>
Date:   Thu Apr 28 10:11:11 2022 +0800

    Add files via upload

commit 316cf02
Author: D-Keqi <[email protected]>
Date:   Thu Apr 28 10:04:29 2022 +0800

    fix conflict

commit 9b33b79
Author: earthmanylf <[email protected]>
Date:   Wed Apr 27 23:22:22 2022 +0800

    Fix format

commit 346a424
Author: earthmanylf <[email protected]>
Date:   Wed Apr 27 22:37:22 2022 +0800

    Fix format

commit 44971ff
Merge: 0ae3773 c4b93e8
Author: Jiatong <[email protected]>
Date:   Wed Apr 27 10:13:03 2022 -0400

    Merge pull request espnet#4324 from ftshijt/master

    Add Test Functions for ST Train and Inference

commit 0d3be31
Author: earthmanylf <[email protected]>
Date:   Wed Apr 27 22:09:12 2022 +0800

    Fix format

commit b24d108
Merge: 4c679c0 f1312a8
Author: earthmanylf <[email protected]>
Date:   Wed Apr 27 21:29:33 2022 +0800

    Fix conflict

commit 4c679c0
Merge: a90e2ec 0ae3773
Author: earthmanylf <[email protected]>
Date:   Wed Apr 27 21:15:33 2022 +0800

    Fix conflict

commit 10e6c7e
Author: Gunnar Thor <[email protected]>
Date:   Wed Apr 27 09:30:47 2022 +0000

    split docstring to conform with linter

commit c4b93e8
Author: ftshijt <[email protected]>
Date:   Wed Apr 27 01:49:00 2022 -0400

    apply black

commit 04d0cd8
Merge: 72b6b21 4a12ab3
Author: ftshijt <[email protected]>
Date:   Wed Apr 27 01:27:36 2022 -0400

    Merge branch 'master' of https://github.com/ftshijt/espnet

commit 72b6b21
Author: ftshijt <[email protected]>
Date:   Wed Apr 27 01:27:09 2022 -0400

    add st unit test

commit d1e8ac3
Author: ftshijt <[email protected]>
Date:   Wed Apr 27 01:15:18 2022 -0400

    update test

commit 5fb7dd6
Author: ftshijt <[email protected]>
Date:   Wed Apr 27 00:53:46 2022 -0400

    remove requirement for src_token_list

commit 4118b1b
Author: D-Keqi <[email protected]>
Date:   Wed Apr 27 10:31:42 2022 +0800

    fix conflict

commit 5436784
Author: D-Keqi <[email protected]>
Date:   Wed Apr 27 10:06:19 2022 +0800

    Update test_integration_espnet2.sh

commit 469168b
Author: D-Keqi <[email protected]>
Date:   Wed Apr 27 10:04:56 2022 +0800

    fix issue

commit 06ddfe1
Author: D-Keqi <[email protected]>
Date:   Wed Apr 27 10:01:38 2022 +0800

    fix conflict

commit 5a81f91
Author: D-Keqi <[email protected]>
Date:   Wed Apr 27 09:57:18 2022 +0800

    fix conflict

commit 91d48d9
Author: Gunnar Thor <[email protected]>
Date:   Tue Apr 26 22:21:13 2022 +0000

    applied black

commit ec518cc
Author: Gunnar Thor <[email protected]>
Date:   Wed Feb 23 11:31:56 2022 +0000

    Add progress bar to phonemization

commit f1312a8
Author: earthmanylf <[email protected]>
Date:   Mon Apr 25 10:37:19 2022 +0800

    Update README.md

    Co-authored-by: Wangyou Zhang <[email protected]>

commit a90e2ec
Author: earthmanylf <[email protected]>
Date:   Sun Apr 24 22:55:54 2022 +0800

    Fix format problems

commit be0112b
Author: earthmanylf <[email protected]>
Date:   Sun Apr 24 22:06:45 2022 +0800

    Fix format problems

commit 16acdad
Merge: feb28ba f6a2522
Author: earthmanylf <[email protected]>
Date:   Sun Apr 24 21:14:02 2022 +0800

    Fix conflict

commit 95be28a
Author: D-Keqi <[email protected]>
Date:   Sat Apr 23 14:47:11 2022 +0800

    Fix CI

commit a0966f6
Author: D-Keqi <[email protected]>
Date:   Sat Apr 23 14:46:10 2022 +0800

    Fix CI

commit 1daecd4
Author: D-Keqi <[email protected]>
Date:   Sat Apr 23 14:44:21 2022 +0800

    fix CI

commit 7261735
Merge: 809106e f6a2522
Author: D-Keqi <[email protected]>
Date:   Sat Apr 23 14:21:06 2022 +0800

    Merge pull request espnet#15 from espnet/master

    Merging the latest ESPnet

commit 809106e
Author: D-Keqi <[email protected]>
Date:   Sat Apr 23 12:33:18 2022 +0800

    show the log result

commit 65b5356
Author: D-Keqi <[email protected]>
Date:   Sat Apr 23 11:10:41 2022 +0800

    show the error report in the log

commit 36bdfcb
Author: D-Keqi <[email protected]>
Date:   Thu Apr 21 15:21:07 2022 +0800

    fix ci

commit c8e05ef
Author: D-Keqi <[email protected]>
Date:   Thu Apr 21 11:30:54 2022 +0800

    fix ci

commit 4831a66
Author: D-Keqi <[email protected]>
Date:   Wed Apr 20 20:34:26 2022 +0800

    fix CI

commit 26fc7e1
Author: D-Keqi <[email protected]>
Date:   Wed Apr 20 16:37:29 2022 +0800

    Add files via upload

commit b7c7bf1
Author: D-Keqi <[email protected]>
Date:   Wed Apr 20 15:19:37 2022 +0800

    fix ci

commit 2b1b6bb
Author: D-Keqi <[email protected]>
Date:   Wed Apr 20 11:33:40 2022 +0800

    fix fbank_pitch issue

commit 0d5736f
Author: D-Keqi <[email protected]>
Date:   Wed Apr 20 11:33:21 2022 +0800

    fix fbank_pitch issue

commit 835033c
Merge: fcf13c4 42eb310
Author: Roshan S Sharma <[email protected]>
Date:   Tue Apr 19 07:36:09 2022 -0400

    Merge branch 'espnet:master' into master

commit 70c1980
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 19:01:41 2022 +0800

    fix CI

commit fabb3a1
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:39:39 2022 +0800

    update the test_integration_espnet2

commit c08e023
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:36:09 2022 +0800

    Update and rename tmp to path.sh

commit 838d2ec
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:35:08 2022 +0800

    Add files via upload

commit 62162ae
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:33:31 2022 +0800

    Create tmp

commit 9a5585e
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:33:00 2022 +0800

    Delete t

commit 349f4ab
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:31:43 2022 +0800

    add conf

commit e3486d2
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:28:12 2022 +0800

    Create t

commit 652cf17
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:27:47 2022 +0800

    Delete tmp

commit 48fcab7
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:27:12 2022 +0800

    add st1 of mini_an4

commit 1800b0b
Author: D-Keqi <[email protected]>
Date:   Tue Apr 19 16:25:21 2022 +0800

    Create tmp

commit 0a1d05b
Merge: 73ca6e4 952a70a
Author: D-Keqi <[email protected]>
Date:   Wed Apr 13 10:20:46 2022 +0800

    Merge pull request espnet#14 from espnet/master

    Merge the latest ESPnet

commit 73ca6e4
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:59:52 2022 +0800

    fix ci

    fix ci

commit acd3e0a
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:58:34 2022 +0800

    fix CI

    fix CI

commit e6da9ba
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:16:45 2022 +0800

    Add files via upload

commit fc45fa3
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:13:53 2022 +0800

    Delete README.md

commit 5b8c0b5
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:13:11 2022 +0800

    Delete egs2/chime4/asr1/exp/asr_train_asr_streaming_transformer_raw_en_char/decode_asr_streamindt05_real_beamformit_2micsg_lm_lm_train_lm_en_char_valid.loss.ave_asr_model_valid.acc.ave directory

commit 87ac110
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:10:14 2022 +0800

    streaming slu

commit 7b7fde9
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:09:27 2022 +0800

    streaming slu

commit fcd1296
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:08:55 2022 +0800

    streaming st

commit 17fe79c
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:07:28 2022 +0800

    streaming st

commit 812a527
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:06:31 2022 +0800

    streaming st

commit e69a6d8
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 17:05:25 2022 +0800

    streaming st

commit e488037
Merge: 9fb4450 189e159
Author: D-Keqi <[email protected]>
Date:   Thu Apr 7 15:32:57 2022 +0800

    Merge pull request espnet#13 from espnet/master

    Update lastest espnet

commit fcf13c4
Merge: 39700a0 c4aba12
Author: Roshan S Sharma <[email protected]>
Date:   Wed Apr 6 13:35:13 2022 -0400

    Merge branch 'espnet:master' into master

commit feb28ba
Merge: 3e6167c c4aba12
Author: earthmanylf <[email protected]>
Date:   Wed Apr 6 19:24:06 2022 +0800

    Add deep clustering end-to-end training method

commit 50269e8
Author: WeiGodHorse <[email protected]>
Date:   Fri Mar 25 22:58:41 2022 +0800

    fix a bug in Mandarin pypinyin_g2p_phone

commit 39700a0
Merge: aa706c5 14c6350
Author: Roshan S Sharma <[email protected]>
Date:   Thu Mar 24 17:42:11 2022 -0400

    Merge branch 'espnet:master' into master

commit aa706c5
Merge: ab2fa25 350af36
Author: Roshan S Sharma <[email protected]>
Date:   Wed Mar 23 23:34:17 2022 -0400

    Merge branch 'espnet:master' into master

commit ab2fa25
Merge: de5e713 cb8181a
Author: Roshan S Sharma <[email protected]>
Date:   Tue Mar 8 16:03:38 2022 -0500

    Merge branch 'espnet:master' into master

commit de5e713
Merge: 5ef36bc 1bac0f0
Author: Roshan S Sharma <[email protected]>
Date:   Tue Mar 8 15:09:20 2022 -0500

    Merge branch 'espnet:master' into master

commit 5ef36bc
Merge: 597cd7b 0c246e2
Author: Roshan S Sharma <[email protected]>
Date:   Tue Mar 8 13:35:27 2022 -0500

    Merge branch 'espnet:master' into master

commit 597cd7b
Merge: 6625f90 f16e579
Author: Roshan S Sharma <[email protected]>
Date:   Mon Mar 7 21:54:06 2022 -0500

    Merge branch 'espnet:master' into master

commit 6625f90
Merge: 5f23786 5e07066
Author: Roshan S Sharma <[email protected]>
Date:   Mon Mar 7 13:35:03 2022 -0500

    Merge branch 'espnet:master' into master

commit 3e6167c
Author: earthmanylf <[email protected]>
Date:   Mon Mar 7 20:03:31 2022 +0800

    Fixed format in some files

commit 294373a
Author: earthmanylf <[email protected]>
Date:   Mon Mar 7 18:26:49 2022 +0800

    Update code and add comments in separator

commit 5f86c11
Merge: 7aa90b5 6f42960
Author: earthmanylf <[email protected]>
Date:   Mon Mar 7 18:06:10 2022 +0800

    Add experiment result in egs2/wsj0_2mix/enh1/README.md; Update code in some files

commit 5f23786
Merge: 66c1a79 6f42960
Author: Roshan S Sharma <[email protected]>
Date:   Sun Mar 6 19:26:35 2022 -0500

    Merge branch 'espnet:master' into master

commit 66c1a79
Merge: 5c5eb02 a04a98c
Author: Roshan S Sharma <[email protected]>
Date:   Thu Mar 3 18:14:47 2022 -0500

    Merge branch 'espnet:master' into master

commit 7aa90b5
Merge: 5f7e2e7 b274c4e
Author: earthmanylf <[email protected]>
Date:   Thu Mar 3 16:20:25 2022 +0800

    Merge branch 'master' of github.com:espnet/espnet into dpclanddan

commit 5c5eb02
Merge: bd8e400 9863980
Author: Roshan S Sharma <[email protected]>
Date:   Wed Mar 2 12:13:35 2022 -0500

    Merge branch 'espnet:master' into master

commit bd8e400
Merge: 58aec43 7999009
Author: Roshan S Sharma <[email protected]>
Date:   Mon Feb 28 20:37:32 2022 -0500

    Merge branch 'espnet:master' into master

commit 5f7e2e7
Merge: d3acdcc 637d8c3
Author: earthmanylf <[email protected]>
Date:   Sun Feb 27 13:19:45 2022 +0800

    Merge branch 'master' of github.com:espnet/espnet into dpclanddan

commit d3acdcc
Author: earthmanylf <[email protected]>
Date:   Fri Feb 25 18:32:30 2022 +0800

    fix bugs of test_dan_separator.py

commit c54d9a4
Author: earthmanylf <[email protected]>
Date:   Fri Feb 25 16:00:30 2022 +0800

    add subs to the abs_separator.py

commit c1d9be5
Author: earthmanylf <[email protected]>
Date:   Fri Feb 25 15:30:46 2022 +0800

    update for dpcl and dan

commit 58aec43
Merge: 23a537e 9c24b3a
Author: Roshan S Sharma <[email protected]>
Date:   Wed Feb 23 16:17:09 2022 -0500

    Merge branch 'espnet:master' into master

commit 23a537e
Author: roshansh-cmu <[email protected]>
Date:   Tue Feb 22 06:50:03 2022 -0500

    black fix

commit 8572a57
Merge: 969b333 650472b
Author: roshansh-cmu <[email protected]>
Date:   Mon Feb 21 22:35:49 2022 -0500

    Mergefix

commit ee20e18
Merge: 63f88c0 a3e1543
Author: earthmanylf <[email protected]>
Date:   Wed Feb 16 14:29:36 2022 +0800

    Merge pull request #1 from espnet/master

    Merge from upstream

commit 9fb4450
Author: D-Keqi <[email protected]>
Date:   Wed Sep 15 00:30:05 2021 +0800

    Update README.md

commit 8c6d3e1
Author: D-Keqi <[email protected]>
Date:   Wed Sep 15 00:29:31 2021 +0800

    Update README.md

commit 2411dbb
Author: D-Keqi <[email protected]>
Date:   Mon Sep 13 13:08:52 2021 +0800

    Update README.md

commit 3edc1a6
Author: D-Keqi <[email protected]>
Date:   Mon Sep 13 13:08:25 2021 +0800

    Update README.md

commit d4d4b7e
Author: D-Keqi <[email protected]>
Date:   Sat Sep 11 23:11:39 2021 +0800

    Update README.md

commit 885ab05
Author: D-Keqi <[email protected]>
Date:   Sat Sep 4 10:48:05 2021 +0800

    add results

commit dfba960
Author: D-Keqi <[email protected]>
Date:   Sat Sep 4 10:43:36 2021 +0800

    create exp

commit 391d7c7
Author: D-Keqi <[email protected]>
Date:   Sat Sep 4 10:40:23 2021 +0800

    steaming results
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Bug bug should be fixed ESPnet2 TTS Text-to-speech Wontfix Want to fix
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix loss = NaN in VITS with mixed precision kan-bayashi/espnet
2 participants
@ariacat3366 @kan-bayashi