Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: speed up maskgct #355

Open
hjc3613 opened this issue Nov 20, 2024 · 5 comments
Open

[Feature]: speed up maskgct #355

hjc3613 opened this issue Nov 20, 2024 · 5 comments
Labels
enhancement New feature or request

Comments

@hjc3613
Copy link

hjc3613 commented Nov 20, 2024

Is your feature request related to a problem? Please describe.

(A clear and concise description of what the problem is.)
when I generate 20s audio, the time cost is about 1 minutes, which cannot meet my requirements

Describe the solution you'd like

(A clear and concise description of what you want to happen.)
expect that the cost time reduced to 10s

Describe alternatives you've considered

(A clear and concise description of any alternative solutions or features you've considered.)

Additional context

(Add any other context or screenshots about the feature request here.)

@hjc3613 hjc3613 added the enhancement New feature or request label Nov 20, 2024
@SunnyTian
Copy link

OMG! The time is 1200S when I ran the maskgct demo.
1732357435441

@jiaqili3
Copy link
Collaborator

We are actively developing a faster version together with more fast tts models, thanks for the attention and we'll release them soon before new year

@jiaqili3
Copy link
Collaborator

OMG! The time is 1200S when I ran the maskgct demo.
1732357435441

Could you kindly check that you're using gpu for inference, otherwise it'll be very slow. Thanks!

@SunnyTian
Copy link

SunnyTian commented Nov 26, 2024

OMG! The time is 1200S when I ran the maskgct demo.
1732357435441

Could you kindly check that you're using gpu for inference, otherwise it'll be very slow. Thanks!

922bdc8f3861275bdfcfb5414c1188c

yes,I can see CUDA is available and the usage of GPU is 100%,but it seems that the GPU only works after a long time of the "maskgct_inference" function execution

@wen0320
Copy link

wen0320 commented Dec 6, 2024

是的,我可以看到 CUDA 可用并且 GPU 的使用率是 100%,但似乎 GPU 只有在长时间的“maskgct_inference”函数执行后才能工作

You should be running for the first time, and the first run will be a short pre-training model that will be downloaded independently, so it takes time

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants