After the request is processed, the result will not be returned immediately. #2419

majiang213 · 2024-08-08T11:10:57Z

majiang213
Aug 8, 2024

Hi, everyone

I am developing a TTS service.When my program runs more than 10 concurrently, the returned results will be delayed.The code does not return the result to the client immediately after processing.The request results will be returned in batches after these concurrent requests are completed. What is the reason for this?

This is my demonstration code and log. You can see that the business code I wrote has been processed, but the results are not returned immediately. They will only be returned in batches after all results have been processed.
In addition, my resources are limited and do not support me starting multiple worker

from fastapi import FastAPI, Body
from fastapi.responses import FileResponse
import urllib.parse
import re
import asyncio
import aiofiles

app = FastAPI()

async def replace_numbers(match):
    # Simulate an asynchronous number replacement function
    return match.group(0)

async def vits(volume, speed, speaker, text_content):
    ...
    print(
            f"----------------------svc genration-----------------------total time:{e - a}, Clone time:{d - c}, TTS time:{b - a}"
    )
    return filepath, "generated_audio.wav"

async def process_text_content(text_content, placeHolderList):
    ...
    return text_content

@app.post("/vits")
async def synthesize(
    content: str = Body(..., description="text dictionary type"),
    placeHolderList: list = Body(default=None, description="text dictionary type"),
    speaker: str = Body(default="default_speaker", description="Select a voice"),
    volume: int = Body(default=0, description="control volume"),
    speed: int = Body(default=50, description="Adjust speed"),
):
    print(f"Request received..........{current_thread}")
    text_content = urllib.parse.unquote(content)
    text_content = await process_text_content(text_content, placeHolderList)

    filepath, filename = await vits(
        volume=volume, speed=speed, speaker=speaker, text_content=text_content
    )
    print("Request processing completed..........")
    return FileResponse(filepath, media_type="audio/wav")

logs

Request received..........<_MainThread(MainThread, started 139811979544384)>
text: Halo, layanan pelanggan saat ini tidak online, silakan hubungi nanti. Hello, there is currently no customer service online, please call later.

----------------------svc genration-----------------------total time:1.0552172660827637, Clone time:0.8010594844818115, TTS time:0.2388448715209961
Request processing completed..........



Request received..........<_MainThread(MainThread, started 139811979544384)>
text: Halo, layanan pelanggan saat ini tidak online, silakan hubungi nanti. Hello, there is currently no customer service online, please call later.

----------------------svc genration-----------------------total time:1.0490658283233643, Clone time:0.7963895797729492, TTS time:0.23700189590454102
Request processing completed..........



Request received..........<_MainThread(MainThread, started 139811979544384)>
text: Halo, layanan pelanggan saat ini tidak online, silakan hubungi nanti. Hello, there is currently no customer service online, please call later.

----------------------svc genration-----------------------total time:1.0482192039489746, Clone time:0.7977125644683838, TTS time:0.23594164848327637
Request processing completed..........



Request received..........<_MainThread(MainThread, started 139811979544384)>
text: Halo, layanan pelanggan saat ini tidak online, silakan hubungi nanti. Hello, there is currently no customer service online, please call later.

----------------------svc genration-----------------------total time:1.0548272132873535, Clone time:0.8033430576324463, TTS time:0.23668241500854492
Request processing completed..........



Request received..........<_MainThread(MainThread, started 139811979544384)>
text: Halo, layanan pelanggan saat ini tidak online, silakan hubungi nanti. Hello, there is currently no customer service online, please call later.

----------------------svc genration-----------------------total time:1.058450698852539, Clone time:0.8062844276428223, TTS time:0.23761868476867676
Request processing completed..........

INFO:     192.168.75.46:53134 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53122 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53150 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53154 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53160 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53180 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53176 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53184 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53182 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53198 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53200 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53208 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53218 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53234 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53244 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53250 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53254 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53260 - "POST /vits HTTP/1.1" 200 OK
INFO:     192.168.75.46:53268 - "POST /vits HTTP/1.1" 200 OK

Running uvicorn 0.30.5 with CPython 3.8.18 on Linux

Answered by Kludex

Aug 8, 2024

You are probably blocking the event loop somehow.

You need to present an MRE.

View full answer

majiang213 · 2024-08-08T11:15:29Z

majiang213
Aug 8, 2024
Author

The above problem causes a long waiting time for all requests during the stress test.

0 replies

Kludex · 2024-08-08T11:18:20Z

Kludex
Aug 8, 2024
Maintainer Sponsor

You are probably blocking the event loop somehow.

You need to present an MRE.

3 replies

majiang213 Aug 9, 2024
Author

You are probably blocking the event loop somehow.

You need to present an MRE.

Sorry for the late reply

Please refer to this MRE. When returning a file, the loop event will be blocked.
When returning a JSON, there is no such problem at all

import threading

from fastapi import FastAPI
from fastapi.responses import FileResponse
import asyncio

app = FastAPI()

@app.post("/vits")
async def vits():
    current_thread = threading.current_thread()
    print(f"Request received..........{current_thread} and sleep 3s")
    await asyncio.sleep(3)
    print(f"Request completed..........{current_thread} and sleep 3s")
    # return {"message": "Hello World"}
    return FileResponse("./audio/warning_warning.wav", media_type="audio/wav")

if __name__ == '__main__':
    import uvicorn

    uvicorn.run("main:app", host="0.0.0.0", port=18080, workers=1)

Kludex Aug 9, 2024
Maintainer Sponsor

It looks like a Starlette issue. Can you create an issue there, please? Also, this is still not an MRE - I don't have your audio file. Please make it easier for me to help you.

majiang213 Aug 9, 2024
Author

warning_warning.zip
Sorry, I overlooked it because it was just a normal audio file. I'll submit an issue

majiang213 · 2024-08-09T09:08:56Z

majiang213
Aug 9, 2024
Author

Returns a file

Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
INFO:     127.0.0.1:60818 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60817 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60819 - "POST /vits HTTP/1.1" 200 OK
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request received..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
INFO:     127.0.0.1:60826 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60827 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60830 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60828 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60829 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60825 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60824 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
INFO:     127.0.0.1:60848 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60839 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60838 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60832 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60843 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60834 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60845 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60844 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60854 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60833 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60842 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60841 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60849 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60837 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60852 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60836 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60840 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60835 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60831 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60850 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60847 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60846 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60853 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60851 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 29548)> and sleep 3s
INFO:     127.0.0.1:60862 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60867 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60856 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60859 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60864 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60860 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60861 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60866 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60869 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60871 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60865 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60870 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60857 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60858 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60863 - "POST /vits HTTP/1.1" 200 OK
INFO:     127.0.0.1:60868 - "POST /vits HTTP/1.1" 200 OK

Returns a JSON

equest received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59989 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59988 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59987 - "POST /vits HTTP/1.1" 200 OK
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request received..........<_MainThread(MainThread, started 7264)> and sleep 3s
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59992 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59990 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59991 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60000 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59998 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59993 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59999 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60001 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59997 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60003 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59996 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59995 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60005 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60004 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:59994 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60002 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60015 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60009 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60014 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60010 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60013 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60016 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60011 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60012 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60008 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60007 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60006 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60020 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60019 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60017 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60018 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60030 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60033 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60031 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60034 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60035 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60032 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60021 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60029 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60028 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60024 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60023 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60022 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60036 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60026 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60025 - "POST /vits HTTP/1.1" 200 OK
Request completed..........<_MainThread(MainThread, started 7264)> and sleep 3s
INFO:     127.0.0.1:60027 - "POST /vits HTTP/1.1" 200 OK

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

After the request is processed, the result will not be returned immediately. #2419

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments 3 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

After the request is processed, the result will not be returned immediately. #2419

majiang213 Aug 8, 2024

Replies: 3 comments · 3 replies

majiang213 Aug 8, 2024 Author

Kludex Aug 8, 2024 Maintainer Sponsor

majiang213 Aug 9, 2024 Author

Kludex Aug 9, 2024 Maintainer Sponsor

majiang213 Aug 9, 2024 Author

majiang213 Aug 9, 2024 Author

majiang213
Aug 8, 2024

Replies: 3 comments 3 replies

majiang213
Aug 8, 2024
Author

Kludex
Aug 8, 2024
Maintainer Sponsor

majiang213 Aug 9, 2024
Author

Kludex Aug 9, 2024
Maintainer Sponsor

majiang213 Aug 9, 2024
Author

majiang213
Aug 9, 2024
Author