Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failed to initialize MR pool sized 128 for QID 24 #27

Open
conodonn opened this issue May 23, 2024 · 0 comments
Open

failed to initialize MR pool sized 128 for QID 24 #27

conodonn opened this issue May 23, 2024 · 0 comments

Comments

@conodonn
Copy link

nvme connect-all -t rdma -a 192.168.1.134 -s 4791

successfully connect to 32 out of the 64 NVME drives on the target then i get
failed to initialize MR pool sized 128 for QID 24

DMESG entries:

[31824.315076] nvme nvme32: creating 63 I/O queues.
[31824.571490] nvme nvme32: failed to initialize MR pool sized 128 for QID 24
[31824.571747] nvme nvme32: rdma connection establishment failed (-12)

stats after the failure shows active mr gets close to max

    Max QP:         65537
    Max SRQ:        4096
    Max CQ:         65536
    Max MR:         262144
    Max MW:         262144
    Max AH:         131072
    Max PD:         65536
    Active QP:      2049
    Active RC QP:   2048
    Active UD QP:   0
    Active SRQ:     0
    Active CQ:      379
    Active MR:      259072
    Active MW:      0
    Active AH:      0
    Active PD:      2
    QP Watermark:   2074

Can i increae MX MR ????

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant