Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REQ] Exposing cublasDx Layout database #231

Open
osayamenja opened this issue Oct 26, 2024 · 0 comments
Open

[REQ] Exposing cublasDx Layout database #231

osayamenja opened this issue Oct 26, 2024 · 0 comments
Labels

Comments

@osayamenja
Copy link

Hello!

I have been checking the internals of cublasdx and I am really amazed with the layout database abstraction. That is, I work with CUTLASS CollectiveMMA, and it takes an expert to get the correct template parameters (TiledMMA, Swizzle Layouts and Copy Operations) that give peak performance.

The cublasDx layout database has seemingly (some qualification needed) solved this problem as the user only specifies a high level GEMM description, which the framework maps to optimal template configurations.

However, as of today, only the smem layouts are exposed via suggest_smem_layout(), understandably so, as this layout is necessary for constructing the tensor arguments passed to the execute(...) method.

My ask, is for a different use case, leveraging cublasDx GEMM descriptions and optimal configurations for CUTLASS methods directly. That is, it would be very helpful if the internally selected TiledMMA and Copy Operations were exposed as well.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants