Back to pull request #2801

Refactor turbomind attention by precomputing rotary embed #1104

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
cuda-11.8	17m 7s
cuda-12.1	16m 55s
	34m 2s