Linux Install Fails on Exllamav2

[phatgeek]

Expected Behavior

Builds without errors

Current Behavior

Fails to install Exllamav2, but then completes the installation. Can't use Exllamav2.

Steps to Reproduce

1. #> scripts/linux/linux_install.sh
2. wait
3. #> scripts/linux/linux_run.sh

Possible Solution

I identified the problem: there are inconsistent version requirements for aqlm. Some requirements.txt files require exactly 1.1.0, some exactly 1.3.0, and in the case of Exllamav2, the requirements.txt file contains requirements for BOTH versions. I have a feeling the "solution" to this is going to be complicated. Obviously, miniconda can't install both versions, and I suspect that there are legitimate requirements for both.

Context

Please provide any additional context about the issue.

Screenshots

If applicable, add screenshots to help explain the issue.

[belaelekelemer]

Similar issue on windows (hardware rtx 3060, p106-100) error message:
DLL load failed while importing exllamav2_ext: The specified procedure could not be found.