探索中文instruct数据在ChatGLM-6B上微调表现,结合PEFT等方法降低资源需求。
目前已微调好的一版模型权重可自行下载体验(Google Drive))
conda env create -f env.yml -n bab
conda activate bab
pip install git+https://github.com/huggingface/peft.git
Run bash dataprocess.sh
to process the data.
Run bash finetune.sh
to finetune the model.
Run python infer.py
to do the inference. Show cases in the dataset by default.
You can also choose to interact with the model through the annotation section.