accelerate
auto-gptq --extra-index-url https://huggingface.github.io/autogptq-index/whl/cu118/
gradio
langchain
pipeline
ctransformers
torch