Vllm support ？
#1
by
justinliu12138 - opened
How to use it through vllm serve……
We are currently working hard on this and expect to add vLLM support in the next 1-2 weeks.
sudongpo changed discussion status to
closed
How to use it through vllm serve……
We are currently working hard on this and expect to add vLLM support in the next 1-2 weeks.