Skip to content

Commit

Permalink
Fix signal handling
Browse files Browse the repository at this point in the history
  • Loading branch information
lukechilds authored Aug 16, 2023
1 parent 067c68b commit 59f51d7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion api/run.sh
Original file line number Diff line number Diff line change
Expand Up @@ -25,4 +25,4 @@ echo "Number of CPU threads: $n_threads"
echo "Number of GPU layers: $n_gpu_layers"
echo "Context window: $n_ctx"

python3 -m llama_cpp.server --n_ctx $n_ctx --n_threads $n_threads --n_gpu_layers $n_gpu_layers --n_batch $n_batch
exec python3 -m llama_cpp.server --n_ctx $n_ctx --n_threads $n_threads --n_gpu_layers $n_gpu_layers --n_batch $n_batch

0 comments on commit 59f51d7

Please sign in to comment.