Queue concurrency 1 to prevent CUDA OOM

Mandatory for me as I have a RTX 2070 (8Gb) and I get CUDA OOM if two users launch jobs at the same time. I can also use multiple tabs and jobs will be queued. You may not want it to be the default though.

Queue concurrency 1 to prevent CUDA OOM
Mandatory for me as I have a RTX 2070 (8Gb) and I get CUDA OOM if two users launch jobs at the same time. I can also use multiple tabs and jobs will be queued. You may not want it to be the default though.
20c33f44 · orionaskatu · GitHub · 93e7dbaa · 20c33f44
Commit 20c33f44 authored Aug 28, 2022 by orionaskatu Committed by GitHub Aug 28, 2022
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

webui.py webui.py +1 -0

No files found.
--- a/webui.py
+++ b/webui.py
@@ -1340,4 +1340,5 @@ demo = gr.TabbedInterface(
 """
 )

+demo.queue(concurrency_count=1)
 demo.launch()