We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
This is a swift clone of examples/batched.
examples/batched
$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]