Commits

Breadcrumbs

History for

onsetup

User selector

All users

All time

Commit History

Commits on May 8, 2023

• Fix: default repeat_penalty

  abetlen

  committed
  82d138f

  Copy full SHA for 82d138f

• Bugfix: not falling back to environment variables when default is value is set.

  abetlen

  committed
  29f094b

  Copy full SHA for 29f094b

• Show default value when --help is called

  abetlen

  committed
  0d6c600

  Copy full SHA for 0d6c600

• Use environment variable if parsed cli arg is None

  abetlen

  committed
  022e9eb

  Copy full SHA for 022e9eb

• Set repeat_penalty to 0 by default

  abetlen

  committed
  0d751a6

  Copy full SHA for 0d751a6

• Add openai frequency and presence penalty parameters. Closes #169

  abetlen

  committed
  65d9cc0

  Copy full SHA for 65d9cc0

• Bugfix for models endpoint

  abetlen

  committed
  a0b61ea

  Copy full SHA for a0b61ea

Commits on May 7, 2023

• Added cache size to settins object.

  abetlen

  committed
  14da46f

  Copy full SHA for 14da46f

• Add verbose flag to server

  abetlen

  committed
  627811e

  Copy full SHA for 627811e

• Fix mlock_supported and mmap_supported return type

  abetlen

  committed
  3fbda71

  Copy full SHA for 3fbda71

• Update cpu_count

  abetlen

  committed
  5a3413e

  Copy full SHA for 5a3413e

• Update settings fields and defaults

  abetlen

  committed
  1a00e45

  Copy full SHA for 1a00e45

• Revert "llama_cpp server: delete some ignored / unused parameters"

  Show description for 8675397
  abetlen

  committed
  8675397

  Copy full SHA for 8675397

• Revert "llama_cpp server: mark model as required"

  Show description for c382d8f
  abetlen

  committed
  c382d8f

  Copy full SHA for c382d8f

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into better-server-params-and-fields

  abetlen

  committed
  d8fddcc

  Copy full SHA for d8fddcc

Commits on May 5, 2023

• Add cli options to server. Closes #37

  abetlen

  committed
  24fc387

  Copy full SHA for 24fc387

Commits on May 2, 2023

• llama_cpp server: prompt is a string

  Show description for b9098b0
  Stonelinks

  committed
  b9098b0

  Copy full SHA for b9098b0

• Merge branch 'main' into better-server-params-and-fields

  abetlen

  authored
  7ab08b8

  Copy full SHA for 7ab08b8

• Refactor server to use factory

  abetlen

  committed
  9eafc4c

  Copy full SHA for 9eafc4c

Commits on May 1, 2023

• llama_cpp server: fix to ChatCompletionRequestMessage

  Show description for dbbfc4b
  Stonelinks

  committed
  dbbfc4b

  Copy full SHA for dbbfc4b

• llama_cpp server: fields for the embedding endpoint

  Stonelinks

  committed
  fa2a61e

  Copy full SHA for fa2a61e

• llama_cpp server: define fields for chat completions

  Show description for 8dcbf65
  Stonelinks

  committed
  8dcbf65

  Copy full SHA for 8dcbf65

• llama_cpp server: add some more information to fields for completions

  Stonelinks

  committed
  978b6da

  Copy full SHA for 978b6da

• llama_cpp server: add missing top_k param to CreateChatCompletionRequest

  Show description for a5aa6c1
  Stonelinks

  committed
  a5aa6c1

  Copy full SHA for a5aa6c1

• llama_cpp server: move logprobs to supported

  Show description for 1e42913
  Stonelinks

  committed
  1e42913

  Copy full SHA for 1e42913

• llama_cpp server: delete some ignored / unused parameters

  Show description for b47b954
  Stonelinks

  committed
  b47b954

  Copy full SHA for b47b954

• llama_cpp server: mark model as required

  Show description for e40fcb0
  Stonelinks

  committed
  e40fcb0

  Copy full SHA for e40fcb0

• Fix import error

  abetlen

  committed
  9ff9cdd

  Copy full SHA for 9ff9cdd

Commits on Apr 29, 2023

• llama_cpp server: slight refactor to init_llama function

  Show description for efe8e6f
  Stonelinks

  committed
  efe8e6f

  Copy full SHA for efe8e6f

• tests: simple test for server module

  Stonelinks

  committed
  6d8db9d

  Copy full SHA for 6d8db9d

• llama_cpp server: app is now importable, still runnable as a module

  Stonelinks

  committed
  468377b

  Copy full SHA for 468377b

Commits on Apr 25, 2023

• Update n_batch for server

  abetlen

  committed
  3cab3ef

  Copy full SHA for 3cab3ef

Commits on Apr 19, 2023

• Add use_mmap flag to server

  abetlen

  committed
  e4647c7

  Copy full SHA for e4647c7

Commits on Apr 15, 2023

• Add experimental cache

  abetlen

  committed
  92c0771

  Copy full SHA for 92c0771

Commits on Apr 14, 2023

• Fix completion request

  abetlen

  committed
  6c7cec0

  Copy full SHA for 6c7cec0