Commits

Breadcrumbs

History for

onbatch-processing

User selector

All users

All time

Commit History

Commits on Jan 17, 2024

• Integration of Jinja2 Templating (#875)

  Show description for 6bfe98b
  teleprint-me

  authored
  6bfe98b

  Copy full SHA for 6bfe98b

Commits on Jan 15, 2024

• Fix Pydantic model parsing (#1087)

  DeNeutoy

  authored
  c689ccc

  Copy full SHA for c689ccc

Commits on Dec 16, 2023

• Fix logits_to_logprobs for 2-D and 3-D logits (#1002)

  Show description for 5a89446
  kddubey

  authored
  5a89446

  Copy full SHA for 5a89446

Commits on Nov 22, 2023

• tests: add mock_kv_cache placeholder functions

  abetlen

  committed
  9515467

  Copy full SHA for 9515467

• tests: avoid constantly reallocating logits

  abetlen

  committed
  0ea2444

  Copy full SHA for 0ea2444

• tests: don't mock sampling functions

  abetlen

  committed
  0a7e05b

  Copy full SHA for 0a7e05b

Commits on Nov 21, 2023

• Use mock_llama for all tests

  abetlen

  committed
  d7388f1

  Copy full SHA for d7388f1

• Do not set `grammar` to `None` for new `LlamaGrammar` objects (#834)

  Show description for c21edb6
  mthuurne

  authored
  c21edb6

  Copy full SHA for c21edb6

• tests: Improve llama.cpp mock

  abetlen

  committed
  3dc21b2

  Copy full SHA for 3dc21b2

Commits on Nov 20, 2023

• Update llama.cpp

  abetlen

  committed
  2c2afa3

  Copy full SHA for 2c2afa3

Commits on Nov 10, 2023

• Fix tests

  abetlen

  committed
  e32ecb0

  Copy full SHA for e32ecb0

Commits on Nov 6, 2023

• Refactor Llama class internals

  abetlen

  committed
  e214a58

  Copy full SHA for e214a58

Commits on Nov 3, 2023

• Migrate inference to llama_batch and llama_decode api (#795)

  Show description for ab028cb
  

  abetlen

  and

  antoine-lizee

  authored
  ab028cb

  Copy full SHA for ab028cb

Commits on Nov 2, 2023

• fix: tokenization of special characters: (#850)

  Show description for 4d4e0f1
  

  antoine-lizee

  authored and

  abetlen

  committed
  4d4e0f1

  Copy full SHA for 4d4e0f1

Commits on Oct 19, 2023

• Enable finish reason tests

  abetlen

  committed
  ef03d77

  Copy full SHA for ef03d77

• Re-enable tests completion function

  abetlen

  committed
  cbeef36

  Copy full SHA for cbeef36

Commits on Sep 29, 2023

• Update llama.cpp

  abetlen

  committed
  1a1c3dc

  Copy full SHA for 1a1c3dc

Commits on Sep 5, 2023

• add test to see if llama_cpp.__version__ exists

  janvdp

  committed
  f49b6d7

  Copy full SHA for f49b6d7

Commits on Aug 27, 2023

• Update llama.cpp

  abetlen

  committed
  4887973

  Copy full SHA for 4887973

• Update llama.cpp

  abetlen

  committed
  3a29d65

  Copy full SHA for 3a29d65

Commits on Aug 25, 2023

• Strip leading space when de-tokenizing.

  abetlen

  committed
  8ac5946

  Copy full SHA for 8ac5946

Commits on Aug 24, 2023

• Update model path

  abetlen

  committed
  3674e5e

  Copy full SHA for 3674e5e

Commits on May 19, 2023

• Fix llama_cpp and Llama type signatures. Closes #221

  abetlen

  committed
  01a010b

  Copy full SHA for 01a010b

Commits on May 2, 2023

• Fix

  abetlen

  committed
  46e3c4b

  Copy full SHA for 46e3c4b

• Refactor server to use factory

  abetlen

  committed
  9eafc4c

  Copy full SHA for 9eafc4c

Commits on May 1, 2023

• Un-skip tests

  abetlen

  committed
  c088a2b

  Copy full SHA for c088a2b

• Temporarily skip sampling tests.

  abetlen

  committed
  2f8a3ad

  Copy full SHA for 2f8a3ad

Commits on Apr 29, 2023

• llama_cpp server: slight refactor to init_llama function

  Show description for efe8e6f
  Stonelinks

  committed
  efe8e6f

  Copy full SHA for efe8e6f

• tests: simple test for server module

  Stonelinks

  committed
  6d8db9d

  Copy full SHA for 6d8db9d

• Remove excessive errors="ignore" and add utf8 test

  

  Mug

  committed
  18a0c10

  Copy full SHA for 18a0c10

Commits on Apr 26, 2023

• Also ignore errors on input prompts

  

  Mug

  committed
  5f81400

  Copy full SHA for 5f81400

Commits on Apr 5, 2023

• Make Llama instance pickleable. Closes #27

  abetlen

  committed
  e96a5c5

  Copy full SHA for e96a5c5

• Add basic tests. Closes #24

  abetlen

  committed
  c3972b6

  Copy full SHA for c3972b6

Loading