Skip to content

Tags: diimdeep/llama.cpp

Tags

master-cd7fa95

Toggle master-cd7fa95's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Define non-positive temperature behavior (ggml-org#720)

master-437e778

Toggle master-437e778's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
10+% performance improvement of ggml_vec_dot_q4_0 on AVX2 (ggml-org#654)

* Performance improvement of AVX2 code
* Fixed problem with MSVC compiler
* Reviewer comments: removed double semicolon, deleted empty line 1962

master-53dbba7

Toggle master-53dbba7's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Windows: reactive sigint handler after each Ctrl-C (ggml-org#736)

master-e986f94

Toggle master-e986f94's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Added api for getting/setting the kv_cache (ggml-org#685)

The api provides access methods for retrieving the current memory buffer for the kv_cache and its token number.
It also contains a method for setting the kv_cache from a memory buffer.

This makes it possible to load/save history - maybe support --cache-prompt paramater as well?

Co-authored-by: Pavol Rusnak <[email protected]>

master-c4f89d8

Toggle master-c4f89d8's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
make : use -march=native -mtune=native on x86 (ggml-org#609)

master-c0bb1d3

Toggle master-c0bb1d3's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
ggml : change ne to int64_t (ggml-org#626)

master-81040f1

Toggle master-81040f1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
llama : do not allocate KV cache for "vocab_only == true" (ggml-org#682)

Fixes sanitizer CI

master-5b70e7d

Toggle master-5b70e7d's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
fix default params for examples/main (ggml-org#697)

master-0d054e2

Toggle master-0d054e2's commit message
Show error message when -f fails

master-3525899

Toggle master-3525899's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Enable -std= for cmake builds, fix warnings (ggml-org#598)