Skip to content

implement LLM checking for context evaluation#8

Merged
neagualexa merged 27 commits intomainfrom
llm_checking
Oct 7, 2024
Merged

implement LLM checking for context evaluation#8
neagualexa merged 27 commits intomainfrom
llm_checking

Conversation

@neagualexa
Copy link
Collaborator

merge shortTextAnswer into this repo

neagualexa and others added 27 commits September 18, 2024 16:33
* feat: initial implementation of language model eval function (no params used); integrated EvaluationResponse class

* feat: initial implementation of language model eval function (no params used); integrated EvaluationResponse class

* feat: combined evaluation functions (nlp and llm based) into one wine multiple modes (dockerfile to be updated)

* feat(in progress): implementing special tags/requirements for the model evaluation

* feat: combined nlp and slm evaluation into one evaluation function (as different checking layers)

* feat: use slm to check if keywords are contextually in the student's response

* fix(in progress): temp Dockerfile (need to be updated)

* fix: testing slm capabilities

* new llm eval methodology (nlp, llm for context and llm for keystring description) [moved from shortTextAnswer repo]
@neagualexa neagualexa merged commit a8e9f93 into main Oct 7, 2024
@neagualexa neagualexa deleted the llm_checking branch October 7, 2024 16:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant