Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jul 29, 2024

• Fix: Add missing arguments for SSHBox in evaluation (#3075)

  Show description for 563ebd4
  SmartManoj

  authored
  563ebd4

  Copy full SHA for 563ebd4

Commits on Jul 26, 2024

• support swebench pull from custom namespace (#3136)

  xingyaoww

  authored
  1c813a2

  Copy full SHA for 1c813a2

• Remove remaining global config (#3099)

  Show description for 275ea70
  neubig

  authored
  275ea70

  Copy full SHA for 275ea70

Commits on Jul 23, 2024

• fix: make max_budget_per_task optional in `run_agent_controller` (#3071)

  Show description for da17665
  xingyaoww

  authored
  da17665

  Copy full SHA for da17665

Commits on Jul 21, 2024

• remove extra arg from swebench ssh box (#3054)

  xingyaoww

  authored
  a61ac5a

  Copy full SHA for a61ac5a

Commits on Jul 20, 2024

• [Eval,Arch] Update GPTQ eval and add `headless_mode` for Controller (#2994)

  Show description for 6b16a5d
  

  xingyaoww

  and

  neubig

  authored
  6b16a5d

  Copy full SHA for 6b16a5d

Commits on Jul 19, 2024

• [FIX] Update SWEBenchSSHBox after global config was removed from sandbox in #2961 (#3014)

  Show description for 9cf2b5b
  

  RajWorking

  and

  xingyaoww

  authored
  9cf2b5b

  Copy full SHA for 9cf2b5b

• Remove monologue agent (#3036)

  Show description for 3a21198
  neubig

  authored
  3a21198

  Copy full SHA for 3a21198

• #2220, integrated aider style linting, currently passes related o… (#2489)

  Show description for fa6c124
  

  5 peopleauthored
  fa6c124

  Copy full SHA for fa6c124

• fix: runtime test for mac (#3005)

  Show description for ff6ddc8
  xingyaoww

  authored
  ff6ddc8

  Copy full SHA for ff6ddc8

Commits on Jul 18, 2024

• fix eval api_key leak in metadata; fix llm config in run infer (#2998)

  xingyaoww

  authored
  cf910df

  Copy full SHA for cf910df

Commits on Jul 16, 2024

• Support Instance Level Images for SWE-Bench Evaluation (#2874)

  Show description for 7111e8e
  

  Jiayi-Pan

  and

  xingyaoww

  authored
  7111e8e

  Copy full SHA for 7111e8e

• [Agent, Eval] Fixes LLM config issue for delegation & Add eval to measure the delegation accuracy (#2948)

  Show description for f45a2ff
  

  3 peopleauthored
  f45a2ff

  Copy full SHA for f45a2ff

• docs: updated docstrings using ruff's autofix feature (#2923)

  Show description for 8f76587
  

  anushkumarv

  and

  neubig

  authored
  8f76587

  Copy full SHA for 8f76587

Commits on Jul 15, 2024

• Remove legacy swe_bench/scripts/summarise_results.py (#2932)

  Show description for 4b4fa1c
  li-boxuan

  authored
  4b4fa1c

  Copy full SHA for 4b4fa1c

• Add compare_patch_filename.py (#2934)

  li-boxuan

  authored
  b834b35

  Copy full SHA for b834b35

Commits on Jul 13, 2024

• remove useless code (#2922)

  yufansong

  authored
  959d21c

  Copy full SHA for 959d21c

Commits on Jul 10, 2024

• Customize LLM config per agent (#2756)

  Show description for c68478f
  li-boxuan

  authored
  c68478f

  Copy full SHA for c68478f

Commits on Jul 8, 2024

• History clean up (#2849)

  Show description for 2df1d67
  enyst

  authored
  2df1d67

  Copy full SHA for 2df1d67

Commits on Jul 7, 2024

• Refactoring: event stream based agent history (#2709)

  Show description for d37b297
  enyst

  authored
  d37b297

  Copy full SHA for d37b297

• Two fixes to swe bench eval (#2831)

  Show description for d0384ca
  neubig

  authored
  d0384ca

  Copy full SHA for d0384ca

• fix git diff TIMEOUT problem in swe_bench evaluation (#2828)

  Show description for c8e5848
  

  bin123apple

  and

  SmartManoj

  authored
  c8e5848

  Copy full SHA for c8e5848

Commits on Jul 5, 2024

• [Evaluation] Simplify eval & and multi-processing related fixes (#2810)

  Show description for f6dc89b
  xingyaoww

  authored
  f6dc89b

  Copy full SHA for f6dc89b

• [Arch] Remove supports for Background Commands (#2803)

  Show description for a47713e
  

  xingyaoww

  and

  enyst

  authored
  a47713e

  Copy full SHA for a47713e

• Simplify eval code (#2775)

  Show description for a081935
  neubig

  authored
  a081935

  Copy full SHA for a081935

• Refactored sandbox config and added fast boot (#2455)

  Show description for 143f38d
  

  SmartManoj

  and

  enyst

  authored
  143f38d

  Copy full SHA for 143f38d

• [Eval] initialize llm inside process_instance to circumvent "AttributeError:… (#2805)

  Show description for 298956c
  xingyaoww

  authored
  298956c

  Copy full SHA for 298956c

Commits on Jul 4, 2024

• [Evaluation] Log empty patch stats for SWE-Bench (#2776)

  Show description for e6cdf18
  xingyaoww

  authored
  e6cdf18

  Copy full SHA for e6cdf18

Commits on Jul 3, 2024

• Remove global args (#2760)

  Show description for ffd3c71
  neubig

  authored
  ffd3c71

  Copy full SHA for ffd3c71

Commits on Jul 2, 2024

• [Evaluation] fix SWE-Bench docker image name (#2751)

  Show description for 4d0c4f3
  xingyaoww

  authored
  4d0c4f3

  Copy full SHA for 4d0c4f3

• [Agent] (Potentially) improve Editing using `diff` (#2685)

  Show description for 41ddba8
  xingyaoww

  authored
  41ddba8

  Copy full SHA for 41ddba8

Commits on Jul 1, 2024

• [Evaluation] Use the latest official SWE-Bench Dockerization for evaluation (#2728)

  Show description for 6a0ffc5
  

  xingyaoww

  and

  enyst

  authored
  6a0ffc5

  Copy full SHA for 6a0ffc5

Commits on Jun 30, 2024

• Add ability to restore the cli session (optional) (#2699)

  Show description for 2d9bb56
  enyst

  authored
  2d9bb56

  Copy full SHA for 2d9bb56

• CLI concurrency (#2695)

  Show description for 874b4c9
  enyst

  authored
  874b4c9

  Copy full SHA for 874b4c9

Commits on Jun 29, 2024

• default to not use hint for eval (#2696)

  xingyaoww

  authored
  15e0c52

  Copy full SHA for 15e0c52