EvalPlus version
0.3.1
Output of running ls ~/.cache/evalplus
NA
Task ID of the programming task
HumanEval/8
Test input
`plus_input[446]`
`plus_input[595]`
Description
for HumanEval/8, two cases in plus_input have incorrect type
plus_input[446]: input is an empty string ""
plus_input[595]: input is an empty dict {}
instead of List[int]
Other context
No response
EvalPlus version
0.3.1
Output of running
ls ~/.cache/evalplusNA
Task ID of the programming task
HumanEval/8
Test input
Description
for
HumanEval/8, two cases in plus_input have incorrect typeplus_input[446]: input is an empty string""plus_input[595]: input is an empty dict{}instead of
List[int]Other context
No response