`code_translate_primary.jsonl` includes a prompt that is longer than `max_model_len` for `vllm_inference.py`.
measure_polish_source_code
Facing issues during the evaluation of code requirement switch (Got pass@1~0 and got WAs and RuntimeError)
[ERROR] solution_id1401751 called a Forbidden system call:176 [4294328496]
No Main Class in run_judge.sh
The private test_input does not match the test_output
[REQUEST] - CodeGeeX-4-9B
Benchmarks of CodeLlama-7B-Instruct are not matching
How to test the gguf model file