GitHub

MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models

Execute the following command to create the conda environment for inference and evaluation. This environment will install PyTorch 1.13.1 with CUDA 11.6. If your ...
IEEE

MAGECODE: Machine-Generated Code Detection Method Using Large Language Models

Abstract: The widespread use of virtual assistants (e.g., GPT4 and Gemini, etc.) by students in their academic assignments raises concerns about academic integrity. Consequently, various ...
IEEE

Source Code Summarization in the Era of Large Language Models

Abstract: To support software developers in understanding and maintaining programs, various automatic (source) code summarization techniques have been proposed to generate a concise natural language ...
GitHub

Evaluating Large Language Models using LLM-as-a-Judge

Evaluating large language models (LLM) is challenging due to their broad capabilities and the inadequacy of existing benchmarks in measuring human preferences. To address this, strong LLMs are used as ...