CodeXGLUE stands for General Language Understanding Evaluation benchmark for CODE. It includes 14 datasets for 10 diversified code intelligence tasks.

CodeXGLUE stands for General Language Understanding Evaluation benchmark for CODE. It includes 14 datasets for 10 diversified programming language tasks ...

9 февр. 2021 г. · In this paper, we introduce CodeXGLUE, a benchmark dataset to foster machine learning research for program understanding and generation.

CodeXGLUE is a benchmark dataset and open challenge for code intelligence. It includes a collection of code intelligence tasks and a platform for model ...

CodeXGLUE includes a collection of 10 tasks across 14 datasets and a platform for model evaluation and comparison. CodeXGLUE also features three baseline ...

The task is to do binary classification (0/1), where 1 stands for semantic equivalence and 0 for others. Models are evaluated by F1 score.

Dataset Summary. CodeXGLUE code-to-text dataset, available at https://github.com/microsoft/CodeXGLUE/tree/main/Code-Text/code-to-text. The dataset we use ...

29 июл. 2021 г. · In this paper, we introduce CodeXGLUE, a benchmark dataset to foster machine learning research for program understanding and generation.

The current state-of-the-art on CodeXGLUE - BigCloneBench is CodeT5. See a full comparison of 5 papers with code.

29 сент. 2020 г. · CodeXGLUE stands for General Language Understanding Evaluation benchmark for code. It includes 14 datasets for 10 diversified code intelligence tasks.