Javascript Benchmark with Code2Vec

[zunairazaman2021]

Hi @urialon, Is there a way to run Code2Vec on Javascript Benchmarks. Can you guide me how do we get Code2Vec input format for Javascript benchmarks.
Currently, I am using ASTminer library but the results I get look like this

[urialon]

Hi @zunairazaman2021 ,
Thank you for your interest in our work!

Our repository supports only Java and C#.
We have a newer model that supports all languages called PolyCoder. Loading it takes only a few lines of code using the Huggingface Transformers library. see:

https://arxiv.org/pdf/2202.13169.pdf
https://github.com/VHellendoorn/Code-LMs#october-2022---polycoder-is-available-on-huggingface

We also have another project called CodeBERTScore: https://github.com/neulab/code-bert-score
Where we trained a CodeBERT model specifically for JavaScript. See: https://github.com/neulab/code-bert-score#backend-model

Best,
Uri

[zunairazaman]

@urialon considering I want to use Code2Vec to predict "what is happening in a JS method/file". Do you think CodeBERTScore can be applied for such case study.

[urialon]

Not out of the box, you will need to train it.