article · 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA) · 2021

COCLUBERT: Clustering Machine Learning Source Code

Marcus Hagglund, Francisco J. Ribadas, Sepideh Pashami, Ahmad Al-Shishtawy, Amir H. Payberah

Cited by 4Abstract and details only

Abstract

Nowadays, we can find machine learning (ML) applications in nearly every aspect of modern life, and we see that more developers are engaged in the field than ever. In order to facilitate the development of new ML applications, it would be beneficial to provide services that enable developers to share, access, and search for source code easily. A step towards making such a service is to cluster source code by functionality. In this work, we present COCLUBERT, a BERT-based model for source code embedding based on their functionality and clustering them accordingly. We build COCLUBERT using CuBERT, a variant of BERT pre-trained on source code, and present three ways to fine-tune it for the clustering task. In the experiments, we compare COCLUBERT with a baseline model, where we cluster source code using CuBERT embedding without fine-tuning. We show that COCLUBERT significantly outperforms the baseline model by increasing the Dunn Index metric by a factor of 141, the Silhouette Score metric by a factor of two, and the Adjusted Rand Index metric by a factor of 11.

Cite this paper

APA 7

Hagglund, M., Ribadas, F. J., Pashami, S., Al-Shishtawy, A., & Payberah, A. H. (2021). COCLUBERT: Clustering Machine Learning Source Code. 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), 151–158. https://doi.org/10.1109/icmla52953.2021.00031

MLA 9

Hagglund, Marcus, et al. “COCLUBERT: Clustering Machine Learning Source Code.” 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), 2021, pp. 151–58, https://doi.org/10.1109/icmla52953.2021.00031.

Chicago

Hagglund, Marcus, Francisco J. Ribadas, Sepideh Pashami, Ahmad Al-Shishtawy, and Amir H. Payberah. 2021. “COCLUBERT: Clustering Machine Learning Source Code.” 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA): 151–58. https://doi.org/10.1109/icmla52953.2021.00031.

Harvard

Hagglund, M. et al. (2021) ‘COCLUBERT: Clustering Machine Learning Source Code’, 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 151–158. Available at: https://doi.org/10.1109/icmla52953.2021.00031.

BibTeX

@article{hagglund2021coclubert,
  title = {{COCLUBERT: Clustering Machine Learning Source Code}},
  author = {Hagglund, Marcus and Ribadas, Francisco J. and Pashami, Sepideh and Al-Shishtawy, Ahmad and Payberah, Amir H.},
  journal = {2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA)},
  pages = {151--158},
  year = {2021},
  doi = {10.1109/icmla52953.2021.00031}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.