research
∙
07/18/2023
Llama 2: Open Foundation and Fine-Tuned Chat Models
In this work, we develop and release Llama 2, a collection of pretrained...
share
research
∙
02/27/2023
LLaMA: Open and Efficient Foundation Language Models
We introduce LLaMA, a collection of foundation language models ranging f...
research
∙
05/23/2022
HyperTree Proof Search for Neural Theorem Proving
We propose an online training procedure for a transformer-based automate...
research
∙
02/15/2021
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages
Recent advances in self-supervised learning have dramatically improved t...
research
∙
09/21/2020
Target Conditioning for One-to-Many Generation
Neural Machine Translation (NMT) models often lack diversity in their ge...
research
∙
06/05/2020
Unsupervised Translation of Programming Languages
A transcompiler, also known as source-to-source translator, is a system ...
research
∙
11/01/2019
CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data
Pre-training text representations have led to significant improvements i...
research
∙
04/22/2019