research
∙
05/03/2023
Shap-E: Generating Conditional 3D Implicit Functions
We present Shap-E, a conditional generative model for 3D assets. Unlike ...
share
research
∙
12/16/2022
Point-E: A System for Generating 3D Point Clouds from Complex Prompts
While recent work on text-conditional 3D object generation has shown pro...
research
∙
07/28/2022
Efficient Training of Language Models to Fill in the Middle
We show that autoregressive language models can learn to infill text aft...
research
∙
07/07/2021
Evaluating Large Language Models Trained on Code
We introduce Codex, a GPT language model fine-tuned on publicly availabl...
research
∙
10/28/2020
Scaling Laws for Autoregressive Generative Modeling
We identify empirical scaling laws for the cross-entropy loss in four do...
research
∙
04/30/2020
Jukebox: A Generative Model for Music
We introduce Jukebox, a model that generates music with singing in the r...
research
∙
10/23/2018
Language Modeling at Scale
We show how Zipf's Law can be used to scale up language modeling (LM) to...
research
∙
08/20/2018
Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks
We propose the multi-head convolutional neural network (MCNN) architectu...
research
∙
12/01/2017
Deep Learning Scaling is Predictable, Empirically
Deep learning (DL) creates impactful advances following a virtuous recip...
research
∙
11/05/2017
Robust Speech Recognition Using Generative Adversarial Networks
This paper describes a general, scalable, end-to-end framework that uses...
research
∙
08/21/2017
Cold Fusion: Training Seq2Seq Models Together with Language Models
Sequence-to-sequence (Seq2Seq) models with attention have excelled at ta...
research
∙
05/11/2017