Who Cited It

Why Does Unsupervised Pre-training Help Deep Learning?

2010 · 2,114 citations · 11 from inside this corpus

Dumitru Erhan, Yoshua Bengio, Aaron Courville, Pierre-Antoine Manzagol, Pascal Vincent low, Samy Bengio

The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.

Why Does Unsupervised Pre-training Help Deep Learning? (2010)Why Does Unsupervised Pre-tra…Reducing the Dimensionality of Data with Neural Networks (2006)Reducing the Dimensionality o…A Fast Learning Algorithm for Deep Belief Nets (2006)A Fast Learning Algorithm for…A unified architecture for natural language processing (2008)A unified architecture for na…Curriculum learning (2009)Curriculum learningLearning Deep Architectures for AI (2009)Learning Deep Architectures f…Training Products of Experts by Minimizing Contrastive Divergence (2002)Training Products of Experts …Semi-Supervised Learning (2006)Semi-Supervised LearningOn Discriminative vs. Generative Classifiers: A comparison of logistic regression and nai… (2001)On Discriminative vs. Generat…Deep learning in neural networks: An overview (2014)Deep learning in neural netwo…Deep Sparse Rectifier Neural Networks (2011)Deep Sparse Rectifier Neural …Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review (2017)Deep Convolutional Neural Net…Deep learning for healthcare: review, opportunities and challenges (2017)Deep learning for healthcare:…Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition (2011)A survey on semi-supervised learning (2019)A survey on semi-supervised l…Recurrent Convolutional Neural Networks for Text Classification (2015)Recurrent Convolutional Neura…Practical Recommendations for Gradient-Based Training of Deep Architectures (2012)Practical Recommendations for…Deep Learning: Methods and Applications (2014)Deep Learning: Methods and Ap…A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer … (2017)A Gift from Knowledge Distill…Pre-trained models for natural language processing: A survey (2020)Pre-trained models for natura…
19 of 19 neighbouring works in this corpus. Blue is what this paper cites; orange is what cites it, and a dashed line is one neighbour citing another. Only the largest labels are drawn — every node carries its full title on hover.
this paper works it cites works citing it node size = global citations · hover for the full title

What this paper cites, inside the corpus

PaperYearCited
Reducing the Dimensionality of Data with Neural Networks200621,247
A Fast Learning Algorithm for Deep Belief Nets200616,540
A unified architecture for natural language processing20085,207
Curriculum learning20095,154
Learning Deep Architectures for AI20095,077
Training Products of Experts by Minimizing Contrastive Divergence20025,032
Semi-Supervised Learning20064,334
On Discriminative vs. Generative Classifiers: A comparison of logistic regression and nai…20011,888

What cites it, inside the corpus

PaperYearCited
Deep learning in neural networks: An overview201418,236
Deep Sparse Rectifier Neural Networks20115,428
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review20173,570
Deep learning for healthcare: review, opportunities and challenges20173,115
Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition20113,089
A survey on semi-supervised learning20192,636
Recurrent Convolutional Neural Networks for Text Classification20152,314
Practical Recommendations for Gradient-Based Training of Deep Architectures20121,960
Deep Learning: Methods and Applications20141,801
A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer …20171,660
Pre-trained models for natural language processing: A survey20201,521

Links

OpenAlex record

Topics

Domain Adaptation and Few-Shot LearningComputer Science
Machine Learning and Data ClassificationComputer Science
Topic ModelingComputer Science

Is this record sound?

complete

Nothing in this record contradicts itself and no field we check is missing.

  • supports6 author record(s) attached.
  • supports55 reference(s) recorded.
  • neutralThe DOI carries no year to check against.
  • supportsA title is present.

Provenance

Everything above was read from one stored OpenAlex payload, fetched 2026-09-04T03:58:51+00:00.

sha256 6e314d9c6052d1ed…