Search Machine Learning Repository:
All publications by Ilya Sutskever
authors venues years



An Empirical Exploration of Recurrent Network Architectures
Rafal Jozefowicz, Wojciech Zaremba and Ilya Sutskever
Proceedings of the 32nd International Conference on Machine Learning (ICML-15), 2015


Grammar as a Foreign Language
Oriol Vinyals, \l U. Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever and Geoffrey Hinton
Advances in Neural Information Processing Systems 28, 2015


Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals and Quoc Le
Advances in Neural Information Processing Systems 27, 2014


Stochastic k-Neighborhood Selection for Supervised and Unsupervised Learning
Daniel Tarlow, Kevin Swersky, Laurent Charlin, Ilya Sutskever and Rich Zemel
Proceedings of the 30th International Conference on Machine Learning (ICML-13), 2013


On the importance of initialization and momentum in deep learning
Ilya Sutskever, James Martens, George Dahl and Geoffrey Hinton
Proceedings of the 30th International Conference on Machine Learning (ICML-13), 2013


Distributed Representations of Words and Phrases and their Compositionality
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado and Jeff Dean
Advances in Neural Information Processing Systems 26, 2013


Cardinality Restricted Boltzmann Machines
Kevin Swersky, Ilya Sutskever, Daniel Tarlow, Richard S. Zemel, Ruslan Salakhutdinov and Ryan P. Adams
Advances in Neural Information Processing Systems 25, 2012


ImageNet Classification with Deep Convolutional Neural Networks
Alex Krizhevsky, Ilya Sutskever and Geoffrey E. Hinton
Advances in Neural Information Processing Systems 25, 2012


Estimating the Hessian by Back-propagating Curvature
James Martens, Ilya Sutskever and Kevin Swersky
Proceedings of the 29th International Conference on Machine Learning (ICML-12), 2012


Generating Text with Recurrent Neural Networks
Ilya Sutskever, James Martens and Geoffrey E. Hinton
Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011


Learning Recurrent Neural Networks with Hessian-Free Optimization
James Martens and Ilya Sutskever
Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011


On the Convergence Properties of Contrastive Divergence
Ilya Sutskever and Tijmen Tieleman
Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS-10), 2010


Parallelizable Sampling of Markov Random Fields
James Martens and Ilya Sutskever
Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS-10), 2010


A simpler unified analysis of budget perceptrons
Ilya Sutskever
Proceedings of the 26th International Conference on Machine Learning (ICML-09), 2009


Modelling Relational Data using Bayesian Clustered Tensor Factorization
Ilya Sutskever, Joshua B. Tenenbaum and Ruslan Salakhutdinov
Advances in Neural Information Processing Systems 22, 2009


The Recurrent Temporal Restricted Boltzmann Machine
Ilya Sutskever, Geoffrey E. Hinton and Graham W. Taylor
Advances in Neural Information Processing Systems 21, 2008


Using matrices to model symbolic relationship
Ilya Sutskever and Geoffrey E. Hinton
Advances in Neural Information Processing Systems 21, 2008


Learning Multilevel Distributed Representations for High-Dimensional Sequences
Ilya Sutskever and Geoffrey E. Hinton
Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics (AISTATS-07), 2007


Visualizing Similarity Data with a Mixture of Maps
James Cook, Ilya Sutskever, Andriy Mnih and Geoffrey E. Hinton
Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics (AISTATS-07), 2007