A collocation of resources for neural networks and deep learning.

• Wikipedia article on neural networks
• WikiBooks article on neural networks
• blog article "Deep Learning, NLP, and Representations"

• Coling 2014 - Tutorial on using neural networks for NLP by Tomáš Mikolov
• NAACL 2013 - Deep Learning Tutorial by Richard Socher & Chris Manning

• Lisbon Machine Learning Summer School 2014

• Code as you go Tutorial by LISA Lab (a brief intro/summary here)
• Kaggle Challenge with BoW Word2Vec
• Using convolutional neural nets to detect facial keypoints tutorial
• Easy read and code exercises for NN and DL ("If you go through this entire book+code and you still don't understand about neural network and how it works, Liling owes you a beer.")

• Unsupervised Feature learning and Deep Learning Resources by Andrew Ng's group at Stanford

• A Brief Introduction to Neural Networks by D. Kriesel, in both English and German. Everything you ever wanted to know about neural networks.
• Deep Learning: Methods and Applications by Li Deng and Dong Yu at MSR
• An Introduction to Statistical Learning, a general, gentle intro to machine learning
• The Elements of Statistical Learning, a more in-depth book on machine learning
• A Course in Machine Learning Hal Daumé III's Book to machine learning (cute hand-drawings)

• Coursera - Neural Networks for Machine Learning by Geoffrey Hinton
• Coursera - Machine Learning by Andrew Ng
• Caltech - Machine Learning by Yaser Abu-Mostafa
• Udacity - Artificial Intelligence by Peter Norvig and Sebastian Thrun
• Udacity - Machine Learning by Charles Isbell and Michael Littman

• "Sequence to Sequence Learning with Neural Networks", Sutskever et al., NIPS 2014. Authors apply a special kind of recurrent neural network (LSTM - Long Short-Term Memory) for machine translation. First author is a former PhD student of G. Hinton.
• Is deep learning really necessary for word embeddings?
• Deep Speech

• word2vec - Computes word vectors
• GloVe - Computes word vectors

• Listing of several neural net language models, and other types of LMs as well

• Lasagne

• Awesome Machine Learning - Words cannot comprehend, it's just awesome
• Theano - Python optimization library

• Neural Talk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.
• NLP-Net Neural Net applications for POS and SRL