Here is my short list of materials related to Deep Learning and NLP that I found useful during my exploration of this topics. I don’t think that this list is exhaustive, but maybe you will find something useful;)


General introduction:


Blog posts:



  •, - I list those books together, because their content is very, very similar, only one user R, and the second uses Python. I decided that I’ll first read R version, and then go to the Python version, because currently, I think in R, so it’s easier for me to grasp new ideas when they’re presented in R. But then, by comparing the examples I learn some Python. But I do not recommend this approach to others. I think starting with Python is a better solution (and you need to buy only one book;)).
  • - I purchased this book as a MEAP (Manning Early Access Program), and I’m still waiting to the completion. It’s a bit different book than the Deep Learning with * because it focuses on the building everything from scratch (backpropagation, gradient descent, etc.). I only skimmed the content, but I think it might be a good read if you are interested in how everything works behind the scene. I hope that I will write more when the book will be completed.
  • - I have not read this book yet, but it seems to be the most mature and advanced position in this short list, and worth read. And it’s also free:) For more opinions about this book goes here:




  • - yup. It’s a deep learning library accompanying the fastai course.
  • - high level deep learning library. It has an R bindings (
  • - more low-level library created by Google (it’s not only a deep learning framework - check this out - - it’s built on top of Tensorflow). It’s better to start with Keras (or fastai).
  • - a bit more low-level library than Keras and fastai. It’s an engine behind the fastai, so it might be easier to start with fastai and then move to the pytorch.
  • - a Facebook’s library for neural nets. It supports only a particular set of predefined tasks like building word embeddings, recommendations, or text classification. Nevertheless, it’s work to check it because it might work pretty well without a lot of fine-tuning.
  • - it’s another tool for NLP from Facebook. From my perspective, the best advantage of fasttext is an ability to handle out-of-vocabulary word by using subwords information. It can greatly simplify the data preparation step because you can put all the data right into the model without stemming or any other form of preprocessing. It might be an excellent tool for quick and dirty solutions.