Useful stuff
Learning resources
Stanford cs224n “Natural Language Processing with Deep Learning” class and their video lectures (highly recommend)
Stanford cs231n notes about neural networks
fast.ai - hipster courses on deep learning, pretty good ones
Libraries and services
HuggingFace Transformers and Tokenizers
Knock Knock - get notified when your training ends with only two additional lines of code
Weights and Biases - the best way to monitor your experiments (bye tensorboard!)
tqdm - a very simple, fast and extensible progress bar for python and CLI
NVIDIA Apex - easy way to use Mixed Precision (use it if you’re out of GPU memory)
Blogs and other stuff
Arxiv CS.CL twitter - an infinite stream of fresh papers, perfect in the morning
Arxiv-sanity - a tool that helps you to keep track of new staff and to stay sane
Distill.pub - an excellent journal with visualizations of difficult NN concepts
Inference - posts on machine learning, statistics, opinions on things (more about the theoretical side)
Off the convex path - deep learning theory blog
Towardsdatascience - a good blog about DS
Kaggle - data science competitions (with free GPUs!)
kaggle.com/notebooks - a lot of examples and how-tos for basically anything
Google Colaboratory - a (heavily modified by Google) jupyter notebook server with a free GPU and TPU; not very useful, but a free TPU is a free TPU (50 Gb of RAM and blazing fast)
TensorFlow Research Cloud - a Google initiative that sponsors cool research projects with free TPU-hours in GCP, apply if you want to pre-train something huge
ruder.io - Sebastian Ruder blog
Ruder Newsletter - concise monthly reviews of NLP state
Paperswithcode - an awesome aggregator of papers and GitHub repositories
paperswithcode.com/sota - leaderboard aggregator, pretty good for finding datasets
PhDcomics - they know that feel bro