The other day, I decided to read one paper about neural networks a day. I chose publications available at Arxiv and I added the site to my RSS reader. And just two days later I was shocked by the number of papers submitted to Arxiv every day! There were so many new ideas in the field of neural networks that it was impossible to follow them all. I gave up this habit after a week, but I realized one important thing: the majority of these papers were related to tuning or modifying already existing types of neural networks.