Temporal Convolutional Nets (TCNs) Take Over from RNNs for NLP Predictions

It’s only been since 2014 or 2015 when our DNN-powered applications passed the 95% accuracy point on text and speech recognition allowing for whole generations of chatbots, personal assistants, and instant translators.

Convolutional Neural Nets (CNNs) are the acknowledged workhorse of image and video recognition while Recurrent Neural Nets (RNNs) became the same for all things language. …

By mid-2017 Facebook and Google had solved the problem of speed of translation by using CNNs combined with the attention function.  Read More

#neural-networks, #nlp