Neural networks have made significant leaps in the\u00a0<\/span>image and natural language processing<\/a>\u00a0<\/span>(NLP) recently. They\u2019ve not only learned to recognise, localise and segment images; they\u2019re now able to effectively translate natural language and answer complex questions. One of the precursors to such massive progress was the introduction of Seq2Seq and\u00a0<\/span>neural attention models<\/a>\u00a0<\/span>\u2013 enabling neural networks to become more selective about the data they\u2019re working with at any given time.<\/p>\n One of the precursors to such massive progress was the introduction of Seq2Seq and neural attention models \u2013 enabling neural networks to become more selective about the data they\u2019re working with at any given time. The core focus of the neural attention mechanism is to learn to recognise where to find important information.<\/p>\n In this blog, we describe the most promising real-life use cases for neural machine translation, with a link to an extended tutorial on neural machine translation with attention mechanism algorithm<\/p>\n The core focus of the neural attention mechanism is to learn to recognise where to find important information. Here\u2019s an example of a neural machine translation:<\/p>\n Source:\u00a0<\/span>Google seq2seq<\/a><\/p>\n But why is this so technologically important? In this blog, we describe the most promising real-life use cases for neural machine translation, with a link to an extended tutorial on neural machine translation with attention mechanism algorithm.<\/p>\n The Seq2Seq algorithm can perform several core tasks, all of them grounded in \u2018translation\u2019 but each with distinct differences. Let\u2019s take a closer look at some of them.<\/p>\n Machine translation took a huge step forward in 2017, with the introduction of a bidirectional residual Seq2Seq (sequence-to-sequence) neural network, complete with an attention mechanism. The mechanism\u2019s role is to determine the importance of each word in the input sentence, then to extract additional context around each word. It\u2019s thanks to this development that modern tools are now able to produce high-quality translations of lengthy, complex sentences.<\/p>\n Source:\u00a0<\/span>TensorFlow seq2seq tutorial<\/a><\/p>\n We can peek under the hood of Google Translate, for one of the best illustrations of neural attention in practice.<\/p>\n The above is a prime example of the distribution of attention when the neural network translates English into French. The decoder\u2019s language model and the attention mechanism were taught the correct word sequence in the output sentence.<\/p>\n Source:\u00a0<\/span>Bahdanau et al., 2015<\/a><\/p>\n Annotating text and articles is a laborious process, especially if the data\u2019s vast and heterogeneous. Attention models can be used pinpoint the most important textual elements and compose a meaningful headline, allowing the reader to skim the text and still capture the basic meaning. What\u2019s more, text summarisation can do this almost instantly. And it can be used to generate titles for web pages and perform high-level information research, or information segmentation, for rapid reading.<\/p>\n Source:\u00a0<\/span>Text summarisation with TensorFlow<\/a><\/p>\n In the constant quest for efficiency, businesses are trying to automate as many routine processes as possible. As yet, however, the perfect tool for human-machine interaction hasn\u2019t been created. Natural language processing (NLP) isn\u2019t yet flawless but, with the addition of the attention mechanism,\u00a0<\/span>its accuracy is greatly improved<\/a>.<\/p>\n An attention mechanism can detect the most significant (key) words from all kinds of questions \u2013 even those that are lengthy and complex \u2013 to produce the right answer. And the mechanism can be implemented as an add-on, to work in conjunction with the neural network on the common knowledge base. With chatbots, the mechanism transcends machine translation and takes on a higher level of abstraction \u2013 allowing it to translate one verbal sequence into another.<\/p>\n The idea here is the same as it is for image recognition. The difference, however, is that to caption the image the attention heat map changes, depending on each word in the focus sentence.<\/p>\n Source:\u00a0<\/span>Show, Attend and Tell: Neural Image Caption Generation with Visual Attention<\/a><\/p>\n A neural network can \u2018translate\u2019 everything it sees in the image into words. The above example shows us how the network distributes its attention while formulating the description.<\/p>\n This image captioning functionality has big practical potential in the real world; from automating hashtags and subtitle creation, to writing descriptions for the visually impaired \u2013 even producing daily surveillance reports for security firms.<\/p>\n Source:\u00a0<\/span>Show, Attend and Tell: Neural Image Caption Generation with Visual Attention<\/a><\/p>\n The attention mechanism turned out to be hugely successful in solving CAPTCHAs based on recognition and segmentation of noisy\/distorted pictures, with subsequent text input. This functionality finds a potential application with chatbots that have to parse third-party sites to answer a query.<\/p>\n Like conventional linguistic question-answering systems, image-based question-answering functionality takes a natural language input but, instead of accessing the knowledge base, it uses the attention mechanism to find the answer within the image.<\/p>\n Source:\u00a0<\/span>Stacked Attention Networks for Image Question Answering<\/a><\/p>\n There are many online tutorials covering neural machine translation, including the official\u00a0<\/span>TensorFlow<\/a>and\u00a0<\/span>PyTorch<\/a>\u00a0<\/span>tutorials. However, what neither of these addresses is the implementation of the attention mechanism (using only attention wrapper), which is a pivotal component of modern neural translation.<\/p>\n Here\u2019s the link to our tutorial on neural machine translation<\/a>, based on modern Seq2Seq with attention mechanism algorithm built from scratch. By comparison to what\u2019s out there, this should offer an in-depth overview of all aspects of seq2seq, including attention algorithm.<\/p>\n We used the TensorFlow framework to offer a usable, low-level working example of the concept, based on the\u00a0<\/span>Dynamic Seq2Seq in TensorFlow tutorial<\/a>. And we aim to make it as good as the original PyTorch version.<\/p>\n We hope this will help you get the most out of your machine translation projects and, ultimately, pay dividends for your outcomes. Feel free to leave any questions and feedback in the comments box below or, if you\u2019d like to discuss how Data Science and neural machine translation can help you address your needs,\u00a0<\/span>get in touch with us<\/a>!<\/p>\n By Michael Konstantinov<\/em> Read the full story here.<\/a><\/p>\n<\/div>\n Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":" Author: Olha Zhydik Neural networks have made significant leaps in the\u00a0image and natural language processing\u00a0(NLP) recently. They\u2019ve not only learned to recognise, localise and segment […] Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":466,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/2493"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=2493"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/2493\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/466"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=2493"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=2493"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=2493"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<\/a><\/p>\n<\/p>\n
![\"neural](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/image5.gif\")
<\/a><\/p>\nThe cycle runs as follows:<\/h4>\n
\n
Neural machine translation\u2019s current success can be attributed to:<\/h4>\n
\n
Seq2Seq algorithm\u2019s real-world applications<\/h2>\n
Neural machine translation<\/h3>\n
![\"TensorFlow](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/TensorFlow-seq2seq-tutorial-compressor.png\")
<\/a><\/p>\n![\"Bahdanau\"](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/Bahdanau-compressor-968x1024.png\")
<\/a><\/p>\nText summarisation<\/h3>\n
![\"Text](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/Text-summarisation-with-TensorFlow-compressor-1024x509.png\")
<\/a><\/p>\nChatbots with a question-answering capabilities<\/h3>\n
Natural language image captioning (Img2Seq)<\/h3>\n
![\"Neural](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/Neural-Image-Caption-compressor-1024x423.png\")
<\/a><\/p>\n![\"Neural](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/Neural-Image-Caption-Generation-1-1024x443.png\")
<\/a><\/p>\nCAPTCHA solving<\/h3>\n
![\"CAPTCHA](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/CAPTCHA-solving.gif\")
<\/a><\/p>\nImage-based question-answering systems<\/h3>\n
![\"Stacked](\"https:\/\/labs.eleks.com\/wp-content\/uploads\/2019\/06\/Stacked-Attention-Networks-for-Image-Question-Answering-compressor.png\")
<\/a><\/p>\nTensorFlow neural machine translation Seq2Seq with attention mechanism: A step-by-step guide<\/h2>\n
Deep Learning Specialist at Eleks<\/em><\/p>\n