Kamphaug, Asmund and Granmo, Ole-Christoffer and Goodwin, Morten and Zadorozhny, Vladimir
(2017)
Towards Open Domain Chatbots - A GRU Architecture for Data Driven Conversations.
In: International Workshop on Chatbot Research and Design (Conversations’17). In conjunction with the 4th International Conference on Internet Science (INSCI’17), 22-24 Nov 2017, Thessaloniki, Greece.
Abstract
Understanding of textual content, such as topic and intent recognition, is a critical part of chatbots, allowing the chatbot to provide relevant responses. Although successful in several narrow domains, the potential diversity of content in broader and more open domains renders traditional pattern recognition techniques inaccurate. In this paper, we propose a novel deep learning architecture for content recognition that consists of multiple levels of gated recurrent units (GRUs). The architecture is designed to capture complex sentence structure at multiple levels of abstraction, seeking content recognition for very wide domains, through a distributed scalable representation of content. To evaluate our architecture, we have compiled 10 years of questions and answers from a youth information service, 200 083 questions spanning a wide range of content, altogether 289 topics, involving law, health, and social issues. Despite the relatively open domain data set, our architecture is able to accurately categorize the 289 intents and topics. Indeed, it provides roughly an order of magnitude higher accuracy compared to more classical content recognition techniques, such as SVM, Naive Bayes, random forest, and K-nearest neighbor, which all seem to fail on this challenging open domain dataset.
Share
Citation/Export: |
|
Social Networking: |
|
Details
Item Type: |
Conference or Workshop Item
(Paper)
|
Status: |
Published |
Creators/Authors: |
|
Date: |
2017 |
Date Type: |
Publication |
Journal or Publication Title: |
International Workshop on Chatbot Research and Design (Conversations’17). In conjunction with the 4th International Conference on Internet Science (INSCI’17) |
Event Title: |
International Workshop on Chatbot Research and Design (Conversations’17). In conjunction with the 4th International Conference on Internet Science (INSCI’17) |
Event Dates: |
22-24 Nov 2017 |
Event Type: |
Workshop |
Schools and Programs: |
School of Computing and Information > Information Science |
Refereed: |
Yes |
Date Deposited: |
05 Jul 2018 18:48 |
Last Modified: |
05 Jul 2018 18:48 |
URI: |
http://d-scholarship.pitt.edu/id/eprint/34838 |
Metrics
Monthly Views for the past 3 years
Plum Analytics
Actions (login required)
|
View Item |