Automated Content Understanding

The goal of the project is to crawl information available on a website, think about FAQs, help sections, and such. This information needs to be cleaned and translated into a format the chatbot understands.

Often a chatbot is placed on a website to help people find information which is also available elsewhere on the website. However, training the chatbot will require you to input this information, which is mostly a manual task. Extracting information can be done with different natural language processing techniques. After the content is understood, it needs to be transformed to user-intents that are used to train the chatbot. Here we need paraphrasing and sentence generation to generate questions for the chatbot to answer.

For this project, experience with one of the following is recommended: