Skip to Main content Skip to Navigation
Journal articles

A reinforcement learning formulation to the complex question answering problem

Abstract : We use extractive multi-document summarization techniques to perform complex question answering and formulate it as a reinforcement learning problem. Given a set of complex questions, a list of relevant documents per question, and the corresponding human generated summaries (i.e. answers to the questions) as training data, the reinforcement learning module iteratively learns a number of feature weights in order to facilitate the automatic generation of summaries i.e. answers to previously unseen complex questions. A reward function is used to measure the similarities between the candidate (machine generated) summary sentences and the abstract summaries. In the training stage, the learner iteratively selects the important document sentences to be included in the candidate summary, analyzes the reward function and updates the related feature weights accordingly. The final weights are used to generate summaries as answers to unseen complex questions in the testing stage. Evaluation results show the effectiveness of our system. We also incorporate user interaction into the reinforcement learner to guide the candidate summary sentence selection process. Experiments reveal the positive impact of the user interaction component on the reinforcement learning framework.
Complete list of metadata

Cited literature [65 references]  Display  Hide  Download
Contributor : Open Archive Toulouse Archive Ouverte (OATAO) Connect in order to contact the contributor
Submitted on : Thursday, May 19, 2016 - 12:14:18 PM
Last modification on : Tuesday, August 16, 2022 - 4:42:22 PM


Files produced by the author(s)



Yllias Chali, Sadid A. Hasan, Mustapha Mojahid. A reinforcement learning formulation to the complex question answering problem. Information Processing and Management, Elsevier, 2015, vol. 51 (n° 3), pp. 252-272. ⟨10.1016/j.ipm.2015.01.002⟩. ⟨hal-01318168⟩



Record views


Files downloads