This is the repository for the collection of Legal Question Answering models and Datasets.
relevant work:
-
PrivacyQA: Ravichander, Abhilasha, Alan W. Black, Shomir Wilson, Thomas Norton, and Norman Sadeh. "Question answering for privacy policies: Combining computational and legal perspectives." arXiv preprint arXiv:1911.00841 (2019). Paper Link, Home Page Link.
-
JEC-QA: Zhong, H., Xiao, C., Tu, C., Zhang, T., Liu, Z., & Sun, M. (2020, April). JEC-QA: a legal-domain question answering dataset. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 34, No. 05, pp. 9701-9708). Paper Link, Home Page Link.
-
The Legal Argument Reasoning Task in Civil Procedure: Bongard, L., Held, L., & Habernal, I. (2022). The Legal Argument Reasoning Task in Civil Procedure. arXiv preprint arXiv:2211.02950. Paper Link, Home Page Link.
-
BSARD: Louis, A., & Spanakis, G. (2021). A statutory article retrieval dataset in French. arXiv preprint arXiv:2108.11792. Paper Link, Home Page Link.
-
PIL: Sovrano, F., Palmirani, M., Distefano, B., Sapienza, S., & Vitali, F. (2021, June). A dataset for evaluating legal question answering on private international law. In Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law (pp. 230-234). Paper Link, Home Page Link.
-
COLIEE-2015: Kim, M. Y., Goebel, R., & Ken, S. (2015). COLIEE-2015: evaluation of legal question answering. In Ninth International Workshop on Juris-informatics (JURISIN 2015). Paper Link, Home Page Link.
-
VLQA: Bach, N. X., Thien, T. H. N., & Phuong, T. M. (2017, October). Question analysis for vietnamese legal question answering. In 2017 9th International Conference on Knowledge and Systems Engineering (KSE) (pp. 154-159). IEEE. Paper Link, Home Page Link.
-
CUAD: Hendrycks, D., Burns, C., Chen, A., & Ball, S. (2021). Cuad: An expert-annotated nlp dataset for legal contract review. arXiv preprint arXiv:2103.06268. Paper Link, Home Page Link.
-
German legal documents: Hoppe, Christoph, David Pelkmann, Nico Migenda, Daniel Hötte, and Wolfram Schenck. "Towards intelligent legal advisors for document retrieval and question-answering in German legal documents." In 2021 IEEE Fourth International Conference on Artificial Intelligence and Knowledge Engineering (AIKE), pp. 29-32. IEEE, 2021. Paper Link, Home Page Link.
-
AILA : Huang, Weiyi, Jiahao Jiang, Qiang Qu, and Min Yang. "AILA: A Question Answering System in the Legal Domain." In IJCAI, pp. 5258-5260. 2020. Paper Link, Home Page Link.
-
CJRC :Duan, Xingyi, Baoxin Wang, Ziyue Wang, Wentao Ma, Yiming Cui, Dayong Wu, Shijin Wang et al. "Cjrc: A reliable human-annotated benchmark dataset for chinese judicial reading comprehension." In Chinese Computational Linguistics: 18th China National Conference, CCL 2019, Kunming, China, October 18–20, 2019, Proceedings 18, pp. 439-451. Springer International Publishing, 2019. Paper Link, Home Page Link.
-
MaRisk regulatory documents : TRIVEDI, Priyansh. "A question answering system on regulatory documents." In Legal Knowledge and Information Systems: JURIX 2018: The Thirty-first Annual Conference, vol. 313, p. 41. IOS Press, 2018. Paper Link.
-
LCQA : Askari, Arian, Suzan Verberne, and Gabriella Pasi. "Expert finding in legal community question answering." In Advances in Information Retrieval: 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10–14, 2022, Proceedings, Part II, pp. 22-30. Cham: Springer International Publishing, 2022. Paper Link, Home Page Link.
-
Vietnamese legal documents : Kien, Phi Manh, Ha-Thanh Nguyen, Ngo Xuan Bach, Vu Tran, Minh Le Nguyen, and Tu Minh Phuong. "Answering legal questions by learning neural attentive text representation." In Proceedings of the 28th International Conference on Computational Linguistics, pp. 988-998. 2020.Paper Link.
-
PolicyQA : Ahmad, Wasi Uddin, Jianfeng Chi, Yuan Tian, and Kai-Wei Chang. "PolicyQA: A reading comprehension dataset for privacy policies." arXiv preprint arXiv:2010.02557 (2020). Paper Link, Home Page Link.
-
Kim, M. Y., Xu, Y., Goebel, R., & Satoh, K. (2014). Answering yes/no questions in legal bar exams. In New Frontiers in Artificial Intelligence: JSAI-isAI 2013 Workshops, LENLS, JURISIN, MiMI, AAA, and DDS, Kanagawa, Japan, October 27–28, 2013, Revised Selected Papers 5 (pp. 199-213). Springer International Publishing. Paper Link
-
Duong, Huu-Thanh, and Bao-Quoc Ho. "A Vietnamese question answering system in Vietnam’s legal documents." In Computer Information Systems and Industrial Management: 13th IFIP TC8 International Conference, CISIM 2014, Ho Chi Minh City, Vietnam, November 5-7, 2014. Proceedings 14, pp. 186-197. Springer Berlin Heidelberg, 2014. Paper Link
-
Taniguchi, R., & Kano, Y. (2017). Legal yes/no question answering system using case-role analysis. In New Frontiers in Artificial Intelligence: JSAI-isAI 2016 Workshops, LENLS, HAT-MASH, AI-Biz, JURISIN and SKL, Kanagawa, Japan, November 14-16, 2016, Revised Selected Papers (pp. 284-298). Springer International Publishing. Paper Link
-
Kim, Mi-Young, Ying Xu, and Randy Goebel. "Applying a convolutional neural network to legal question answering." In New Frontiers in Artificial Intelligence: JSAI-isAI 2015 Workshops, LENLS, JURISIN, AAA, HAT-MASH, TSDAA, ASD-HR, and SKL, Kanagawa, Japan, November 16-18, 2015, Revised Selected Papers, pp. 282-294. Springer International Publishing, 2017. Paper Link
-
Kim, Mi-Young, Ying Xu, Yao Lu, and Randy Goebel. "Question answering of bar exams by paraphrasing and legal text analysis." In New Frontiers in Artificial Intelligence: JSAI-isAI 2016 Workshops, LENLS, HAT-MASH, AI-Biz, JURISIN and SKL, Kanagawa, Japan, November 14-16, 2016, Revised Selected Papers, pp. 299-313. Springer International Publishing, 2017. Paper Link
- Kim, Mi-Young, Yao Lu, and Randy Goebel. "Textual entailment in legal bar exam question answering using deep siamese networks." In New Frontiers in Artificial Intelligence: JSAI-isAI Workshops, JURISIN, SKL, AI-Biz, LENLS, AAA, SCIDOCA, kNeXI, Tsukuba, Tokyo, November 13-15, 2017, Revised Selected Papers 9, pp. 35-48. Springer International Publishing, 2018. Paper Link
-
McElvain, Gayle, George Sanchez, Sean Matthews, Don Teo, Filippo Pompili, and Tonya Custis. "Westsearch plus: A non-factoid question-answering system for the legal domain." In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1361-1364. 2019. Paper Link
-
Taniguchi, Ryosuke, Reina Hoshino, and Yoshinobu Kano. "Legal question answering system using framenet." In New Frontiers in Artificial Intelligence: JSAI-isAI 2018 Workshops, JURISIN, AI-Biz, SKL, LENLS, IDAA, Yokohama, Japan, November 12–14, 2018, Revised Selected Papers, pp. 193-206. Springer International Publishing, 2019.Paper Link
-
McElvain, Gayle, George Sanchez, Don Teo, and Tonya Custis. "Non-factoid question answering in the legal domain." In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1395-1396. 2019.Paper Link
-
Martinez-Gil, Jorge, Bernhard Freudenthaler, and A. Min Tjoa. "Multiple choice question answering in the legal domain using reinforced co-occurrence." In Database and Expert Systems Applications: 30th International Conference, DEXA 2019, Linz, Austria, August 26–29, 2019, Proceedings, Part I 30, pp. 138-148. Springer International Publishing, 2019. Paper Link
-
Hoshino, Reina, Ryosuke Taniguchi, Naoki Kiyota, and Yoshinobu Kano. "Question answering system for legal bar examination using predicate argument structure." In New Frontiers in Artificial Intelligence: JSAI-isAI 2018 Workshops, JURISIN, AI-Biz, SKL, LENLS, IDAA, Yokohama, Japan, November 12–14, 2018, Revised Selected Papers, pp. 207-220. Springer International Publishing, 2019. Paper Link Paper Link
- Sovrano, F., Palmirani, M., & Vitali, F. (2020). Legal knowledge extraction for knowledge graph based question-answering. In Legal Knowledge and Information Systems (pp. 143-153). IOS Press. Paper Link
- Hoppe, Christoph, David Pelkmann, Nico Migenda, Daniel Hötte, and Wolfram Schenck. "Towards intelligent legal advisors for document retrieval and question-answering in German legal documents." In 2021 IEEE Fourth International Conference on Artificial Intelligence and Knowledge Engineering (AIKE), pp. 29-32. IEEE, 2021.Paper Link
- Askari, Arian, Suzan Verberne, and Gabriella Pasi. "Expert finding in legal community question answering." In Advances in Information Retrieval: 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10–14, 2022, Proceedings, Part II, pp. 22-30. Cham: Springer International Publishing, 2022. Paper Link
- S. S. Alotaibi, A. A. Munshi, A. T. Farag, O. E. Rakha, A. A. Al Sallab, and M. Alotaibi. Kab: Knowledge augmented bert2bert automated questionsanswering system for jurisprudential legal opinions. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 22(6):346{356, JUN 30 2022. ISSN 1738-7906. doi: 10.22937/IJCSNS. 2022.22.6.44. Paper Link
If you find this work useful for your research, please cite our paper:
@misc{abdallah2023exploring,
title={Exploring the State of the Art in Legal QA Systems},
author={Abdelrahman Abdallah and Bhawna Piryani and Adam Jatowt},
year={2023},
eprint={2304.06623},
archivePrefix={arXiv},
primaryClass={cs.CL}
}