diff --git a/dbpedia/LC-QuAD v2.md b/dbpedia/LC-QuAD v2.md index 7b7a9192..2978adfe 100644 --- a/dbpedia/LC-QuAD v2.md +++ b/dbpedia/LC-QuAD v2.md @@ -5,6 +5,8 @@ datasetUrl: https://figshare.com/projects/LCQuAD_2_0/62270 | Model / System | Year | Precision | Recall | F1 | Hits@1 | Language | Reported by | Gold Entity | | :-----------------------: | :--: | :-------: | :----: | :---: | :----: | :------: | :----------------------------------------------------------------------------------: | :---------: | +| TSET-Small | 2024 | - | - | 94.0 | - | EN | [Qi et al](https://www.mdpi.com/2076-3417/14/4/1521) | ✅ | +| TSET-Base | 2024 | - | - | 95.0 | - | EN | [Qi et al.](https://www.mdpi.com/2076-3417/14/4/1521) | ✅ | | T5-Small | 2022 | - | - | 92 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ | | T5-Base | 2022 | - | - | 91 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ | | PGN-BERT-BERT | 2022 | - | - | 86 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ | diff --git a/freebase/PathQuestion - 2 Hops.md b/freebase/PathQuestion - 2 Hops.md index df72e6d3..19abdd14 100644 --- a/freebase/PathQuestion - 2 Hops.md +++ b/freebase/PathQuestion - 2 Hops.md @@ -26,3 +26,4 @@ | HR-BiLSTM | 2022 | - | - | 76.8(Hits@1) | EN | [AlAgha, 2022](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9834917) | | MINERVA | 2022 | - | - | 75.9(Hits@1) | EN | [Wang et al.](https://arxiv.org/pdf/2206.01818.pdf) | | Subgraph Embed | 2023 | - | - | 74.4 | EN | [Xu et al.](https://link.springer.com/chapter/10.1007/978-3-031-30672-3_40) | +| DSAMR | 2024 | - | - | 98.4 | EN | [Sun et al.](https://www.sciencedirect.com/science/article/pii/S0957417423035947)| diff --git a/freebase/PathQuestion - 3 Hops.md b/freebase/PathQuestion - 3 Hops.md index 684b485e..95d19e6c 100644 --- a/freebase/PathQuestion - 3 Hops.md +++ b/freebase/PathQuestion - 3 Hops.md @@ -26,4 +26,5 @@ | IRN | 2022 | - | - | 74.3(Hits@1) | EN | [AlAgha, 2022](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9834917) | | HR-BiLSTM | 2022 | - | - | 74.1(Hits@1) | EN | [AlAgha, 2022](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9834917) | | MINERVA | 2022 | - | - | 71.2(Hits@1) | EN | [Wang et al.](https://arxiv.org/pdf/2206.01818.pdf) | -| Subgraph Embed | 2023 | - | - | 50.6 | EN | [Xu et al.](https://link.springer.com/chapter/10.1007/978-3-031-30672-3_40) | \ No newline at end of file +| Subgraph Embed | 2023 | - | - | 50.6 | EN | [Xu et al.](https://link.springer.com/chapter/10.1007/978-3-031-30672-3_40) | +| DSAMR | 2024 | - | - | 91.1 | EN | [Sun et al.](https://www.sciencedirect.com/science/article/pii/S0957417423035947) | diff --git a/freebase/PathQuestion-Large - 2 Hops.md b/freebase/PathQuestion-Large - 2 Hops.md index 30501a6a..d27a4efa 100644 --- a/freebase/PathQuestion-Large - 2 Hops.md +++ b/freebase/PathQuestion-Large - 2 Hops.md @@ -28,4 +28,5 @@ | UHop | 2022 | - | - | - | 97.5 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | | HR-BiLSTM | 2022 | - | - | - | 97.5 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | | ABWIM | 2022 | - | - | - | 94.3 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | -| KV-MemNN | 2022 | - | - | - | 72.2 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | \ No newline at end of file +| KV-MemNN | 2022 | - | - | - | 72.2 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | +| DSAMR | 2024 | - | - | 95.6 | EN | [Sun et al.](https://www.sciencedirect.com/science/article/pii/S0957417423035947) | diff --git a/freebase/PathQuestion-Large - 3 Hops.md b/freebase/PathQuestion-Large - 3 Hops.md index aeff65e2..0e017f93 100644 --- a/freebase/PathQuestion-Large - 3 Hops.md +++ b/freebase/PathQuestion-Large - 3 Hops.md @@ -27,4 +27,5 @@ | MRP-QA-marginal_prob | 2022 | - | - | - | 97.8 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | | UHop | 2022 | - | - | - | 89.3 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | | ABWIM | 2022 | - | - | - | 89.3 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | -| HR-BiLSTM | 2022 | - | - | - | 87.9 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | \ No newline at end of file +| HR-BiLSTM | 2022 | - | - | - | 87.9 | EN | [Wang et al.](https://aclanthology.org/2022.naacl-main.294.pdf) | +| DSAMR | 2024 | - | - | 81.7 | EN | [Sun et al.](https://www.sciencedirect.com/science/article/pii/S0957417423035947) | diff --git a/freebase/TempQuestions.md b/freebase/TempQuestions.md index 8365ec22..7cc167a7 100644 --- a/freebase/TempQuestions.md +++ b/freebase/TempQuestions.md @@ -3,8 +3,8 @@ datasetUrl: http://qa.mpi-inf.mpg.de/TempQuestions.zip --- -| Model / System | Year | Precision | Recall | F-Score | Reported by | Metric | Precision@1 | Hits@5 | MRR | -|----------------|------|-----------|--------|---------|-------------------------------------------------------------------|-----------------|-------------|--------|------| +| Model / System | Year | Precision | Recall | F-Score | Reported by | Metric | Precision@1 | Hits@5 | MRR | Hits@1 | +|----------------|------|-----------|--------|---------|-------------------------------------------------------------------|-----------------|-------------|--------|------|------| | AQQU | 2018 | 27.6 | 60.7 | 31.1 | [Jia et. al.](https://dl.acm.org/doi/abs/10.1145/3184558.3191536) | Explicit | | | | | QUINT | 2018 | 29.3 | 60.9 | 32.6 | [Jia et. al.](https://dl.acm.org/doi/abs/10.1145/3184558.3191536) | Explicit | | | | | AQQU | 2018 | 12.9 | 34.9 | 14.5 | [Jia et. al.](https://dl.acm.org/doi/abs/10.1145/3184558.3191536) | Implicit | | | | @@ -13,3 +13,4 @@ | QUINT | 2018 | | | | [Jia et. al.](https://dl.acm.org/doi/abs/10.1145/3184558.3191536) | Ordinal | 21.3 | 26.1 | 54.9 | | AQQU | 2018 | 26.1 | 33.5 | 27.4 | [Jia et. al.](https://dl.acm.org/doi/abs/10.1145/3184558.3191536) | Temporal Answer | | | | | QUINT | 2018 | 25.2 | 38.2 | 27.3 | [Jia et. al.](https://dl.acm.org/doi/abs/10.1145/3184558.3191536) | Temporal Answer | | | | +| JMFRN | 2024 | | | | [Huang et. al.](https://arxiv.org/pdf/2401.02212) | | | | | 64.6 | diff --git a/freebase/WebQuestionsSP.md b/freebase/WebQuestionsSP.md index 0b99b378..a8dbed1b 100644 --- a/freebase/WebQuestionsSP.md +++ b/freebase/WebQuestionsSP.md @@ -98,4 +98,5 @@ | FILM | 2022 | 54.7 | - | - | EN | [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf) | | ReifKB | 2020 | - | 52.7 | - | EN | [Cohen et al.](https://arxiv.org/pdf/2002.06115.pdf) | | KV-Mem | 2022 | 38.6 | 46.7 | - | EN | [Du et al.](https://arxiv.org/pdf/2209.03005.pdf) | -| KGQA-RR(GPT2) | 2023 | - | - | 18.11 | EN | [Hu et al.](https://arxiv.org/pdf/2303.10368.pdf) | +| KGQA-RR(GPT2) | 2023 | - | - | 18.11 | EN | [Hu et al.](https://arxiv.org/pdf/2303.10368.pdf) | +| GENConv | 2024 | - | 74.64 | - | EN | [Thambi et al.](https://link.springer.com/article/10.1007/s10844-023-00839-4) | diff --git a/other/MetaQA - 1 Hop.md b/other/MetaQA - 1 Hop.md index aedb27e8..4849f623 100644 --- a/other/MetaQA - 1 Hop.md +++ b/other/MetaQA - 1 Hop.md @@ -40,4 +40,5 @@ | Supervised embedding | 2017 | 54.4 | - | - | EN | [Zhang et al.](https://arxiv.org/pdf/1709.04071.pdf) | | T5+KG | 2022 | - | - | 71.47 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | | T5 | 2022 | - | - | 24.5 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | -| T5+C4 | 2022 | - | - | 23.53 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | +| T5+C4 | 2022 | - | - | 23.53 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | +| GENConv | 2024 | 98.50 | - | - | EN | [Thambi et al.](https://link.springer.com/article/10.1007/s10844-023-00839-4) | diff --git a/other/MetaQA - 2 Hop.md b/other/MetaQA - 2 Hop.md index ebc5fa1d..a5944b46 100644 --- a/other/MetaQA - 2 Hop.md +++ b/other/MetaQA - 2 Hop.md @@ -44,4 +44,5 @@ | KV-MemNN | 2017 | 25.1 | - | - | EN | [Zhang et al.](https://arxiv.org/pdf/1709.04071.pdf) | | T5+KG | 2022 | - | - | 33.57 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | | T5+C4 | 2022 | - | - | 32.78 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | -| T5 | 2022 | - | - | 32.65 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | +| T5 | 2022 | - | - | 32.65 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | +| GENConv | 2024 | 96.97 | - | - | EN | [Thambi et al.](https://link.springer.com/article/10.1007/s10844-023-00839-4) | diff --git a/other/MetaQA - 3 Hop.md b/other/MetaQA - 3 Hop.md index cbe8a777..0bd9164f 100644 --- a/other/MetaQA - 3 Hop.md +++ b/other/MetaQA - 3 Hop.md @@ -43,4 +43,5 @@ | T5+KG | 2022 | - | - | 43.41 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | | T5 | 2022 | - | - | 42.31 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | | T5+C4 | 2022 | - | - | 39.66 | EN | [Moiseev et al.](https://arxiv.org/pdf/2205.08184.pdf) | +| GENConv | 2024 | 95.30 | - | - | EN | [Thambi et al.](https://link.springer.com/article/10.1007/s10844-023-00839-4) | diff --git a/wikidata/QALD-9-Plus-Wikidata.md b/wikidata/QALD-9-Plus-Wikidata.md index 0338a49e..60ba50ac 100644 --- a/wikidata/QALD-9-Plus-Wikidata.md +++ b/wikidata/QALD-9-Plus-Wikidata.md @@ -5,6 +5,8 @@ | Model / System | Year |Precision| Recall | F1 | Language | Reported by | |:---------------------------------:|:----:|:-------:|:------:|:-----:|:--------:|:------------------------------------------------------------------------------:| +| TSET-Small | 2024 | | | 72.86| EN | [Qi et. al.](https://www.mdpi.com/2076-3417/14/4/1521) | +| TSET-Base | 2024 | | | 75.85| EN | [Qi et. al.](https://www.mdpi.com/2076-3417/14/4/1521) | | QAnswer | 2022 | 50.46 | 44.84 | 44.59 | EN | [Perevalov et. al.](https://dl.acm.org/doi/pdf/10.1145/3485447.3511940) | | QAnswer-en-de-Yandex | 2022 | 34.91 | 35.18 | 32.83 | EN | [Perevalov et. al.](https://dl.acm.org/doi/pdf/10.1145/3485447.3511940) | | QAnswer-en-de-Helsinki NLP | 2022 | 34.90 | 35.00 | 33.74 | EN | [Perevalov et. al.](https://dl.acm.org/doi/pdf/10.1145/3485447.3511940) |