Experiment Result

| Model | Prompt | Precision(Entities) | Recall(Entities) | F1-Score(Entities) | Macro F1-Score(Entities) | Precision(Aspect) | Recall(Aspect) | F1-Score(Aspect) | Macro F1-Score(Aspect) | Precision(Sentiment) | Recall(Sentiment) | F1-Score(Sentiment) | Macro F1-Score(Sentiment) | Joint Exact Match Accuracy (Entity + Aspect + Sentiment) **** | Entity Semantic Similarity Metrics ( Average ) | Entity Semantic Similarity Metrics ( Semantic Match Accuracy with threshold = 0.75 ) | Aspect Semantic Similarity Metrics ( Average ) | Aspect Semantic Similarity Metrics ( Semantic Match Accuracy with threshold = 0.75 ) | Sentiment Semantic Similarity Metrics ( Average ) | Sentiment Semantic Similarity Metrics ( Semantic Match Accuracy with threshold = 0.75 ) | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | meta-llama/Llama-3.2-3B-Instruct | FewShot | 0.7630 | 0.6830 | 0.6989 | 0.6561 | 0.4465 | 0.2930 | 0.2978 | 0.2375 | 0.6099 | 0.6400 | 0.6209 | 0.5380 | 0.1290 | 0.8842 | 0.8490 | 0.5124 | 0.3250 | 0.8401 | 0.7700 | | meta-llama/Llama-3.2-3B-Instruct | ZeroShot | 0.5371 | 0.3300 | 0.3703 | 0.3615 | 0.4199 | 0.1670 | 0.1992 | 0.1662 | 0.5385 | 0.5240 | 0.5028 | 0.4524 | 0.0440 | 0.6244 | 0.5000 | 0.3911 | 0.1930 | 0.8054 | 0.7780 | | meta-llama/Llama-3.1-8B-Instruct | FewShot | 0.7985 | 0.7190 | 0.7375 | 0.6979 | 0.5062 | 0.3960 | 0.4055 | 0.3487 | 0.6338 | 0.6190 | 0.6250 | 0.5571 | 0.1830 | 0.9016 | 0.8730 | 0.5772 | 0.4070 | 0.8217 | 0.7210 | | meta-llama/Llama-3.1-8B-Instruct | ZeroShot | 0.6850 | 0.5260 | 0.5643 | 0.5543 | 0.4771 | 0.3560 | 0.3754 | 0.3100 | 0.6388 | 0.6350 | 0.6368 | 0.5700 | 0.1210 | 0.8529 | 0.8460 | 0.5551 | 0.3680 | 0.8315 | 0.7410 | | meta-llama/Llama-3.3-70B-Instruct | FewShot | 0.7857 | 0.7693 | 0.7623 | 0.7550 | 0.5984 | 0.4792 | 0.4696 | 0.3761 | 0.8386 | 0.8426 | 0.8382 | 0.5475 | 0.3218 | 0.9281 | 0.9069 | 0.6469 | 0.4941 | 0.9200 | 0.8683 | | meta-llama/Llama-3.3-70B-Instruct | ZeroShot | 0.7607 | 0.6990 | 0.7127 | 0.6909 | 0.6073 | 0.4545 | 0.4487 | 0.3562 | 0.8422 | 0.8396 | 0.8397 | 0.5487 | 0.2941 | 0.9023 | 0.8901 | 0.6285 | 0.4743 | 0.9167 | 0.8604 | | Qwen/Qwen2.5-7B-Instruct-1M | FewShot | 0.8107 | 0.7390 | 0.7518 | 0.7108 | 0.4703 | 0.3570 | 0.3773 | 0.3217 | 0.6441 | 0.6640 | 0.6520 | 0.5755 | 0.1890 | 0.8896 | 0.8510 | 0.5737 | 0.3980 | 0.8476 | 0.7730 | | Qwen/Qwen2.5-7B-Instruct-1M | ZeroShot | 0.7119 | 0.6140 | 0.6370 | 0.5932 | 0.4850 | 0.3130 | 0.3206 | 0.2900 | 0.6347 | 0.6420 | 0.6379 | 0.5676 | 0.1310 | 0.8691 | 0.8510 | 0.5412 | 0.3590 | 0.8365 | 0.7530 | | Qwen/Qwen2.5-14B-Instruct-1M | ZeroShot | 0.8571 | 0.7870 | 0.7980 | 0.7502 | 0.5449 | 0.3940 | 0.4164 | 0.3611 | 0.6512 | 0.6440 | 0.6472 | 0.5767 | 0.2160 | 0.9211 | 0.8960 | 0.5913 | 0.4230 | 0.8314 | 0.7380 | | Qwen/Qwen2.5-14B-Instruct-1M | FewShot | 0.8742 | 0.8410 | 0.8405 | 0.8096 | 0.5463 | 0.4100 | 0.4255 | 0.3679 | 0.6439 | 0.6300 | 0.6364 | 0.5657 | 0.2300 | 0.9377 | 0.9110 | 0.6034 | 0.4420 | 0.8240 | 0.7220 | | Qwen/Qwen2.5-1.5B-Instruct | FewShot | 0.5746 | 0.4110 | 0.4435 | 0.4375 | 0.4034 | 0.2540 | 0.2706 | 0.2254 | 0.6210 | 0.4430 | 0.4689 | 0.4546 | 0.0560 | 0.7494 | 0.6950 | 0.5060 | 0.3170 | 0.7222 | 0.5170 | | Qwen/Qwen2.5-1.5B-Instruct | ZeroShot | 0.4906 | 0.3150 | 0.3465 | 0.3647 | 0.3254 | 0.1530 | 0.1856 | 0.1576 | 0.6307 | 0.3870 | 0.4078 | 0.3994 | 0.0230 | 0.7229 | 0.6840 | 0.4586 | 0.2510 | 0.6858 | 0.4430 | | Qwen/Qwen2.5-32B-Instruct | FewShot | 0.8555 | 0.8440 | 0.8389 | 0.8194 | 0.5415 | 0.4370 | 0.4474 | 0.4005 | 0.6566 | 0.6170 | 0.6330 | 0.5739 | 0.2490 | 0.9383 | 0.9160 | 0.6078 | 0.4570 | 0.8105 | 0.7040 | | Qwen/Qwen2.5-32B-Instruct | ZeroShot | 0.8366 | 0.8080 | 0.8084 | 0.7788 | 0.5351 | 0.4290 | 0.4454 | 0.3928 | 0.6433 | 0.6030 | 0.6187 | 0.5584 | 0.2240 | 0.9270 | 0.8980 | 0.6055 | 0.4540 | 0.8064 | 0.6930 |

Experiment Result with Only Implicit Data

| Model | Prompt | Precision(Entities) | Recall(Entities) | F1-Score(Entities) | Macro F1-Score(Entities) | Precision(Aspect) | Recall(Aspect) | F1-Score(Aspect) | Macro F1-Score(Aspect) | Precision(Sentiment) | Recall(Sentiment) | F1-Score(Sentiment) | Macro F1-Score(Sentiment) | Joint Exact Match Accuracy (Entity + Aspect + Sentiment) **** | Entity Semantic Similarity Metrics ( Average ) | Entity Semantic Similarity Metrics ( Semantic slack Match Accuracy with threshold = 0.75 ) | Aspect Semantic Similarity Metrics ( Average ) | Aspect Semantic Similarity Metrics ( Semantic Match Accuracy with threshold = 0.75 ) | Sentiment Semantic Similarity Metrics ( Average ) | Sentiment Semantic Similarity Metrics ( Semantic Match Accuracy with threshold = 0.75 ) | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | meta-llama/Llama-3.2-3B-Instruct | FewShot | 0.5210 | 0.5163 | 0.4933 | 0.4105 | 0.4231 | 0.3116 | 0.3171 | 0.2640 | 0.7055 | 0.6837 | 0.6932 | 0.6074 | 0.1209 | 0.7173 | 0.5721 | 0.5228 | 0.3302 | 0.8439 | 0.7395 | | meta-llama/Llama-3.2-3B-Instruct | ZeroShot | 0.3482 | 0.2372 | 0.2620 | 0.2066 | 0.3721 | 0.2000 | 0.2337 | 0.1936 | 0.7236 | 0.4698 | 0.5587 | 0.4838 | 0.0837 | 0.4355 | 0.2837 | 0.3958 | 0.2279 | 0.6659 | 0.5070 | | meta-llama/Llama-3.1-8B-Instruct | FewShot | 0.6148 | 0.5907 | 0.5743 | 0.5207 | 0.5105 | 0.4186 | 0.4224 | 0.3477 | 0.7159 | 0.6140 | 0.6492 | 0.5826 | 0.1535 | 0.7844 | 0.6651 | 0.5950 | 0.4233 | 0.8043 | 0.6558 | | meta-llama/Llama-3.1-8B-Instruct | ZeroShot | 0.6531 | 0.6093 | 0.6061 | 0.5661 | 0.5158 | 0.4372 | 0.4343 | 0.4097 | 0.7388 | 0.6465 | 0.6774 | 0.6119 | 0.1907 | 0.7893 | 0.6744 | 0.6088 | 0.4512 | 0.8202 | 0.6837 | | meta-llama/Llama-3.3-70B-Instruct | FewShot | 0.7857 | 0.7693 | 0.7623 | 0.7550 | 0.5984 | 0.4792 | 0.4696 | 0.3761 | 0.8386 | 0.8426 | 0.8382 | 0.5475 | 0.3218 | 0.9281 | 0.9069 | 0.6469 | 0.4941 | 0.9200 | 0.8683 | | meta-llama/Llama-3.3-70B-Instruct | ZeroShot | 0.7607 | 0.6990 | 0.7127 | 0.6909 | 0.6073 | 0.4545 | 0.4487 | 0.3562 | 0.8422 | 0.8396 | 0.8397 | 0.5487 | 0.2941 | 0.9023 | 0.8901 | 0.6285 | 0.4743 | 0.9167 | 0.8604 | | Qwen/Qwen2.5-7B-Instruct-1M | FewShot | 0.5226 | 0.5070 | 0.4857 | 0.4216 | 0.3721 | 0.3488 | 0.3103 | 0.2959 | 0.7029 | 0.7023 | 0.7016 | 0.6190 | 0.1442 | 0.7204 | 0.5581 | 0.5598 | 0.3628 | 0.8593 | 0.7767 | | Qwen/Qwen2.5-7B-Instruct-1M | ZeroShot | 0.4782 | 0.4791 | 0.4387 | 0.3755 | 0.4255 | 0.3488 | 0.3242 | 0.2989 | 0.7129 | 0.6558 | 0.6786 | 0.6039 | 0.1302 | 0.7022 | 0.5302 | 0.5677 | 0.3907 | 0.8281 | 0.7023 | | Qwen/Qwen2.5-14B-Instruct-1M | FewShot | 0.7129 | 0.7163 | 0.6943 | 0.6249 | 0.5123 | 0.4000 | 0.3971 | 0.3854 | 0.7422 | 0.6930 | 0.7111 | 0.6412 | 0.1860 | 0.8373 | 0.7488 | 0.6001 | 0.4186 | 0.8460 | 0.7442 | | Qwen/Qwen2.5-14B-Instruct-1M | ZeroShot | 0.6647 | 0.6558 | 0.6342 | 0.5519 | 0.4295 | 0.3674 | 0.3519 | 0.3664 | 0.7505 | 0.6837 | 0.7087 | 0.6353 | 0.1535 | 0.7970 | 0.6837 | 0.5842 | 0.3860 | 0.8363 | 0.7163 | | Qwen/Qwen2.5-1.5B-Instruct | FewShot | 0.1729 | 0.1581 | 0.1407 | 0.1027 | 0.3584 | 0.2558 | 0.2446 | 0.2504 | 0.7383 | 0.4930 | 0.5411 | 0.5083 | 0.0279 | 0.4656 | 0.2047 | 0.5088 | 0.3023 | 0.7364 | 0.5163 | | Qwen/Qwen2.5-1.5B-Instruct | ZeroShot | 0.1995 | 0.1628 | 0.1482 | 0.0897 | 0.3235 | 0.2000 | 0.1874 | 0.1419 | 0.7645 | 0.4279 | 0.4742 | 0.4490 | 0.0140 | 0.4776 | 0.2140 | 0.4843 | 0.2744 | 0.6966 | 0.4372 | | Qwen/Qwen2.5-32B-Instruct | FewShot | 0.7327 | 0.7349 | 0.7201 | 0.6886 | 0.6062 | 0.4512 | 0.4566 | 0.4709 | 0.7445 | 0.6279 | 0.6682 | 0.6043 | 0.2233 | 0.8626 | 0.7860 | 0.6164 | 0.4605 | 0.7949 | 0.6558 | | Qwen/Qwen2.5-32B-Instruct | ZeroShot | 0.7208 | 0.7163 | 0.6996 | 0.6729 | 0.5728 | 0.4465 | 0.4556 | 0.4527 | 0.7485 | 0.6558 | 0.6882 | 0.6179 | 0.2279 | 0.8589 | 0.7767 | 0.6158 | 0.4605 | 0.8179 | 0.6837 |

| Model | Prompt | Precision(Entities) | Recall(Entities) | F1-Score(Entities) | Macro F1-Score(Entities) | Precision(Aspect) | Recall(Aspect) | F1-Score(Aspect) | Macro F1-Score(Aspect) | Precision(Sentiment) | Recall(Sentiment) | F1-Score(Sentiment) | Macro F1-Score(Sentiment) | Joint Exact Match Accuracy (Entity + Aspect + Sentiment) **** | Entity Semantic Similarity Metrics ( Average ) | Entity Semantic Similarity Metrics ( Semantic slack Match Accuracy with threshold = 0.75 ) | Aspect Semantic Similarity Metrics ( Average ) | Aspect Semantic Similarity Metrics ( Semantic Match Accuracy with threshold = 0.75 ) | Sentiment Semantic Similarity Metrics ( Average ) | Sentiment Semantic Similarity Metrics ( Semantic Match Accuracy with threshold = 0.75 ) | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | meta-llama/Llama-3.2-3B-Instruct | FewShot | 0.5210 | 0.5163 | 0.4933 | 0.4105 | 0.4231 | 0.3116 | 0.3171 | 0.2640 | 0.7055 | 0.6837 | 0.6932 | 0.6074 | 0.1209 | 0.7173 | 0.5721 | 0.5228 | 0.3302 | 0.8439 | 0.7395 | | meta-llama/Llama-3.2-3B-Instruct | ZeroShot | 0.3482 | 0.2372 | 0.2620 | 0.2066 | 0.3721 | 0.2000 | 0.2337 | 0.1936 | 0.7236 | 0.4698 | 0.5587 | 0.4838 | 0.0837 | 0.4355 | 0.2837 | 0.3958 | 0.2279 | 0.6659 | 0.5070 | | meta-llama/Llama-3.1-8B-Instruct | FewShot | 0.6148 | 0.5907 | 0.5743 | 0.5207 | 0.5105 | 0.4186 | 0.4224 | 0.3477 | 0.7159 | 0.6140 | 0.6492 | 0.5826 | 0.1535 | 0.7844 | 0.6651 | 0.5950 | 0.4233 | 0.8043 | 0.6558 | | meta-llama/Llama-3.1-8B-Instruct | ZeroShot | 0.6531 | 0.6093 | 0.6061 | 0.5661 | 0.5158 | 0.4372 | 0.4343 | 0.4097 | 0.7388 | 0.6465 | 0.6774 | 0.6119 | 0.1907 | 0.7893 | 0.6744 | 0.6088 | 0.4512 | 0.8202 | 0.6837 | | meta-llama/Llama-3.3-70B-Instruct | FewShot | 0.7857 | 0.7693 | 0.7623 | 0.7550 | 0.5984 | 0.4792 | 0.4696 | 0.3761 | 0.8386 | 0.8426 | 0.8382 | 0.5475 | 0.3218 | 0.9281 | 0.9069 | 0.6469 | 0.4941 | 0.9200 | 0.8683 | | meta-llama/Llama-3.3-70B-Instruct | ZeroShot | 0.7607 | 0.6990 | 0.7127 | 0.6909 | 0.6073 | 0.4545 | 0.4487 | 0.3562 | 0.8422 | 0.8396 | 0.8397 | 0.5487 | 0.2941 | 0.9023 | 0.8901 | 0.6285 | 0.4743 | 0.9167 | 0.8604 | | Qwen/Qwen2.5-7B-Instruct-1M | FewShot | 0.5226 | 0.5070 | 0.4857 | 0.4216 | 0.3721 | 0.3488 | 0.3103 | 0.2959 | 0.7029 | 0.7023 | 0.7016 | 0.6190 | 0.1442 | 0.7204 | 0.5581 | 0.5598 | 0.3628 | 0.8593 | 0.7767 | | Qwen/Qwen2.5-7B-Instruct-1M | ZeroShot | 0.4782 | 0.4791 | 0.4387 | 0.3755 | 0.4255 | 0.3488 | 0.3242 | 0.2989 | 0.7129 | 0.6558 | 0.6786 | 0.6039 | 0.1302 | 0.7022 | 0.5302 | 0.5677 | 0.3907 | 0.8281 | 0.7023 | | Qwen/Qwen2.5-14B-Instruct-1M | FewShot | 0.7129 | 0.7163 | 0.6943 | 0.6249 | 0.5123 | 0.4000 | 0.3971 | 0.3854 | 0.7422 | 0.6930 | 0.7111 | 0.6412 | 0.1860 | 0.8373 | 0.7488 | 0.6001 | 0.4186 | 0.8460 | 0.7442 | | Qwen/Qwen2.5-14B-Instruct-1M | ZeroShot | 0.6647 | 0.6558 | 0.6342 | 0.5519 | 0.4295 | 0.3674 | 0.3519 | 0.3664 | 0.7505 | 0.6837 | 0.7087 | 0.6353 | 0.1535 | 0.7970 | 0.6837 | 0.5842 | 0.3860 | 0.8363 | 0.7163 | | Qwen/Qwen2.5-1.5B-Instruct | FewShot | 0.1729 | 0.1581 | 0.1407 | 0.1027 | 0.3584 | 0.2558 | 0.2446 | 0.2504 | 0.7383 | 0.4930 | 0.5411 | 0.5083 | 0.0279 | 0.4656 | 0.2047 | 0.5088 | 0.3023 | 0.7364 | 0.5163 | | Qwen/Qwen2.5-1.5B-Instruct | ZeroShot | 0.1995 | 0.1628 | 0.1482 | 0.0897 | 0.3235 | 0.2000 | 0.1874 | 0.1419 | 0.7645 | 0.4279 | 0.4742 | 0.4490 | 0.0140 | 0.4776 | 0.2140 | 0.4843 | 0.2744 | 0.6966 | 0.4372 | | Qwen/Qwen2.5-32B-Instruct | FewShot | 0.7327 | 0.7349 | 0.7201 | 0.6886 | 0.6062 | 0.4512 | 0.4566 | 0.4709 | 0.7445 | 0.6279 | 0.6682 | 0.6043 | 0.2233 | 0.8626 | 0.7860 | 0.6164 | 0.4605 | 0.7949 | 0.6558 | | Qwen/Qwen2.5-32B-Instruct | ZeroShot | 0.7208 | 0.7163 | 0.6996 | 0.6729 | 0.5728 | 0.4465 | 0.4556 | 0.4527 | 0.7485 | 0.6558 | 0.6882 | 0.6179 | 0.2279 | 0.8589 | 0.7767 | 0.6158 | 0.4605 | 0.8179 | 0.6837 |