NFM
The results of NFM on the 6 datasets (i.e., ML-1M, LastFM, Book-X, Epinions, Yelp, AMZe) under three views (i.e., origin, 5-filter and 10-filter) w.r.t time-aware split-by-ratio (TSBR) are listed below.
ML-1M
The results on ML-1M dataset across origin, 5- and 10-filter settings are listed below.
origin
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.4936 |
0.4410 |
0.4162 |
0.3777 |
0.3501 |
0.3126 |
Rec |
0.0147 |
0.0566 |
0.0999 |
0.1741 |
0.2335 |
0.3265 |
HR |
0.4936 |
0.7647 |
0.8426 |
0.9020 |
0.9283 |
0.9457 |
MAP |
0.4936 |
0.3654 |
0.3171 |
0.2678 |
0.2383 |
0.2020 |
MRR |
0.4936 |
1.0457 |
1.2995 |
1.5285 |
1.6462 |
1.7764 |
NDCG |
0.4936 |
0.6304 |
0.6473 |
0.6564 |
0.6591 |
0.6583 |
5-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.4871 |
0.4270 |
0.4042 |
0.3667 |
0.3386 |
0.3007 |
Rec |
0.0130 |
0.0543 |
0.0972 |
0.1681 |
0.2244 |
0.3148 |
HR |
0.4871 |
0.7506 |
0.8397 |
0.8952 |
0.9238 |
0.9462 |
MAP |
0.4871 |
0.3550 |
0.3066 |
0.2575 |
0.2281 |
0.1917 |
MRR |
0.4871 |
1.0201 |
1.2672 |
1.4891 |
1.6017 |
1.7256 |
NDCG |
0.4871 |
0.6179 |
0.6381 |
0.6458 |
0.6489 |
0.6493 |
10-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.4470 |
0.4144 |
0.3898 |
0.3535 |
0.3267 |
0.2894 |
Rec |
0.0118 |
0.0517 |
0.0916 |
0.1593 |
0.2131 |
0.2980 |
HR |
0.4470 |
0.7430 |
0.8303 |
0.8912 |
0.9126 |
0.9425 |
MAP |
0.4470 |
0.3408 |
0.2923 |
0.2453 |
0.2170 |
0.1815 |
MRR |
0.4470 |
0.9783 |
1.2141 |
1.4284 |
1.5372 |
1.6556 |
NDCG |
0.4470 |
0.6006 |
0.6232 |
0.6316 |
0.6343 |
0.6368 |
LastFM
The results on LastFM dataset across origin, 5- and 10-filter settings are listed below.
origin
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.4158 |
0.3365 |
0.2656 |
0.1954 |
0.1552 |
0.1112 |
Rec |
0.0438 |
0.1732 |
0.2723 |
0.3961 |
0.4714 |
0.5628 |
HR |
0.4158 |
0.7440 |
0.8449 |
0.9081 |
0.9315 |
0.9543 |
MAP |
0.4158 |
0.2601 |
0.1772 |
0.1098 |
0.0789 |
0.0503 |
MRR |
0.4158 |
0.8438 |
0.9723 |
1.0581 |
1.0883 |
1.1116 |
NDCG |
0.4158 |
0.5843 |
0.6058 |
0.6050 |
0.6013 |
0.5954 |
5-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.2120 |
0.1536 |
0.1198 |
0.0888 |
0.0747 |
0.0583 |
Rec |
0.0262 |
0.0919 |
0.1428 |
0.2122 |
0.2667 |
0.3478 |
HR |
0.2120 |
0.4570 |
0.5717 |
0.6955 |
0.7647 |
0.8302 |
MAP |
0.2120 |
0.1055 |
0.0675 |
0.0396 |
0.0287 |
0.0187 |
MRR |
0.2120 |
0.3976 |
0.4543 |
0.4934 |
0.5120 |
0.5294 |
NDCG |
0.2120 |
0.3323 |
0.3625 |
0.3844 |
0.3934 |
0.3990 |
10-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.1047 |
0.0890 |
0.0745 |
0.0580 |
0.0490 |
0.0393 |
Rec |
0.0135 |
0.0581 |
0.0967 |
0.1528 |
0.1930 |
0.2609 |
HR |
0.1047 |
0.3202 |
0.4495 |
0.5876 |
0.6601 |
0.7496 |
MAP |
0.1047 |
0.0521 |
0.0336 |
0.0202 |
0.0147 |
0.0096 |
MRR |
0.1047 |
0.2182 |
0.2574 |
0.2858 |
0.2983 |
0.3110 |
NDCG |
0.1047 |
0.2139 |
0.2532 |
0.2841 |
0.2960 |
0.3090 |
Book-X
The results on Book-X dataset across origin, 5- and 10-filter settings are listed below.
origin
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.1853 |
0.1137 |
0.0858 |
0.0622 |
0.0504 |
0.0379 |
Rec |
0.0842 |
0.2062 |
0.2757 |
0.3555 |
0.4027 |
0.4639 |
HR |
0.1853 |
0.3518 |
0.4278 |
0.5071 |
0.5502 |
0.6050 |
MAP |
0.1853 |
0.0855 |
0.0576 |
0.0378 |
0.0292 |
0.0208 |
MRR |
0.1853 |
0.3168 |
0.3548 |
0.3812 |
0.3920 |
0.4018 |
NDCG |
0.1853 |
0.2707 |
0.2919 |
0.3081 |
0.3148 |
0.3219 |
5-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.1455 |
0.0990 |
0.0802 |
0.0627 |
0.0531 |
0.0421 |
Rec |
0.0354 |
0.1022 |
0.1549 |
0.2246 |
0.2739 |
0.3452 |
HR |
0.1455 |
0.3097 |
0.3971 |
0.4876 |
0.5402 |
0.6099 |
MAP |
0.1455 |
0.0699 |
0.0480 |
0.0321 |
0.0250 |
0.0180 |
MRR |
0.1455 |
0.2628 |
0.3030 |
0.3338 |
0.3473 |
0.3604 |
NDCG |
0.1455 |
0.2284 |
0.2529 |
0.2706 |
0.2785 |
0.2876 |
10-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.1300 |
0.0902 |
0.0741 |
0.0590 |
0.0510 |
0.0413 |
Rec |
0.0232 |
0.0721 |
0.1119 |
0.1682 |
0.2090 |
0.2724 |
HR |
0.1300 |
0.2952 |
0.3841 |
0.4766 |
0.5318 |
0.6021 |
MAP |
0.1300 |
0.0610 |
0.0415 |
0.0274 |
0.0214 |
0.0154 |
MRR |
0.1300 |
0.2369 |
0.2748 |
0.3047 |
0.3187 |
0.3323 |
NDCG |
0.1300 |
0.2129 |
0.2380 |
0.2562 |
0.2651 |
0.2740 |
Epinions
The results on Epinions dataset across origin, 5- and 10-filter settings are listed below.
origin
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.0995 |
0.0769 |
0.0693 |
0.0602 |
0.0547 |
0.0475 |
Rec |
0.0072 |
0.0249 |
0.0416 |
0.0666 |
0.0865 |
0.1169 |
HR |
0.0995 |
0.2100 |
0.2822 |
0.3630 |
0.4142 |
0.4849 |
MAP |
0.0995 |
0.0561 |
0.0431 |
0.0328 |
0.0280 |
0.0230 |
MRR |
0.0995 |
0.1923 |
0.2322 |
0.2668 |
0.2842 |
0.3028 |
NDCG |
0.0995 |
0.1537 |
0.1745 |
0.1931 |
0.2028 |
0.2150 |
5-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.0449 |
0.0328 |
0.0289 |
0.0241 |
0.0214 |
0.0195 |
Rec |
0.0052 |
0.0150 |
0.0252 |
0.0406 |
0.0532 |
0.0816 |
HR |
0.0449 |
0.1132 |
0.1638 |
0.2240 |
0.2659 |
0.3431 |
MAP |
0.0449 |
0.0214 |
0.0150 |
0.0102 |
0.0081 |
0.0063 |
MRR |
0.0449 |
0.0846 |
0.1008 |
0.1139 |
0.1202 |
0.1286 |
NDCG |
0.0449 |
0.0796 |
0.0946 |
0.1086 |
0.1168 |
0.1299 |
10-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.0385 |
0.0239 |
0.0200 |
0.0162 |
0.0153 |
0.0132 |
Rec |
0.0057 |
0.0139 |
0.0219 |
0.0338 |
0.0489 |
0.0703 |
HR |
0.0385 |
0.0903 |
0.1278 |
0.1763 |
0.2232 |
0.2812 |
MAP |
0.0385 |
0.0153 |
0.0101 |
0.0064 |
0.0051 |
0.0037 |
MRR |
0.0385 |
0.0650 |
0.0756 |
0.0838 |
0.0893 |
0.0945 |
NDCG |
0.0385 |
0.0642 |
0.0756 |
0.0866 |
0.0955 |
0.1053 |
Yelp
The results on Yelp dataset across origin, 5- and 10-filter settings are listed below.
origin
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.0672 |
0.0447 |
0.0349 |
0.0263 |
0.0219 |
0.0168 |
Rec |
0.0377 |
0.1083 |
0.1598 |
0.2301 |
0.2806 |
0.3538 |
HR |
0.0672 |
0.1735 |
0.2431 |
0.3309 |
0.3894 |
0.4674 |
MAP |
0.0672 |
0.0283 |
0.0175 |
0.0103 |
0.0075 |
0.0049 |
MRR |
0.0672 |
0.1204 |
0.1369 |
0.1490 |
0.1542 |
0.1590 |
NDCG |
0.0672 |
0.1210 |
0.1425 |
0.1635 |
0.1754 |
0.1893 |
5-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.0902 |
0.0726 |
0.0612 |
0.0491 |
0.0422 |
0.0340 |
Rec |
0.0196 |
0.0709 |
0.1149 |
0.1783 |
0.2256 |
0.2995 |
HR |
0.0902 |
0.2383 |
0.3322 |
0.4415 |
0.5087 |
0.5971 |
MAP |
0.0902 |
0.0471 |
0.0317 |
0.0202 |
0.0152 |
0.0104 |
MRR |
0.0902 |
0.1816 |
0.2142 |
0.2395 |
0.2507 |
0.2619 |
NDCG |
0.0902 |
0.1650 |
0.1931 |
0.2183 |
0.2311 |
0.2464 |
10-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.0911 |
0.0804 |
0.0697 |
0.0575 |
0.0503 |
0.0416 |
Rec |
0.0140 |
0.0542 |
0.0894 |
0.1421 |
0.1824 |
0.2463 |
HR |
0.0911 |
0.2550 |
0.3510 |
0.4628 |
0.5300 |
0.6164 |
MAP |
0.0911 |
0.0513 |
0.0360 |
0.0239 |
0.0184 |
0.0129 |
MRR |
0.0911 |
0.1936 |
0.2322 |
0.2630 |
0.2773 |
0.2918 |
NDCG |
0.0911 |
0.1737 |
0.2028 |
0.2289 |
0.2422 |
0.2575 |
AMZe
The results on AMZe dataset across origin, 5- and 10-filter settings are listed below.
origin
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.1570 |
0.0765 |
0.0517 |
0.0333 |
0.0252 |
0.0174 |
Rec |
0.1139 |
0.2640 |
0.3524 |
0.4496 |
0.5088 |
0.5840 |
HR |
0.1570 |
0.3310 |
0.4243 |
0.5214 |
0.5783 |
0.6481 |
MAP |
0.1570 |
0.0515 |
0.0285 |
0.0152 |
0.0103 |
0.0063 |
MRR |
0.1570 |
0.2367 |
0.2546 |
0.2649 |
0.2685 |
0.2715 |
NDCG |
0.1570 |
0.2458 |
0.2741 |
0.2961 |
0.3066 |
0.3177 |
5-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.1958 |
0.1084 |
0.0760 |
0.0516 |
0.0406 |
0.0292 |
Rec |
0.0667 |
0.1711 |
0.2356 |
0.3160 |
0.3711 |
0.4432 |
HR |
0.1958 |
0.3890 |
0.4792 |
0.5726 |
0.6282 |
0.6920 |
MAP |
0.1958 |
0.0759 |
0.0441 |
0.0244 |
0.0170 |
0.0106 |
MRR |
0.1958 |
0.3170 |
0.3458 |
0.3645 |
0.3719 |
0.3782 |
NDCG |
0.1958 |
0.2936 |
0.3176 |
0.3337 |
0.3406 |
0.3463 |
10-filter
Metric@K |
1 |
5 |
10 |
20 |
30 |
50 |
|---|---|---|---|---|---|---|
Pre |
0.2090 |
0.1186 |
0.0866 |
0.0601 |
0.0478 |
0.0350 |
Rec |
0.0510 |
0.1336 |
0.1906 |
0.2597 |
0.3082 |
0.3742 |
HR |
0.2090 |
0.3989 |
0.4919 |
0.5813 |
0.6330 |
0.6937 |
MAP |
0.2090 |
0.0846 |
0.0509 |
0.0289 |
0.0204 |
0.0129 |
MRR |
0.2090 |
0.3418 |
0.3780 |
0.4009 |
0.4102 |
0.4183 |
NDCG |
0.2090 |
0.3041 |
0.3276 |
0.3417 |
0.3469 |
0.3508 |