cngthnh/Thesis
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
417a38d2e5
Thesis/log/wikidata12k

1117 lines
133 KiB
Plaintext
Raw Normal View History

update viz util
2023-06-24 04:11:17 +00:00
2023-05-06 08:38:26,841 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '3', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': False}
2023-05-06 08:38:37,550 - wikidata12k - [INFO] - [E:0| 0]: Train Loss:0.69813, Val MRR:0.0, wikidata12k
2023-05-06 08:40:16,077 - wikidata12k - [INFO] - [E:0| 100]: Train Loss:0.36818, Val MRR:0.0, wikidata12k
2023-05-06 08:41:42,399 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '3', 'train_strategy': 'one_to_x', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': False}
2023-05-06 08:41:55,608 - wikidata12k - [INFO] - [E:0| 0]: Train Loss:0.69843, Val MRR:0.0, wikidata12k
2023-05-06 08:44:00,988 - wikidata12k - [INFO] - [E:0| 100]: Train Loss:0.38415, Val MRR:0.0, wikidata12k
2023-05-06 08:46:06,496 - wikidata12k - [INFO] - [E:0| 200]: Train Loss:0.25601, Val MRR:0.0, wikidata12k
2023-05-06 08:48:12,376 - wikidata12k - [INFO] - [E:0| 300]: Train Loss:0.19192, Val MRR:0.0, wikidata12k
2023-05-06 08:50:03,581 - wikidata12k - [INFO] - [E:0| 400]: Train Loss:0.15386, Val MRR:0.0, wikidata12k
2023-05-06 08:52:09,033 - wikidata12k - [INFO] - [E:0| 500]: Train Loss:0.1287, Val MRR:0.0, wikidata12k
2023-05-06 08:54:14,636 - wikidata12k - [INFO] - [E:0| 600]: Train Loss:0.11084, Val MRR:0.0, wikidata12k
2023-05-06 08:56:19,204 - wikidata12k - [INFO] - [E:0| 700]: Train Loss:0.097513, Val MRR:0.0, wikidata12k
2023-05-06 08:58:09,969 - wikidata12k - [INFO] - [E:0| 800]: Train Loss:0.087186, Val MRR:0.0, wikidata12k
2023-05-06 09:00:15,685 - wikidata12k - [INFO] - [E:0| 900]: Train Loss:0.078949, Val MRR:0.0, wikidata12k
2023-05-06 09:02:21,479 - wikidata12k - [INFO] - [E:0| 1000]: Train Loss:0.072226, Val MRR:0.0, wikidata12k
2023-05-06 09:04:27,402 - wikidata12k - [INFO] - [E:0| 1100]: Train Loss:0.066637, Val MRR:0.0, wikidata12k
2023-05-06 09:06:20,590 - wikidata12k - [INFO] - [E:0| 1200]: Train Loss:0.061915, Val MRR:0.0, wikidata12k
2023-05-06 09:08:25,868 - wikidata12k - [INFO] - [E:0| 1300]: Train Loss:0.057877, Val MRR:0.0, wikidata12k
2023-05-06 09:10:31,851 - wikidata12k - [INFO] - [E:0| 1400]: Train Loss:0.054381, Val MRR:0.0, wikidata12k
2023-05-06 09:12:38,025 - wikidata12k - [INFO] - [E:0| 1500]: Train Loss:0.051327, Val MRR:0.0, wikidata12k
2023-05-06 09:14:42,515 - wikidata12k - [INFO] - [E:0| 1600]: Train Loss:0.048637, Val MRR:0.0, wikidata12k
2023-05-06 09:16:35,502 - wikidata12k - [INFO] - [E:0| 1700]: Train Loss:0.046249, Val MRR:0.0, wikidata12k
2023-05-06 09:18:41,591 - wikidata12k - [INFO] - [E:0| 1800]: Train Loss:0.044114, Val MRR:0.0, wikidata12k
2023-05-06 09:20:46,918 - wikidata12k - [INFO] - [E:0| 1900]: Train Loss:0.042196, Val MRR:0.0, wikidata12k
2023-05-06 09:22:52,928 - wikidata12k - [INFO] - [E:0| 2000]: Train Loss:0.040462, Val MRR:0.0, wikidata12k
2023-05-06 09:24:44,959 - wikidata12k - [INFO] - [E:0| 2100]: Train Loss:0.038887, Val MRR:0.0, wikidata12k
2023-05-06 09:26:50,564 - wikidata12k - [INFO] - [E:0| 2200]: Train Loss:0.037452, Val MRR:0.0, wikidata12k
2023-05-06 09:28:55,988 - wikidata12k - [INFO] - [E:0| 2300]: Train Loss:0.036137, Val MRR:0.0, wikidata12k
2023-05-06 09:31:01,418 - wikidata12k - [INFO] - [E:0| 2400]: Train Loss:0.03493, Val MRR:0.0, wikidata12k
2023-05-06 09:32:53,330 - wikidata12k - [INFO] - [E:0| 2500]: Train Loss:0.033815, Val MRR:0.0, wikidata12k
2023-05-06 09:34:59,654 - wikidata12k - [INFO] - [E:0| 2600]: Train Loss:0.032784, Val MRR:0.0, wikidata12k
2023-05-06 09:37:05,460 - wikidata12k - [INFO] - [E:0| 2700]: Train Loss:0.031827, Val MRR:0.0, wikidata12k
2023-05-06 09:39:11,323 - wikidata12k - [INFO] - [E:0| 2800]: Train Loss:0.030937, Val MRR:0.0, wikidata12k
2023-05-06 09:41:02,324 - wikidata12k - [INFO] - [E:0| 2900]: Train Loss:0.030106, Val MRR:0.0, wikidata12k
2023-05-06 09:43:07,972 - wikidata12k - [INFO] - [E:0| 3000]: Train Loss:0.029329, Val MRR:0.0, wikidata12k
2023-05-06 09:45:11,926 - wikidata12k - [INFO] - [E:0| 3100]: Train Loss:0.028601, Val MRR:0.0, wikidata12k
2023-05-06 09:47:04,497 - wikidata12k - [INFO] - [E:0| 3200]: Train Loss:0.027918, Val MRR:0.0, wikidata12k
2023-05-06 09:48:53,405 - wikidata12k - [INFO] - [E:0| 3300]: Train Loss:0.027274, Val MRR:0.0, wikidata12k
2023-05-06 09:50:55,538 - wikidata12k - [INFO] - [E:0| 3400]: Train Loss:0.026666, Val MRR:0.0, wikidata12k
2023-05-06 09:53:02,734 - wikidata12k - [INFO] - [E:0| 3500]: Train Loss:0.026092, Val MRR:0.0, wikidata12k
2023-05-06 09:55:08,460 - wikidata12k - [INFO] - [E:0| 3600]: Train Loss:0.025549, Val MRR:0.0, wikidata12k
2023-05-06 09:57:14,307 - wikidata12k - [INFO] - [E:0| 3700]: Train Loss:0.025033, Val MRR:0.0, wikidata12k
2023-05-06 09:59:04,769 - wikidata12k - [INFO] - [E:0| 3800]: Train Loss:0.024543, Val MRR:0.0, wikidata12k
2023-05-06 10:01:10,559 - wikidata12k - [INFO] - [E:0| 3900]: Train Loss:0.024077, Val MRR:0.0, wikidata12k
2023-05-06 10:02:02,921 - wikidata12k - [INFO] - [Epoch:0]: Training Loss:0.02389
2023-05-06 10:02:03,338 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 10:02:41,529 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 10:03:03,389 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 10:03:41,884 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 10:04:03,729 - wikidata12k - [INFO] - [Evaluating Epoch 0 valid]:
MRR: Tail : 0.17247, Head : 0.01138, Avg : 0.09193
2023-05-06 10:04:04,731 - wikidata12k - [INFO] - [Epoch 0]: Training Loss: 0.023888, Valid MRR: 0.09193,
2023-05-06 10:04:05,852 - wikidata12k - [INFO] - [E:1| 0]: Train Loss:0.0062049, Val MRR:0.09193, wikidata12k
2023-05-06 10:06:06,762 - wikidata12k - [INFO] - [E:1| 100]: Train Loss:0.0063195, Val MRR:0.09193, wikidata12k
2023-05-06 10:08:01,287 - wikidata12k - [INFO] - [E:1| 200]: Train Loss:0.0062903, Val MRR:0.09193, wikidata12k
2023-05-06 10:10:07,033 - wikidata12k - [INFO] - [E:1| 300]: Train Loss:0.0062679, Val MRR:0.09193, wikidata12k
2023-05-06 10:12:12,624 - wikidata12k - [INFO] - [E:1| 400]: Train Loss:0.0062467, Val MRR:0.09193, wikidata12k
2023-05-06 10:14:17,128 - wikidata12k - [INFO] - [E:1| 500]: Train Loss:0.0062264, Val MRR:0.09193, wikidata12k
2023-05-06 10:16:07,430 - wikidata12k - [INFO] - [E:1| 600]: Train Loss:0.0062055, Val MRR:0.09193, wikidata12k
2023-05-06 10:18:12,943 - wikidata12k - [INFO] - [E:1| 700]: Train Loss:0.0061881, Val MRR:0.09193, wikidata12k
2023-05-06 10:20:18,884 - wikidata12k - [INFO] - [E:1| 800]: Train Loss:0.0061652, Val MRR:0.09193, wikidata12k
2023-05-06 10:22:24,423 - wikidata12k - [INFO] - [E:1| 900]: Train Loss:0.0061459, Val MRR:0.09193, wikidata12k
2023-05-06 10:24:16,160 - wikidata12k - [INFO] - [E:1| 1000]: Train Loss:0.0061277, Val MRR:0.09193, wikidata12k
2023-05-06 10:26:22,552 - wikidata12k - [INFO] - [E:1| 1100]: Train Loss:0.0061055, Val MRR:0.09193, wikidata12k
2023-05-06 10:28:28,389 - wikidata12k - [INFO] - [E:1| 1200]: Train Loss:0.0060841, Val MRR:0.09193, wikidata12k
2023-05-06 10:30:34,052 - wikidata12k - [INFO] - [E:1| 1300]: Train Loss:0.0060627, Val MRR:0.09193, wikidata12k
2023-05-06 10:32:24,667 - wikidata12k - [INFO] - [E:1| 1400]: Train Loss:0.006038, Val MRR:0.09193, wikidata12k
2023-05-06 10:34:30,310 - wikidata12k - [INFO] - [E:1| 1500]: Train Loss:0.0060152, Val MRR:0.09193, wikidata12k
2023-05-06 10:36:36,487 - wikidata12k - [INFO] - [E:1| 1600]: Train Loss:0.0059926, Val MRR:0.09193, wikidata12k
2023-05-06 10:38:42,194 - wikidata12k - [INFO] - [E:1| 1700]: Train Loss:0.0059693, Val MRR:0.09193, wikidata12k
2023-05-06 10:40:41,051 - wikidata12k - [INFO] - [E:1| 1800]: Train Loss:0.0059458, Val MRR:0.09193, wikidata12k
2023-05-06 10:42:40,359 - wikidata12k - [INFO] - [E:1| 1900]: Train Loss:0.0059242, Val MRR:0.09193, wikidata12k
2023-05-06 10:44:45,748 - wikidata12k - [INFO] - [E:1| 2000]: Train Loss:0.005903, Val MRR:0.09193, wikidata12k
2023-05-06 10:46:50,999 - wikidata12k - [INFO] - [E:1| 2100]: Train Loss:0.0058796, Val MRR:0.09193, wikidata12k
2023-05-06 10:48:56,241 - wikidata12k - [INFO] - [E:1| 2200]: Train Loss:0.0058572, Val MRR:0.09193, wikidata12k
2023-05-06 10:50:47,638 - wikidata12k - [INFO] - [E:1| 2300]: Train Loss:0.0058349, Val MRR:0.09193, wikidata12k
2023-05-06 10:52:53,368 - wikidata12k - [INFO] - [E:1| 2400]: Train Loss:0.0058123, Val MRR:0.09193, wikidata12k
2023-05-06 10:54:59,234 - wikidata12k - [INFO] - [E:1| 2500]: Train Loss:0.0057887, Val MRR:0.09193, wikidata12k
2023-05-06 10:57:05,070 - wikidata12k - [INFO] - [E:1| 2600]: Train Loss:0.0057664, Val MRR:0.09193, wikidata12k
2023-05-06 10:58:55,418 - wikidata12k - [INFO] - [E:1| 2700]: Train Loss:0.0057436, Val MRR:0.09193, wikidata12k
2023-05-06 11:01:01,236 - wikidata12k - [INFO] - [E:1| 2800]: Train Loss:0.0057204, Val MRR:0.09193, wikidata12k
2023-05-06 11:03:06,442 - wikidata12k - [INFO] - [E:1| 2900]: Train Loss:0.0056984, Val MRR:0.09193, wikidata12k
2023-05-06 11:05:11,682 - wikidata12k - [INFO] - [E:1| 3000]: Train Loss:0.0056751, Val MRR:0.09193, wikidata12k
2023-05-06 11:07:02,884 - wikidata12k - [INFO] - [E:1| 3100]: Train Loss:0.0056521, Val MRR:0.09193, wikidata12k
2023-05-06 11:09:08,174 - wikidata12k - [INFO] - [E:1| 3200]: Train Loss:0.0056294, Val MRR:0.09193, wikidata12k
2023-05-06 11:11:13,921 - wikidata12k - [INFO] - [E:1| 3300]: Train Loss:0.0056056, Val MRR:0.09193, wikidata12k
2023-05-06 11:13:19,522 - wikidata12k - [INFO] - [E:1| 3400]: Train Loss:0.0055829, Val MRR:0.09193, wikidata12k
2023-05-06 11:15:14,230 - wikidata12k - [INFO] - [E:1| 3500]: Train Loss:0.0055602, Val MRR:0.09193, wikidata12k
2023-05-06 11:17:06,422 - wikidata12k - [INFO] - [E:1| 3600]: Train Loss:0.0055376, Val MRR:0.09193, wikidata12k
2023-05-06 11:19:02,633 - wikidata12k - [INFO] - [E:1| 3700]: Train Loss:0.0055147, Val MRR:0.09193, wikidata12k
2023-05-06 11:21:08,735 - wikidata12k - [INFO] - [E:1| 3800]: Train Loss:0.0054916, Val MRR:0.09193, wikidata12k
2023-05-06 11:23:09,854 - wikidata12k - [INFO] - [E:1| 3900]: Train Loss:0.0054684, Val MRR:0.09193, wikidata12k
2023-05-06 11:23:53,083 - wikidata12k - [INFO] - [Epoch:1]: Training Loss:0.005459
2023-05-06 11:23:53,349 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 11:24:31,701 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 11:24:54,090 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 11:25:32,225 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 11:25:54,199 - wikidata12k - [INFO] - [Evaluating Epoch 1 valid]:
MRR: Tail : 0.38569, Head : 0.12248, Avg : 0.25408
2023-05-06 11:25:55,254 - wikidata12k - [INFO] - [Epoch 1]: Training Loss: 0.005459, Valid MRR: 0.25408,
2023-05-06 11:25:56,514 - wikidata12k - [INFO] - [E:2| 0]: Train Loss:0.0044401, Val MRR:0.25408, wikidata12k
2023-05-06 11:28:03,155 - wikidata12k - [INFO] - [E:2| 100]: Train Loss:0.0044659, Val MRR:0.25408, wikidata12k
2023-05-06 11:30:08,393 - wikidata12k - [INFO] - [E:2| 200]: Train Loss:0.0044342, Val MRR:0.25408, wikidata12k
2023-05-06 11:32:01,260 - wikidata12k - [INFO] - [E:2| 300]: Train Loss:0.0044133, Val MRR:0.25408, wikidata12k
2023-05-06 11:34:06,010 - wikidata12k - [INFO] - [E:2| 400]: Train Loss:0.00439, Val MRR:0.25408, wikidata12k
2023-05-06 11:36:11,864 - wikidata12k - [INFO] - [E:2| 500]: Train Loss:0.0043598, Val MRR:0.25408, wikidata12k
2023-05-06 11:38:16,405 - wikidata12k - [INFO] - [E:2| 600]: Train Loss:0.0043286, Val MRR:0.25408, wikidata12k
2023-05-06 11:40:21,058 - wikidata12k - [INFO] - [E:2| 700]: Train Loss:0.0042981, Val MRR:0.25408, wikidata12k
2023-05-06 11:42:13,124 - wikidata12k - [INFO] - [E:2| 800]: Train Loss:0.0042687, Val MRR:0.25408, wikidata12k
2023-05-06 11:44:19,047 - wikidata12k - [INFO] - [E:2| 900]: Train Loss:0.0042391, Val MRR:0.25408, wikidata12k
2023-05-06 11:46:24,455 - wikidata12k - [INFO] - [E:2| 1000]: Train Loss:0.0042091, Val MRR:0.25408, wikidata12k
2023-05-06 11:48:30,230 - wikidata12k - [INFO] - [E:2| 1100]: Train Loss:0.0041778, Val MRR:0.25408, wikidata12k
2023-05-06 11:50:21,953 - wikidata12k - [INFO] - [E:2| 1200]: Train Loss:0.004147, Val MRR:0.25408, wikidata12k
2023-05-06 11:52:27,852 - wikidata12k - [INFO] - [E:2| 1300]: Train Loss:0.004118, Val MRR:0.25408, wikidata12k
2023-05-06 11:54:33,784 - wikidata12k - [INFO] - [E:2| 1400]: Train Loss:0.0040862, Val MRR:0.25408, wikidata12k
2023-05-06 11:56:39,473 - wikidata12k - [INFO] - [E:2| 1500]: Train Loss:0.0040563, Val MRR:0.25408, wikidata12k
2023-05-06 11:58:31,096 - wikidata12k - [INFO] - [E:2| 1600]: Train Loss:0.0040286, Val MRR:0.25408, wikidata12k
2023-05-06 12:00:36,190 - wikidata12k - [INFO] - [E:2| 1700]: Train Loss:0.0040004, Val MRR:0.25408, wikidata12k
2023-05-06 12:02:42,048 - wikidata12k - [INFO] - [E:2| 1800]: Train Loss:0.0039716, Val MRR:0.25408, wikidata12k
2023-05-06 12:04:47,538 - wikidata12k - [INFO] - [E:2| 1900]: Train Loss:0.0039437, Val MRR:0.25408, wikidata12k
2023-05-06 12:06:39,315 - wikidata12k - [INFO] - [E:2| 2000]: Train Loss:0.0039161, Val MRR:0.25408, wikidata12k
2023-05-06 12:08:44,932 - wikidata12k - [INFO] - [E:2| 2100]: Train Loss:0.003888, Val MRR:0.25408, wikidata12k
2023-05-06 12:10:50,644 - wikidata12k - [INFO] - [E:2| 2200]: Train Loss:0.003862, Val MRR:0.25408, wikidata12k
2023-05-06 12:12:56,450 - wikidata12k - [INFO] - [E:2| 2300]: Train Loss:0.0038366, Val MRR:0.25408, wikidata12k
2023-05-06 12:14:55,713 - wikidata12k - [INFO] - [E:2| 2400]: Train Loss:0.0038108, Val MRR:0.25408, wikidata12k
2023-05-06 12:16:53,395 - wikidata12k - [INFO] - [E:2| 2500]: Train Loss:0.0037852, Val MRR:0.25408, wikidata12k
2023-05-06 12:18:59,077 - wikidata12k - [INFO] - [E:2| 2600]: Train Loss:0.0037614, Val MRR:0.25408, wikidata12k
2023-05-06 12:21:04,450 - wikidata12k - [INFO] - [E:2| 2700]: Train Loss:0.0037387, Val MRR:0.25408, wikidata12k
2023-05-06 12:23:09,955 - wikidata12k - [INFO] - [E:2| 2800]: Train Loss:0.0037152, Val MRR:0.25408, wikidata12k
2023-05-06 12:25:00,372 - wikidata12k - [INFO] - [E:2| 2900]: Train Loss:0.0036921, Val MRR:0.25408, wikidata12k
2023-05-06 12:27:04,978 - wikidata12k - [INFO] - [E:2| 3000]: Train Loss:0.0036691, Val MRR:0.25408, wikidata12k
2023-05-06 12:29:10,325 - wikidata12k - [INFO] - [E:2| 3100]: Train Loss:0.0036472, Val MRR:0.25408, wikidata12k
2023-05-06 12:31:15,886 - wikidata12k - [INFO] - [E:2| 3200]: Train Loss:0.0036265, Val MRR:0.25408, wikidata12k
2023-05-06 12:33:07,576 - wikidata12k - [INFO] - [E:2| 3300]: Train Loss:0.0036057, Val MRR:0.25408, wikidata12k
2023-05-06 12:35:12,048 - wikidata12k - [INFO] - [E:2| 3400]: Train Loss:0.003585, Val MRR:0.25408, wikidata12k
2023-05-06 12:37:18,052 - wikidata12k - [INFO] - [E:2| 3500]: Train Loss:0.0035642, Val MRR:0.25408, wikidata12k
2023-05-06 12:39:23,637 - wikidata12k - [INFO] - [E:2| 3600]: Train Loss:0.0035449, Val MRR:0.25408, wikidata12k
2023-05-06 12:41:15,530 - wikidata12k - [INFO] - [E:2| 3700]: Train Loss:0.0035277, Val MRR:0.25408, wikidata12k
2023-05-06 12:43:21,240 - wikidata12k - [INFO] - [E:2| 3800]: Train Loss:0.0035099, Val MRR:0.25408, wikidata12k
2023-05-06 12:45:27,348 - wikidata12k - [INFO] - [E:2| 3900]: Train Loss:0.0034922, Val MRR:0.25408, wikidata12k
2023-05-06 12:46:19,636 - wikidata12k - [INFO] - [Epoch:2]: Training Loss:0.003485
2023-05-06 12:46:19,902 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 12:46:56,963 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 12:47:18,749 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 12:47:55,594 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 12:48:16,904 - wikidata12k - [INFO] - [Evaluating Epoch 2 valid]:
MRR: Tail : 0.43897, Head : 0.2092, Avg : 0.32409
2023-05-06 12:48:18,100 - wikidata12k - [INFO] - [Epoch 2]: Training Loss: 0.0034846, Valid MRR: 0.32409,
2023-05-06 12:48:19,114 - wikidata12k - [INFO] - [E:3| 0]: Train Loss:0.003084, Val MRR:0.32409, wikidata12k
2023-05-06 12:50:05,368 - wikidata12k - [INFO] - [E:3| 100]: Train Loss:0.0027641, Val MRR:0.32409, wikidata12k
2023-05-06 12:52:10,525 - wikidata12k - [INFO] - [E:3| 200]: Train Loss:0.0027512, Val MRR:0.32409, wikidata12k
2023-05-06 12:54:16,318 - wikidata12k - [INFO] - [E:3| 300]: Train Loss:0.0027487, Val MRR:0.32409, wikidata12k
2023-05-06 12:56:21,521 - wikidata12k - [INFO] - [E:3| 400]: Train Loss:0.0027438, Val MRR:0.32409, wikidata12k
2023-05-06 12:58:13,194 - wikidata12k - [INFO] - [E:3| 500]: Train Loss:0.0027439, Val MRR:0.32409, wikidata12k
2023-05-06 13:00:18,422 - wikidata12k - [INFO] - [E:3| 600]: Train Loss:0.0027372, Val MRR:0.32409, wikidata12k
2023-05-06 13:02:23,963 - wikidata12k - [INFO] - [E:3| 700]: Train Loss:0.0027297, Val MRR:0.32409, wikidata12k
2023-05-06 13:04:30,543 - wikidata12k - [INFO] - [E:3| 800]: Train Loss:0.0027182, Val MRR:0.32409, wikidata12k
2023-05-06 13:06:23,069 - wikidata12k - [INFO] - [E:3| 900]: Train Loss:0.0027104, Val MRR:0.32409, wikidata12k
2023-05-06 13:08:27,801 - wikidata12k - [INFO] - [E:3| 1000]: Train Loss:0.0027054, Val MRR:0.32409, wikidata12k
2023-05-06 13:10:33,320 - wikidata12k - [INFO] - [E:3| 1100]: Train Loss:0.0026982, Val MRR:0.32409, wikidata12k
2023-05-06 13:12:38,418 - wikidata12k - [INFO] - [E:3| 1200]: Train Loss:0.0026888, Val MRR:0.32409, wikidata12k
2023-05-06 13:14:42,787 - wikidata12k - [INFO] - [E:3| 1300]: Train Loss:0.0026819, Val MRR:0.32409, wikidata12k
2023-05-06 13:16:35,824 - wikidata12k - [INFO] - [E:3| 1400]: Train Loss:0.0026732, Val MRR:0.32409, wikidata12k
2023-05-06 13:18:41,495 - wikidata12k - [INFO] - [E:3| 1500]: Train Loss:0.0026656, Val MRR:0.32409, wikidata12k
2023-05-06 13:20:46,863 - wikidata12k - [INFO] - [E:3| 1600]: Train Loss:0.0026598, Val MRR:0.32409, wikidata12k
2023-05-06 13:22:52,753 - wikidata12k - [INFO] - [E:3| 1700]: Train Loss:0.002655, Val MRR:0.32409, wikidata12k
2023-05-06 13:24:44,420 - wikidata12k - [INFO] - [E:3| 1800]: Train Loss:0.0026501, Val MRR:0.32409, wikidata12k
2023-05-06 13:26:50,116 - wikidata12k - [INFO] - [E:3| 1900]: Train Loss:0.0026447, Val MRR:0.32409, wikidata12k
2023-05-06 13:28:55,538 - wikidata12k - [INFO] - [E:3| 2000]: Train Loss:0.0026383, Val MRR:0.32409, wikidata12k
2023-05-06 13:31:01,057 - wikidata12k - [INFO] - [E:3| 2100]: Train Loss:0.0026313, Val MRR:0.32409, wikidata12k
2023-05-06 13:32:52,360 - wikidata12k - [INFO] - [E:3| 2200]: Train Loss:0.0026247, Val MRR:0.32409, wikidata12k
2023-05-06 13:34:57,935 - wikidata12k - [INFO] - [E:3| 2300]: Train Loss:0.0026191, Val MRR:0.32409, wikidata12k
2023-05-06 13:37:03,445 - wikidata12k - [INFO] - [E:3| 2400]: Train Loss:0.0026118, Val MRR:0.32409, wikidata12k
2023-05-06 13:39:09,149 - wikidata12k - [INFO] - [E:3| 2500]: Train Loss:0.0026066, Val MRR:0.32409, wikidata12k
2023-05-06 13:40:59,973 - wikidata12k - [INFO] - [E:3| 2600]: Train Loss:0.0026002, Val MRR:0.32409, wikidata12k
2023-05-06 13:43:05,649 - wikidata12k - [INFO] - [E:3| 2700]: Train Loss:0.0025944, Val MRR:0.32409, wikidata12k
2023-05-06 13:45:11,174 - wikidata12k - [INFO] - [E:3| 2800]: Train Loss:0.0025885, Val MRR:0.32409, wikidata12k
2023-05-06 13:47:17,144 - wikidata12k - [INFO] - [E:3| 2900]: Train Loss:0.0025828, Val MRR:0.32409, wikidata12k
2023-05-06 13:49:14,377 - wikidata12k - [INFO] - [E:3| 3000]: Train Loss:0.0025781, Val MRR:0.32409, wikidata12k
2023-05-06 13:51:14,784 - wikidata12k - [INFO] - [E:3| 3100]: Train Loss:0.002573, Val MRR:0.32409, wikidata12k
2023-05-06 13:53:20,551 - wikidata12k - [INFO] - [E:3| 3200]: Train Loss:0.0025682, Val MRR:0.32409, wikidata12k
2023-05-06 13:55:26,083 - wikidata12k - [INFO] - [E:3| 3300]: Train Loss:0.0025628, Val MRR:0.32409, wikidata12k
2023-05-06 13:57:31,645 - wikidata12k - [INFO] - [E:3| 3400]: Train Loss:0.0025565, Val MRR:0.32409, wikidata12k
2023-05-06 13:59:23,603 - wikidata12k - [INFO] - [E:3| 3500]: Train Loss:0.0025516, Val MRR:0.32409, wikidata12k
2023-05-06 14:01:29,735 - wikidata12k - [INFO] - [E:3| 3600]: Train Loss:0.0025467, Val MRR:0.32409, wikidata12k
2023-05-06 14:03:35,131 - wikidata12k - [INFO] - [E:3| 3700]: Train Loss:0.0025418, Val MRR:0.32409, wikidata12k
2023-05-06 14:05:41,183 - wikidata12k - [INFO] - [E:3| 3800]: Train Loss:0.0025373, Val MRR:0.32409, wikidata12k
2023-05-06 14:07:32,957 - wikidata12k - [INFO] - [E:3| 3900]: Train Loss:0.0025325, Val MRR:0.32409, wikidata12k
2023-05-06 14:08:25,826 - wikidata12k - [INFO] - [Epoch:3]: Training Loss:0.002531
2023-05-06 14:08:26,351 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 14:09:04,796 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 14:09:27,292 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 14:10:05,840 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 14:10:27,665 - wikidata12k - [INFO] - [Evaluating Epoch 3 valid]:
MRR: Tail : 0.45995, Head : 0.29954, Avg : 0.37975
2023-05-06 14:10:28,990 - wikidata12k - [INFO] - [Epoch 3]: Training Loss: 0.0025305, Valid MRR: 0.37975,
2023-05-06 14:10:30,004 - wikidata12k - [INFO] - [E:4| 0]: Train Loss:0.0022724, Val MRR:0.37975, wikidata12k
2023-05-06 14:12:35,579 - wikidata12k - [INFO] - [E:4| 100]: Train Loss:0.0023295, Val MRR:0.37975, wikidata12k
2023-05-06 14:14:15,115 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True}
2023-05-06 14:14:26,963 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
2023-05-06 14:14:41,436 - wikidata12k - [INFO] - [E:4| 200]: Train Loss:0.0023096, Val MRR:0.37975, wikidata12k
2023-05-06 14:15:05,140 - wikidata12k - [INFO] - [Test, Tail_Batch Step 100] wikidata12k
2023-05-06 14:15:17,741 - wikidata12k - [INFO] - [Test, Head_Batch Step 0] wikidata12k
2023-05-06 14:15:48,718 - wikidata12k - [INFO] - [Test, Head_Batch Step 100] wikidata12k
2023-05-06 14:16:07,651 - wikidata12k - [INFO] - [Evaluating Epoch 0 test]:
MRR: Tail : 0.42277, Head : 0.2658, Avg : 0.34428
MR: Tail : 287.65, Head : 641.2, Avg : 464.43
Hit-1: Tail : 0.33325, Head : 0.20232, Avg : 0.26779
Hit-3: Tail : 0.47055, Head : 0.28872, Avg : 0.37964
Hit-10: Tail : 0.57937, Head : 0.3867, Avg : 0.48303
2023-05-06 14:16:33,294 - wikidata12k - [INFO] - [E:4| 300]: Train Loss:0.0023037, Val MRR:0.37975, wikidata12k
2023-05-06 14:18:28,249 - wikidata12k - [INFO] - [E:4| 400]: Train Loss:0.0022967, Val MRR:0.37975, wikidata12k
2023-05-06 14:20:25,819 - wikidata12k - [INFO] - [E:4| 500]: Train Loss:0.0022954, Val MRR:0.37975, wikidata12k
2023-05-06 14:22:31,497 - wikidata12k - [INFO] - [E:4| 600]: Train Loss:0.0022897, Val MRR:0.37975, wikidata12k
2023-05-06 14:24:21,996 - wikidata12k - [INFO] - [E:4| 700]: Train Loss:0.0022871, Val MRR:0.37975, wikidata12k
2023-05-06 14:26:27,528 - wikidata12k - [INFO] - [E:4| 800]: Train Loss:0.0022865, Val MRR:0.37975, wikidata12k
2023-05-06 14:28:33,598 - wikidata12k - [INFO] - [E:4| 900]: Train Loss:0.0022824, Val MRR:0.37975, wikidata12k
2023-05-06 14:30:39,112 - wikidata12k - [INFO] - [E:4| 1000]: Train Loss:0.0022804, Val MRR:0.37975, wikidata12k
2023-05-06 14:32:31,000 - wikidata12k - [INFO] - [E:4| 1100]: Train Loss:0.0022816, Val MRR:0.37975, wikidata12k
2023-05-06 14:34:36,735 - wikidata12k - [INFO] - [E:4| 1200]: Train Loss:0.0022763, Val MRR:0.37975, wikidata12k
2023-05-06 14:36:42,514 - wikidata12k - [INFO] - [E:4| 1300]: Train Loss:0.0022741, Val MRR:0.37975, wikidata12k
2023-05-06 14:38:49,139 - wikidata12k - [INFO] - [E:4| 1400]: Train Loss:0.0022712, Val MRR:0.37975, wikidata12k
2023-05-06 14:40:45,844 - wikidata12k - [INFO] - [E:4| 1500]: Train Loss:0.0022678, Val MRR:0.37975, wikidata12k
2023-05-06 14:42:46,452 - wikidata12k - [INFO] - [E:4| 1600]: Train Loss:0.0022638, Val MRR:0.37975, wikidata12k
2023-05-06 14:44:52,042 - wikidata12k - [INFO] - [E:4| 1700]: Train Loss:0.0022596, Val MRR:0.37975, wikidata12k
2023-05-06 14:46:57,004 - wikidata12k - [INFO] - [E:4| 1800]: Train Loss:0.002258, Val MRR:0.37975, wikidata12k
2023-05-06 14:49:02,659 - wikidata12k - [INFO] - [E:4| 1900]: Train Loss:0.0022545, Val MRR:0.37975, wikidata12k
2023-05-06 14:50:53,943 - wikidata12k - [INFO] - [E:4| 2000]: Train Loss:0.0022518, Val MRR:0.37975, wikidata12k
2023-05-06 14:53:00,050 - wikidata12k - [INFO] - [E:4| 2100]: Train Loss:0.002249, Val MRR:0.37975, wikidata12k
2023-05-06 14:55:05,445 - wikidata12k - [INFO] - [E:4| 2200]: Train Loss:0.0022456, Val MRR:0.37975, wikidata12k
2023-05-06 14:57:11,304 - wikidata12k - [INFO] - [E:4| 2300]: Train Loss:0.0022426, Val MRR:0.37975, wikidata12k
2023-05-06 14:59:02,801 - wikidata12k - [INFO] - [E:4| 2400]: Train Loss:0.002239, Val MRR:0.37975, wikidata12k
2023-05-06 15:01:08,427 - wikidata12k - [INFO] - [E:4| 2500]: Train Loss:0.0022361, Val MRR:0.37975, wikidata12k
2023-05-06 15:03:14,497 - wikidata12k - [INFO] - [E:4| 2600]: Train Loss:0.0022336, Val MRR:0.37975, wikidata12k
2023-05-06 15:05:19,918 - wikidata12k - [INFO] - [E:4| 2700]: Train Loss:0.0022304, Val MRR:0.37975, wikidata12k
2023-05-06 15:07:11,227 - wikidata12k - [INFO] - [E:4| 2800]: Train Loss:0.002228, Val MRR:0.37975, wikidata12k
2023-05-06 15:09:16,614 - wikidata12k - [INFO] - [E:4| 2900]: Train Loss:0.0022259, Val MRR:0.37975, wikidata12k
2023-05-06 15:11:21,936 - wikidata12k - [INFO] - [E:4| 3000]: Train Loss:0.0022234, Val MRR:0.37975, wikidata12k
2023-05-06 15:13:27,205 - wikidata12k - [INFO] - [E:4| 3100]: Train Loss:0.0022209, Val MRR:0.37975, wikidata12k
2023-05-06 15:15:17,210 - wikidata12k - [INFO] - [E:4| 3200]: Train Loss:0.0022177, Val MRR:0.37975, wikidata12k
2023-05-06 15:17:23,193 - wikidata12k - [INFO] - [E:4| 3300]: Train Loss:0.0022155, Val MRR:0.37975, wikidata12k
2023-05-06 15:19:29,004 - wikidata12k - [INFO] - [E:4| 3400]: Train Loss:0.0022135, Val MRR:0.37975, wikidata12k
2023-05-06 15:21:34,824 - wikidata12k - [INFO] - [E:4| 3500]: Train Loss:0.0022114, Val MRR:0.37975, wikidata12k
2023-05-06 15:23:34,517 - wikidata12k - [INFO] - [E:4| 3600]: Train Loss:0.002209, Val MRR:0.37975, wikidata12k
2023-05-06 15:25:32,916 - wikidata12k - [INFO] - [E:4| 3700]: Train Loss:0.0022072, Val MRR:0.37975, wikidata12k
2023-05-06 15:27:38,780 - wikidata12k - [INFO] - [E:4| 3800]: Train Loss:0.0022041, Val MRR:0.37975, wikidata12k
2023-05-06 15:29:44,783 - wikidata12k - [INFO] - [E:4| 3900]: Train Loss:0.0022015, Val MRR:0.37975, wikidata12k
2023-05-06 15:30:37,291 - wikidata12k - [INFO] - [Epoch:4]: Training Loss:0.0022
2023-05-06 15:30:37,558 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 15:31:16,079 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 15:31:38,266 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 15:32:15,531 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 15:32:28,048 - wikidata12k - [INFO] - [Evaluating Epoch 4 valid]:
MRR: Tail : 0.4723, Head : 0.32162, Avg : 0.39696
2023-05-06 15:32:31,220 - wikidata12k - [INFO] - [Epoch 4]: Training Loss: 0.0022003, Valid MRR: 0.39696,
2023-05-06 15:32:32,012 - wikidata12k - [INFO] - [E:5| 0]: Train Loss:0.0017552, Val MRR:0.39696, wikidata12k
2023-05-06 15:34:36,754 - wikidata12k - [INFO] - [E:5| 100]: Train Loss:0.0020845, Val MRR:0.39696, wikidata12k
2023-05-06 15:36:42,485 - wikidata12k - [INFO] - [E:5| 200]: Train Loss:0.0020805, Val MRR:0.39696, wikidata12k
2023-05-06 15:38:48,370 - wikidata12k - [INFO] - [E:5| 300]: Train Loss:0.0020781, Val MRR:0.39696, wikidata12k
2023-05-06 15:40:53,929 - wikidata12k - [INFO] - [E:5| 400]: Train Loss:0.0020718, Val MRR:0.39696, wikidata12k
2023-05-06 15:42:45,469 - wikidata12k - [INFO] - [E:5| 500]: Train Loss:0.0020684, Val MRR:0.39696, wikidata12k
2023-05-06 15:44:51,350 - wikidata12k - [INFO] - [E:5| 600]: Train Loss:0.002067, Val MRR:0.39696, wikidata12k
2023-05-06 15:46:57,310 - wikidata12k - [INFO] - [E:5| 700]: Train Loss:0.002064, Val MRR:0.39696, wikidata12k
2023-05-06 15:48:54,796 - wikidata12k - [INFO] - [E:5| 800]: Train Loss:0.0020609, Val MRR:0.39696, wikidata12k
2023-05-06 15:50:41,095 - wikidata12k - [INFO] - [E:5| 900]: Train Loss:0.0020574, Val MRR:0.39696, wikidata12k
2023-05-06 15:52:47,274 - wikidata12k - [INFO] - [E:5| 1000]: Train Loss:0.0020557, Val MRR:0.39696, wikidata12k
2023-05-06 15:54:53,498 - wikidata12k - [INFO] - [E:5| 1100]: Train Loss:0.0020556, Val MRR:0.39696, wikidata12k
2023-05-06 15:56:58,862 - wikidata12k - [INFO] - [E:5| 1200]: Train Loss:0.002051, Val MRR:0.39696, wikidata12k
2023-05-06 15:58:50,256 - wikidata12k - [INFO] - [E:5| 1300]: Train Loss:0.0020485, Val MRR:0.39696, wikidata12k
2023-05-06 16:00:55,701 - wikidata12k - [INFO] - [E:5| 1400]: Train Loss:0.0020462, Val MRR:0.39696, wikidata12k
2023-05-06 16:03:00,836 - wikidata12k - [INFO] - [E:5| 1500]: Train Loss:0.002044, Val MRR:0.39696, wikidata12k
2023-05-06 16:05:06,342 - wikidata12k - [INFO] - [E:5| 1600]: Train Loss:0.0020427, Val MRR:0.39696, wikidata12k
2023-05-06 16:06:58,074 - wikidata12k - [INFO] - [E:5| 1700]: Train Loss:0.0020407, Val MRR:0.39696, wikidata12k
2023-05-06 16:09:03,128 - wikidata12k - [INFO] - [E:5| 1800]: Train Loss:0.002039, Val MRR:0.39696, wikidata12k
2023-05-06 16:11:08,669 - wikidata12k - [INFO] - [E:5| 1900]: Train Loss:0.0020371, Val MRR:0.39696, wikidata12k
2023-05-06 16:13:15,433 - wikidata12k - [INFO] - [E:5| 2000]: Train Loss:0.0020348, Val MRR:0.39696, wikidata12k
2023-05-06 16:15:12,259 - wikidata12k - [INFO] - [E:5| 2100]: Train Loss:0.0020335, Val MRR:0.39696, wikidata12k
2023-05-06 16:17:11,287 - wikidata12k - [INFO] - [E:5| 2200]: Train Loss:0.002033, Val MRR:0.39696, wikidata12k
2023-05-06 16:19:17,481 - wikidata12k - [INFO] - [E:5| 2300]: Train Loss:0.0020307, Val MRR:0.39696, wikidata12k
2023-05-06 16:21:23,538 - wikidata12k - [INFO] - [E:5| 2400]: Train Loss:0.0020286, Val MRR:0.39696, wikidata12k
2023-05-06 16:23:29,059 - wikidata12k - [INFO] - [E:5| 2500]: Train Loss:0.0020258, Val MRR:0.39696, wikidata12k
2023-05-06 16:25:19,324 - wikidata12k - [INFO] - [E:5| 2600]: Train Loss:0.002024, Val MRR:0.39696, wikidata12k
2023-05-06 16:27:25,068 - wikidata12k - [INFO] - [E:5| 2700]: Train Loss:0.0020218, Val MRR:0.39696, wikidata12k
2023-05-06 16:29:30,445 - wikidata12k - [INFO] - [E:5| 2800]: Train Loss:0.0020196, Val MRR:0.39696, wikidata12k
2023-05-06 16:31:36,200 - wikidata12k - [INFO] - [E:5| 2900]: Train Loss:0.002017, Val MRR:0.39696, wikidata12k
2023-05-06 16:33:27,952 - wikidata12k - [INFO] - [E:5| 3000]: Train Loss:0.0020165, Val MRR:0.39696, wikidata12k
2023-05-06 16:35:33,689 - wikidata12k - [INFO] - [E:5| 3100]: Train Loss:0.0020157, Val MRR:0.39696, wikidata12k
2023-05-06 16:37:39,856 - wikidata12k - [INFO] - [E:5| 3200]: Train Loss:0.0020136, Val MRR:0.39696, wikidata12k
2023-05-06 16:39:45,760 - wikidata12k - [INFO] - [E:5| 3300]: Train Loss:0.0020125, Val MRR:0.39696, wikidata12k
2023-05-06 16:41:39,153 - wikidata12k - [INFO] - [E:5| 3400]: Train Loss:0.0020114, Val MRR:0.39696, wikidata12k
2023-05-06 16:43:44,866 - wikidata12k - [INFO] - [E:5| 3500]: Train Loss:0.0020094, Val MRR:0.39696, wikidata12k
2023-05-06 16:44:20,785 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True}
2023-05-06 16:44:32,197 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
2023-05-06 16:45:10,185 - wikidata12k - [INFO] - [Test, Tail_Batch Step 100] wikidata12k
2023-05-06 16:45:29,653 - wikidata12k - [INFO] - [Test, Head_Batch Step 0] wikidata12k
2023-05-06 16:45:51,160 - wikidata12k - [INFO] - [E:5| 3600]: Train Loss:0.0020087, Val MRR:0.39696, wikidata12k
2023-05-06 16:46:08,074 - wikidata12k - [INFO] - [Test, Head_Batch Step 100] wikidata12k
2023-05-06 16:46:27,277 - wikidata12k - [INFO] - [Evaluating Epoch 0 test]:
MRR: Tail : 0.43125, Head : 0.28505, Avg : 0.35815
MR: Tail : 237.16, Head : 528.53, Avg : 382.84
Hit-1: Tail : 0.32494, Head : 0.21639, Avg : 0.27067
Hit-3: Tail : 0.49759, Head : 0.30595, Avg : 0.40177
Hit-10: Tail : 0.62265, Head : 0.4377, Avg : 0.53017
2023-05-06 16:47:57,216 - wikidata12k - [INFO] - [E:5| 3700]: Train Loss:0.0020071, Val MRR:0.39696, wikidata12k
2023-05-06 16:49:50,233 - wikidata12k - [INFO] - [E:5| 3800]: Train Loss:0.0020055, Val MRR:0.39696, wikidata12k
2023-05-06 16:51:54,293 - wikidata12k - [INFO] - [E:5| 3900]: Train Loss:0.0020041, Val MRR:0.39696, wikidata12k
2023-05-06 16:52:46,672 - wikidata12k - [INFO] - [Epoch:5]: Training Loss:0.002003
2023-05-06 16:52:47,200 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 16:53:25,291 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 16:53:47,123 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 16:54:25,550 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 16:54:47,467 - wikidata12k - [INFO] - [Evaluating Epoch 5 valid]:
MRR: Tail : 0.46959, Head : 0.3264, Avg : 0.39799
2023-05-06 16:54:48,713 - wikidata12k - [INFO] - [Epoch 5]: Training Loss: 0.0020031, Valid MRR: 0.39799,
2023-05-06 16:54:50,154 - wikidata12k - [INFO] - [E:6| 0]: Train Loss:0.0017254, Val MRR:0.39799, wikidata12k
2023-05-06 16:56:10,171 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True}
2023-05-06 16:56:21,672 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
2023-05-06 16:56:55,707 - wikidata12k - [INFO] - [E:6| 100]: Train Loss:0.0019136, Val MRR:0.39799, wikidata12k
2023-05-06 16:56:59,689 - wikidata12k - [INFO] - [Test, Tail_Batch Step 100] wikidata12k
2023-05-06 16:57:18,776 - wikidata12k - [INFO] - [Test, Head_Batch Step 0] wikidata12k
2023-05-06 16:57:57,077 - wikidata12k - [INFO] - [Test, Head_Batch Step 100] wikidata12k
2023-05-06 16:58:14,027 - wikidata12k - [INFO] - [Evaluating Epoch 0 test]:
MRR: Tail : 0.42582, Head : 0.27768, Avg : 0.35175
MR: Tail : 221.69, Head : 505.81, Avg : 363.75
Hit-1: Tail : 0.30657, Head : 0.1935, Avg : 0.25004
Hit-3: Tail : 0.50044, Head : 0.31026, Avg : 0.40535
Hit-10: Tail : 0.64402, Head : 0.45799, Avg : 0.55101
2023-05-06 16:58:46,689 - wikidata12k - [INFO] - [E:6| 200]: Train Loss:0.0019103, Val MRR:0.39799, wikidata12k
2023-05-06 17:00:53,771 - wikidata12k - [INFO] - [E:6| 300]: Train Loss:0.0019186, Val MRR:0.39799, wikidata12k
2023-05-06 17:02:59,099 - wikidata12k - [INFO] - [E:6| 400]: Train Loss:0.0019073, Val MRR:0.39799, wikidata12k
2023-05-06 17:05:05,302 - wikidata12k - [INFO] - [E:6| 500]: Train Loss:0.0019065, Val MRR:0.39799, wikidata12k
2023-05-06 17:07:03,542 - wikidata12k - [INFO] - [E:6| 600]: Train Loss:0.0019066, Val MRR:0.39799, wikidata12k
2023-05-06 17:09:02,276 - wikidata12k - [INFO] - [E:6| 700]: Train Loss:0.0019039, Val MRR:0.39799, wikidata12k
2023-05-06 17:11:07,229 - wikidata12k - [INFO] - [E:6| 800]: Train Loss:0.001902, Val MRR:0.39799, wikidata12k
2023-05-06 17:13:13,089 - wikidata12k - [INFO] - [E:6| 900]: Train Loss:0.0019006, Val MRR:0.39799, wikidata12k
2023-05-06 17:15:18,463 - wikidata12k - [INFO] - [E:6| 1000]: Train Loss:0.0019012, Val MRR:0.39799, wikidata12k
2023-05-06 17:17:08,762 - wikidata12k - [INFO] - [E:6| 1100]: Train Loss:0.0018983, Val MRR:0.39799, wikidata12k
2023-05-06 17:19:08,414 - wikidata12k - [INFO] - [E:6| 1200]: Train Loss:0.0018981, Val MRR:0.39799, wikidata12k
2023-05-06 17:21:01,508 - wikidata12k - [INFO] - [E:6| 1300]: Train Loss:0.0018956, Val MRR:0.39799, wikidata12k
2023-05-06 17:23:07,088 - wikidata12k - [INFO] - [E:6| 1400]: Train Loss:0.0018962, Val MRR:0.39799, wikidata12k
2023-05-06 17:24:58,948 - wikidata12k - [INFO] - [E:6| 1500]: Train Loss:0.0018947, Val MRR:0.39799, wikidata12k
2023-05-06 17:27:05,082 - wikidata12k - [INFO] - [E:6| 1600]: Train Loss:0.001893, Val MRR:0.39799, wikidata12k
2023-05-06 17:29:10,859 - wikidata12k - [INFO] - [E:6| 1700]: Train Loss:0.0018934, Val MRR:0.39799, wikidata12k
2023-05-06 17:31:16,962 - wikidata12k - [INFO] - [E:6| 1800]: Train Loss:0.0018931, Val MRR:0.39799, wikidata12k
2023-05-06 17:33:07,716 - wikidata12k - [INFO] - [E:6| 1900]: Train Loss:0.0018925, Val MRR:0.39799, wikidata12k
2023-05-06 17:35:12,650 - wikidata12k - [INFO] - [E:6| 2000]: Train Loss:0.0018918, Val MRR:0.39799, wikidata12k
2023-05-06 17:37:18,425 - wikidata12k - [INFO] - [E:6| 2100]: Train Loss:0.001891, Val MRR:0.39799, wikidata12k
2023-05-06 17:39:24,243 - wikidata12k - [INFO] - [E:6| 2200]: Train Loss:0.00189, Val MRR:0.39799, wikidata12k
2023-05-06 17:41:15,715 - wikidata12k - [INFO] - [E:6| 2300]: Train Loss:0.0018889, Val MRR:0.39799, wikidata12k
2023-05-06 17:43:21,648 - wikidata12k - [INFO] - [E:6| 2400]: Train Loss:0.0018878, Val MRR:0.39799, wikidata12k
2023-05-06 17:45:26,972 - wikidata12k - [INFO] - [E:6| 2500]: Train Loss:0.0018866, Val MRR:0.39799, wikidata12k
2023-05-06 17:47:33,633 - wikidata12k - [INFO] - [E:6| 2600]: Train Loss:0.0018857, Val MRR:0.39799, wikidata12k
2023-05-06 17:49:36,848 - wikidata12k - [INFO] - [E:6| 2700]: Train Loss:0.0018843, Val MRR:0.39799, wikidata12k
2023-05-06 17:51:30,780 - wikidata12k - [INFO] - [E:6| 2800]: Train Loss:0.0018834, Val MRR:0.39799, wikidata12k
2023-05-06 17:53:36,648 - wikidata12k - [INFO] - [E:6| 2900]: Train Loss:0.0018824, Val MRR:0.39799, wikidata12k
2023-05-06 17:55:42,636 - wikidata12k - [INFO] - [E:6| 3000]: Train Loss:0.0018818, Val MRR:0.39799, wikidata12k
2023-05-06 17:57:48,476 - wikidata12k - [INFO] - [E:6| 3100]: Train Loss:0.0018803, Val MRR:0.39799, wikidata12k
2023-05-06 17:59:39,226 - wikidata12k - [INFO] - [E:6| 3200]: Train Loss:0.0018801, Val MRR:0.39799, wikidata12k
2023-05-06 18:01:44,741 - wikidata12k - [INFO] - [E:6| 3300]: Train Loss:0.0018798, Val MRR:0.39799, wikidata12k
2023-05-06 18:03:49,846 - wikidata12k - [INFO] - [E:6| 3400]: Train Loss:0.0018786, Val MRR:0.39799, wikidata12k
2023-05-06 18:05:55,193 - wikidata12k - [INFO] - [E:6| 3500]: Train Loss:0.001878, Val MRR:0.39799, wikidata12k
2023-05-06 18:07:46,888 - wikidata12k - [INFO] - [E:6| 3600]: Train Loss:0.0018774, Val MRR:0.39799, wikidata12k
2023-05-06 18:09:52,478 - wikidata12k - [INFO] - [E:6| 3700]: Train Loss:0.0018761, Val MRR:0.39799, wikidata12k
2023-05-06 18:11:57,805 - wikidata12k - [INFO] - [E:6| 3800]: Train Loss:0.001875, Val MRR:0.39799, wikidata12k
2023-05-06 18:14:03,792 - wikidata12k - [INFO] - [E:6| 3900]: Train Loss:0.0018742, Val MRR:0.39799, wikidata12k
2023-05-06 18:14:56,314 - wikidata12k - [INFO] - [Epoch:6]: Training Loss:0.001874
2023-05-06 18:14:56,579 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 18:15:30,538 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 18:15:43,162 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 18:16:21,784 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 18:16:43,517 - wikidata12k - [INFO] - [Evaluating Epoch 6 valid]:
MRR: Tail : 0.46722, Head : 0.34216, Avg : 0.40469
2023-05-06 18:16:44,981 - wikidata12k - [INFO] - [Epoch 6]: Training Loss: 0.001874, Valid MRR: 0.40469,
2023-05-06 18:16:46,361 - wikidata12k - [INFO] - [E:7| 0]: Train Loss:0.0018042, Val MRR:0.40469, wikidata12k
2023-05-06 18:18:51,495 - wikidata12k - [INFO] - [E:7| 100]: Train Loss:0.0018085, Val MRR:0.40469, wikidata12k
2023-05-06 18:20:56,865 - wikidata12k - [INFO] - [E:7| 200]: Train Loss:0.001816, Val MRR:0.40469, wikidata12k
2023-05-06 18:23:02,224 - wikidata12k - [INFO] - [E:7| 300]: Train Loss:0.0018083, Val MRR:0.40469, wikidata12k
2023-05-06 18:24:54,194 - wikidata12k - [INFO] - [E:7| 400]: Train Loss:0.0018074, Val MRR:0.40469, wikidata12k
2023-05-06 18:26:59,328 - wikidata12k - [INFO] - [E:7| 500]: Train Loss:0.0018046, Val MRR:0.40469, wikidata12k
2023-05-06 18:29:05,165 - wikidata12k - [INFO] - [E:7| 600]: Train Loss:0.0018052, Val MRR:0.40469, wikidata12k
2023-05-06 18:31:10,752 - wikidata12k - [INFO] - [E:7| 700]: Train Loss:0.0018036, Val MRR:0.40469, wikidata12k
2023-05-06 18:33:02,508 - wikidata12k - [INFO] - [E:7| 800]: Train Loss:0.0018026, Val MRR:0.40469, wikidata12k
2023-05-06 18:35:09,283 - wikidata12k - [INFO] - [E:7| 900]: Train Loss:0.0018032, Val MRR:0.40469, wikidata12k
2023-05-06 18:37:14,967 - wikidata12k - [INFO] - [E:7| 1000]: Train Loss:0.0018023, Val MRR:0.40469, wikidata12k
2023-05-06 18:39:20,192 - wikidata12k - [INFO] - [E:7| 1100]: Train Loss:0.0018015, Val MRR:0.40469, wikidata12k
2023-05-06 18:41:24,608 - wikidata12k - [INFO] - [E:7| 1200]: Train Loss:0.0018003, Val MRR:0.40469, wikidata12k
2023-05-06 18:43:17,424 - wikidata12k - [INFO] - [E:7| 1300]: Train Loss:0.0017992, Val MRR:0.40469, wikidata12k
2023-05-06 18:45:23,009 - wikidata12k - [INFO] - [E:7| 1400]: Train Loss:0.0017995, Val MRR:0.40469, wikidata12k
2023-05-06 18:47:29,091 - wikidata12k - [INFO] - [E:7| 1500]: Train Loss:0.001798, Val MRR:0.40469, wikidata12k
2023-05-06 18:49:30,364 - wikidata12k - [INFO] - [E:7| 1600]: Train Loss:0.0017981, Val MRR:0.40469, wikidata12k
2023-05-06 18:51:12,837 - wikidata12k - [INFO] - [E:7| 1700]: Train Loss:0.0017976, Val MRR:0.40469, wikidata12k
2023-05-06 18:53:18,789 - wikidata12k - [INFO] - [E:7| 1800]: Train Loss:0.0017969, Val MRR:0.40469, wikidata12k
2023-05-06 18:55:24,918 - wikidata12k - [INFO] - [E:7| 1900]: Train Loss:0.0017957, Val MRR:0.40469, wikidata12k
2023-05-06 18:57:30,556 - wikidata12k - [INFO] - [E:7| 2000]: Train Loss:0.0017956, Val MRR:0.40469, wikidata12k
2023-05-06 18:59:21,271 - wikidata12k - [INFO] - [E:7| 2100]: Train Loss:0.0017957, Val MRR:0.40469, wikidata12k
2023-05-06 19:01:26,885 - wikidata12k - [INFO] - [E:7| 2200]: Train Loss:0.0017952, Val MRR:0.40469, wikidata12k
2023-05-06 19:03:32,151 - wikidata12k - [INFO] - [E:7| 2300]: Train Loss:0.0017945, Val MRR:0.40469, wikidata12k
2023-05-06 19:05:37,958 - wikidata12k - [INFO] - [E:7| 2400]: Train Loss:0.0017939, Val MRR:0.40469, wikidata12k
2023-05-06 19:07:29,353 - wikidata12k - [INFO] - [E:7| 2500]: Train Loss:0.0017939, Val MRR:0.40469, wikidata12k
2023-05-06 19:09:34,850 - wikidata12k - [INFO] - [E:7| 2600]: Train Loss:0.0017934, Val MRR:0.40469, wikidata12k
2023-05-06 19:11:40,219 - wikidata12k - [INFO] - [E:7| 2700]: Train Loss:0.0017926, Val MRR:0.40469, wikidata12k
2023-05-06 19:13:46,198 - wikidata12k - [INFO] - [E:7| 2800]: Train Loss:0.0017921, Val MRR:0.40469, wikidata12k
2023-05-06 19:15:40,838 - wikidata12k - [INFO] - [E:7| 2900]: Train Loss:0.0017913, Val MRR:0.40469, wikidata12k
2023-05-06 19:17:43,368 - wikidata12k - [INFO] - [E:7| 3000]: Train Loss:0.0017906, Val MRR:0.40469, wikidata12k
2023-05-06 19:19:48,947 - wikidata12k - [INFO] - [E:7| 3100]: Train Loss:0.0017904, Val MRR:0.40469, wikidata12k
2023-05-06 19:21:54,405 - wikidata12k - [INFO] - [E:7| 3200]: Train Loss:0.0017894, Val MRR:0.40469, wikidata12k
2023-05-06 19:24:01,546 - wikidata12k - [INFO] - [E:7| 3300]: Train Loss:0.0017891, Val MRR:0.40469, wikidata12k
2023-05-06 19:25:53,318 - wikidata12k - [INFO] - [E:7| 3400]: Train Loss:0.0017885, Val MRR:0.40469, wikidata12k
2023-05-06 19:27:08,560 - wikidata12k - [INFO] - [E:7| 3500]: Train Loss:0.0017878, Val MRR:0.40469, wikidata12k
2023-05-06 19:28:19,494 - wikidata12k - [INFO] - [E:7| 3600]: Train Loss:0.0017872, Val MRR:0.40469, wikidata12k
2023-05-06 19:29:30,355 - wikidata12k - [INFO] - [E:7| 3700]: Train Loss:0.0017873, Val MRR:0.40469, wikidata12k
2023-05-06 19:30:41,224 - wikidata12k - [INFO] - [E:7| 3800]: Train Loss:0.0017867, Val MRR:0.40469, wikidata12k
2023-05-06 19:32:14,257 - wikidata12k - [INFO] - [E:7| 3900]: Train Loss:0.0017859, Val MRR:0.40469, wikidata12k
2023-05-06 19:33:00,713 - wikidata12k - [INFO] - [Epoch:7]: Training Loss:0.001786
2023-05-06 19:33:01,218 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 19:33:39,458 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 19:34:01,729 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 19:34:39,332 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 19:35:01,621 - wikidata12k - [INFO] - [Evaluating Epoch 7 valid]:
MRR: Tail : 0.46486, Head : 0.35119, Avg : 0.40803
2023-05-06 19:35:02,639 - wikidata12k - [INFO] - [Epoch 7]: Training Loss: 0.0017858, Valid MRR: 0.40803,
2023-05-06 19:35:03,985 - wikidata12k - [INFO] - [E:8| 0]: Train Loss:0.0017065, Val MRR:0.40803, wikidata12k
2023-05-06 19:37:03,896 - wikidata12k - [INFO] - [E:8| 100]: Train Loss:0.0017297, Val MRR:0.40803, wikidata12k
2023-05-06 19:39:08,224 - wikidata12k - [INFO] - [E:8| 200]: Train Loss:0.0017282, Val MRR:0.40803, wikidata12k
2023-05-06 19:41:06,613 - wikidata12k - [INFO] - [E:8| 300]: Train Loss:0.0017315, Val MRR:0.40803, wikidata12k
2023-05-06 19:42:59,628 - wikidata12k - [INFO] - [E:8| 400]: Train Loss:0.0017273, Val MRR:0.40803, wikidata12k
2023-05-06 19:45:05,908 - wikidata12k - [INFO] - [E:8| 500]: Train Loss:0.0017224, Val MRR:0.40803, wikidata12k
2023-05-06 19:47:11,031 - wikidata12k - [INFO] - [E:8| 600]: Train Loss:0.0017232, Val MRR:0.40803, wikidata12k
2023-05-06 19:49:14,658 - wikidata12k - [INFO] - [E:8| 700]: Train Loss:0.0017253, Val MRR:0.40803, wikidata12k
2023-05-06 19:51:04,709 - wikidata12k - [INFO] - [E:8| 800]: Train Loss:0.001725, Val MRR:0.40803, wikidata12k
2023-05-06 19:53:10,286 - wikidata12k - [INFO] - [E:8| 900]: Train Loss:0.001727, Val MRR:0.40803, wikidata12k
2023-05-06 19:55:15,976 - wikidata12k - [INFO] - [E:8| 1000]: Train Loss:0.0017284, Val MRR:0.40803, wikidata12k
2023-05-06 19:57:20,984 - wikidata12k - [INFO] - [E:8| 1100]: Train Loss:0.0017291, Val MRR:0.40803, wikidata12k
2023-05-06 19:59:11,878 - wikidata12k - [INFO] - [E:8| 1200]: Train Loss:0.0017296, Val MRR:0.40803, wikidata12k
2023-05-06 20:01:16,445 - wikidata12k - [INFO] - [E:8| 1300]: Train Loss:0.0017291, Val MRR:0.40803, wikidata12k
2023-05-06 20:03:21,780 - wikidata12k - [INFO] - [E:8| 1400]: Train Loss:0.0017284, Val MRR:0.40803, wikidata12k
2023-05-06 20:05:26,541 - wikidata12k - [INFO] - [E:8| 1500]: Train Loss:0.0017278, Val MRR:0.40803, wikidata12k
2023-05-06 20:07:19,399 - wikidata12k - [INFO] - [E:8| 1600]: Train Loss:0.0017276, Val MRR:0.40803, wikidata12k
2023-05-06 20:09:21,615 - wikidata12k - [INFO] - [E:8| 1700]: Train Loss:0.0017278, Val MRR:0.40803, wikidata12k
2023-05-06 20:11:27,063 - wikidata12k - [INFO] - [E:8| 1800]: Train Loss:0.0017282, Val MRR:0.40803, wikidata12k
2023-05-06 20:13:33,112 - wikidata12k - [INFO] - [E:8| 1900]: Train Loss:0.001728, Val MRR:0.40803, wikidata12k
2023-05-06 20:15:38,252 - wikidata12k - [INFO] - [E:8| 2000]: Train Loss:0.0017278, Val MRR:0.40803, wikidata12k
2023-05-06 20:17:23,305 - wikidata12k - [INFO] - [E:8| 2100]: Train Loss:0.0017271, Val MRR:0.40803, wikidata12k
2023-05-06 20:19:15,962 - wikidata12k - [INFO] - [E:8| 2200]: Train Loss:0.001727, Val MRR:0.40803, wikidata12k
2023-05-06 20:21:21,952 - wikidata12k - [INFO] - [E:8| 2300]: Train Loss:0.0017262, Val MRR:0.40803, wikidata12k
2023-05-06 20:23:27,272 - wikidata12k - [INFO] - [E:8| 2400]: Train Loss:0.001726, Val MRR:0.40803, wikidata12k
2023-05-06 20:25:19,590 - wikidata12k - [INFO] - [E:8| 2500]: Train Loss:0.0017259, Val MRR:0.40803, wikidata12k
2023-05-06 20:27:25,738 - wikidata12k - [INFO] - [E:8| 2600]: Train Loss:0.0017256, Val MRR:0.40803, wikidata12k
2023-05-06 20:29:30,992 - wikidata12k - [INFO] - [E:8| 2700]: Train Loss:0.0017254, Val MRR:0.40803, wikidata12k
2023-05-06 20:31:36,925 - wikidata12k - [INFO] - [E:8| 2800]: Train Loss:0.0017259, Val MRR:0.40803, wikidata12k
2023-05-06 20:33:28,551 - wikidata12k - [INFO] - [E:8| 2900]: Train Loss:0.0017253, Val MRR:0.40803, wikidata12k
2023-05-06 20:35:32,950 - wikidata12k - [INFO] - [E:8| 3000]: Train Loss:0.0017246, Val MRR:0.40803, wikidata12k
2023-05-06 20:37:38,857 - wikidata12k - [INFO] - [E:8| 3100]: Train Loss:0.0017245, Val MRR:0.40803, wikidata12k
2023-05-06 20:39:44,522 - wikidata12k - [INFO] - [E:8| 3200]: Train Loss:0.0017238, Val MRR:0.40803, wikidata12k
2023-05-06 20:41:36,578 - wikidata12k - [INFO] - [E:8| 3300]: Train Loss:0.0017237, Val MRR:0.40803, wikidata12k
2023-05-06 20:43:41,131 - wikidata12k - [INFO] - [E:8| 3400]: Train Loss:0.0017241, Val MRR:0.40803, wikidata12k
2023-05-06 20:45:47,282 - wikidata12k - [INFO] - [E:8| 3500]: Train Loss:0.0017234, Val MRR:0.40803, wikidata12k
2023-05-06 20:47:52,882 - wikidata12k - [INFO] - [E:8| 3600]: Train Loss:0.0017233, Val MRR:0.40803, wikidata12k
2023-05-06 20:49:51,067 - wikidata12k - [INFO] - [E:8| 3700]: Train Loss:0.001723, Val MRR:0.40803, wikidata12k
2023-05-06 20:51:49,402 - wikidata12k - [INFO] - [E:8| 3800]: Train Loss:0.0017231, Val MRR:0.40803, wikidata12k
2023-05-06 20:53:55,357 - wikidata12k - [INFO] - [E:8| 3900]: Train Loss:0.0017228, Val MRR:0.40803, wikidata12k
2023-05-06 20:54:47,939 - wikidata12k - [INFO] - [Epoch:8]: Training Loss:0.001723
2023-05-06 20:54:48,324 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 20:55:26,238 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 20:55:48,481 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 20:56:26,632 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 20:56:48,367 - wikidata12k - [INFO] - [Evaluating Epoch 8 valid]:
MRR: Tail : 0.46026, Head : 0.34823, Avg : 0.40424
2023-05-06 20:56:48,367 - wikidata12k - [INFO] - [Epoch 8]: Training Loss: 0.0017228, Valid MRR: 0.40803,
2023-05-06 20:56:49,616 - wikidata12k - [INFO] - [E:9| 0]: Train Loss:0.0016281, Val MRR:0.40803, wikidata12k
2023-05-06 20:58:41,512 - wikidata12k - [INFO] - [E:9| 100]: Train Loss:0.0016761, Val MRR:0.40803, wikidata12k
2023-05-06 21:00:47,160 - wikidata12k - [INFO] - [E:9| 200]: Train Loss:0.0016778, Val MRR:0.40803, wikidata12k
2023-05-06 21:02:52,504 - wikidata12k - [INFO] - [E:9| 300]: Train Loss:0.001674, Val MRR:0.40803, wikidata12k
2023-05-06 21:04:58,240 - wikidata12k - [INFO] - [E:9| 400]: Train Loss:0.0016739, Val MRR:0.40803, wikidata12k
2023-05-06 21:06:56,209 - wikidata12k - [INFO] - [E:9| 500]: Train Loss:0.0016754, Val MRR:0.40803, wikidata12k
2023-05-06 21:08:56,853 - wikidata12k - [INFO] - [E:9| 600]: Train Loss:0.0016732, Val MRR:0.40803, wikidata12k
2023-05-06 21:11:02,532 - wikidata12k - [INFO] - [E:9| 700]: Train Loss:0.0016752, Val MRR:0.40803, wikidata12k
2023-05-06 21:13:07,321 - wikidata12k - [INFO] - [E:9| 800]: Train Loss:0.001675, Val MRR:0.40803, wikidata12k
2023-05-06 21:15:12,907 - wikidata12k - [INFO] - [E:9| 900]: Train Loss:0.0016759, Val MRR:0.40803, wikidata12k
2023-05-06 21:17:04,226 - wikidata12k - [INFO] - [E:9| 1000]: Train Loss:0.0016776, Val MRR:0.40803, wikidata12k
2023-05-06 21:19:10,338 - wikidata12k - [INFO] - [E:9| 1100]: Train Loss:0.0016784, Val MRR:0.40803, wikidata12k
2023-05-06 21:21:15,688 - wikidata12k - [INFO] - [E:9| 1200]: Train Loss:0.001678, Val MRR:0.40803, wikidata12k
2023-05-06 21:23:21,053 - wikidata12k - [INFO] - [E:9| 1300]: Train Loss:0.0016774, Val MRR:0.40803, wikidata12k
2023-05-06 21:25:12,030 - wikidata12k - [INFO] - [E:9| 1400]: Train Loss:0.0016772, Val MRR:0.40803, wikidata12k
2023-05-06 21:27:17,284 - wikidata12k - [INFO] - [E:9| 1500]: Train Loss:0.0016765, Val MRR:0.40803, wikidata12k
2023-05-06 21:29:22,449 - wikidata12k - [INFO] - [E:9| 1600]: Train Loss:0.0016761, Val MRR:0.40803, wikidata12k
2023-05-06 21:31:28,421 - wikidata12k - [INFO] - [E:9| 1700]: Train Loss:0.0016765, Val MRR:0.40803, wikidata12k
2023-05-06 21:33:19,113 - wikidata12k - [INFO] - [E:9| 1800]: Train Loss:0.0016765, Val MRR:0.40803, wikidata12k
2023-05-06 21:35:24,989 - wikidata12k - [INFO] - [E:9| 1900]: Train Loss:0.0016769, Val MRR:0.40803, wikidata12k
2023-05-06 21:37:29,161 - wikidata12k - [INFO] - [E:9| 2000]: Train Loss:0.0016768, Val MRR:0.40803, wikidata12k
2023-05-06 21:39:34,610 - wikidata12k - [INFO] - [E:9| 2100]: Train Loss:0.0016768, Val MRR:0.40803, wikidata12k
2023-05-06 21:41:29,447 - wikidata12k - [INFO] - [E:9| 2200]: Train Loss:0.0016767, Val MRR:0.40803, wikidata12k
2023-05-06 21:43:32,325 - wikidata12k - [INFO] - [E:9| 2300]: Train Loss:0.0016764, Val MRR:0.40803, wikidata12k
2023-05-06 21:45:37,799 - wikidata12k - [INFO] - [E:9| 2400]: Train Loss:0.001676, Val MRR:0.40803, wikidata12k
2023-05-06 21:47:43,167 - wikidata12k - [INFO] - [E:9| 2500]: Train Loss:0.0016763, Val MRR:0.40803, wikidata12k
2023-05-06 21:49:31,602 - wikidata12k - [INFO] - [E:9| 2600]: Train Loss:0.0016768, Val MRR:0.40803, wikidata12k
2023-05-06 21:51:26,280 - wikidata12k - [INFO] - [E:9| 2700]: Train Loss:0.0016764, Val MRR:0.40803, wikidata12k
2023-05-06 21:53:32,371 - wikidata12k - [INFO] - [E:9| 2800]: Train Loss:0.0016761, Val MRR:0.40803, wikidata12k
2023-05-06 21:55:38,119 - wikidata12k - [INFO] - [E:9| 2900]: Train Loss:0.0016762, Val MRR:0.40803, wikidata12k
2023-05-06 21:57:42,478 - wikidata12k - [INFO] - [E:9| 3000]: Train Loss:0.0016763, Val MRR:0.40803, wikidata12k
2023-05-06 21:59:34,015 - wikidata12k - [INFO] - [E:9| 3100]: Train Loss:0.0016762, Val MRR:0.40803, wikidata12k
2023-05-06 22:01:39,515 - wikidata12k - [INFO] - [E:9| 3200]: Train Loss:0.0016761, Val MRR:0.40803, wikidata12k
2023-05-06 22:03:43,724 - wikidata12k - [INFO] - [E:9| 3300]: Train Loss:0.0016765, Val MRR:0.40803, wikidata12k
2023-05-06 22:05:49,474 - wikidata12k - [INFO] - [E:9| 3400]: Train Loss:0.0016763, Val MRR:0.40803, wikidata12k
2023-05-06 22:07:41,324 - wikidata12k - [INFO] - [E:9| 3500]: Train Loss:0.0016763, Val MRR:0.40803, wikidata12k
2023-05-06 22:09:44,969 - wikidata12k - [INFO] - [E:9| 3600]: Train Loss:0.001676, Val MRR:0.40803, wikidata12k
2023-05-06 22:11:51,088 - wikidata12k - [INFO] - [E:9| 3700]: Train Loss:0.0016759, Val MRR:0.40803, wikidata12k
2023-05-06 22:13:56,398 - wikidata12k - [INFO] - [E:9| 3800]: Train Loss:0.0016753, Val MRR:0.40803, wikidata12k
2023-05-06 22:15:46,733 - wikidata12k - [INFO] - [E:9| 3900]: Train Loss:0.0016749, Val MRR:0.40803, wikidata12k
2023-05-06 22:16:38,084 - wikidata12k - [INFO] - [Epoch:9]: Training Loss:0.001675
2023-05-06 22:16:38,435 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 22:17:16,865 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 22:17:39,079 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 22:18:17,506 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 22:18:39,285 - wikidata12k - [INFO] - [Evaluating Epoch 9 valid]:
MRR: Tail : 0.45924, Head : 0.30641, Avg : 0.38282
MR: Tail : 293.13, Head : 604.54, Avg : 448.84
Hit-1: Tail : 0.35313, Head : 0.19923, Avg : 0.27618
Hit-3: Tail : 0.51999, Head : 0.35748, Avg : 0.43874
Hit-10: Tail : 0.65746, Head : 0.51509, Avg : 0.58628
2023-05-06 22:18:39,286 - wikidata12k - [INFO] - [Epoch 9]: Training Loss: 0.0016747, Valid MRR: 0.40803,
2023-05-06 22:18:40,553 - wikidata12k - [INFO] - [E:10| 0]: Train Loss:0.001646, Val MRR:0.40803, wikidata12k
2023-05-06 22:20:46,131 - wikidata12k - [INFO] - [E:10| 100]: Train Loss:0.0016364, Val MRR:0.40803, wikidata12k
2023-05-06 22:22:51,733 - wikidata12k - [INFO] - [E:10| 200]: Train Loss:0.0016368, Val MRR:0.40803, wikidata12k
2023-05-06 22:24:42,968 - wikidata12k - [INFO] - [E:10| 300]: Train Loss:0.0016365, Val MRR:0.40803, wikidata12k
2023-05-06 22:26:48,302 - wikidata12k - [INFO] - [E:10| 400]: Train Loss:0.0016381, Val MRR:0.40803, wikidata12k
2023-05-06 22:28:53,745 - wikidata12k - [INFO] - [E:10| 500]: Train Loss:0.0016368, Val MRR:0.40803, wikidata12k
2023-05-06 22:30:58,902 - wikidata12k - [INFO] - [E:10| 600]: Train Loss:0.0016386, Val MRR:0.40803, wikidata12k
2023-05-06 22:32:50,051 - wikidata12k - [INFO] - [E:10| 700]: Train Loss:0.0016403, Val MRR:0.40803, wikidata12k
2023-05-06 22:34:55,034 - wikidata12k - [INFO] - [E:10| 800]: Train Loss:0.0016401, Val MRR:0.40803, wikidata12k
2023-05-06 22:37:00,539 - wikidata12k - [INFO] - [E:10| 900]: Train Loss:0.0016407, Val MRR:0.40803, wikidata12k
2023-05-06 22:39:06,141 - wikidata12k - [INFO] - [E:10| 1000]: Train Loss:0.0016416, Val MRR:0.40803, wikidata12k
2023-05-06 22:41:03,708 - wikidata12k - [INFO] - [E:10| 1100]: Train Loss:0.0016426, Val MRR:0.40803, wikidata12k
2023-05-06 22:43:02,715 - wikidata12k - [INFO] - [E:10| 1200]: Train Loss:0.0016429, Val MRR:0.40803, wikidata12k
2023-05-06 22:45:08,676 - wikidata12k - [INFO] - [E:10| 1300]: Train Loss:0.0016429, Val MRR:0.40803, wikidata12k
2023-05-06 22:47:14,019 - wikidata12k - [INFO] - [E:10| 1400]: Train Loss:0.0016423, Val MRR:0.40803, wikidata12k
2023-05-06 22:49:19,444 - wikidata12k - [INFO] - [E:10| 1500]: Train Loss:0.001642, Val MRR:0.40803, wikidata12k
2023-05-06 22:51:09,764 - wikidata12k - [INFO] - [E:10| 1600]: Train Loss:0.001641, Val MRR:0.40803, wikidata12k
2023-05-06 22:53:15,373 - wikidata12k - [INFO] - [E:10| 1700]: Train Loss:0.0016411, Val MRR:0.40803, wikidata12k
2023-05-06 22:55:20,016 - wikidata12k - [INFO] - [E:10| 1800]: Train Loss:0.0016417, Val MRR:0.40803, wikidata12k
2023-05-06 22:57:23,943 - wikidata12k - [INFO] - [E:10| 1900]: Train Loss:0.0016419, Val MRR:0.40803, wikidata12k
2023-05-06 22:59:14,149 - wikidata12k - [INFO] - [E:10| 2000]: Train Loss:0.0016415, Val MRR:0.40803, wikidata12k
2023-05-06 23:01:19,356 - wikidata12k - [INFO] - [E:10| 2100]: Train Loss:0.0016412, Val MRR:0.40803, wikidata12k
2023-05-06 23:03:24,376 - wikidata12k - [INFO] - [E:10| 2200]: Train Loss:0.0016415, Val MRR:0.40803, wikidata12k
2023-05-06 23:05:29,109 - wikidata12k - [INFO] - [E:10| 2300]: Train Loss:0.0016418, Val MRR:0.40803, wikidata12k
2023-05-06 23:07:20,641 - wikidata12k - [INFO] - [E:10| 2400]: Train Loss:0.0016422, Val MRR:0.40803, wikidata12k
2023-05-06 23:09:25,800 - wikidata12k - [INFO] - [E:10| 2500]: Train Loss:0.0016417, Val MRR:0.40803, wikidata12k
2023-05-06 23:11:29,516 - wikidata12k - [INFO] - [E:10| 2600]: Train Loss:0.0016415, Val MRR:0.40803, wikidata12k
2023-05-06 23:13:35,031 - wikidata12k - [INFO] - [E:10| 2700]: Train Loss:0.0016414, Val MRR:0.40803, wikidata12k
2023-05-06 23:15:36,137 - wikidata12k - [INFO] - [E:10| 2800]: Train Loss:0.0016411, Val MRR:0.40803, wikidata12k
2023-05-06 23:17:30,952 - wikidata12k - [INFO] - [E:10| 2900]: Train Loss:0.0016406, Val MRR:0.40803, wikidata12k
2023-05-06 23:19:30,017 - wikidata12k - [INFO] - [E:10| 3000]: Train Loss:0.0016407, Val MRR:0.40803, wikidata12k
2023-05-06 23:21:21,851 - wikidata12k - [INFO] - [E:10| 3100]: Train Loss:0.0016409, Val MRR:0.40803, wikidata12k
2023-05-06 23:23:26,516 - wikidata12k - [INFO] - [E:10| 3200]: Train Loss:0.0016409, Val MRR:0.40803, wikidata12k
2023-05-06 23:25:17,266 - wikidata12k - [INFO] - [E:10| 3300]: Train Loss:0.0016407, Val MRR:0.40803, wikidata12k
2023-05-06 23:27:21,092 - wikidata12k - [INFO] - [E:10| 3400]: Train Loss:0.0016403, Val MRR:0.40803, wikidata12k
2023-05-06 23:29:26,843 - wikidata12k - [INFO] - [E:10| 3500]: Train Loss:0.0016399, Val MRR:0.40803, wikidata12k
2023-05-06 23:31:32,339 - wikidata12k - [INFO] - [E:10| 3600]: Train Loss:0.00164, Val MRR:0.40803, wikidata12k
2023-05-06 23:33:24,932 - wikidata12k - [INFO] - [E:10| 3700]: Train Loss:0.0016396, Val MRR:0.40803, wikidata12k
2023-05-06 23:35:28,757 - wikidata12k - [INFO] - [E:10| 3800]: Train Loss:0.0016399, Val MRR:0.40803, wikidata12k
2023-05-06 23:37:32,323 - wikidata12k - [INFO] - [E:10| 3900]: Train Loss:0.00164, Val MRR:0.40803, wikidata12k
2023-05-06 23:38:24,874 - wikidata12k - [INFO] - [Epoch:10]: Training Loss:0.00164
2023-05-06 23:38:25,394 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-06 23:39:03,307 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-06 23:39:25,579 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-06 23:40:03,773 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-06 23:40:25,370 - wikidata12k - [INFO] - [Evaluating Epoch 10 valid]:
MRR: Tail : 0.46297, Head : 0.32621, Avg : 0.39459
2023-05-06 23:40:25,370 - wikidata12k - [INFO] - [Epoch 10]: Training Loss: 0.0016398, Valid MRR: 0.40803,
2023-05-06 23:40:26,674 - wikidata12k - [INFO] - [E:11| 0]: Train Loss:0.0015237, Val MRR:0.40803, wikidata12k
2023-05-06 23:42:17,197 - wikidata12k - [INFO] - [E:11| 100]: Train Loss:0.0016163, Val MRR:0.40803, wikidata12k
2023-05-06 23:44:21,825 - wikidata12k - [INFO] - [E:11| 200]: Train Loss:0.0016109, Val MRR:0.40803, wikidata12k
2023-05-06 23:46:25,185 - wikidata12k - [INFO] - [E:11| 300]: Train Loss:0.001612, Val MRR:0.40803, wikidata12k
2023-05-06 23:48:29,828 - wikidata12k - [INFO] - [E:11| 400]: Train Loss:0.0016121, Val MRR:0.40803, wikidata12k
2023-05-06 23:50:22,196 - wikidata12k - [INFO] - [E:11| 500]: Train Loss:0.0016098, Val MRR:0.40803, wikidata12k
2023-05-06 23:52:25,615 - wikidata12k - [INFO] - [E:11| 600]: Train Loss:0.0016094, Val MRR:0.40803, wikidata12k
2023-05-06 23:54:30,178 - wikidata12k - [INFO] - [E:11| 700]: Train Loss:0.0016091, Val MRR:0.40803, wikidata12k
2023-05-06 23:56:33,596 - wikidata12k - [INFO] - [E:11| 800]: Train Loss:0.0016103, Val MRR:0.40803, wikidata12k
2023-05-06 23:58:25,844 - wikidata12k - [INFO] - [E:11| 900]: Train Loss:0.0016115, Val MRR:0.40803, wikidata12k
2023-05-07 00:00:29,810 - wikidata12k - [INFO] - [E:11| 1000]: Train Loss:0.0016123, Val MRR:0.40803, wikidata12k
2023-05-07 00:02:35,396 - wikidata12k - [INFO] - [E:11| 1100]: Train Loss:0.0016122, Val MRR:0.40803, wikidata12k
2023-05-07 00:04:39,013 - wikidata12k - [INFO] - [E:11| 1200]: Train Loss:0.0016126, Val MRR:0.40803, wikidata12k
2023-05-07 00:06:43,638 - wikidata12k - [INFO] - [E:11| 1300]: Train Loss:0.0016114, Val MRR:0.40803, wikidata12k
2023-05-07 00:08:35,556 - wikidata12k - [INFO] - [E:11| 1400]: Train Loss:0.0016113, Val MRR:0.40803, wikidata12k
2023-05-07 00:10:39,003 - wikidata12k - [INFO] - [E:11| 1500]: Train Loss:0.0016115, Val MRR:0.40803, wikidata12k
2023-05-07 00:12:42,068 - wikidata12k - [INFO] - [E:11| 1600]: Train Loss:0.0016121, Val MRR:0.40803, wikidata12k
2023-05-07 00:14:45,668 - wikidata12k - [INFO] - [E:11| 1700]: Train Loss:0.0016121, Val MRR:0.40803, wikidata12k
2023-05-07 00:16:36,927 - wikidata12k - [INFO] - [E:11| 1800]: Train Loss:0.0016128, Val MRR:0.40803, wikidata12k
2023-05-07 00:18:40,971 - wikidata12k - [INFO] - [E:11| 1900]: Train Loss:0.0016123, Val MRR:0.40803, wikidata12k
2023-05-07 00:20:45,281 - wikidata12k - [INFO] - [E:11| 2000]: Train Loss:0.0016122, Val MRR:0.40803, wikidata12k
2023-05-07 00:22:50,855 - wikidata12k - [INFO] - [E:11| 2100]: Train Loss:0.0016125, Val MRR:0.40803, wikidata12k
2023-05-07 00:24:41,397 - wikidata12k - [INFO] - [E:11| 2200]: Train Loss:0.0016117, Val MRR:0.40803, wikidata12k
2023-05-07 00:26:47,003 - wikidata12k - [INFO] - [E:11| 2300]: Train Loss:0.0016112, Val MRR:0.40803, wikidata12k
2023-05-07 00:28:51,641 - wikidata12k - [INFO] - [E:11| 2400]: Train Loss:0.001611, Val MRR:0.40803, wikidata12k
2023-05-07 00:30:56,504 - wikidata12k - [INFO] - [E:11| 2500]: Train Loss:0.0016101, Val MRR:0.40803, wikidata12k
2023-05-07 00:32:56,594 - wikidata12k - [INFO] - [E:11| 2600]: Train Loss:0.0016102, Val MRR:0.40803, wikidata12k
2023-05-07 00:34:50,810 - wikidata12k - [INFO] - [E:11| 2700]: Train Loss:0.0016098, Val MRR:0.40803, wikidata12k
2023-05-07 00:36:52,807 - wikidata12k - [INFO] - [E:11| 2800]: Train Loss:0.0016103, Val MRR:0.40803, wikidata12k
2023-05-07 00:38:56,981 - wikidata12k - [INFO] - [E:11| 2900]: Train Loss:0.0016101, Val MRR:0.40803, wikidata12k
2023-05-07 00:41:01,700 - wikidata12k - [INFO] - [E:11| 3000]: Train Loss:0.0016102, Val MRR:0.40803, wikidata12k
2023-05-07 00:42:52,127 - wikidata12k - [INFO] - [E:11| 3100]: Train Loss:0.0016099, Val MRR:0.40803, wikidata12k
2023-05-07 00:44:56,688 - wikidata12k - [INFO] - [E:11| 3200]: Train Loss:0.00161, Val MRR:0.40803, wikidata12k
2023-05-07 00:47:00,395 - wikidata12k - [INFO] - [E:11| 3300]: Train Loss:0.0016103, Val MRR:0.40803, wikidata12k
2023-05-07 00:49:04,254 - wikidata12k - [INFO] - [E:11| 3400]: Train Loss:0.0016103, Val MRR:0.40803, wikidata12k
2023-05-07 00:50:50,417 - wikidata12k - [INFO] - [E:11| 3500]: Train Loss:0.0016101, Val MRR:0.40803, wikidata12k
2023-05-07 00:52:44,846 - wikidata12k - [INFO] - [E:11| 3600]: Train Loss:0.0016103, Val MRR:0.40803, wikidata12k
2023-05-07 00:54:47,430 - wikidata12k - [INFO] - [E:11| 3700]: Train Loss:0.0016102, Val MRR:0.40803, wikidata12k
2023-05-07 00:56:50,835 - wikidata12k - [INFO] - [E:11| 3800]: Train Loss:0.0016104, Val MRR:0.40803, wikidata12k
2023-05-07 00:58:42,086 - wikidata12k - [INFO] - [E:11| 3900]: Train Loss:0.0016104, Val MRR:0.40803, wikidata12k
2023-05-07 00:59:34,722 - wikidata12k - [INFO] - [Epoch:11]: Training Loss:0.00161
2023-05-07 00:59:35,232 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 01:00:12,697 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 01:00:34,266 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 01:01:12,575 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 01:01:34,480 - wikidata12k - [INFO] - [Evaluating Epoch 11 valid]:
MRR: Tail : 0.46088, Head : 0.3047, Avg : 0.38279
2023-05-07 01:01:34,481 - wikidata12k - [INFO] - [Epoch 11]: Training Loss: 0.0016104, Valid MRR: 0.40803,
2023-05-07 01:01:35,742 - wikidata12k - [INFO] - [E:12| 0]: Train Loss:0.0014715, Val MRR:0.40803, wikidata12k
2023-05-07 01:03:39,323 - wikidata12k - [INFO] - [E:12| 100]: Train Loss:0.001584, Val MRR:0.40803, wikidata12k
2023-05-07 01:05:44,226 - wikidata12k - [INFO] - [E:12| 200]: Train Loss:0.0015769, Val MRR:0.40803, wikidata12k
2023-05-07 01:07:35,699 - wikidata12k - [INFO] - [E:12| 300]: Train Loss:0.0015811, Val MRR:0.40803, wikidata12k
2023-05-07 01:09:40,934 - wikidata12k - [INFO] - [E:12| 400]: Train Loss:0.0015827, Val MRR:0.40803, wikidata12k
2023-05-07 01:11:45,821 - wikidata12k - [INFO] - [E:12| 500]: Train Loss:0.0015821, Val MRR:0.40803, wikidata12k
2023-05-07 01:13:50,092 - wikidata12k - [INFO] - [E:12| 600]: Train Loss:0.0015804, Val MRR:0.40803, wikidata12k
2023-05-07 01:15:44,893 - wikidata12k - [INFO] - [E:12| 700]: Train Loss:0.0015821, Val MRR:0.40803, wikidata12k
2023-05-07 01:17:44,799 - wikidata12k - [INFO] - [E:12| 800]: Train Loss:0.0015844, Val MRR:0.40803, wikidata12k
2023-05-07 01:19:48,397 - wikidata12k - [INFO] - [E:12| 900]: Train Loss:0.0015848, Val MRR:0.40803, wikidata12k
2023-05-07 01:21:51,605 - wikidata12k - [INFO] - [E:12| 1000]: Train Loss:0.0015843, Val MRR:0.40803, wikidata12k
2023-05-07 01:23:55,989 - wikidata12k - [INFO] - [E:12| 1100]: Train Loss:0.001584, Val MRR:0.40803, wikidata12k
2023-05-07 01:25:46,942 - wikidata12k - [INFO] - [E:12| 1200]: Train Loss:0.0015833, Val MRR:0.40803, wikidata12k
2023-05-07 01:27:49,160 - wikidata12k - [INFO] - [E:12| 1300]: Train Loss:0.0015832, Val MRR:0.40803, wikidata12k
2023-05-07 01:29:51,319 - wikidata12k - [INFO] - [E:12| 1400]: Train Loss:0.0015846, Val MRR:0.40803, wikidata12k
2023-05-07 01:31:54,374 - wikidata12k - [INFO] - [E:12| 1500]: Train Loss:0.0015845, Val MRR:0.40803, wikidata12k
2023-05-07 01:33:44,738 - wikidata12k - [INFO] - [E:12| 1600]: Train Loss:0.0015853, Val MRR:0.40803, wikidata12k
2023-05-07 01:35:49,760 - wikidata12k - [INFO] - [E:12| 1700]: Train Loss:0.001586, Val MRR:0.40803, wikidata12k
2023-05-07 01:37:55,421 - wikidata12k - [INFO] - [E:12| 1800]: Train Loss:0.0015861, Val MRR:0.40803, wikidata12k
2023-05-07 01:40:00,973 - wikidata12k - [INFO] - [E:12| 1900]: Train Loss:0.0015864, Val MRR:0.40803, wikidata12k
2023-05-07 01:41:52,850 - wikidata12k - [INFO] - [E:12| 2000]: Train Loss:0.0015864, Val MRR:0.40803, wikidata12k
2023-05-07 01:43:55,093 - wikidata12k - [INFO] - [E:12| 2100]: Train Loss:0.0015864, Val MRR:0.40803, wikidata12k
2023-05-07 01:45:57,361 - wikidata12k - [INFO] - [E:12| 2200]: Train Loss:0.0015863, Val MRR:0.40803, wikidata12k
2023-05-07 01:47:59,801 - wikidata12k - [INFO] - [E:12| 2300]: Train Loss:0.0015862, Val MRR:0.40803, wikidata12k
2023-05-07 01:48:07,440 - wikidata12k - [INFO] - {'dataset': 'FB15k-237', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True}
2023-05-07 01:48:25,665 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True}
2023-05-07 01:48:36,455 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
2023-05-07 01:49:13,626 - wikidata12k - [INFO] - [Test, Tail_Batch Step 100] wikidata12k
2023-05-07 01:49:32,230 - wikidata12k - [INFO] - [Test, Head_Batch Step 0] wikidata12k
2023-05-07 01:50:00,418 - wikidata12k - [INFO] - [E:12| 2400]: Train Loss:0.0015866, Val MRR:0.40803, wikidata12k
2023-05-07 01:50:05,348 - wikidata12k - [INFO] - [Test, Head_Batch Step 100] wikidata12k
2023-05-07 01:50:16,075 - wikidata12k - [INFO] - [Evaluating Epoch 0 test]:
MRR: Tail : 0.42577, Head : 0.29595, Avg : 0.36086
MR: Tail : 239.1, Head : 520.46, Avg : 379.78
Hit-1: Tail : 0.30829, Head : 0.20891, Avg : 0.2586
Hit-3: Tail : 0.49769, Head : 0.32432, Avg : 0.41101
Hit-10: Tail : 0.64761, Head : 0.48228, Avg : 0.56494
2023-05-07 01:51:51,435 - wikidata12k - [INFO] - [E:12| 2500]: Train Loss:0.0015871, Val MRR:0.40803, wikidata12k
2023-05-07 01:53:56,885 - wikidata12k - [INFO] - [E:12| 2600]: Train Loss:0.0015876, Val MRR:0.40803, wikidata12k
2023-05-07 01:56:00,403 - wikidata12k - [INFO] - [E:12| 2700]: Train Loss:0.0015876, Val MRR:0.40803, wikidata12k
2023-05-07 01:58:05,089 - wikidata12k - [INFO] - [E:12| 2800]: Train Loss:0.0015874, Val MRR:0.40803, wikidata12k
2023-05-07 01:59:56,989 - wikidata12k - [INFO] - [E:12| 2900]: Train Loss:0.0015875, Val MRR:0.40803, wikidata12k
2023-05-07 02:02:02,562 - wikidata12k - [INFO] - [E:12| 3000]: Train Loss:0.0015884, Val MRR:0.40803, wikidata12k
2023-05-07 02:04:08,610 - wikidata12k - [INFO] - [E:12| 3100]: Train Loss:0.0015884, Val MRR:0.40803, wikidata12k
2023-05-07 02:06:14,091 - wikidata12k - [INFO] - [E:12| 3200]: Train Loss:0.0015883, Val MRR:0.40803, wikidata12k
2023-05-07 02:08:07,070 - wikidata12k - [INFO] - [E:12| 3300]: Train Loss:0.0015882, Val MRR:0.40803, wikidata12k
2023-05-07 02:10:13,114 - wikidata12k - [INFO] - [E:12| 3400]: Train Loss:0.0015879, Val MRR:0.40803, wikidata12k
2023-05-07 02:12:18,916 - wikidata12k - [INFO] - [E:12| 3500]: Train Loss:0.0015881, Val MRR:0.40803, wikidata12k
2023-05-07 02:14:24,617 - wikidata12k - [INFO] - [E:12| 3600]: Train Loss:0.001588, Val MRR:0.40803, wikidata12k
2023-05-07 02:16:16,764 - wikidata12k - [INFO] - [E:12| 3700]: Train Loss:0.0015877, Val MRR:0.40803, wikidata12k
2023-05-07 02:18:21,266 - wikidata12k - [INFO] - [E:12| 3800]: Train Loss:0.0015879, Val MRR:0.40803, wikidata12k
2023-05-07 02:20:25,774 - wikidata12k - [INFO] - [E:12| 3900]: Train Loss:0.001588, Val MRR:0.40803, wikidata12k
2023-05-07 02:21:13,778 - wikidata12k - [INFO] - [Epoch:12]: Training Loss:0.001588
2023-05-07 02:21:14,302 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 02:21:51,133 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 02:22:12,120 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 02:22:49,151 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 02:23:10,312 - wikidata12k - [INFO] - [Evaluating Epoch 12 valid]:
MRR: Tail : 0.46282, Head : 0.29885, Avg : 0.38084
2023-05-07 02:23:10,312 - wikidata12k - [INFO] - [Epoch 12]: Training Loss: 0.001588, Valid MRR: 0.40803,
2023-05-07 02:23:11,665 - wikidata12k - [INFO] - [E:13| 0]: Train Loss:0.0015893, Val MRR:0.40803, wikidata12k
2023-05-07 02:25:03,300 - wikidata12k - [INFO] - [E:13| 100]: Train Loss:0.0015696, Val MRR:0.40803, wikidata12k
2023-05-07 02:27:06,851 - wikidata12k - [INFO] - [E:13| 200]: Train Loss:0.0015593, Val MRR:0.40803, wikidata12k
2023-05-07 02:29:09,720 - wikidata12k - [INFO] - [E:13| 300]: Train Loss:0.0015583, Val MRR:0.40803, wikidata12k
2023-05-07 02:31:15,365 - wikidata12k - [INFO] - [E:13| 400]: Train Loss:0.0015593, Val MRR:0.40803, wikidata12k
2023-05-07 02:33:06,938 - wikidata12k - [INFO] - [E:13| 500]: Train Loss:0.0015596, Val MRR:0.40803, wikidata12k
2023-05-07 02:35:11,682 - wikidata12k - [INFO] - [E:13| 600]: Train Loss:0.0015598, Val MRR:0.40803, wikidata12k
2023-05-07 02:37:13,834 - wikidata12k - [INFO] - [E:13| 700]: Train Loss:0.0015595, Val MRR:0.40803, wikidata12k
2023-05-07 02:39:17,843 - wikidata12k - [INFO] - [E:13| 800]: Train Loss:0.0015602, Val MRR:0.40803, wikidata12k
2023-05-07 02:41:23,451 - wikidata12k - [INFO] - [E:13| 900]: Train Loss:0.0015606, Val MRR:0.40803, wikidata12k
2023-05-07 02:43:15,138 - wikidata12k - [INFO] - [E:13| 1000]: Train Loss:0.0015611, Val MRR:0.40803, wikidata12k
2023-05-07 02:45:20,278 - wikidata12k - [INFO] - [E:13| 1100]: Train Loss:0.0015622, Val MRR:0.40803, wikidata12k
2023-05-07 02:47:24,888 - wikidata12k - [INFO] - [E:13| 1200]: Train Loss:0.001563, Val MRR:0.40803, wikidata12k
2023-05-07 02:49:30,679 - wikidata12k - [INFO] - [E:13| 1300]: Train Loss:0.0015639, Val MRR:0.40803, wikidata12k
2023-05-07 02:51:23,511 - wikidata12k - [INFO] - [E:13| 1400]: Train Loss:0.0015648, Val MRR:0.40803, wikidata12k
2023-05-07 02:53:29,195 - wikidata12k - [INFO] - [E:13| 1500]: Train Loss:0.0015642, Val MRR:0.40803, wikidata12k
2023-05-07 02:55:34,081 - wikidata12k - [INFO] - [E:13| 1600]: Train Loss:0.0015652, Val MRR:0.40803, wikidata12k
2023-05-07 02:57:39,615 - wikidata12k - [INFO] - [E:13| 1700]: Train Loss:0.0015656, Val MRR:0.40803, wikidata12k
2023-05-07 02:59:31,200 - wikidata12k - [INFO] - [E:13| 1800]: Train Loss:0.001566, Val MRR:0.40803, wikidata12k
2023-05-07 03:01:34,461 - wikidata12k - [INFO] - [E:13| 1900]: Train Loss:0.0015665, Val MRR:0.40803, wikidata12k
2023-05-07 03:03:36,542 - wikidata12k - [INFO] - [E:13| 2000]: Train Loss:0.0015669, Val MRR:0.40803, wikidata12k
2023-05-07 03:05:39,177 - wikidata12k - [INFO] - [E:13| 2100]: Train Loss:0.001567, Val MRR:0.40803, wikidata12k
2023-05-07 03:07:31,441 - wikidata12k - [INFO] - [E:13| 2200]: Train Loss:0.0015676, Val MRR:0.40803, wikidata12k
2023-05-07 03:09:33,132 - wikidata12k - [INFO] - [E:13| 2300]: Train Loss:0.0015679, Val MRR:0.40803, wikidata12k
2023-05-07 03:11:36,713 - wikidata12k - [INFO] - [E:13| 2400]: Train Loss:0.001568, Val MRR:0.40803, wikidata12k
2023-05-07 03:13:40,156 - wikidata12k - [INFO] - [E:13| 2500]: Train Loss:0.0015678, Val MRR:0.40803, wikidata12k
2023-05-07 03:15:43,618 - wikidata12k - [INFO] - [E:13| 2600]: Train Loss:0.0015675, Val MRR:0.40803, wikidata12k
2023-05-07 03:17:34,839 - wikidata12k - [INFO] - [E:13| 2700]: Train Loss:0.0015678, Val MRR:0.40803, wikidata12k
2023-05-07 03:19:37,644 - wikidata12k - [INFO] - [E:13| 2800]: Train Loss:0.0015677, Val MRR:0.40803, wikidata12k
2023-05-07 03:21:40,868 - wikidata12k - [INFO] - [E:13| 2900]: Train Loss:0.0015681, Val MRR:0.40803, wikidata12k
2023-05-07 03:23:43,267 - wikidata12k - [INFO] - [E:13| 3000]: Train Loss:0.0015683, Val MRR:0.40803, wikidata12k
2023-05-07 03:25:33,553 - wikidata12k - [INFO] - [E:13| 3100]: Train Loss:0.0015683, Val MRR:0.40803, wikidata12k
2023-05-07 03:27:40,050 - wikidata12k - [INFO] - [E:13| 3200]: Train Loss:0.0015682, Val MRR:0.40803, wikidata12k
2023-05-07 03:29:45,560 - wikidata12k - [INFO] - [E:13| 3300]: Train Loss:0.0015681, Val MRR:0.40803, wikidata12k
2023-05-07 03:31:50,492 - wikidata12k - [INFO] - [E:13| 3400]: Train Loss:0.001568, Val MRR:0.40803, wikidata12k
2023-05-07 03:33:41,221 - wikidata12k - [INFO] - [E:13| 3500]: Train Loss:0.0015677, Val MRR:0.40803, wikidata12k
2023-05-07 03:35:45,990 - wikidata12k - [INFO] - [E:13| 3600]: Train Loss:0.0015678, Val MRR:0.40803, wikidata12k
2023-05-07 03:37:50,250 - wikidata12k - [INFO] - [E:13| 3700]: Train Loss:0.0015681, Val MRR:0.40803, wikidata12k
2023-05-07 03:39:55,726 - wikidata12k - [INFO] - [E:13| 3800]: Train Loss:0.001568, Val MRR:0.40803, wikidata12k
2023-05-07 03:41:56,966 - wikidata12k - [INFO] - [E:13| 3900]: Train Loss:0.0015682, Val MRR:0.40803, wikidata12k
2023-05-07 03:42:38,681 - wikidata12k - [INFO] - [Epoch:13]: Training Loss:0.001568
2023-05-07 03:42:38,945 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 03:43:17,021 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 03:43:38,905 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 03:44:17,413 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 03:44:39,450 - wikidata12k - [INFO] - [Evaluating Epoch 13 valid]:
MRR: Tail : 0.47519, Head : 0.26003, Avg : 0.36761
2023-05-07 03:44:39,450 - wikidata12k - [INFO] - [Epoch 13]: Training Loss: 0.0015682, Valid MRR: 0.40803,
2023-05-07 03:44:40,746 - wikidata12k - [INFO] - [E:14| 0]: Train Loss:0.0015209, Val MRR:0.40803, wikidata12k
2023-05-07 03:46:45,753 - wikidata12k - [INFO] - [E:14| 100]: Train Loss:0.0015476, Val MRR:0.40803, wikidata12k
2023-05-07 03:48:51,350 - wikidata12k - [INFO] - [E:14| 200]: Train Loss:0.0015414, Val MRR:0.40803, wikidata12k
2023-05-07 03:50:46,227 - wikidata12k - [INFO] - [E:14| 300]: Train Loss:0.0015431, Val MRR:0.40803, wikidata12k
2023-05-07 03:52:40,002 - wikidata12k - [INFO] - [E:14| 400]: Train Loss:0.001547, Val MRR:0.40803, wikidata12k
2023-05-07 03:54:35,284 - wikidata12k - [INFO] - [E:14| 500]: Train Loss:0.0015479, Val MRR:0.40803, wikidata12k
2023-05-07 03:56:41,349 - wikidata12k - [INFO] - [E:14| 600]: Train Loss:0.0015482, Val MRR:0.40803, wikidata12k
2023-05-07 03:58:41,765 - wikidata12k - [INFO] - [E:14| 700]: Train Loss:0.0015493, Val MRR:0.40803, wikidata12k
2023-05-07 04:00:38,942 - wikidata12k - [INFO] - [E:14| 800]: Train Loss:0.0015519, Val MRR:0.40803, wikidata12k
2023-05-07 04:02:43,697 - wikidata12k - [INFO] - [E:14| 900]: Train Loss:0.0015513, Val MRR:0.40803, wikidata12k
2023-05-07 04:04:48,869 - wikidata12k - [INFO] - [E:14| 1000]: Train Loss:0.0015513, Val MRR:0.40803, wikidata12k
2023-05-07 04:06:54,508 - wikidata12k - [INFO] - [E:14| 1100]: Train Loss:0.0015505, Val MRR:0.40803, wikidata12k
2023-05-07 04:08:45,239 - wikidata12k - [INFO] - [E:14| 1200]: Train Loss:0.0015496, Val MRR:0.40803, wikidata12k
2023-05-07 04:10:48,476 - wikidata12k - [INFO] - [E:14| 1300]: Train Loss:0.0015489, Val MRR:0.40803, wikidata12k
2023-05-07 04:12:53,139 - wikidata12k - [INFO] - [E:14| 1400]: Train Loss:0.0015489, Val MRR:0.40803, wikidata12k
2023-05-07 04:14:58,186 - wikidata12k - [INFO] - [E:14| 1500]: Train Loss:0.0015492, Val MRR:0.40803, wikidata12k
2023-05-07 04:16:49,545 - wikidata12k - [INFO] - [E:14| 1600]: Train Loss:0.0015497, Val MRR:0.40803, wikidata12k
2023-05-07 04:18:52,983 - wikidata12k - [INFO] - [E:14| 1700]: Train Loss:0.0015496, Val MRR:0.40803, wikidata12k
2023-05-07 04:20:57,707 - wikidata12k - [INFO] - [E:14| 1800]: Train Loss:0.0015495, Val MRR:0.40803, wikidata12k
2023-05-07 04:23:01,324 - wikidata12k - [INFO] - [E:14| 1900]: Train Loss:0.0015489, Val MRR:0.40803, wikidata12k
2023-05-07 04:24:52,337 - wikidata12k - [INFO] - [E:14| 2000]: Train Loss:0.0015494, Val MRR:0.40803, wikidata12k
2023-05-07 04:26:57,209 - wikidata12k - [INFO] - [E:14| 2100]: Train Loss:0.0015495, Val MRR:0.40803, wikidata12k
2023-05-07 04:29:01,744 - wikidata12k - [INFO] - [E:14| 2200]: Train Loss:0.0015494, Val MRR:0.40803, wikidata12k
2023-05-07 04:31:06,839 - wikidata12k - [INFO] - [E:14| 2300]: Train Loss:0.0015489, Val MRR:0.40803, wikidata12k
2023-05-07 04:33:12,705 - wikidata12k - [INFO] - [E:14| 2400]: Train Loss:0.0015495, Val MRR:0.40803, wikidata12k
2023-05-07 04:35:03,005 - wikidata12k - [INFO] - [E:14| 2500]: Train Loss:0.0015494, Val MRR:0.40803, wikidata12k
2023-05-07 04:37:07,435 - wikidata12k - [INFO] - [E:14| 2600]: Train Loss:0.0015497, Val MRR:0.40803, wikidata12k
2023-05-07 04:39:11,045 - wikidata12k - [INFO] - [E:14| 2700]: Train Loss:0.00155, Val MRR:0.40803, wikidata12k
2023-05-07 04:41:15,855 - wikidata12k - [INFO] - [E:14| 2800]: Train Loss:0.0015506, Val MRR:0.40803, wikidata12k
2023-05-07 04:43:08,788 - wikidata12k - [INFO] - [E:14| 2900]: Train Loss:0.0015507, Val MRR:0.40803, wikidata12k
2023-05-07 04:45:14,658 - wikidata12k - [INFO] - [E:14| 3000]: Train Loss:0.001551, Val MRR:0.40803, wikidata12k
2023-05-07 04:47:20,559 - wikidata12k - [INFO] - [E:14| 3100]: Train Loss:0.001551, Val MRR:0.40803, wikidata12k
2023-05-07 04:49:25,144 - wikidata12k - [INFO] - [E:14| 3200]: Train Loss:0.0015508, Val MRR:0.40803, wikidata12k
2023-05-07 04:51:17,929 - wikidata12k - [INFO] - [E:14| 3300]: Train Loss:0.0015508, Val MRR:0.40803, wikidata12k
2023-05-07 04:53:22,510 - wikidata12k - [INFO] - [E:14| 3400]: Train Loss:0.001551, Val MRR:0.40803, wikidata12k
2023-05-07 04:55:27,444 - wikidata12k - [INFO] - [E:14| 3500]: Train Loss:0.0015507, Val MRR:0.40803, wikidata12k
2023-05-07 04:57:31,917 - wikidata12k - [INFO] - [E:14| 3600]: Train Loss:0.0015506, Val MRR:0.40803, wikidata12k
2023-05-07 04:59:24,982 - wikidata12k - [INFO] - [E:14| 3700]: Train Loss:0.0015508, Val MRR:0.40803, wikidata12k
2023-05-07 05:01:29,186 - wikidata12k - [INFO] - [E:14| 3800]: Train Loss:0.001551, Val MRR:0.40803, wikidata12k
2023-05-07 05:03:35,121 - wikidata12k - [INFO] - [E:14| 3900]: Train Loss:0.0015511, Val MRR:0.40803, wikidata12k
2023-05-07 05:04:27,879 - wikidata12k - [INFO] - [Epoch:14]: Training Loss:0.001551
2023-05-07 05:04:28,282 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 05:05:05,842 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 05:05:27,585 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 05:06:06,230 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 05:06:27,977 - wikidata12k - [INFO] - [Evaluating Epoch 14 valid]:
MRR: Tail : 0.464, Head : 0.26699, Avg : 0.3655
2023-05-07 05:06:27,977 - wikidata12k - [INFO] - [Epoch 14]: Training Loss: 0.0015512, Valid MRR: 0.40803,
2023-05-07 05:06:29,331 - wikidata12k - [INFO] - [E:15| 0]: Train Loss:0.0015406, Val MRR:0.40803, wikidata12k
2023-05-07 05:08:21,343 - wikidata12k - [INFO] - [E:15| 100]: Train Loss:0.0015274, Val MRR:0.40803, wikidata12k
2023-05-07 05:10:27,050 - wikidata12k - [INFO] - [E:15| 200]: Train Loss:0.0015325, Val MRR:0.40803, wikidata12k
2023-05-07 05:12:31,685 - wikidata12k - [INFO] - [E:15| 300]: Train Loss:0.0015344, Val MRR:0.40803, wikidata12k
2023-05-07 05:14:37,191 - wikidata12k - [INFO] - [E:15| 400]: Train Loss:0.0015316, Val MRR:0.40803, wikidata12k
2023-05-07 05:16:37,563 - wikidata12k - [INFO] - [E:15| 500]: Train Loss:0.0015315, Val MRR:0.40803, wikidata12k
2023-05-07 05:18:34,637 - wikidata12k - [INFO] - [E:15| 600]: Train Loss:0.001533, Val MRR:0.40803, wikidata12k
2023-05-07 05:20:40,099 - wikidata12k - [INFO] - [E:15| 700]: Train Loss:0.0015327, Val MRR:0.40803, wikidata12k
2023-05-07 05:22:35,766 - wikidata12k - [INFO] - [E:15| 800]: Train Loss:0.0015331, Val MRR:0.40803, wikidata12k
2023-05-07 05:23:47,486 - wikidata12k - [INFO] - [E:15| 900]: Train Loss:0.0015326, Val MRR:0.40803, wikidata12k
2023-05-07 05:25:31,889 - wikidata12k - [INFO] - [E:15| 1000]: Train Loss:0.0015319, Val MRR:0.40803, wikidata12k
2023-05-07 05:27:28,553 - wikidata12k - [INFO] - [E:15| 1100]: Train Loss:0.0015319, Val MRR:0.40803, wikidata12k
2023-05-07 05:29:28,760 - wikidata12k - [INFO] - [E:15| 1200]: Train Loss:0.0015322, Val MRR:0.40803, wikidata12k
2023-05-07 05:31:30,004 - wikidata12k - [INFO] - [E:15| 1300]: Train Loss:0.001532, Val MRR:0.40803, wikidata12k
2023-05-07 05:33:31,008 - wikidata12k - [INFO] - [E:15| 1400]: Train Loss:0.0015324, Val MRR:0.40803, wikidata12k
2023-05-07 05:35:22,677 - wikidata12k - [INFO] - [E:15| 1500]: Train Loss:0.0015333, Val MRR:0.40803, wikidata12k
2023-05-07 05:37:26,878 - wikidata12k - [INFO] - [E:15| 1600]: Train Loss:0.0015344, Val MRR:0.40803, wikidata12k
2023-05-07 05:39:30,933 - wikidata12k - [INFO] - [E:15| 1700]: Train Loss:0.0015344, Val MRR:0.40803, wikidata12k
2023-05-07 05:41:33,827 - wikidata12k - [INFO] - [E:15| 1800]: Train Loss:0.0015341, Val MRR:0.40803, wikidata12k
2023-05-07 05:43:24,651 - wikidata12k - [INFO] - [E:15| 1900]: Train Loss:0.0015343, Val MRR:0.40803, wikidata12k
2023-05-07 05:45:28,280 - wikidata12k - [INFO] - [E:15| 2000]: Train Loss:0.0015346, Val MRR:0.40803, wikidata12k
2023-05-07 05:47:32,123 - wikidata12k - [INFO] - [E:15| 2100]: Train Loss:0.0015348, Val MRR:0.40803, wikidata12k
2023-05-07 05:49:35,548 - wikidata12k - [INFO] - [E:15| 2200]: Train Loss:0.0015351, Val MRR:0.40803, wikidata12k
2023-05-07 05:51:29,021 - wikidata12k - [INFO] - [E:15| 2300]: Train Loss:0.0015351, Val MRR:0.40803, wikidata12k
2023-05-07 05:53:30,388 - wikidata12k - [INFO] - [E:15| 2400]: Train Loss:0.0015346, Val MRR:0.40803, wikidata12k
2023-05-07 05:55:36,252 - wikidata12k - [INFO] - [E:15| 2500]: Train Loss:0.0015346, Val MRR:0.40803, wikidata12k
2023-05-07 05:57:41,525 - wikidata12k - [INFO] - [E:15| 2600]: Train Loss:0.0015347, Val MRR:0.40803, wikidata12k
2023-05-07 05:59:47,355 - wikidata12k - [INFO] - [E:15| 2700]: Train Loss:0.001535, Val MRR:0.40803, wikidata12k
2023-05-07 06:01:38,830 - wikidata12k - [INFO] - [E:15| 2800]: Train Loss:0.0015353, Val MRR:0.40803, wikidata12k
2023-05-07 06:03:44,050 - wikidata12k - [INFO] - [E:15| 2900]: Train Loss:0.0015357, Val MRR:0.40803, wikidata12k
2023-05-07 06:05:47,938 - wikidata12k - [INFO] - [E:15| 3000]: Train Loss:0.0015356, Val MRR:0.40803, wikidata12k
2023-05-07 06:07:52,218 - wikidata12k - [INFO] - [E:15| 3100]: Train Loss:0.0015361, Val MRR:0.40803, wikidata12k
2023-05-07 06:09:42,680 - wikidata12k - [INFO] - [E:15| 3200]: Train Loss:0.0015362, Val MRR:0.40803, wikidata12k
2023-05-07 06:11:47,785 - wikidata12k - [INFO] - [E:15| 3300]: Train Loss:0.0015365, Val MRR:0.40803, wikidata12k
2023-05-07 06:13:53,667 - wikidata12k - [INFO] - [E:15| 3400]: Train Loss:0.0015366, Val MRR:0.40803, wikidata12k
2023-05-07 06:15:59,063 - wikidata12k - [INFO] - [E:15| 3500]: Train Loss:0.0015367, Val MRR:0.40803, wikidata12k
2023-05-07 06:17:51,009 - wikidata12k - [INFO] - [E:15| 3600]: Train Loss:0.0015367, Val MRR:0.40803, wikidata12k
2023-05-07 06:19:55,693 - wikidata12k - [INFO] - [E:15| 3700]: Train Loss:0.0015369, Val MRR:0.40803, wikidata12k
2023-05-07 06:22:00,027 - wikidata12k - [INFO] - [E:15| 3800]: Train Loss:0.0015367, Val MRR:0.40803, wikidata12k
2023-05-07 06:24:04,858 - wikidata12k - [INFO] - [E:15| 3900]: Train Loss:0.0015367, Val MRR:0.40803, wikidata12k
2023-05-07 06:24:57,604 - wikidata12k - [INFO] - [Epoch:15]: Training Loss:0.001537
2023-05-07 06:24:58,119 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 06:25:36,024 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 06:25:57,838 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 06:26:23,251 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 06:26:45,610 - wikidata12k - [INFO] - [Evaluating Epoch 15 valid]:
MRR: Tail : 0.47163, Head : 0.26033, Avg : 0.36598
2023-05-07 06:26:45,610 - wikidata12k - [INFO] - [Epoch 15]: Training Loss: 0.0015365, Valid MRR: 0.40803,
2023-05-07 06:26:46,967 - wikidata12k - [INFO] - [E:16| 0]: Train Loss:0.0014838, Val MRR:0.40803, wikidata12k
2023-05-07 06:28:53,291 - wikidata12k - [INFO] - [E:16| 100]: Train Loss:0.0015307, Val MRR:0.40803, wikidata12k
2023-05-07 06:30:59,418 - wikidata12k - [INFO] - [E:16| 200]: Train Loss:0.0015241, Val MRR:0.40803, wikidata12k
2023-05-07 06:33:04,007 - wikidata12k - [INFO] - [E:16| 300]: Train Loss:0.0015208, Val MRR:0.40803, wikidata12k
2023-05-07 06:34:54,545 - wikidata12k - [INFO] - [E:16| 400]: Train Loss:0.001522, Val MRR:0.40803, wikidata12k
2023-05-07 06:36:58,778 - wikidata12k - [INFO] - [E:16| 500]: Train Loss:0.001522, Val MRR:0.40803, wikidata12k
2023-05-07 06:39:04,147 - wikidata12k - [INFO] - [E:16| 600]: Train Loss:0.0015204, Val MRR:0.40803, wikidata12k
2023-05-07 06:41:10,129 - wikidata12k - [INFO] - [E:16| 700]: Train Loss:0.0015214, Val MRR:0.40803, wikidata12k
2023-05-07 06:43:13,089 - wikidata12k - [INFO] - [E:16| 800]: Train Loss:0.0015205, Val MRR:0.40803, wikidata12k
2023-05-07 06:45:06,222 - wikidata12k - [INFO] - [E:16| 900]: Train Loss:0.0015207, Val MRR:0.40803, wikidata12k
2023-05-07 06:47:07,584 - wikidata12k - [INFO] - [E:16| 1000]: Train Loss:0.0015211, Val MRR:0.40803, wikidata12k
2023-05-07 06:49:11,220 - wikidata12k - [INFO] - [E:16| 1100]: Train Loss:0.0015209, Val MRR:0.40803, wikidata12k
2023-05-07 06:51:16,816 - wikidata12k - [INFO] - [E:16| 1200]: Train Loss:0.0015206, Val MRR:0.40803, wikidata12k
2023-05-07 06:53:03,087 - wikidata12k - [INFO] - [E:16| 1300]: Train Loss:0.0015202, Val MRR:0.40803, wikidata12k
2023-05-07 06:54:54,469 - wikidata12k - [INFO] - [E:16| 1400]: Train Loss:0.0015204, Val MRR:0.40803, wikidata12k
2023-05-07 06:56:57,760 - wikidata12k - [INFO] - [E:16| 1500]: Train Loss:0.0015204, Val MRR:0.40803, wikidata12k
2023-05-07 06:59:02,080 - wikidata12k - [INFO] - [E:16| 1600]: Train Loss:0.0015209, Val MRR:0.40803, wikidata12k
2023-05-07 07:00:53,440 - wikidata12k - [INFO] - [E:16| 1700]: Train Loss:0.0015203, Val MRR:0.40803, wikidata12k
2023-05-07 07:02:58,608 - wikidata12k - [INFO] - [E:16| 1800]: Train Loss:0.0015208, Val MRR:0.40803, wikidata12k
2023-05-07 07:05:04,162 - wikidata12k - [INFO] - [E:16| 1900]: Train Loss:0.0015206, Val MRR:0.40803, wikidata12k
2023-05-07 07:07:08,267 - wikidata12k - [INFO] - [E:16| 2000]: Train Loss:0.001521, Val MRR:0.40803, wikidata12k
2023-05-07 07:08:59,416 - wikidata12k - [INFO] - [E:16| 2100]: Train Loss:0.0015215, Val MRR:0.40803, wikidata12k
2023-05-07 07:11:04,576 - wikidata12k - [INFO] - [E:16| 2200]: Train Loss:0.0015216, Val MRR:0.40803, wikidata12k
2023-05-07 07:13:10,491 - wikidata12k - [INFO] - [E:16| 2300]: Train Loss:0.001522, Val MRR:0.40803, wikidata12k
2023-05-07 07:15:16,058 - wikidata12k - [INFO] - [E:16| 2400]: Train Loss:0.0015223, Val MRR:0.40803, wikidata12k
2023-05-07 07:17:07,924 - wikidata12k - [INFO] - [E:16| 2500]: Train Loss:0.0015226, Val MRR:0.40803, wikidata12k
2023-05-07 07:19:12,063 - wikidata12k - [INFO] - [E:16| 2600]: Train Loss:0.0015222, Val MRR:0.40803, wikidata12k
2023-05-07 07:21:18,042 - wikidata12k - [INFO] - [E:16| 2700]: Train Loss:0.0015225, Val MRR:0.40803, wikidata12k
2023-05-07 07:23:23,457 - wikidata12k - [INFO] - [E:16| 2800]: Train Loss:0.0015228, Val MRR:0.40803, wikidata12k
2023-05-07 07:25:27,512 - wikidata12k - [INFO] - [E:16| 2900]: Train Loss:0.0015229, Val MRR:0.40803, wikidata12k
2023-05-07 07:27:19,484 - wikidata12k - [INFO] - [E:16| 3000]: Train Loss:0.0015232, Val MRR:0.40803, wikidata12k
2023-05-07 07:29:25,228 - wikidata12k - [INFO] - [E:16| 3100]: Train Loss:0.001523, Val MRR:0.40803, wikidata12k
2023-05-07 07:31:30,583 - wikidata12k - [INFO] - [E:16| 3200]: Train Loss:0.0015231, Val MRR:0.40803, wikidata12k
2023-05-07 07:33:35,806 - wikidata12k - [INFO] - [E:16| 3300]: Train Loss:0.0015233, Val MRR:0.40803, wikidata12k
2023-05-07 07:35:26,749 - wikidata12k - [INFO] - [E:16| 3400]: Train Loss:0.0015237, Val MRR:0.40803, wikidata12k
2023-05-07 07:37:32,310 - wikidata12k - [INFO] - [E:16| 3500]: Train Loss:0.0015242, Val MRR:0.40803, wikidata12k
2023-05-07 07:39:37,628 - wikidata12k - [INFO] - [E:16| 3600]: Train Loss:0.0015245, Val MRR:0.40803, wikidata12k
2023-05-07 07:41:42,238 - wikidata12k - [INFO] - [E:16| 3700]: Train Loss:0.0015247, Val MRR:0.40803, wikidata12k
2023-05-07 07:43:33,556 - wikidata12k - [INFO] - [E:16| 3800]: Train Loss:0.0015248, Val MRR:0.40803, wikidata12k
2023-05-07 07:43:34,817 - wikidata12k - [INFO] - {'dataset': 'FB15k-237', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 07:44:58,003 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 07:45:36,884 - wikidata12k - [INFO] - [E:16| 3900]: Train Loss:0.0015248, Val MRR:0.40803, wikidata12k
2023-05-07 07:45:45,235 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 07:46:29,595 - wikidata12k - [INFO] - [Epoch:16]: Training Loss:0.001525
2023-05-07 07:46:29,984 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 07:47:08,306 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 07:47:31,544 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 07:48:10,713 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 07:48:32,273 - wikidata12k - [INFO] - [Evaluating Epoch 16 valid]:
MRR: Tail : 0.46673, Head : 0.27508, Avg : 0.3709
2023-05-07 07:48:32,274 - wikidata12k - [INFO] - [Epoch 16]: Training Loss: 0.001525, Valid MRR: 0.40803,
2023-05-07 07:48:33,630 - wikidata12k - [INFO] - [E:17| 0]: Train Loss:0.001513, Val MRR:0.40803, wikidata12k
2023-05-07 07:50:38,596 - wikidata12k - [INFO] - [E:17| 100]: Train Loss:0.0015144, Val MRR:0.40803, wikidata12k
2023-05-07 07:51:01,971 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 07:52:30,107 - wikidata12k - [INFO] - [E:17| 200]: Train Loss:0.0015077, Val MRR:0.40803, wikidata12k
2023-05-07 07:54:36,035 - wikidata12k - [INFO] - [E:17| 300]: Train Loss:0.0015074, Val MRR:0.40803, wikidata12k
2023-05-07 07:56:40,364 - wikidata12k - [INFO] - [E:17| 400]: Train Loss:0.0015085, Val MRR:0.40803, wikidata12k
2023-05-07 07:58:45,933 - wikidata12k - [INFO] - [E:17| 500]: Train Loss:0.0015081, Val MRR:0.40803, wikidata12k
2023-05-07 08:00:38,258 - wikidata12k - [INFO] - [E:17| 600]: Train Loss:0.0015064, Val MRR:0.40803, wikidata12k
2023-05-07 08:02:42,835 - wikidata12k - [INFO] - [E:17| 700]: Train Loss:0.0015066, Val MRR:0.40803, wikidata12k
2023-05-07 08:03:04,535 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:04:48,673 - wikidata12k - [INFO] - [E:17| 800]: Train Loss:0.0015073, Val MRR:0.40803, wikidata12k
2023-05-07 08:06:52,858 - wikidata12k - [INFO] - [E:17| 900]: Train Loss:0.0015078, Val MRR:0.40803, wikidata12k
2023-05-07 08:07:15,623 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': False}
2023-05-07 08:08:44,620 - wikidata12k - [INFO] - [E:17| 1000]: Train Loss:0.0015085, Val MRR:0.40803, wikidata12k
2023-05-07 08:10:49,986 - wikidata12k - [INFO] - [E:17| 1100]: Train Loss:0.001509, Val MRR:0.40803, wikidata12k
2023-05-07 08:12:54,143 - wikidata12k - [INFO] - [E:17| 1200]: Train Loss:0.0015083, Val MRR:0.40803, wikidata12k
2023-05-07 08:13:31,569 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:14:59,682 - wikidata12k - [INFO] - [E:17| 1300]: Train Loss:0.0015092, Val MRR:0.40803, wikidata12k
2023-05-07 08:15:18,899 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:16:14,562 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:16:59,575 - wikidata12k - [INFO] - [E:17| 1400]: Train Loss:0.0015095, Val MRR:0.40803, wikidata12k
2023-05-07 08:17:10,776 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:18:56,555 - wikidata12k - [INFO] - [E:17| 1500]: Train Loss:0.0015088, Val MRR:0.40803, wikidata12k
2023-05-07 08:21:01,748 - wikidata12k - [INFO] - [E:17| 1600]: Train Loss:0.0015096, Val MRR:0.40803, wikidata12k
2023-05-07 08:23:07,131 - wikidata12k - [INFO] - [E:17| 1700]: Train Loss:0.0015098, Val MRR:0.40803, wikidata12k
2023-05-07 08:25:02,922 - wikidata12k - [INFO] - [E:17| 1800]: Train Loss:0.0015103, Val MRR:0.40803, wikidata12k
2023-05-07 08:25:08,233 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:26:52,690 - wikidata12k - [INFO] - [E:17| 1900]: Train Loss:0.0015105, Val MRR:0.40803, wikidata12k
2023-05-07 08:28:06,313 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:28:22,860 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:28:58,045 - wikidata12k - [INFO] - [E:17| 2000]: Train Loss:0.0015103, Val MRR:0.40803, wikidata12k
2023-05-07 08:29:59,979 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:30:21,661 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:31:04,214 - wikidata12k - [INFO] - [E:17| 2100]: Train Loss:0.0015107, Val MRR:0.40803, wikidata12k
2023-05-07 08:32:32,786 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:33:09,514 - wikidata12k - [INFO] - [E:17| 2200]: Train Loss:0.0015108, Val MRR:0.40803, wikidata12k
2023-05-07 08:34:10,687 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:34:49,648 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:35:02,538 - wikidata12k - [INFO] - [E:17| 2300]: Train Loss:0.0015114, Val MRR:0.40803, wikidata12k
2023-05-07 08:37:08,238 - wikidata12k - [INFO] - [E:17| 2400]: Train Loss:0.0015114, Val MRR:0.40803, wikidata12k
2023-05-07 08:39:13,807 - wikidata12k - [INFO] - [E:17| 2500]: Train Loss:0.0015111, Val MRR:0.40803, wikidata12k
2023-05-07 08:39:48,130 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:41:19,473 - wikidata12k - [INFO] - [E:17| 2600]: Train Loss:0.0015117, Val MRR:0.40803, wikidata12k
2023-05-07 08:43:12,143 - wikidata12k - [INFO] - [E:17| 2700]: Train Loss:0.0015116, Val MRR:0.40803, wikidata12k
2023-05-07 08:43:53,939 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:45:18,437 - wikidata12k - [INFO] - [E:17| 2800]: Train Loss:0.0015118, Val MRR:0.40803, wikidata12k
2023-05-07 08:47:24,090 - wikidata12k - [INFO] - [E:17| 2900]: Train Loss:0.0015121, Val MRR:0.40803, wikidata12k
2023-05-07 08:48:41,991 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:49:29,950 - wikidata12k - [INFO] - [E:17| 3000]: Train Loss:0.0015121, Val MRR:0.40803, wikidata12k
2023-05-07 08:51:22,687 - wikidata12k - [INFO] - [E:17| 3100]: Train Loss:0.0015123, Val MRR:0.40803, wikidata12k
2023-05-07 08:52:21,080 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-07 08:53:27,609 - wikidata12k - [INFO] - [E:17| 3200]: Train Loss:0.0015125, Val MRR:0.40803, wikidata12k
2023-05-07 08:55:33,263 - wikidata12k - [INFO] - [E:17| 3300]: Train Loss:0.0015129, Val MRR:0.40803, wikidata12k
2023-05-07 08:57:38,498 - wikidata12k - [INFO] - [E:17| 3400]: Train Loss:0.0015135, Val MRR:0.40803, wikidata12k
2023-05-07 08:59:37,635 - wikidata12k - [INFO] - [E:17| 3500]: Train Loss:0.0015139, Val MRR:0.40803, wikidata12k
2023-05-07 09:01:35,627 - wikidata12k - [INFO] - [E:17| 3600]: Train Loss:0.001514, Val MRR:0.40803, wikidata12k
2023-05-07 09:03:41,257 - wikidata12k - [INFO] - [E:17| 3700]: Train Loss:0.0015141, Val MRR:0.40803, wikidata12k
2023-05-07 09:05:45,872 - wikidata12k - [INFO] - [E:17| 3800]: Train Loss:0.0015143, Val MRR:0.40803, wikidata12k
2023-05-07 09:07:48,402 - wikidata12k - [INFO] - [E:17| 3900]: Train Loss:0.0015143, Val MRR:0.40803, wikidata12k
2023-05-07 09:08:27,473 - wikidata12k - [INFO] - [Epoch:17]: Training Loss:0.001514
2023-05-07 09:08:27,759 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 09:09:05,922 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 09:09:28,134 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 09:10:06,448 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 09:10:28,311 - wikidata12k - [INFO] - [Evaluating Epoch 17 valid]:
MRR: Tail : 0.46579, Head : 0.28206, Avg : 0.37392
2023-05-07 09:10:28,311 - wikidata12k - [INFO] - [Epoch 17]: Training Loss: 0.0015144, Valid MRR: 0.40803,
2023-05-07 09:10:29,303 - wikidata12k - [INFO] - [E:18| 0]: Train Loss:0.0014566, Val MRR:0.40803, wikidata12k
2023-05-07 09:12:33,971 - wikidata12k - [INFO] - [E:18| 100]: Train Loss:0.0014938, Val MRR:0.40803, wikidata12k
2023-05-07 09:14:39,986 - wikidata12k - [INFO] - [E:18| 200]: Train Loss:0.0014987, Val MRR:0.40803, wikidata12k
2023-05-07 09:16:46,049 - wikidata12k - [INFO] - [E:18| 300]: Train Loss:0.0014982, Val MRR:0.40803, wikidata12k
2023-05-07 09:18:36,530 - wikidata12k - [INFO] - [E:18| 400]: Train Loss:0.0014981, Val MRR:0.40803, wikidata12k
2023-05-07 09:20:42,111 - wikidata12k - [INFO] - [E:18| 500]: Train Loss:0.0014989, Val MRR:0.40803, wikidata12k
2023-05-07 09:22:48,416 - wikidata12k - [INFO] - [E:18| 600]: Train Loss:0.0014995, Val MRR:0.40803, wikidata12k
2023-05-07 09:24:53,781 - wikidata12k - [INFO] - [E:18| 700]: Train Loss:0.0014987, Val MRR:0.40803, wikidata12k
2023-05-07 09:26:44,852 - wikidata12k - [INFO] - [E:18| 800]: Train Loss:0.0014979, Val MRR:0.40803, wikidata12k
2023-05-07 09:28:49,442 - wikidata12k - [INFO] - [E:18| 900]: Train Loss:0.0014983, Val MRR:0.40803, wikidata12k
2023-05-07 09:30:54,021 - wikidata12k - [INFO] - [E:18| 1000]: Train Loss:0.0014987, Val MRR:0.40803, wikidata12k
2023-05-07 09:32:59,848 - wikidata12k - [INFO] - [E:18| 1100]: Train Loss:0.0014983, Val MRR:0.40803, wikidata12k
2023-05-07 09:34:53,011 - wikidata12k - [INFO] - [E:18| 1200]: Train Loss:0.0014985, Val MRR:0.40803, wikidata12k
2023-05-07 09:36:58,580 - wikidata12k - [INFO] - [E:18| 1300]: Train Loss:0.0014978, Val MRR:0.40803, wikidata12k
2023-05-07 09:39:01,767 - wikidata12k - [INFO] - [E:18| 1400]: Train Loss:0.0014982, Val MRR:0.40803, wikidata12k
2023-05-07 09:41:07,334 - wikidata12k - [INFO] - [E:18| 1500]: Train Loss:0.0014984, Val MRR:0.40803, wikidata12k
2023-05-07 09:42:59,243 - wikidata12k - [INFO] - [E:18| 1600]: Train Loss:0.0014986, Val MRR:0.40803, wikidata12k
2023-05-07 09:45:04,166 - wikidata12k - [INFO] - [E:18| 1700]: Train Loss:0.0014995, Val MRR:0.40803, wikidata12k
2023-05-07 09:47:07,629 - wikidata12k - [INFO] - [E:18| 1800]: Train Loss:0.0014993, Val MRR:0.40803, wikidata12k
2023-05-07 09:49:12,804 - wikidata12k - [INFO] - [E:18| 1900]: Train Loss:0.0014998, Val MRR:0.40803, wikidata12k
2023-05-07 09:51:14,651 - wikidata12k - [INFO] - [E:18| 2000]: Train Loss:0.0014999, Val MRR:0.40803, wikidata12k
2023-05-07 09:53:08,145 - wikidata12k - [INFO] - [E:18| 2100]: Train Loss:0.0015004, Val MRR:0.40803, wikidata12k
2023-05-07 09:55:07,377 - wikidata12k - [INFO] - [E:18| 2200]: Train Loss:0.0015006, Val MRR:0.40803, wikidata12k
2023-05-07 09:56:59,212 - wikidata12k - [INFO] - [E:18| 2300]: Train Loss:0.0015005, Val MRR:0.40803, wikidata12k
2023-05-07 09:59:00,700 - wikidata12k - [INFO] - [E:18| 2400]: Train Loss:0.001501, Val MRR:0.40803, wikidata12k
2023-05-07 10:00:57,198 - wikidata12k - [INFO] - [E:18| 2500]: Train Loss:0.001501, Val MRR:0.40803, wikidata12k
2023-05-07 10:03:02,347 - wikidata12k - [INFO] - [E:18| 2600]: Train Loss:0.0015011, Val MRR:0.40803, wikidata12k
2023-05-07 10:05:07,688 - wikidata12k - [INFO] - [E:18| 2700]: Train Loss:0.0015014, Val MRR:0.40803, wikidata12k
2023-05-07 10:07:12,923 - wikidata12k - [INFO] - [E:18| 2800]: Train Loss:0.001502, Val MRR:0.40803, wikidata12k
2023-05-07 10:09:05,017 - wikidata12k - [INFO] - [E:18| 2900]: Train Loss:0.0015019, Val MRR:0.40803, wikidata12k
2023-05-07 10:11:10,875 - wikidata12k - [INFO] - [E:18| 3000]: Train Loss:0.0015021, Val MRR:0.40803, wikidata12k
2023-05-07 10:13:15,603 - wikidata12k - [INFO] - [E:18| 3100]: Train Loss:0.0015022, Val MRR:0.40803, wikidata12k
2023-05-07 10:15:20,327 - wikidata12k - [INFO] - [E:18| 3200]: Train Loss:0.0015027, Val MRR:0.40803, wikidata12k
2023-05-07 10:17:11,852 - wikidata12k - [INFO] - [E:18| 3300]: Train Loss:0.0015031, Val MRR:0.40803, wikidata12k
2023-05-07 10:19:15,412 - wikidata12k - [INFO] - [E:18| 3400]: Train Loss:0.0015033, Val MRR:0.40803, wikidata12k
2023-05-07 10:21:20,155 - wikidata12k - [INFO] - [E:18| 3500]: Train Loss:0.0015033, Val MRR:0.40803, wikidata12k
2023-05-07 10:23:26,060 - wikidata12k - [INFO] - [E:18| 3600]: Train Loss:0.0015034, Val MRR:0.40803, wikidata12k
2023-05-07 10:25:16,776 - wikidata12k - [INFO] - [E:18| 3700]: Train Loss:0.0015034, Val MRR:0.40803, wikidata12k
2023-05-07 10:27:22,090 - wikidata12k - [INFO] - [E:18| 3800]: Train Loss:0.0015037, Val MRR:0.40803, wikidata12k
2023-05-07 10:29:27,793 - wikidata12k - [INFO] - [E:18| 3900]: Train Loss:0.0015038, Val MRR:0.40803, wikidata12k
2023-05-07 10:30:20,566 - wikidata12k - [INFO] - [Epoch:18]: Training Loss:0.001504
2023-05-07 10:30:21,079 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 0] wikidata12k
2023-05-07 10:30:58,926 - wikidata12k - [INFO] - [Valid, Tail_Batch Step 100] wikidata12k
2023-05-07 10:31:21,023 - wikidata12k - [INFO] - [Valid, Head_Batch Step 0] wikidata12k
2023-05-07 10:31:59,482 - wikidata12k - [INFO] - [Valid, Head_Batch Step 100] wikidata12k
2023-05-07 10:32:21,062 - wikidata12k - [INFO] - [Evaluating Epoch 18 valid]:
MRR: Tail : 0.46944, Head : 0.28318, Avg : 0.37631
2023-05-07 10:32:21,062 - wikidata12k - [INFO] - [Epoch 18]: Training Loss: 0.0015037, Valid MRR: 0.40803,
2023-05-07 10:32:22,040 - wikidata12k - [INFO] - [E:19| 0]: Train Loss:0.0014476, Val MRR:0.40803, wikidata12k
2023-05-07 10:34:12,736 - wikidata12k - [INFO] - [E:19| 100]: Train Loss:0.0014835, Val MRR:0.40803, wikidata12k
2023-05-07 10:36:18,065 - wikidata12k - [INFO] - [E:19| 200]: Train Loss:0.001486, Val MRR:0.40803, wikidata12k
2023-05-07 10:38:23,437 - wikidata12k - [INFO] - [E:19| 300]: Train Loss:0.0014869, Val MRR:0.40803, wikidata12k
2023-05-07 10:40:29,077 - wikidata12k - [INFO] - [E:19| 400]: Train Loss:0.0014836, Val MRR:0.40803, wikidata12k
2023-05-07 10:42:20,661 - wikidata12k - [INFO] - [E:19| 500]: Train Loss:0.0014835, Val MRR:0.40803, wikidata12k
2023-05-07 10:44:25,950 - wikidata12k - [INFO] - [E:19| 600]: Train Loss:0.0014842, Val MRR:0.40803, wikidata12k
2023-05-07 10:46:30,398 - wikidata12k - [INFO] - [E:19| 700]: Train Loss:0.0014849, Val MRR:0.40803, wikidata12k
2023-05-07 10:48:35,739 - wikidata12k - [INFO] - [E:19| 800]: Train Loss:0.0014857, Val MRR:0.40803, wikidata12k
2023-05-07 10:50:35,532 - wikidata12k - [INFO] - [E:19| 900]: Train Loss:0.0014857, Val MRR:0.40803, wikidata12k
2023-05-07 10:52:33,637 - wikidata12k - [INFO] - [E:19| 1000]: Train Loss:0.0014863, Val MRR:0.40803, wikidata12k
2023-05-07 10:54:39,378 - wikidata12k - [INFO] - [E:19| 1100]: Train Loss:0.001487, Val MRR:0.40803, wikidata12k
2023-05-07 10:56:45,514 - wikidata12k - [INFO] - [E:19| 1200]: Train Loss:0.0014879, Val MRR:0.40803, wikidata12k
2023-05-07 10:58:51,168 - wikidata12k - [INFO] - [E:19| 1300]: Train Loss:0.0014879, Val MRR:0.40803, wikidata12k
2023-05-07 11:00:42,777 - wikidata12k - [INFO] - [E:19| 1400]: Train Loss:0.0014882, Val MRR:0.40803, wikidata12k
2023-05-07 11:02:46,537 - wikidata12k - [INFO] - [E:19| 1500]: Train Loss:0.0014889, Val MRR:0.40803, wikidata12k
2023-05-07 11:49:05,097 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True}
2023-05-07 11:49:16,229 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
2023-05-07 11:49:53,715 - wikidata12k - [INFO] - [Test, Tail_Batch Step 100] wikidata12k
2023-05-07 11:50:12,666 - wikidata12k - [INFO] - [Test, Head_Batch Step 0] wikidata12k
2023-05-07 11:50:51,118 - wikidata12k - [INFO] - [Test, Head_Batch Step 100] wikidata12k
2023-05-07 11:51:10,340 - wikidata12k - [INFO] - [Evaluating Epoch 0 test]:
MRR: Tail : 0.42577, Head : 0.29595, Avg : 0.36086
MR: Tail : 239.1, Head : 520.46, Avg : 379.78
Hit-1: Tail : 0.30829, Head : 0.20891, Avg : 0.2586
Hit-3: Tail : 0.49769, Head : 0.32432, Avg : 0.41101
Hit-10: Tail : 0.64761, Head : 0.48228, Avg : 0.56494
2023-05-09 13:36:12,157 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-09 13:48:03,025 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-09 13:52:09,220 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-09 13:53:46,930 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
2023-05-09 13:57:57,209 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-09 13:58:12,180 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
2023-05-09 13:59:15,253 - wikidata12k - [INFO] - {'dataset': 'wikidata12k', 'name': 'wikidata12k', 'gpu': '0', 'train_strategy': 'one_to_n', 'opt': 'adam', 'neg_num': 1000, 'batch_size': 128, 'l2': 0.0, 'lr': 0.0001, 'max_epochs': 500, 'num_workers': 0, 'seed': 42, 'restore': False, 'lbl_smooth': 0.1, 'embed_dim': 400, 'ent_vec_dim': 400, 'rel_vec_dim': 400, 'bias': False, 'form': 'plain', 'k_w': 10, 'k_h': 20, 'num_filt': 96, 'ker_sz': 9, 'perm': 1, 'hid_drop': 0.5, 'feat_drop': 0.2, 'inp_drop': 0.2, 'drop_path': 0.0, 'drop': 0.0, 'in_channels': 1, 'out_channels': 32, 'filt_h': 1, 'filt_w': 9, 'image_h': 128, 'image_w': 128, 'patch_size': 8, 'mixer_dim': 256, 'expansion_factor': 4, 'expansion_factor_token': 0.5, 'mixer_depth': 16, 'mixer_dropout': 0.2, 'log_dir': './log/', 'config_dir': './config/', 'test_only': True, 'filtered': True}
2023-05-09 14:01:14,274 - wikidata12k - [INFO] - [Test, Tail_Batch Step 0] wikidata12k
Reference in New Issue Copy Permalink