Script exit with exit code 255
files: 0%| | 0/4857 [00:00<?, ?it/s]
files: 0%| | 14/4857 [00:00<00:35, 137.02it/s]
files: 1%| | 32/4857 [00:00<00:32, 147.36it/s]
files: 1%| | 47/4857 [00:00<00:32, 146.55it/s]
files: 1%| | 58/4857 [00:00<00:38, 125.64it/s]
files: 2%|▏ | 75/4857 [00:00<00:35, 134.75it/s]
files: 2%|▏ | 87/4857 [00:00<00:36, 129.13it/s]
files: 2%|▏ | 100/4857 [00:00<00:37, 127.97it/s]
files: 2%|▏ | 113/4857 [00:00<00:44, 106.76it/s]
files: 3%|▎ | 131/4857 [00:01<00:38, 121.47it/s]
files: 3%|▎ | 152/4857 [00:01<00:34, 138.05it/s]
files: 4%|▎ | 170/4857 [00:01<00:32, 146.34it/s]
files: 4%|▍ | 186/4857 [00:01<00:37, 122.94it/s]
files: 4%|▍ | 201/4857 [00:01<00:35, 129.36it/s]
files: 4%|▍ | 217/4857 [00:01<00:34, 135.85it/s]
files: 5%|▍ | 232/4857 [00:01<00:35, 130.95it/s]
files: 5%|▌ | 247/4857 [00:01<00:33, 135.60it/s]
files: 5%|▌ | 266/4857 [00:01<00:31, 146.41it/s]
files: 6%|▌ | 282/4857 [00:02<00:31, 144.94it/s]
files: 6%|▌ | 297/4857 [00:02<00:33, 135.59it/s]
files: 6%|▋ | 311/4857 [00:02<00:35, 128.92it/s]
files: 7%|▋ | 325/4857 [00:02<00:34, 131.11it/s]
files: 7%|▋ | 344/4857 [00:02<00:31, 143.00it/s]
files: 7%|▋ | 359/4857 [00:02<00:31, 144.26it/s]
files: 8%|▊ | 374/4857 [00:02<00:31, 144.47it/s]
files: 8%|▊ | 391/4857 [00:02<00:29, 150.31it/s]
files: 8%|▊ | 407/4857 [00:02<00:31, 142.98it/s]
files: 9%|▉ | 427/4857 [00:03<00:28, 155.12it/s]
files: 9%|▉ | 445/4857 [00:03<00:27, 160.28it/s]
files: 10%|▉ | 465/4857 [00:03<00:25, 169.10it/s]
files: 10%|▉ | 483/4857 [00:03<00:27, 158.20it/s]
files: 10%|█ | 501/4857 [00:03<00:26, 162.77it/s]
files: 11%|█ | 518/4857 [00:03<00:27, 156.28it/s]
files: 11%|█ | 534/4857 [00:03<00:28, 154.32it/s]
files: 11%|█▏ | 552/4857 [00:03<00:27, 159.08it/s]
files: 12%|█▏ | 569/4857 [00:03<00:28, 150.83it/s]
files: 12%|█▏ | 585/4857 [00:04<00:27, 152.91it/s]
files: 12%|█▏ | 601/4857 [00:04<00:28, 147.34it/s]
files: 13%|█▎ | 621/4857 [00:04<00:26, 159.69it/s]
files: 13%|█▎ | 639/4857 [00:04<00:25, 165.22it/s]
files: 14%|█▎ | 656/4857 [00:04<00:25, 162.53it/s]
files: 14%|█▍ | 674/4857 [00:04<00:25, 166.86it/s]
files: 14%|█▍ | 691/4857 [00:04<00:25, 164.55it/s]
files: 15%|█▍ | 708/4857 [00:04<00:25, 163.68it/s]
files: 15%|█▍ | 726/4857 [00:04<00:24, 167.39it/s]
files: 15%|█▌ | 743/4857 [00:04<00:26, 156.75it/s]
files: 16%|█▌ | 759/4857 [00:05<00:27, 147.10it/s]
files: 16%|█▌ | 774/4857 [00:05<00:33, 122.83it/s]
files: 16%|█▌ | 789/4857 [00:05<00:31, 127.67it/s]
files: 17%|█▋ | 804/4857 [00:05<00:30, 132.73it/s]
files: 17%|█▋ | 818/4857 [00:05<00:32, 123.36it/s]
files: 17%|█▋ | 834/4857 [00:05<00:31, 129.62it/s]
files: 17%|█▋ | 848/4857 [00:05<00:31, 126.94it/s]
files: 18%|█▊ | 864/4857 [00:05<00:30, 131.78it/s]
files: 18%|█▊ | 880/4857 [00:06<00:28, 139.08it/s]
files: 18%|█▊ | 895/4857 [00:06<00:33, 118.53it/s]
files: 19%|█▉ | 911/4857 [00:06<00:30, 127.96it/s]
files: 19%|█▉ | 925/4857 [00:06<00:31, 124.33it/s]
files: 19%|█▉ | 942/4857 [00:06<00:29, 134.66it/s]
files: 20%|█▉ | 957/4857 [00:06<00:28, 137.71it/s]
files: 20%|██ | 972/4857 [00:06<00:27, 140.16it/s]
files: 20%|██ | 987/4857 [00:06<00:27, 142.87it/s]
files: 21%|██ | 1002/4857 [00:06<00:28, 135.57it/s]
files: 21%|██ | 1018/4857 [00:07<00:27, 138.85it/s]
files: 21%|██▏ | 1034/4857 [00:07<00:27, 137.39it/s]
files: 22%|██▏ | 1053/4857 [00:07<00:25, 148.16it/s]
files: 22%|██▏ | 1070/4857 [00:07<00:24, 153.31it/s]
files: 22%|██▏ | 1086/4857 [00:07<00:24, 152.47it/s]
files: 23%|██▎ | 1102/4857 [00:07<00:29, 125.57it/s]
files: 23%|██▎ | 1118/4857 [00:07<00:27, 133.78it/s]
files: 23%|██▎ | 1133/4857 [00:07<00:26, 138.12it/s]
files: 24%|██▎ | 1148/4857 [00:08<00:27, 134.33it/s]
files: 24%|██▍ | 1162/4857 [00:08<00:29, 124.71it/s]
files: 24%|██▍ | 1177/4857 [00:08<00:28, 129.71it/s]
files: 25%|██▍ | 1191/4857 [00:08<00:28, 127.30it/s]
files: 25%|██▍ | 1208/4857 [00:08<00:26, 135.27it/s]
files: 25%|██▌ | 1226/4857 [00:08<00:25, 144.18it/s]
files: 26%|██▌ | 1242/4857 [00:08<00:24, 147.09it/s]
files: 26%|██▌ | 1257/4857 [00:08<00:24, 146.11it/s]
files: 26%|██▌ | 1272/4857 [00:08<00:26, 134.09it/s]
files: 27%|██▋ | 1290/4857 [00:09<00:24, 144.06it/s]
files: 27%|██▋ | 1306/4857 [00:09<00:25, 141.33it/s]
files: 27%|██▋ | 1323/4857 [00:09<00:23, 148.37it/s]
files: 28%|██▊ | 1339/4857 [00:09<00:24, 141.58it/s]
files: 28%|██▊ | 1357/4857 [00:09<00:23, 150.89it/s]
files: 28%|██▊ | 1374/4857 [00:09<00:22, 155.76it/s]
files: 29%|██▊ | 1392/4857 [00:09<00:21, 160.53it/s]
files: 29%|██▉ | 1410/4857 [00:09<00:20, 164.70it/s]
files: 29%|██▉ | 1427/4857 [00:09<00:21, 159.16it/s]
files: 30%|██▉ | 1447/4857 [00:10<00:20, 168.31it/s]
files: 30%|███ | 1465/4857 [00:10<00:19, 170.77it/s]
files: 31%|███ | 1487/4857 [00:10<00:18, 180.29it/s]
files: 31%|███ | 1507/4857 [00:10<00:18, 185.00it/s]
files: 31%|███▏ | 1528/4857 [00:10<00:17, 187.67it/s]
files: 32%|███▏ | 1547/4857 [00:10<00:17, 185.63it/s]
files: 32%|███▏ | 1570/4857 [00:10<00:16, 195.69it/s]
files: 33%|███▎ | 1590/4857 [00:10<00:18, 180.16it/s]
files: 33%|███▎ | 1609/4857 [00:10<00:20, 159.43it/s]
files: 34%|███▎ | 1629/4857 [00:11<00:19, 168.23it/s]
files: 34%|███▍ | 1647/4857 [00:11<00:20, 157.80it/s]
files: 34%|███▍ | 1667/4857 [00:11<00:19, 167.02it/s]
files: 35%|███▍ | 1685/4857 [00:11<00:18, 167.57it/s]
files: 35%|███▌ | 1703/4857 [00:11<00:18, 166.54it/s]
files: 35%|███▌ | 1720/4857 [00:11<00:18, 165.58it/s]
files: 36%|███▌ | 1738/4857 [00:11<00:18, 168.89it/s]
files: 36%|███▌ | 1758/4857 [00:11<00:17, 175.26it/s]
files: 37%|███▋ | 1776/4857 [00:11<00:17, 172.13it/s]
files: 37%|███▋ | 1800/4857 [00:11<00:16, 186.77it/s]
files: 37%|███▋ | 1820/4857 [00:12<00:16, 186.19it/s]
files: 38%|███▊ | 1839/4857 [00:12<00:16, 180.08it/s]
files: 38%|███▊ | 1858/4857 [00:12<00:16, 176.52it/s]
files: 39%|███▊ | 1876/4857 [00:12<00:17, 168.63it/s]
files: 39%|███▉ | 1894/4857 [00:12<00:17, 165.66it/s]
files: 39%|███▉ | 1911/4857 [00:12<00:18, 159.32it/s]
files: 40%|███▉ | 1928/4857 [00:12<00:18, 158.30it/s]
files: 40%|████ | 1949/4857 [00:12<00:17, 168.83it/s]
files: 40%|████ | 1967/4857 [00:13<00:17, 168.14it/s]
files: 41%|████ | 1988/4857 [00:13<00:16, 176.73it/s]
files: 41%|████▏ | 2006/4857 [00:13<00:17, 165.65it/s]
files: 42%|████▏ | 2026/4857 [00:13<00:16, 173.83it/s]
files: 42%|████▏ | 2044/4857 [00:13<00:16, 168.33it/s]
files: 42%|████▏ | 2062/4857 [00:13<00:17, 158.33it/s]
files: 43%|████▎ | 2079/4857 [00:13<00:17, 159.32it/s]
files: 43%|████▎ | 2096/4857 [00:13<00:17, 157.76it/s]
files: 44%|████▎ | 2116/4857 [00:13<00:16, 167.79it/s]
files: 44%|████▍ | 2138/4857 [00:13<00:15, 179.81it/s]
files: 44%|████▍ | 2157/4857 [00:14<00:14, 180.13it/s]
files: 45%|████▍ | 2177/4857 [00:14<00:14, 183.69it/s]
files: 45%|████▌ | 2196/4857 [00:14<00:15, 171.25it/s]
files: 46%|████▌ | 2214/4857 [00:14<00:16, 156.05it/s]
files: 46%|████▌ | 2232/4857 [00:14<00:16, 160.46it/s]
files: 46%|████▋ | 2252/4857 [00:14<00:15, 169.22it/s]
files: 47%|████▋ | 2270/4857 [00:14<00:15, 171.92it/s]
files: 47%|████▋ | 2290/4857 [00:14<00:14, 178.09it/s]
files: 48%|████▊ | 2311/4857 [00:14<00:13, 185.09it/s]
files: 48%|████▊ | 2330/4857 [00:15<00:14, 175.20it/s]
files: 48%|████▊ | 2348/4857 [00:15<00:15, 167.01it/s]
files: 49%|████▊ | 2365/4857 [00:15<00:15, 160.65it/s]
files: 49%|████▉ | 2384/4857 [00:15<00:14, 167.90it/s]
files: 49%|████▉ | 2403/4857 [00:15<00:14, 172.90it/s]
files: 50%|████▉ | 2421/4857 [00:15<00:14, 173.50it/s]
files: 50%|█████ | 2439/4857 [00:15<00:14, 170.80it/s]
files: 51%|█████ | 2457/4857 [00:15<00:16, 146.78it/s]
files: 51%|█████ | 2477/4857 [00:16<00:15, 157.55it/s]
files: 51%|█████▏ | 2495/4857 [00:16<00:14, 162.03it/s]
files: 52%|█████▏ | 2512/4857 [00:16<00:15, 152.00it/s]
files: 52%|█████▏ | 2528/4857 [00:16<00:15, 151.21it/s]
files: 52%|█████▏ | 2547/4857 [00:16<00:14, 159.25it/s]
files: 53%|█████▎ | 2564/4857 [00:16<00:14, 158.32it/s]
files: 53%|█████▎ | 2581/4857 [00:16<00:14, 161.57it/s]
files: 53%|█████▎ | 2598/4857 [00:16<00:14, 156.34it/s]
files: 54%|█████▍ | 2614/4857 [00:16<00:14, 154.16it/s]
files: 54%|█████▍ | 2635/4857 [00:17<00:13, 166.21it/s]
files: 55%|█████▍ | 2653/4857 [00:17<00:13, 169.20it/s]
files: 55%|█████▌ | 2672/4857 [00:17<00:12, 173.54it/s]
files: 55%|█████▌ | 2690/4857 [00:17<00:13, 165.73it/s]
files: 56%|█████▌ | 2708/4857 [00:17<00:12, 169.29it/s]
files: 56%|█████▌ | 2727/4857 [00:17<00:12, 174.80it/s]
files: 57%|█████▋ | 2745/4857 [00:17<00:12, 173.65it/s]
files: 57%|█████▋ | 2763/4857 [00:17<00:12, 172.54it/s]
files: 57%|█████▋ | 2784/4857 [00:17<00:11, 181.70it/s]
files: 58%|█████▊ | 2803/4857 [00:17<00:12, 165.88it/s]
files: 58%|█████▊ | 2822/4857 [00:18<00:11, 169.63it/s]
files: 58%|█████▊ | 2840/4857 [00:18<00:12, 164.85it/s]
files: 59%|█████▉ | 2859/4857 [00:18<00:11, 169.46it/s]
files: 59%|█████▉ | 2877/4857 [00:18<00:12, 160.10it/s]
files: 60%|█████▉ | 2894/4857 [00:18<00:12, 152.39it/s]
files: 60%|█████▉ | 2911/4857 [00:18<00:12, 155.97it/s]
files: 60%|██████ | 2932/4857 [00:18<00:11, 165.11it/s]
files: 61%|██████ | 2951/4857 [00:18<00:11, 166.67it/s]
files: 61%|██████ | 2968/4857 [00:18<00:11, 166.77it/s]
files: 61%|██████▏ | 2987/4857 [00:19<00:10, 172.26it/s]
files: 62%|██████▏ | 3005/4857 [00:19<00:11, 164.86it/s]
files: 62%|██████▏ | 3022/4857 [00:19<00:11, 159.70it/s]
files: 63%|██████▎ | 3039/4857 [00:19<00:12, 150.57it/s]
files: 63%|██████▎ | 3055/4857 [00:19<00:12, 149.31it/s]
files: 63%|██████▎ | 3071/4857 [00:19<00:12, 138.04it/s]
files: 64%|██████▎ | 3086/4857 [00:19<00:12, 139.71it/s]
files: 64%|██████▍ | 3101/4857 [00:19<00:12, 136.86it/s]
files: 64%|██████▍ | 3120/4857 [00:20<00:11, 147.64it/s]
files: 65%|██████▍ | 3136/4857 [00:20<00:11, 147.18it/s]
files: 65%|██████▍ | 3157/4857 [00:20<00:10, 159.18it/s]
files: 65%|██████▌ | 3174/4857 [00:20<00:11, 147.71it/s]
files: 66%|██████▌ | 3190/4857 [00:20<00:11, 140.88it/s]
files: 66%|██████▌ | 3207/4857 [00:20<00:11, 147.16it/s]
files: 66%|██████▋ | 3225/4857 [00:20<00:10, 154.69it/s]
files: 67%|██████▋ | 3245/4857 [00:20<00:09, 165.64it/s]
files: 67%|██████▋ | 3263/4857 [00:20<00:09, 161.94it/s]
files: 68%|██████▊ | 3284/4857 [00:21<00:09, 170.77it/s]
files: 68%|██████▊ | 3302/4857 [00:21<00:09, 172.11it/s]
files: 68%|██████▊ | 3321/4857 [00:21<00:08, 176.17it/s]
files: 69%|██████▉ | 3341/4857 [00:21<00:08, 179.97it/s]
files: 69%|██████▉ | 3360/4857 [00:21<00:09, 156.52it/s]
files: 70%|██████▉ | 3377/4857 [00:21<00:09, 158.24it/s]
files: 70%|██████▉ | 3394/4857 [00:21<00:09, 154.03it/s]
files: 70%|███████ | 3417/4857 [00:21<00:08, 166.62it/s]
files: 71%|███████ | 3435/4857 [00:21<00:09, 156.98it/s]
files: 71%|███████ | 3456/4857 [00:22<00:08, 167.62it/s]
files: 72%|███████▏ | 3474/4857 [00:22<00:12, 115.07it/s]
files: 72%|███████▏ | 3492/4857 [00:22<00:10, 127.33it/s]
files: 72%|███████▏ | 3509/4857 [00:22<00:09, 136.72it/s]
files: 73%|███████▎ | 3527/4857 [00:22<00:09, 147.27it/s]
files: 73%|███████▎ | 3547/4857 [00:22<00:08, 159.32it/s]
files: 73%|███████▎ | 3565/4857 [00:22<00:08, 152.55it/s]
files: 74%|███████▎ | 3582/4857 [00:22<00:08, 156.41it/s]
files: 74%|███████▍ | 3602/4857 [00:23<00:07, 164.48it/s]
files: 75%|███████▍ | 3621/4857 [00:23<00:07, 170.47it/s]
files: 75%|███████▍ | 3642/4857 [00:23<00:06, 180.27it/s]
files: 75%|███████▌ | 3662/4857 [00:23<00:06, 180.76it/s]
files: 76%|███████▌ | 3681/4857 [00:23<00:08, 137.57it/s]
files: 76%|███████▌ | 3697/4857 [00:23<00:09, 126.18it/s]
files: 76%|███████▋ | 3712/4857 [00:23<00:08, 131.15it/s]
files: 77%|███████▋ | 3731/4857 [00:23<00:07, 143.56it/s]
files: 77%|███████▋ | 3749/4857 [00:24<00:07, 151.28it/s]
files: 78%|███████▊ | 3770/4857 [00:24<00:06, 163.92it/s]
files: 78%|███████▊ | 3788/4857 [00:24<00:06, 154.31it/s]
files: 78%|███████▊ | 3808/4857 [00:24<00:06, 163.62it/s]
files: 79%|███████▉ | 3826/4857 [00:24<00:06, 158.28it/s]
files: 79%|███████▉ | 3845/4857 [00:24<00:06, 166.49it/s]
files: 80%|███████▉ | 3866/4857 [00:24<00:05, 177.50it/s]
files: 80%|███████▉ | 3885/4857 [00:24<00:05, 170.09it/s]
files: 80%|████████ | 3903/4857 [00:25<00:06, 148.98it/s]
files: 81%|████████ | 3919/4857 [00:25<00:06, 147.52it/s]
files: 81%|████████ | 3935/4857 [00:25<00:06, 146.43it/s]
files: 81%|████████▏ | 3952/4857 [00:25<00:06, 149.92it/s]
files: 82%|████████▏ | 3970/4857 [00:25<00:05, 156.25it/s]
files: 82%|████████▏ | 3986/4857 [00:25<00:05, 153.27it/s]
files: 82%|████████▏ | 4003/4857 [00:25<00:05, 157.59it/s]
files: 83%|████████▎ | 4019/4857 [00:25<00:05, 157.71it/s]
files: 83%|████████▎ | 4037/4857 [00:25<00:05, 161.55it/s]
files: 83%|████████▎ | 4054/4857 [00:26<00:05, 140.25it/s]
files: 84%|████████▍ | 4069/4857 [00:26<00:06, 130.95it/s]
files: 84%|████████▍ | 4089/4857 [00:26<00:05, 145.20it/s]
files: 85%|████████▍ | 4105/4857 [00:26<00:05, 147.58it/s]
files: 85%|████████▍ | 4121/4857 [00:26<00:04, 150.68it/s]
files: 85%|████████▌ | 4140/4857 [00:26<00:04, 159.43it/s]
files: 86%|████████▌ | 4160/4857 [00:26<00:04, 168.37it/s]
files: 86%|████████▌ | 4180/4857 [00:26<00:03, 174.56it/s]
files: 86%|████████▋ | 4199/4857 [00:26<00:03, 178.31it/s]
files: 87%|████████▋ | 4218/4857 [00:27<00:03, 164.91it/s]
files: 87%|████████▋ | 4235/4857 [00:27<00:03, 164.24it/s]
files: 88%|████████▊ | 4254/4857 [00:27<00:03, 168.46it/s]
files: 88%|████████▊ | 4272/4857 [00:27<00:03, 165.67it/s]
files: 88%|████████▊ | 4290/4857 [00:27<00:03, 166.97it/s]
files: 89%|████████▊ | 4307/4857 [00:27<00:03, 154.09it/s]
files: 89%|████████▉ | 4324/4857 [00:27<00:03, 157.53it/s]
files: 89%|████████▉ | 4340/4857 [00:27<00:03, 156.50it/s]
files: 90%|████████▉ | 4359/4857 [00:27<00:03, 164.72it/s]
files: 90%|█████████ | 4379/4857 [00:27<00:02, 173.70it/s]
files: 91%|█████████ | 4397/4857 [00:28<00:02, 164.64it/s]
files: 91%|█████████ | 4416/4857 [00:28<00:02, 169.04it/s]
files: 91%|█████████▏| 4434/4857 [00:28<00:02, 155.06it/s]
files: 92%|█████████▏| 4451/4857 [00:28<00:02, 156.87it/s]
files: 92%|█████████▏| 4471/4857 [00:28<00:02, 166.54it/s]
files: 92%|█████████▏| 4489/4857 [00:28<00:02, 167.14it/s]
files: 93%|█████████▎| 4509/4857 [00:28<00:01, 175.61it/s]
files: 93%|█████████▎| 4531/4857 [00:28<00:01, 185.75it/s]
files: 94%|█████████▎| 4550/4857 [00:28<00:01, 186.27it/s]
files: 94%|█████████▍| 4569/4857 [00:29<00:01, 180.89it/s]
files: 94%|█████████▍| 4588/4857 [00:29<00:01, 180.87it/s]
files: 95%|█████████▍| 4607/4857 [00:29<00:01, 175.55it/s]
files: 95%|█████████▌| 4625/4857 [00:29<00:01, 173.30it/s]
files: 96%|█████████▌| 4643/4857 [00:29<00:01, 161.08it/s]
files: 96%|█████████▌| 4660/4857 [00:29<00:01, 128.59it/s]
files: 96%|█████████▋| 4677/4857 [00:29<00:01, 138.02it/s]
files: 97%|█████████▋| 4692/4857 [00:29<00:01, 138.61it/s]
files: 97%|█████████▋| 4707/4857 [00:30<00:01, 129.02it/s]
files: 97%|█████████▋| 4721/4857 [00:30<00:01, 124.92it/s]
files: 98%|█████████▊| 4738/4857 [00:30<00:00, 135.36it/s]
files: 98%|█████████▊| 4756/4857 [00:30<00:00, 145.69it/s]
files: 98%|█████████▊| 4774/4857 [00:30<00:00, 153.83it/s]
files: 99%|█████████▊| 4791/4857 [00:30<00:00, 156.58it/s]
files: 99%|█████████▉| 4812/4857 [00:30<00:00, 168.87it/s]
files: 99%|█████████▉| 4830/4857 [00:30<00:00, 166.65it/s]
files: 100%|█████████▉| 4848/4857 [00:30<00:00, 161.03it/s]
files: 100%|██████████| 4857/4857 [00:30<00:00, 156.72it/s][18021] Failed to execute script tgnews
Traceback (most recent call last):
File "src/tgnews.py", line 73, in <module>
out_json = run_algo(algo, html_features, include_languages, min_text_len)
File "src/tgnews.py", line 52, in run_algo
min_text_len)
File "src/threads.py", line 77, in cluster_news
**vect_params)
File "src/rgutils/nlp.py", line 77, in vectorize_text
vectorizer.fit(data[0])
File "site-packages/sklearn/feature_extraction/text.py", line 1631, in fit
File "site-packages/sklearn/feature_extraction/text.py", line 1075, in fit_transform
ValueError: max_df corresponds to < documents than min_df