nohup: ignoring input === ./data/debi-output_november.txt === [debi-output_november.txt] 200,000 lines read | 199,995 valid | 5 rejected | 0 inserted | 69 lines/s [debi-output_november.txt] 400,000 lines read | 399,984 valid | 16 rejected | 0 inserted | 72 lines/s [debi-output_november.txt] 600,000 lines read | 599,982 valid | 18 rejected | 0 inserted | 73 lines/s [debi-output_november.txt] 800,000 lines read | 799,974 valid | 26 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 1,000,000 lines read | 999,968 valid | 32 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 1,200,000 lines read | 1,199,952 valid | 48 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 1,400,000 lines read | 1,399,944 valid | 56 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 1,600,000 lines read | 1,599,936 valid | 64 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 1,800,000 lines read | 1,799,929 valid | 71 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 2,000,000 lines read | 1,999,923 valid | 77 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 2,200,000 lines read | 2,199,918 valid | 82 rejected | 0 inserted | 78 lines/s [debi-output_november.txt] 2,400,000 lines read | 2,399,910 valid | 90 rejected | 0 inserted | 78 lines/s [debi-output_november.txt] 2,600,000 lines read | 2,599,904 valid | 96 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 2,800,000 lines read | 2,799,898 valid | 102 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 3,000,000 lines read | 2,999,890 valid | 110 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 3,200,000 lines read | 3,199,885 valid | 115 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 3,400,000 lines read | 3,399,882 valid | 118 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 3,600,000 lines read | 3,599,878 valid | 122 rejected | 0 inserted | 78 lines/s [debi-output_november.txt] 3,800,000 lines read | 3,799,866 valid | 134 rejected | 0 inserted | 78 lines/s [debi-output_november.txt] 4,000,000 lines read | 3,999,854 valid | 146 rejected | 0 inserted | 79 lines/s [debi-output_november.txt] 4,200,000 lines read | 4,199,846 valid | 154 rejected | 0 inserted | 79 lines/s [debi-output_november.txt] 4,400,000 lines read | 4,399,835 valid | 165 rejected | 0 inserted | 79 lines/s [debi-output_november.txt] 4,600,000 lines read | 4,599,819 valid | 181 rejected | 0 inserted | 80 lines/s [debi-output_november.txt] 4,800,000 lines read | 4,799,808 valid | 192 rejected | 0 inserted | 80 lines/s [debi-output_november.txt] 5,000,000 lines read | 4,999,800 valid | 200 rejected | 0 inserted | 80 lines/s [debi-output_november.txt] 5,200,000 lines read | 5,199,791 valid | 209 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 5,400,000 lines read | 5,399,779 valid | 221 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 5,600,000 lines read | 5,599,773 valid | 227 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 5,800,000 lines read | 5,799,765 valid | 235 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 6,000,000 lines read | 5,999,760 valid | 240 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 6,200,000 lines read | 6,199,755 valid | 245 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 6,400,000 lines read | 6,399,747 valid | 253 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 6,600,000 lines read | 6,599,739 valid | 261 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 6,800,000 lines read | 6,799,736 valid | 264 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 7,000,000 lines read | 6,999,728 valid | 272 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 7,200,000 lines read | 7,199,716 valid | 284 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 7,400,000 lines read | 7,399,705 valid | 295 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 7,600,000 lines read | 7,599,696 valid | 304 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 7,800,000 lines read | 7,799,689 valid | 311 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 8,000,000 lines read | 7,999,684 valid | 316 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 8,200,000 lines read | 8,199,681 valid | 319 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 8,400,000 lines read | 8,399,672 valid | 328 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 8,600,000 lines read | 8,599,667 valid | 333 rejected | 0 inserted | 81 lines/s [debi-output_november.txt] 8,800,000 lines read | 8,799,659 valid | 341 rejected | 0 inserted | 80 lines/s [debi-output_november.txt] 9,000,000 lines read | 8,999,649 valid | 351 rejected | 0 inserted | 80 lines/s [debi-output_november.txt] 9,200,000 lines read | 9,199,642 valid | 358 rejected | 0 inserted | 80 lines/s [debi-output_november.txt] 9,400,000 lines read | 9,399,636 valid | 364 rejected | 0 inserted | 80 lines/s [debi-output_november.txt] 9,600,000 lines read | 9,599,626 valid | 374 rejected | 0 inserted | 79 lines/s [debi-output_november.txt] 9,800,000 lines read | 9,799,615 valid | 385 rejected | 0 inserted | 78 lines/s [debi-output_november.txt] 10,000,000 lines read | 9,999,607 valid | 393 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 10,200,000 lines read | 10,199,601 valid | 399 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 10,400,000 lines read | 10,399,594 valid | 406 rejected | 0 inserted | 73 lines/s [debi-output_november.txt] 10,600,000 lines read | 10,599,585 valid | 415 rejected | 0 inserted | 73 lines/s [debi-output_november.txt] 10,800,000 lines read | 10,799,573 valid | 427 rejected | 0 inserted | 73 lines/s [debi-output_november.txt] 11,000,000 lines read | 10,999,563 valid | 437 rejected | 0 inserted | 73 lines/s [debi-output_november.txt] 11,200,000 lines read | 11,199,553 valid | 447 rejected | 0 inserted | 73 lines/s [debi-output_november.txt] 11,400,000 lines read | 11,399,544 valid | 456 rejected | 0 inserted | 73 lines/s [debi-output_november.txt] 11,600,000 lines read | 11,599,538 valid | 462 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 11,800,000 lines read | 11,799,529 valid | 471 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 12,000,000 lines read | 11,999,522 valid | 478 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 12,200,000 lines read | 12,199,515 valid | 485 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 12,400,000 lines read | 12,399,512 valid | 488 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 12,600,000 lines read | 12,599,510 valid | 490 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 12,800,000 lines read | 12,799,507 valid | 493 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 13,000,000 lines read | 12,999,497 valid | 503 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 13,200,000 lines read | 13,199,487 valid | 513 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 13,400,000 lines read | 13,399,473 valid | 527 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 13,600,000 lines read | 13,599,461 valid | 539 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 13,800,000 lines read | 13,799,454 valid | 546 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 14,000,000 lines read | 13,999,452 valid | 548 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 14,200,000 lines read | 14,199,446 valid | 554 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 14,400,000 lines read | 14,399,440 valid | 560 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 14,600,000 lines read | 14,599,435 valid | 565 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 14,800,000 lines read | 14,799,427 valid | 573 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 15,000,000 lines read | 14,999,422 valid | 578 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 15,200,000 lines read | 15,199,419 valid | 581 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 15,400,000 lines read | 15,399,414 valid | 586 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 15,600,000 lines read | 15,599,408 valid | 592 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 15,800,000 lines read | 15,799,402 valid | 598 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 16,000,000 lines read | 15,999,394 valid | 606 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 16,200,000 lines read | 16,199,392 valid | 608 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 16,400,000 lines read | 16,399,387 valid | 613 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 16,600,000 lines read | 16,599,383 valid | 617 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 16,800,000 lines read | 16,799,380 valid | 620 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 17,000,000 lines read | 16,999,373 valid | 627 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 17,200,000 lines read | 17,199,364 valid | 636 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 17,400,000 lines read | 17,399,358 valid | 642 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 17,600,000 lines read | 17,599,348 valid | 652 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 17,800,000 lines read | 17,799,341 valid | 659 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 18,000,000 lines read | 17,999,332 valid | 668 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 18,200,000 lines read | 18,199,328 valid | 672 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 18,400,000 lines read | 18,399,320 valid | 680 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 18,600,000 lines read | 18,599,311 valid | 689 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 18,800,000 lines read | 18,799,306 valid | 694 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 19,000,000 lines read | 18,999,297 valid | 703 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 19,200,000 lines read | 19,199,288 valid | 712 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 19,400,000 lines read | 19,399,281 valid | 719 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 19,600,000 lines read | 19,599,275 valid | 725 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 19,800,000 lines read | 19,799,272 valid | 728 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 20,000,000 lines read | 19,999,262 valid | 738 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 20,200,000 lines read | 20,199,255 valid | 745 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 20,400,000 lines read | 20,399,253 valid | 747 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 20,600,000 lines read | 20,599,250 valid | 750 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 20,800,000 lines read | 20,799,239 valid | 761 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 21,000,000 lines read | 20,999,232 valid | 768 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 21,200,000 lines read | 21,199,229 valid | 771 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 21,400,000 lines read | 21,399,223 valid | 777 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 21,600,000 lines read | 21,599,221 valid | 779 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 21,800,000 lines read | 21,799,217 valid | 783 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 22,000,000 lines read | 21,999,206 valid | 794 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 22,200,000 lines read | 22,199,201 valid | 799 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 22,400,000 lines read | 22,399,193 valid | 807 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 22,600,000 lines read | 22,599,190 valid | 810 rejected | 0 inserted | 74 lines/s [debi-output_november.txt] 22,800,000 lines read | 22,799,182 valid | 818 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 23,000,000 lines read | 22,999,166 valid | 834 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 23,200,000 lines read | 23,199,162 valid | 838 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 23,400,000 lines read | 23,399,158 valid | 842 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 23,600,000 lines read | 23,599,149 valid | 851 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 23,800,000 lines read | 23,799,141 valid | 859 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 24,000,000 lines read | 23,999,133 valid | 867 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 24,200,000 lines read | 24,199,126 valid | 874 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 24,400,000 lines read | 24,399,122 valid | 878 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 24,600,000 lines read | 24,599,112 valid | 888 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 24,800,000 lines read | 24,799,106 valid | 894 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 25,000,000 lines read | 24,999,094 valid | 906 rejected | 0 inserted | 75 lines/s [debi-output_november.txt] 25,200,000 lines read | 25,199,090 valid | 910 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 25,400,000 lines read | 25,399,083 valid | 917 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 25,600,000 lines read | 25,599,077 valid | 923 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 25,800,000 lines read | 25,799,070 valid | 930 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 26,000,000 lines read | 25,999,066 valid | 934 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 26,200,000 lines read | 26,199,059 valid | 941 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 26,400,000 lines read | 26,399,053 valid | 947 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 26,600,000 lines read | 26,599,046 valid | 954 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 26,800,000 lines read | 26,799,040 valid | 960 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 27,000,000 lines read | 26,999,036 valid | 964 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 27,200,000 lines read | 27,199,030 valid | 970 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 27,400,000 lines read | 27,399,027 valid | 973 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 27,600,000 lines read | 27,599,017 valid | 983 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 27,800,000 lines read | 27,799,006 valid | 994 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 28,000,000 lines read | 27,999,005 valid | 995 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 28,200,000 lines read | 28,198,995 valid | 1,005 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 28,400,000 lines read | 28,398,989 valid | 1,011 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 28,600,000 lines read | 28,598,982 valid | 1,018 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 28,800,000 lines read | 28,798,974 valid | 1,026 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 29,000,000 lines read | 28,998,969 valid | 1,031 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 29,200,000 lines read | 29,198,961 valid | 1,039 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 29,400,000 lines read | 29,398,954 valid | 1,046 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 29,600,000 lines read | 29,598,948 valid | 1,052 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 29,800,000 lines read | 29,798,941 valid | 1,059 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 30,000,000 lines read | 29,998,934 valid | 1,066 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 30,200,000 lines read | 30,198,923 valid | 1,077 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 30,400,000 lines read | 30,398,914 valid | 1,086 rejected | 0 inserted | 76 lines/s [debi-output_november.txt] 30,600,000 lines read | 30,598,901 valid | 1,099 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 30,800,000 lines read | 30,798,894 valid | 1,106 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 31,000,000 lines read | 30,998,888 valid | 1,112 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 31,200,000 lines read | 31,198,882 valid | 1,118 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 31,400,000 lines read | 31,398,874 valid | 1,126 rejected | 0 inserted | 77 lines/s [debi-output_november.txt] 31,600,000 lines read | 31,598,869 valid | 1,131 rejected | 20,000 inserted | 77 lines/s [WARN] unrecognized transaction_type values kept: ['Balance Transfer', 'Cash Service', 'Charity', 'Insurance', 'MicroFinance', 'Subscription', 'Syndicates', 'Universities'] done: 31,754,046 lines | 31,752,910 valid | 1,136 rejected | 177,910 inserted | 31,575,000 duplicates | 414,129.8s === ./data/debi-output_octber.txt === [debi-output_octber.txt] 200,000 lines read | 199,984 valid | 16 rejected | 195,000 inserted | 72 lines/s [debi-output_octber.txt] 400,000 lines read | 399,977 valid | 23 rejected | 395,000 inserted | 71 lines/s [debi-output_octber.txt] 600,000 lines read | 599,965 valid | 35 rejected | 595,000 inserted | 69 lines/s [debi-output_octber.txt] 800,000 lines read | 799,956 valid | 44 rejected | 795,000 inserted | 67 lines/s [debi-output_octber.txt] 1,000,000 lines read | 999,945 valid | 55 rejected | 995,000 inserted | 63 lines/s [debi-output_octber.txt] 1,200,000 lines read | 1,199,935 valid | 65 rejected | 1,195,000 inserted | 61 lines/s [debi-output_octber.txt] 1,400,000 lines read | 1,399,927 valid | 73 rejected | 1,395,000 inserted | 62 lines/s [debi-output_octber.txt] 1,600,000 lines read | 1,599,908 valid | 92 rejected | 1,595,000 inserted | 63 lines/s [debi-output_octber.txt] 1,800,000 lines read | 1,799,894 valid | 106 rejected | 1,795,000 inserted | 63 lines/s [debi-output_octber.txt] 2,000,000 lines read | 1,999,881 valid | 119 rejected | 1,995,000 inserted | 63 lines/s [debi-output_octber.txt] 2,200,000 lines read | 2,199,866 valid | 134 rejected | 2,195,000 inserted | 62 lines/s [debi-output_octber.txt] 2,400,000 lines read | 2,399,851 valid | 149 rejected | 2,395,000 inserted | 61 lines/s [debi-output_octber.txt] 2,600,000 lines read | 2,599,839 valid | 161 rejected | 2,595,000 inserted | 61 lines/s [debi-output_octber.txt] 2,800,000 lines read | 2,799,827 valid | 173 rejected | 2,795,000 inserted | 62 lines/s [debi-output_octber.txt] 3,000,000 lines read | 2,999,822 valid | 178 rejected | 2,995,000 inserted | 62 lines/s [debi-output_octber.txt] 3,200,000 lines read | 3,199,817 valid | 183 rejected | 3,195,000 inserted | 60 lines/s [debi-output_octber.txt] 3,400,000 lines read | 3,399,808 valid | 192 rejected | 3,395,000 inserted | 59 lines/s [debi-output_octber.txt] 3,600,000 lines read | 3,599,793 valid | 207 rejected | 3,595,000 inserted | 60 lines/s [debi-output_octber.txt] 3,800,000 lines read | 3,799,782 valid | 218 rejected | 3,795,000 inserted | 60 lines/s [debi-output_octber.txt] 4,000,000 lines read | 3,999,772 valid | 228 rejected | 3,995,000 inserted | 60 lines/s [debi-output_octber.txt] 4,200,000 lines read | 4,199,758 valid | 242 rejected | 4,195,000 inserted | 60 lines/s [debi-output_octber.txt] 4,400,000 lines read | 4,399,745 valid | 255 rejected | 4,395,000 inserted | 60 lines/s [debi-output_octber.txt] 4,600,000 lines read | 4,599,735 valid | 265 rejected | 4,595,000 inserted | 60 lines/s [debi-output_octber.txt] 4,800,000 lines read | 4,799,722 valid | 278 rejected | 4,795,000 inserted | 61 lines/s [debi-output_octber.txt] 5,000,000 lines read | 4,999,709 valid | 291 rejected | 4,995,000 inserted | 61 lines/s [debi-output_octber.txt] 5,200,000 lines read | 5,199,702 valid | 298 rejected | 5,195,000 inserted | 61 lines/s [debi-output_octber.txt] 5,400,000 lines read | 5,399,691 valid | 309 rejected | 5,395,000 inserted | 60 lines/s [debi-output_octber.txt] 5,600,000 lines read | 5,599,676 valid | 324 rejected | 5,595,000 inserted | 60 lines/s [debi-output_octber.txt] 5,800,000 lines read | 5,799,666 valid | 334 rejected | 5,795,000 inserted | 60 lines/s [debi-output_octber.txt] 6,000,000 lines read | 5,999,655 valid | 345 rejected | 5,995,000 inserted | 61 lines/s [debi-output_octber.txt] 6,200,000 lines read | 6,199,643 valid | 357 rejected | 6,195,000 inserted | 61 lines/s [debi-output_octber.txt] 6,400,000 lines read | 6,399,631 valid | 369 rejected | 6,395,000 inserted | 61 lines/s [debi-output_octber.txt] 6,600,000 lines read | 6,599,625 valid | 375 rejected | 6,595,000 inserted | 60 lines/s [debi-output_octber.txt] 6,800,000 lines read | 6,799,609 valid | 391 rejected | 6,795,000 inserted | 61 lines/s [debi-output_octber.txt] 7,000,000 lines read | 6,999,595 valid | 405 rejected | 6,995,000 inserted | 61 lines/s [debi-output_octber.txt] 7,200,000 lines read | 7,199,584 valid | 416 rejected | 7,195,000 inserted | 61 lines/s [debi-output_octber.txt] 7,400,000 lines read | 7,399,574 valid | 426 rejected | 7,395,000 inserted | 61 lines/s [debi-output_octber.txt] 7,600,000 lines read | 7,599,563 valid | 437 rejected | 7,595,000 inserted | 61 lines/s [debi-output_octber.txt] 7,800,000 lines read | 7,799,551 valid | 449 rejected | 7,795,000 inserted | 61 lines/s [debi-output_octber.txt] 8,000,000 lines read | 7,999,541 valid | 459 rejected | 7,995,000 inserted | 61 lines/s [debi-output_octber.txt] 8,200,000 lines read | 8,199,529 valid | 471 rejected | 8,195,000 inserted | 61 lines/s [debi-output_octber.txt] 8,400,000 lines read | 8,399,517 valid | 483 rejected | 8,395,000 inserted | 60 lines/s [debi-output_octber.txt] 8,600,000 lines read | 8,599,511 valid | 489 rejected | 8,595,000 inserted | 60 lines/s [debi-output_octber.txt] 8,800,000 lines read | 8,799,501 valid | 499 rejected | 8,795,000 inserted | 60 lines/s [debi-output_octber.txt] 9,000,000 lines read | 8,999,491 valid | 509 rejected | 8,995,000 inserted | 60 lines/s [debi-output_octber.txt] 9,200,000 lines read | 9,199,479 valid | 521 rejected | 9,195,000 inserted | 60 lines/s [debi-output_octber.txt] 9,400,000 lines read | 9,399,466 valid | 534 rejected | 9,395,000 inserted | 60 lines/s [debi-output_octber.txt] 9,600,000 lines read | 9,599,453 valid | 547 rejected | 9,595,000 inserted | 60 lines/s [debi-output_octber.txt] 9,800,000 lines read | 9,799,443 valid | 557 rejected | 9,795,000 inserted | 60 lines/s [debi-output_octber.txt] 10,000,000 lines read | 9,999,434 valid | 566 rejected | 9,995,000 inserted | 60 lines/s [debi-output_octber.txt] 10,200,000 lines read | 10,199,427 valid | 573 rejected | 10,195,000 inserted | 60 lines/s [debi-output_octber.txt] 10,400,000 lines read | 10,399,416 valid | 584 rejected | 10,395,000 inserted | 60 lines/s [debi-output_octber.txt] 10,600,000 lines read | 10,599,413 valid | 587 rejected | 10,595,000 inserted | 60 lines/s [debi-output_octber.txt] 10,800,000 lines read | 10,799,394 valid | 606 rejected | 10,795,000 inserted | 60 lines/s [debi-output_octber.txt] 11,000,000 lines read | 10,999,381 valid | 619 rejected | 10,995,000 inserted | 60 lines/s [debi-output_octber.txt] 11,200,000 lines read | 11,199,364 valid | 636 rejected | 11,195,000 inserted | 61 lines/s [debi-output_octber.txt] 11,400,000 lines read | 11,399,353 valid | 647 rejected | 11,395,000 inserted | 61 lines/s [debi-output_octber.txt] 11,600,000 lines read | 11,599,346 valid | 654 rejected | 11,595,000 inserted | 61 lines/s [debi-output_octber.txt] 11,800,000 lines read | 11,799,335 valid | 665 rejected | 11,795,000 inserted | 60 lines/s [debi-output_octber.txt] 12,000,000 lines read | 11,999,323 valid | 677 rejected | 11,995,000 inserted | 61 lines/s [debi-output_octber.txt] 12,200,000 lines read | 12,199,313 valid | 687 rejected | 12,195,000 inserted | 61 lines/s [debi-output_octber.txt] 12,400,000 lines read | 12,399,307 valid | 693 rejected | 12,395,000 inserted | 61 lines/s [debi-output_octber.txt] 12,600,000 lines read | 12,599,299 valid | 701 rejected | 12,595,000 inserted | 61 lines/s [debi-output_octber.txt] 12,800,000 lines read | 12,799,291 valid | 709 rejected | 12,795,000 inserted | 60 lines/s [debi-output_octber.txt] 13,000,000 lines read | 12,999,276 valid | 724 rejected | 12,995,000 inserted | 60 lines/s [debi-output_octber.txt] 13,200,000 lines read | 13,199,264 valid | 736 rejected | 13,195,000 inserted | 61 lines/s [debi-output_octber.txt] 13,400,000 lines read | 13,399,250 valid | 750 rejected | 13,395,000 inserted | 61 lines/s [debi-output_octber.txt] 13,600,000 lines read | 13,599,245 valid | 755 rejected | 13,595,000 inserted | 60 lines/s [debi-output_octber.txt] 13,800,000 lines read | 13,799,235 valid | 765 rejected | 13,795,000 inserted | 60 lines/s [debi-output_octber.txt] 14,000,000 lines read | 13,999,228 valid | 772 rejected | 13,995,000 inserted | 60 lines/s [debi-output_octber.txt] 14,200,000 lines read | 14,199,218 valid | 782 rejected | 14,195,000 inserted | 60 lines/s [debi-output_octber.txt] 14,400,000 lines read | 14,399,205 valid | 795 rejected | 14,395,000 inserted | 60 lines/s [debi-output_octber.txt] 14,600,000 lines read | 14,599,200 valid | 800 rejected | 14,595,000 inserted | 60 lines/s [debi-output_octber.txt] 14,800,000 lines read | 14,799,191 valid | 809 rejected | 14,795,000 inserted | 60 lines/s [debi-output_octber.txt] 15,000,000 lines read | 14,999,185 valid | 815 rejected | 14,995,000 inserted | 60 lines/s [debi-output_octber.txt] 15,200,000 lines read | 15,199,181 valid | 819 rejected | 15,195,000 inserted | 60 lines/s [debi-output_octber.txt] 15,400,000 lines read | 15,399,168 valid | 832 rejected | 15,395,000 inserted | 60 lines/s [debi-output_octber.txt] 15,600,000 lines read | 15,599,156 valid | 844 rejected | 15,595,000 inserted | 60 lines/s [debi-output_octber.txt] 15,800,000 lines read | 15,799,144 valid | 856 rejected | 15,795,000 inserted | 60 lines/s [debi-output_octber.txt] 16,000,000 lines read | 15,999,137 valid | 863 rejected | 15,995,000 inserted | 60 lines/s [debi-output_octber.txt] 16,200,000 lines read | 16,199,126 valid | 874 rejected | 16,195,000 inserted | 60 lines/s [debi-output_octber.txt] 16,400,000 lines read | 16,399,113 valid | 887 rejected | 16,395,000 inserted | 60 lines/s [debi-output_octber.txt] 16,600,000 lines read | 16,599,099 valid | 901 rejected | 16,595,000 inserted | 60 lines/s [debi-output_octber.txt] 16,800,000 lines read | 16,799,089 valid | 911 rejected | 16,795,000 inserted | 60 lines/s [debi-output_octber.txt] 17,000,000 lines read | 16,999,069 valid | 931 rejected | 16,995,000 inserted | 60 lines/s [debi-output_octber.txt] 17,200,000 lines read | 17,199,060 valid | 940 rejected | 17,195,000 inserted | 60 lines/s [debi-output_octber.txt] 17,400,000 lines read | 17,399,047 valid | 953 rejected | 17,395,000 inserted | 60 lines/s [debi-output_octber.txt] 17,600,000 lines read | 17,599,037 valid | 963 rejected | 17,595,000 inserted | 60 lines/s [debi-output_octber.txt] 17,800,000 lines read | 17,799,026 valid | 974 rejected | 17,795,000 inserted | 60 lines/s [debi-output_octber.txt] 18,000,000 lines read | 17,999,019 valid | 981 rejected | 17,995,000 inserted | 60 lines/s [debi-output_octber.txt] 18,200,000 lines read | 18,199,011 valid | 989 rejected | 18,195,000 inserted | 60 lines/s [debi-output_octber.txt] 18,400,000 lines read | 18,399,007 valid | 993 rejected | 18,395,000 inserted | 60 lines/s [debi-output_octber.txt] 18,600,000 lines read | 18,598,994 valid | 1,006 rejected | 18,595,000 inserted | 60 lines/s [debi-output_octber.txt] 18,800,000 lines read | 18,798,982 valid | 1,018 rejected | 18,795,000 inserted | 60 lines/s [debi-output_octber.txt] 19,000,000 lines read | 18,998,968 valid | 1,032 rejected | 18,995,000 inserted | 60 lines/s [debi-output_octber.txt] 19,200,000 lines read | 19,198,956 valid | 1,044 rejected | 19,195,000 inserted | 60 lines/s [debi-output_octber.txt] 19,400,000 lines read | 19,398,947 valid | 1,053 rejected | 19,395,000 inserted | 59 lines/s [debi-output_octber.txt] 19,600,000 lines read | 19,598,936 valid | 1,064 rejected | 19,595,000 inserted | 59 lines/s [debi-output_octber.txt] 19,800,000 lines read | 19,798,918 valid | 1,082 rejected | 19,795,000 inserted | 58 lines/s [debi-output_octber.txt] 20,000,000 lines read | 19,998,908 valid | 1,092 rejected | 19,995,000 inserted | 58 lines/s [debi-output_octber.txt] 20,200,000 lines read | 20,198,890 valid | 1,110 rejected | 20,195,000 inserted | 58 lines/s [debi-output_octber.txt] 20,400,000 lines read | 20,398,874 valid | 1,126 rejected | 20,395,000 inserted | 58 lines/s [debi-output_octber.txt] 20,600,000 lines read | 20,598,864 valid | 1,136 rejected | 20,595,000 inserted | 58 lines/s [debi-output_octber.txt] 20,800,000 lines read | 20,798,857 valid | 1,143 rejected | 20,795,000 inserted | 58 lines/s [debi-output_octber.txt] 21,000,000 lines read | 20,998,844 valid | 1,156 rejected | 20,995,000 inserted | 58 lines/s [debi-output_octber.txt] 21,200,000 lines read | 21,198,834 valid | 1,166 rejected | 21,195,000 inserted | 58 lines/s [debi-output_octber.txt] 21,400,000 lines read | 21,398,823 valid | 1,177 rejected | 21,395,000 inserted | 58 lines/s [debi-output_octber.txt] 21,600,000 lines read | 21,598,810 valid | 1,190 rejected | 21,595,000 inserted | 58 lines/s [debi-output_octber.txt] 21,800,000 lines read | 21,798,801 valid | 1,199 rejected | 21,795,000 inserted | 58 lines/s [debi-output_octber.txt] 22,000,000 lines read | 21,998,790 valid | 1,210 rejected | 21,995,000 inserted | 58 lines/s [debi-output_octber.txt] 22,200,000 lines read | 22,198,780 valid | 1,220 rejected | 22,195,000 inserted | 58 lines/s [debi-output_octber.txt] 22,400,000 lines read | 22,398,773 valid | 1,227 rejected | 22,395,000 inserted | 58 lines/s Traceback (most recent call last): File "/home/hema2imholding/public_html/insert.py", line 262, in main() File "/home/hema2imholding/public_html/insert.py", line 243, in main total, valid, rejected, inserted = process_file( File "/home/hema2imholding/public_html/insert.py", line 188, in process_file flush() File "/home/hema2imholding/public_html/insert.py", line 159, in flush cur.executemany(INSERT_SQL, batch) File "/usr/local/lib/python3.9/site-packages/pymysql/cursors.py", line 188, in executemany return self._do_execute_many( File "/usr/local/lib/python3.9/site-packages/pymysql/cursors.py", line 221, in _do_execute_many rows += self.execute(sql + postfix) File "/usr/local/lib/python3.9/site-packages/pymysql/cursors.py", line 159, in execute result = self._query(query) File "/usr/local/lib/python3.9/site-packages/pymysql/cursors.py", line 330, in _query conn.query(q) File "/usr/local/lib/python3.9/site-packages/pymysql/connections.py", line 582, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/usr/local/lib/python3.9/site-packages/pymysql/connections.py", line 847, in _read_query_result result.read() File "/usr/local/lib/python3.9/site-packages/pymysql/connections.py", line 1245, in read first_packet = self.connection._read_packet() File "/usr/local/lib/python3.9/site-packages/pymysql/connections.py", line 772, in _read_packet packet_header = self._read_bytes(4) File "/usr/local/lib/python3.9/site-packages/pymysql/connections.py", line 826, in _read_bytes raise err.OperationalError( pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')