Mercurial > repos > iuc > tooldistillator_summarize
view test-data/megahit/log.txt @ 7:7fe1fe92de41 draft
planemo upload for repository https://github.com/galaxyproject/tools-iuc/tree/master/tools/tooldistillator commit b14e0602e63d833befda354faa901e4b3e8d06fe
| author | iuc |
|---|---|
| date | Tue, 15 Jul 2025 09:51:56 +0000 |
| parents | |
| children |
line wrap: on
line source
2025-05-06 15:55:42 - MEGAHIT v1.2.9 2025-05-06 15:55:42 - Using megahit_core with POPCNT and BMI2 support 2025-05-06 15:55:42 - Convert reads to binary library 2025-05-06 15:55:42 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core buildlib /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib 2025-05-06 15:56:00 - b'INFO sequence/io/sequence_lib.cpp : 75 - Lib 0 (/shared/ifbstor1/galaxy/datasets2/f/2/7/dataset_f2732895-cf11-4caf-81a5-abff40998680.dat,/shared/ifbstor1/galaxy/datasets2/e/d/4/dataset_ed453ac0-01f0-49ac-850a-cc52bead832e.dat): pe, 13163984 reads, 101 max length' 2025-05-06 15:56:00 - b'INFO utils/utils.h : 152 - Real: 17.6387\tuser: 18.0141\tsys: 1.6238\tmaxrss: 278536' 2025-05-06 15:56:00 - Start assembly. Number of CPU threads 10 2025-05-06 15:56:00 - k list: 21,29,39,59,79,99,119,141 2025-05-06 15:56:00 - Memory used: 83886080 2025-05-06 15:56:00 - Extract solid (k+1)-mers for k = 21 2025-05-06 15:56:00 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core count -k 21 -m 2 --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 --num_cpu_threads 10 --read_lib_file /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib 2025-05-06 15:56:00 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 15:56:00 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 15:56:01 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 15:56:01 - b'INFO sorting/kmer_counter.cpp : 76 - 13163984 reads, 101 max read length' 2025-05-06 15:56:01 - b'INFO sorting/kmer_counter.cpp : 82 - 2 words per substring, 2 words per edge' 2025-05-06 15:56:01 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.8890' 2025-05-06 15:56:01 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 561884312 bytes' 2025-05-06 15:56:02 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 561884312), still trying to perform sorting' 2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 7346844, Lv2 items: 241796' 2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 528628200, Memory for Lv1+Lv2: 33256112' 2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 1.5723' 2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 8' 2025-05-06 15:56:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4914' 2025-05-06 15:56:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0903' 2025-05-06 15:56:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8 to 21' 2025-05-06 15:56:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4736' 2025-05-06 15:56:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0615' 2025-05-06 15:56:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21 to 42' 2025-05-06 15:56:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4851' 2025-05-06 15:56:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1414' 2025-05-06 15:56:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42 to 70' 2025-05-06 15:56:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4749' 2025-05-06 15:56:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0775' 2025-05-06 15:56:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 70 to 104' 2025-05-06 15:56:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4707' 2025-05-06 15:56:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0922' 2025-05-06 15:56:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 104 to 145' 2025-05-06 15:56:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4761' 2025-05-06 15:56:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1232' 2025-05-06 15:56:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 145 to 192' 2025-05-06 15:56:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4891' 2025-05-06 15:56:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1146' 2025-05-06 15:56:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 192 to 244' 2025-05-06 15:56:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4772' 2025-05-06 15:56:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1196' 2025-05-06 15:56:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 244 to 301' 2025-05-06 15:56:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4751' 2025-05-06 15:56:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1163' 2025-05-06 15:56:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 301 to 362' 2025-05-06 15:56:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4774' 2025-05-06 15:56:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1287' 2025-05-06 15:56:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 362 to 428' 2025-05-06 15:56:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4753' 2025-05-06 15:56:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1226' 2025-05-06 15:56:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 428 to 499' 2025-05-06 15:56:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4770' 2025-05-06 15:56:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1551' 2025-05-06 15:56:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 499 to 574' 2025-05-06 15:56:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4791' 2025-05-06 15:56:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1778' 2025-05-06 15:56:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 574 to 653' 2025-05-06 15:56:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4778' 2025-05-06 15:56:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1487' 2025-05-06 15:56:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 653 to 736' 2025-05-06 15:56:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4777' 2025-05-06 15:56:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1401' 2025-05-06 15:56:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 736 to 823' 2025-05-06 15:56:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4755' 2025-05-06 15:56:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1356' 2025-05-06 15:56:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 823 to 914' 2025-05-06 15:56:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4741' 2025-05-06 15:56:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1527' 2025-05-06 15:56:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 914 to 1009' 2025-05-06 15:56:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4783' 2025-05-06 15:56:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1483' 2025-05-06 15:56:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1009 to 1109' 2025-05-06 15:56:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4769' 2025-05-06 15:56:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1563' 2025-05-06 15:56:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1109 to 1213' 2025-05-06 15:56:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4778' 2025-05-06 15:56:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1535' 2025-05-06 15:56:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1213 to 1322' 2025-05-06 15:56:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' 2025-05-06 15:56:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1623' 2025-05-06 15:56:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1322 to 1435' 2025-05-06 15:56:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4796' 2025-05-06 15:56:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1575' 2025-05-06 15:56:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1435 to 1552' 2025-05-06 15:56:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4780' 2025-05-06 15:56:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1677' 2025-05-06 15:56:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1552 to 1672' 2025-05-06 15:56:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4868' 2025-05-06 15:56:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1816' 2025-05-06 15:56:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1672 to 1796' 2025-05-06 15:56:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4923' 2025-05-06 15:56:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1648' 2025-05-06 15:56:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1796 to 1924' 2025-05-06 15:56:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4782' 2025-05-06 15:56:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1774' 2025-05-06 15:56:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1924 to 2056' 2025-05-06 15:56:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4792' 2025-05-06 15:56:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1680' 2025-05-06 15:56:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2056 to 2192' 2025-05-06 15:56:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4770' 2025-05-06 15:56:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1692' 2025-05-06 15:56:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2192 to 2332' 2025-05-06 15:56:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4773' 2025-05-06 15:56:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1793' 2025-05-06 15:56:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2332 to 2475' 2025-05-06 15:56:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4780' 2025-05-06 15:56:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1712' 2025-05-06 15:56:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2475 to 2621' 2025-05-06 15:56:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4812' 2025-05-06 15:56:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1728' 2025-05-06 15:56:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2621 to 2771' 2025-05-06 15:56:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4781' 2025-05-06 15:56:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1783' 2025-05-06 15:56:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2771 to 2925' 2025-05-06 15:56:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4840' 2025-05-06 15:56:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1723' 2025-05-06 15:56:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2925 to 3082' 2025-05-06 15:56:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4810' 2025-05-06 15:56:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1830' 2025-05-06 15:56:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3082 to 3243' 2025-05-06 15:56:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4805' 2025-05-06 15:56:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1770' 2025-05-06 15:56:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3243 to 3409' 2025-05-06 15:57:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4795' 2025-05-06 15:57:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1858' 2025-05-06 15:57:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3409 to 3579' 2025-05-06 15:57:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' 2025-05-06 15:57:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1867' 2025-05-06 15:57:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3579 to 3752' 2025-05-06 15:57:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4814' 2025-05-06 15:57:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1819' 2025-05-06 15:57:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3752 to 3929' 2025-05-06 15:57:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4783' 2025-05-06 15:57:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1876' 2025-05-06 15:57:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3929 to 4109' 2025-05-06 15:57:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4806' 2025-05-06 15:57:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1856' 2025-05-06 15:57:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4109 to 4293' 2025-05-06 15:57:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4789' 2025-05-06 15:57:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1857' 2025-05-06 15:57:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4293 to 4481' 2025-05-06 15:57:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' 2025-05-06 15:57:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1923' 2025-05-06 15:57:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4481 to 4673' 2025-05-06 15:57:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' 2025-05-06 15:57:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1860' 2025-05-06 15:57:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4673 to 4869' 2025-05-06 15:57:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4786' 2025-05-06 15:57:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1965' 2025-05-06 15:57:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4869 to 5069' 2025-05-06 15:57:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4833' 2025-05-06 15:57:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1915' 2025-05-06 15:57:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5069 to 5273' 2025-05-06 15:57:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4799' 2025-05-06 15:57:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1897' 2025-05-06 15:57:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5273 to 5481' 2025-05-06 15:57:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4887' 2025-05-06 15:57:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2032' 2025-05-06 15:57:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5481 to 5693' 2025-05-06 15:57:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4864' 2025-05-06 15:57:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2289' 2025-05-06 15:57:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5693 to 5909' 2025-05-06 15:57:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4799' 2025-05-06 15:57:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2003' 2025-05-06 15:57:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5909 to 6129' 2025-05-06 15:57:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4838' 2025-05-06 15:57:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2016' 2025-05-06 15:57:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6129 to 6353' 2025-05-06 15:57:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4800' 2025-05-06 15:57:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1965' 2025-05-06 15:57:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6353 to 6581' 2025-05-06 15:57:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4797' 2025-05-06 15:57:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2005' 2025-05-06 15:57:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6581 to 6813' 2025-05-06 15:57:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4802' 2025-05-06 15:57:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1961' 2025-05-06 15:57:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6813 to 7050' 2025-05-06 15:57:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4795' 2025-05-06 15:57:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2028' 2025-05-06 15:57:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7050 to 7291' 2025-05-06 15:57:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4796' 2025-05-06 15:57:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1982' 2025-05-06 15:57:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7291 to 7536' 2025-05-06 15:57:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4806' 2025-05-06 15:57:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2012' 2025-05-06 15:57:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7536 to 7785' 2025-05-06 15:57:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4792' 2025-05-06 15:57:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2018' 2025-05-06 15:57:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7785 to 8039' 2025-05-06 15:57:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4809' 2025-05-06 15:57:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2039' 2025-05-06 15:57:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8039 to 8297' 2025-05-06 15:57:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4784' 2025-05-06 15:57:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2032' 2025-05-06 15:57:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8297 to 8560' 2025-05-06 15:57:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4815' 2025-05-06 15:57:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2000' 2025-05-06 15:57:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8560 to 8827' 2025-05-06 15:57:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4810' 2025-05-06 15:57:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2055' 2025-05-06 15:57:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8827 to 9098' 2025-05-06 15:57:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4802' 2025-05-06 15:57:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2039' 2025-05-06 15:57:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9098 to 9373' 2025-05-06 15:57:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' 2025-05-06 15:57:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2078' 2025-05-06 15:57:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9373 to 9653' 2025-05-06 15:57:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4798' 2025-05-06 15:57:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2049' 2025-05-06 15:57:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9653 to 9937' 2025-05-06 15:57:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4806' 2025-05-06 15:57:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2079' 2025-05-06 15:57:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9937 to 10226' 2025-05-06 15:57:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4804' 2025-05-06 15:57:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2073' 2025-05-06 15:57:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10226 to 10520' 2025-05-06 15:57:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4826' 2025-05-06 15:57:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2093' 2025-05-06 15:57:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10520 to 10819' 2025-05-06 15:57:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4803' 2025-05-06 15:57:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2068' 2025-05-06 15:57:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10819 to 11124' 2025-05-06 15:57:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4808' 2025-05-06 15:57:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2110' 2025-05-06 15:57:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11124 to 11434' 2025-05-06 15:57:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4821' 2025-05-06 15:57:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2081' 2025-05-06 15:57:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11434 to 11749' 2025-05-06 15:58:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4825' 2025-05-06 15:58:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2116' 2025-05-06 15:58:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11749 to 12070' 2025-05-06 15:58:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4810' 2025-05-06 15:58:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2075' 2025-05-06 15:58:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12070 to 12396' 2025-05-06 15:58:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4822' 2025-05-06 15:58:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2114' 2025-05-06 15:58:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12396 to 12727' 2025-05-06 15:58:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4818' 2025-05-06 15:58:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2079' 2025-05-06 15:58:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12727 to 13064' 2025-05-06 15:58:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4828' 2025-05-06 15:58:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2111' 2025-05-06 15:58:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13064 to 13407' 2025-05-06 15:58:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4830' 2025-05-06 15:58:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2102' 2025-05-06 15:58:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13407 to 13755' 2025-05-06 15:58:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4813' 2025-05-06 15:58:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2063' 2025-05-06 15:58:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13755 to 14109' 2025-05-06 15:58:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.8583' 2025-05-06 15:58:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2129' 2025-05-06 15:58:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14109 to 14469' 2025-05-06 15:58:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4853' 2025-05-06 15:58:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2061' 2025-05-06 15:58:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14469 to 14835' 2025-05-06 15:58:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4813' 2025-05-06 15:58:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2074' 2025-05-06 15:58:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14835 to 15207' 2025-05-06 15:58:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4811' 2025-05-06 15:58:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2095' 2025-05-06 15:58:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15207 to 15586' 2025-05-06 15:58:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4807' 2025-05-06 15:58:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2084' 2025-05-06 15:58:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15586 to 15971' 2025-05-06 15:58:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4812' 2025-05-06 15:58:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2086' 2025-05-06 15:58:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15971 to 16364' 2025-05-06 15:58:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' 2025-05-06 15:58:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2113' 2025-05-06 15:58:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16364 to 16764' 2025-05-06 15:58:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' 2025-05-06 15:58:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2096' 2025-05-06 15:58:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16764 to 17171' 2025-05-06 15:58:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' 2025-05-06 15:58:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2132' 2025-05-06 15:58:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17171 to 17585' 2025-05-06 15:58:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4818' 2025-05-06 15:58:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2137' 2025-05-06 15:58:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17585 to 18007' 2025-05-06 15:58:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4825' 2025-05-06 15:58:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2122' 2025-05-06 15:58:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18007 to 18436' 2025-05-06 15:58:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4826' 2025-05-06 15:58:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2220' 2025-05-06 15:58:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18436 to 18873' 2025-05-06 15:58:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4875' 2025-05-06 15:58:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2451' 2025-05-06 15:58:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18873 to 19318' 2025-05-06 15:58:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4869' 2025-05-06 15:58:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2158' 2025-05-06 15:58:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19318 to 19771' 2025-05-06 15:58:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4822' 2025-05-06 15:58:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2154' 2025-05-06 15:58:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19771 to 20233' 2025-05-06 15:58:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4828' 2025-05-06 15:58:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2156' 2025-05-06 15:58:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20233 to 20704' 2025-05-06 15:58:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4830' 2025-05-06 15:58:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2154' 2025-05-06 15:58:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20704 to 21185' 2025-05-06 15:58:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4819' 2025-05-06 15:58:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2157' 2025-05-06 15:58:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21185 to 21675' 2025-05-06 15:58:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4832' 2025-05-06 15:58:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2163' 2025-05-06 15:58:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21675 to 22174' 2025-05-06 15:58:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4832' 2025-05-06 15:58:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2168' 2025-05-06 15:58:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22174 to 22684' 2025-05-06 15:58:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4836' 2025-05-06 15:58:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2146' 2025-05-06 15:58:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22684 to 23204' 2025-05-06 15:58:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4833' 2025-05-06 15:58:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2166' 2025-05-06 15:58:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23204 to 23734' 2025-05-06 15:58:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4883' 2025-05-06 15:58:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2153' 2025-05-06 15:58:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23734 to 24276' 2025-05-06 15:58:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4834' 2025-05-06 15:58:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2137' 2025-05-06 15:58:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24276 to 24829' 2025-05-06 15:58:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4844' 2025-05-06 15:58:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2159' 2025-05-06 15:58:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24829 to 25394' 2025-05-06 15:58:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4849' 2025-05-06 15:58:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2158' 2025-05-06 15:58:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25394 to 25971' 2025-05-06 15:58:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4848' 2025-05-06 15:58:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2189' 2025-05-06 15:58:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25971 to 26561' 2025-05-06 15:58:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4861' 2025-05-06 15:58:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2150' 2025-05-06 15:58:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26561 to 27165' 2025-05-06 15:58:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4859' 2025-05-06 15:59:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2164' 2025-05-06 15:59:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27165 to 27783' 2025-05-06 15:59:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4851' 2025-05-06 15:59:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2200' 2025-05-06 15:59:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27783 to 28416' 2025-05-06 15:59:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 2.1820' 2025-05-06 15:59:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2197' 2025-05-06 15:59:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28416 to 29065' 2025-05-06 15:59:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4858' 2025-05-06 15:59:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2164' 2025-05-06 15:59:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29065 to 29730' 2025-05-06 15:59:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4870' 2025-05-06 15:59:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2176' 2025-05-06 15:59:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29730 to 30412' 2025-05-06 15:59:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4876' 2025-05-06 15:59:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2174' 2025-05-06 15:59:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30412 to 31111' 2025-05-06 15:59:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4870' 2025-05-06 15:59:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2191' 2025-05-06 15:59:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31111 to 31830' 2025-05-06 15:59:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4884' 2025-05-06 15:59:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2189' 2025-05-06 15:59:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31830 to 32571' 2025-05-06 15:59:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4872' 2025-05-06 15:59:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2199' 2025-05-06 15:59:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32571 to 33335' 2025-05-06 15:59:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4884' 2025-05-06 15:59:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2194' 2025-05-06 15:59:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33335 to 34122' 2025-05-06 15:59:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4886' 2025-05-06 15:59:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2201' 2025-05-06 15:59:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34122 to 34934' 2025-05-06 15:59:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4918' 2025-05-06 15:59:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2202' 2025-05-06 15:59:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34934 to 35775' 2025-05-06 15:59:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4899' 2025-05-06 15:59:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2201' 2025-05-06 15:59:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35775 to 36645' 2025-05-06 15:59:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4906' 2025-05-06 15:59:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2197' 2025-05-06 15:59:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36645 to 37547' 2025-05-06 15:59:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4916' 2025-05-06 15:59:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2221' 2025-05-06 15:59:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37547 to 38486' 2025-05-06 15:59:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4922' 2025-05-06 15:59:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2220' 2025-05-06 15:59:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38486 to 39466' 2025-05-06 15:59:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4939' 2025-05-06 15:59:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2228' 2025-05-06 15:59:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39466 to 40488' 2025-05-06 15:59:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4941' 2025-05-06 15:59:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2231' 2025-05-06 15:59:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40488 to 41561' 2025-05-06 15:59:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4948' 2025-05-06 15:59:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2229' 2025-05-06 15:59:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41561 to 42693' 2025-05-06 15:59:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5038' 2025-05-06 15:59:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2266' 2025-05-06 15:59:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42693 to 43893' 2025-05-06 15:59:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5029' 2025-05-06 15:59:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2259' 2025-05-06 15:59:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43893 to 45170' 2025-05-06 15:59:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5013' 2025-05-06 15:59:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2288' 2025-05-06 15:59:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45170 to 46541' 2025-05-06 15:59:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5064' 2025-05-06 15:59:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2275' 2025-05-06 15:59:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46541 to 48029' 2025-05-06 15:59:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5056' 2025-05-06 15:59:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2275' 2025-05-06 15:59:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48029 to 49666' 2025-05-06 15:59:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5026' 2025-05-06 15:59:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2283' 2025-05-06 15:59:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49666 to 51507' 2025-05-06 15:59:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5086' 2025-05-06 15:59:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2291' 2025-05-06 15:59:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51507 to 53630' 2025-05-06 15:59:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5073' 2025-05-06 15:59:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2291' 2025-05-06 15:59:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53630 to 56208' 2025-05-06 15:59:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5075' 2025-05-06 15:59:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2305' 2025-05-06 15:59:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56208 to 59730' 2025-05-06 15:59:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5165' 2025-05-06 15:59:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2319' 2025-05-06 15:59:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59730 to 65536' 2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5030' 2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1751' 2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 227.7403' 2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 15:59:50 - b'INFO sorting/kmer_counter.cpp : 405 - Total number of candidate reads: 163023 (920098)' 2025-05-06 15:59:50 - b'INFO sorting/kmer_counter.cpp : 407 - Total number of solid edges: 92664799' 2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.1896' 2025-05-06 15:59:50 - b'INFO utils/utils.h : 152 - Real: 230.4691\tuser: 2250.7830\tsys: 6.3315\tmaxrss: 574140' 2025-05-06 15:59:50 - Build graph for k = 21 2025-05-06 15:59:50 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 --num_cpu_threads 10 -k 21 --kmer_from 0 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 --need_mercy 2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 15:59:51 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 92664799' 2025-05-06 15:59:51 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 2548281956, number contigs: 0, number multiplicity: 115830998' 2025-05-06 15:59:51 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 637070500, multiplicity vector: 115830998' 2025-05-06 15:59:53 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 92664799 edges.' 2025-05-06 15:59:53 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 637070500/92664799/2038625578, multiplicity vector: 92664799/115830998' 2025-05-06 15:59:53 - b'INFO sorting/seq_to_sdbg.cpp : 440 - Adding mercy edges...' 2025-05-06 15:59:54 - b'INFO sorting/seq_to_sdbg.cpp : 191 - Read 65536 reads to search for mercy k-mers' 2025-05-06 15:59:55 - b'INFO sorting/seq_to_sdbg.cpp : 191 - Read 65536 reads to search for mercy k-mers' 2025-05-06 15:59:55 - b'INFO sorting/seq_to_sdbg.cpp : 191 - Read 31951 reads to search for mercy k-mers' 2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 355 - Number of reads: 163023, Number of mercy edges: 2654870' 2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 444 - Done. Time elapsed: 2.8473' 2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 445 - After adding mercy, sizeof seq_package: 637070500/95319669/2097032718, multiplicity vector: 95319669/115830998' 2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 637070500/95319669/2097032718, multiplicity vector: 95319669/115830998' 2025-05-06 15:59:56 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 5.3960' 2025-05-06 15:59:56 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 903608516 bytes' 2025-05-06 15:59:57 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 903608516), still trying to perform sorting' 2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 4485631, Lv2 items: 68800' 2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 885115592, Memory for Lv1+Lv2: 18492924' 2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.9848' 2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 69' 2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5085' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2244' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 69 to 171' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2093' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0577' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 171 to 288' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2680' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0604' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 288 to 419' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2079' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0608' 2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 419 to 560' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2075' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0600' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 560 to 710' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2085' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0609' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 710 to 867' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2092' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0625' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 867 to 1031' 2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2092' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0629' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1031 to 1202' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2077' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0626' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1202 to 1379' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2119' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1379 to 1562' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2083' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0639' 2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1562 to 1750' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2107' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0709' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1750 to 1943' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2077' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0638' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1943 to 2142' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2090' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0641' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2142 to 2347' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2262' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' 2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2347 to 2557' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0641' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2557 to 2772' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2095' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0651' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2772 to 2992' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2254' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0675' 2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2992 to 3217' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2093' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0642' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3217 to 3447' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2093' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0649' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3447 to 3681' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0644' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3681 to 3920' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2109' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0657' 2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3920 to 4163' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2096' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0668' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4163 to 4410' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2101' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0659' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4410 to 4662' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2108' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0658' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4662 to 4918' 2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2094' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0652' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4918 to 5178' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2118' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0665' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5178 to 5442' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2123' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0655' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5442 to 5710' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2103' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0662' 2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5710 to 5982' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2118' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0660' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5982 to 6258' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2096' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0676' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6258 to 6537' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2100' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0673' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6537 to 6820' 2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2158' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0925' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6820 to 7107' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2123' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0661' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7107 to 7397' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2132' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0664' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7397 to 7691' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2165' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0819' 2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7691 to 7989' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2149' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0666' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7989 to 8292' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0668' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8292 to 8598' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2928' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0745' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8598 to 8908' 2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0659' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8908 to 9222' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2117' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0667' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9222 to 9540' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2367' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9540 to 9862' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2138' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0662' 2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9862 to 10188' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2136' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0671' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10188 to 10518' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2146' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0665' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10518 to 10852' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2131' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0669' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10852 to 11189' 2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2121' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0659' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11189 to 11530' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2135' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0671' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11530 to 11875' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2134' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11875 to 12224' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2173' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' 2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12224 to 12577' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2145' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0679' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12577 to 12934' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2128' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12934 to 13294' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2127' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0679' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13294 to 13658' 2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2117' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0675' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13658 to 14026' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2135' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14026 to 14398' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2130' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0697' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14398 to 14774' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2156' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0669' 2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14774 to 15154' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2149' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0688' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15154 to 15538' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2168' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0671' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15538 to 15926' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2177' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0676' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15926 to 16318' 2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2168' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16318 to 16714' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2169' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16714 to 17114' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2169' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1435' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17114 to 17519' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2225' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0679' 2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17519 to 17928' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2180' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0667' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17928 to 18341' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2166' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18341 to 18759' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2140' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0677' 2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18759 to 19181' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2147' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19181 to 19608' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2182' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0684' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19608 to 20040' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2182' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0675' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20040 to 20476' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2183' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0779' 2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20476 to 20917' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2192' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20917 to 21363' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2185' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0680' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21363 to 21814' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2185' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0774' 2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21814 to 22270' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.4154' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0720' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22270 to 22731' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2228' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0794' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22731 to 23197' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2194' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' 2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23197 to 23668' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2195' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0680' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23668 to 24144' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2192' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0689' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24144 to 24625' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2198' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24625 to 25111' 2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2177' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0777' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25111 to 25603' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2167' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25603 to 26100' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2197' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0681' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26100 to 26603' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2198' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' 2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26603 to 27111' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2211' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0706' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27111 to 27625' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2202' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0690' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27625 to 28145' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2207' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' 2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28145 to 28671' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2196' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0686' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28671 to 29203' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2209' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29203 to 29741' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2213' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0684' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29741 to 30286' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2206' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0682' 2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30286 to 30838' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2204' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30838 to 31396' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2174' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31396 to 31961' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2147' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' 2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31961 to 32533' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2147' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0685' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32533 to 33113' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2154' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0692' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33113 to 33700' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2148' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0692' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33700 to 34295' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2151' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' 2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34295 to 34898' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2343' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0713' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34898 to 35510' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2212' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0685' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35510 to 36131' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2199' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0688' 2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36131 to 36761' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2220' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36761 to 37400' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2169' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37400 to 38049' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2156' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38049 to 38709' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2154' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' 2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38709 to 39380' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2153' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39380 to 40062' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2158' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40062 to 40755' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2186' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0794' 2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40755 to 41460' 2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.4199' 2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0834' 2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41460 to 42178' 2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3866' 2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0725' 2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42178 to 42910' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2193' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0690' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42910 to 43657' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2218' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0699' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43657 to 44420' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2166' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0700' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 44420 to 45199' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2166' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' 2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45199 to 45996' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0699' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45996 to 46811' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46811 to 47647' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2159' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' 2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47647 to 48505' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48505 to 49385' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49385 to 50290' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2167' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0696' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50290 to 51224' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2167' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0703' 2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51224 to 52192' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2183' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52192 to 53197' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2231' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0696' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53197 to 54244' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2176' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' 2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 54244 to 55343' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2173' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0692' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55343 to 56504' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2224' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0795' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56504 to 57742' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3230' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0718' 2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 57742 to 59082' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2211' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59082 to 60575' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2241' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 60575 to 62347' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2183' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0685' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 62347 to 65536' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2189' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0636' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 38.6441' 2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 968795 51219806 44324149 44242015 51224080 141578 158697 156622 140646' 2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 192576388' 2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 191010050' 2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 968795' 2025-05-06 16:00:36 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0591' 2025-05-06 16:00:36 - b'INFO utils/utils.h : 152 - Real: 45.1308\tuser: 386.6365\tsys: 6.5397\tmaxrss: 1032000' 2025-05-06 16:00:36 - Assemble contigs from SdBG for k = 21 2025-05-06 16:00:36 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble 2025-05-06 16:00:38 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21Done. Time elapsed: 2.530597' 2025-05-06 16:00:38 - b'INFO main_assemble.cpp : 133 - Number of Edges: 192576388; K value: 21' 2025-05-06 16:00:38 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:00:41 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 22734; time elapsed: 0.2021' 2025-05-06 16:00:41 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 52171; time elapsed: 0.4023' 2025-05-06 16:00:42 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 97065; time elapsed: 0.8729' 2025-05-06 16:00:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 179073; time elapsed: 1.9333' 2025-05-06 16:00:48 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 306821; time elapsed: 3.7212' 2025-05-06 16:00:52 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 42; Accumulated tips removed: 407773; time elapsed: 4.4926' 2025-05-06 16:00:52 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 14.071' 2025-05-06 16:01:12 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 1016753, palindrome: 529' 2025-05-06 16:01:12 - b'INFO main_assemble.cpp : 166 - unitig graph size: 1016929, time for building: 19.572' 2025-05-06 16:01:15 - b'INFO assembly/contig_stat.h : 40 - Max: 11382, Min: 22, N50: 165, number contigs: 1016929, number isolated: 289308, number looped: 176, total size: 112740156,' 2025-05-06 16:01:15 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:01:16 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 40835, Time elapsed(sec): 1.520' 2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 9819, Time elapsed(sec): 0.699494' 2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 30916, time: 0.265' 2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 62, time: 0.162' 2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:01:18 - b'INFO main_assemble.cpp : 192 - Tips removed: 8436, time: 0.809' 2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 615, Time elapsed(sec): 0.269' 2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 235, Time elapsed(sec): 0.444457' 2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 287, time: 0.236' 2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.168' 2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:01:20 - b'INFO main_assemble.cpp : 192 - Tips removed: 96, time: 0.758' 2025-05-06 16:01:20 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.251' 2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 3, Time elapsed(sec): 0.443489' 2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 17, time: 0.225' 2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.039' 2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:01:22 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.731' 2025-05-06 16:01:22 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.240' 2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.435591' 2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 9, time: 0.232' 2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.033' 2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' 2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.707' 2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.236' 2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.422163' 2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 9, time: 0.216' 2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.033' 2025-05-06 16:01:27 - b'INFO assembly/contig_stat.h : 40 - Max: 31381, Min: 22, N50: 196, number contigs: 827315, number isolated: 302249, number looped: 90, total size: 107326489,' 2025-05-06 16:01:34 - b'INFO main_assemble.cpp : 267 - Time to output: 7.472257' 2025-05-06 16:01:41 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 16039, complex bubbles removed: 1073, time: 7.385293' 2025-05-06 16:01:43 - b'INFO assembly/contig_stat.h : 40 - Max: 34490, Min: 22, N50: 204, number contigs: 781125, number isolated: 302371, number looped: 91, total size: 106005456,' 2025-05-06 16:01:50 - b'INFO utils/utils.h : 152 - Real: 73.9337\tuser: 616.9657\tsys: 2.8704\tmaxrss: 454772' 2025-05-06 16:01:50 - Local assembly for k = 21 2025-05-06 16:01:50 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.local.fa --kmax 29 2025-05-06 16:01:54 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 99683, index size: 6321120' 2025-05-06 16:01:54 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 4.133395' 2025-05-06 16:01:54 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 16:01:55 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 16:01:55 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.716704' 2025-05-06 16:01:56 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 174.00 sd: 114.64' 2025-05-06 16:01:56 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.753277' 2025-05-06 16:02:04 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 8736916, added 1424390 reads to local assembly' 2025-05-06 16:02:04 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 8.076452' 2025-05-06 16:02:04 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' 2025-05-06 16:02:18 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 14.163707' 2025-05-06 16:02:18 - b'INFO utils/utils.h : 152 - Real: 27.9144\tuser: 225.4284\tsys: 1.5279\tmaxrss: 696940' 2025-05-06 16:02:18 - Extract iterative edges from k = 21 to 29 2025-05-06 16:02:18 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.bubble_seq.fa -t 10 -k 21 -s 8 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin 2025-05-06 16:02:18 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 8' 2025-05-06 16:02:18 - b'INFO main_iterate.cpp : 174 - Read 525066 contigs' 2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 1021006' 2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 174 - Read 107060 contigs' 2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 1181004' 2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 8' 2025-05-06 16:02:22 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 944610. Iterative edges: 3587266' 2025-05-06 16:02:25 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 1892328. Iterative edges: 4326289' 2025-05-06 16:02:27 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 2839663. Iterative edges: 4622084' 2025-05-06 16:02:27 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 2970005. Iterative edges: 4649513' 2025-05-06 16:02:28 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 2970005. Iterative edges: 4649513' 2025-05-06 16:02:28 - b'INFO utils/utils.h : 152 - Real: 10.0571\tuser: 70.4235\tsys: 1.1392\tmaxrss: 501728' 2025-05-06 16:02:28 - Build graph for k = 29 2025-05-06 16:02:28 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 --num_cpu_threads 10 -k 29 --kmer_from 21 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.bubble_seq.fa 2025-05-06 16:02:28 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 4649513' 2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 216390200, number contigs: 1074653, number multiplicity: 5724166' 2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 62694784, multiplicity vector: 5724166' 2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 4649513 edges.' 2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 62694784/4649513/139485390, multiplicity vector: 4649513/5724166' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 684048 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa.' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 116792336/5333561/243268884, multiplicity vector: 5333561/5724166' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 92193 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.bubble_seq.fa.' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 116792336/5425754/253844404, multiplicity vector: 5425754/5724166' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 19204 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.addi.fa.' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 116792336/5444958/258862158, multiplicity vector: 5444958/5724166' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 119515 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.local.fa.' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 116792336/5564473/309023104, multiplicity vector: 5564473/5724166' 2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 116792336/5564473/309023104, multiplicity vector: 5564473/5724166' 2025-05-06 16:02:29 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.8659' 2025-05-06 16:02:29 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 141083868 bytes' 2025-05-06 16:02:30 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 141083868), still trying to perform sorting' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 2490703, Lv2 items: 38843' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 130654940, Memory for Lv1+Lv2: 10428928' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.9688' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 54' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6086' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0407' 2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 54 to 142' 2025-05-06 16:02:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5952' 2025-05-06 16:02:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0399' 2025-05-06 16:02:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 142 to 245' 2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5957' 2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0412' 2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 245 to 362' 2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5960' 2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0415' 2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 362 to 491' 2025-05-06 16:02:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6017' 2025-05-06 16:02:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0457' 2025-05-06 16:02:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 491 to 628' 2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5971' 2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0561' 2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 628 to 772' 2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6073' 2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0487' 2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 772 to 923' 2025-05-06 16:02:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6031' 2025-05-06 16:02:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0470' 2025-05-06 16:02:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 923 to 1080' 2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5993' 2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0472' 2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1080 to 1243' 2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' 2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0606' 2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1243 to 1412' 2025-05-06 16:02:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6001' 2025-05-06 16:02:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0475' 2025-05-06 16:02:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1412 to 1587' 2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5980' 2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0480' 2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1587 to 1768' 2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6067' 2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0488' 2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1768 to 1953' 2025-05-06 16:02:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6052' 2025-05-06 16:02:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0485' 2025-05-06 16:02:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1953 to 2144' 2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6049' 2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0494' 2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2144 to 2340' 2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6192' 2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0555' 2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2340 to 2541' 2025-05-06 16:02:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5989' 2025-05-06 16:02:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0492' 2025-05-06 16:02:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2541 to 2748' 2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5991' 2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0494' 2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2748 to 2960' 2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6013' 2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0501' 2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2960 to 3176' 2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6011' 2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0649' 2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3176 to 3397' 2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5994' 2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0514' 2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3397 to 3623' 2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5983' 2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0505' 2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3623 to 3853' 2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5970' 2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0504' 2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3853 to 4087' 2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6138' 2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0568' 2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4087 to 4325' 2025-05-06 16:02:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6032' 2025-05-06 16:02:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0593' 2025-05-06 16:02:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4325 to 4567' 2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6051' 2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0574' 2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4567 to 4813' 2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6054' 2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0571' 2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4813 to 5064' 2025-05-06 16:02:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5980' 2025-05-06 16:02:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0512' 2025-05-06 16:02:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5064 to 5319' 2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6144' 2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' 2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5319 to 5578' 2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5990' 2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0512' 2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5578 to 5841' 2025-05-06 16:02:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6075' 2025-05-06 16:02:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' 2025-05-06 16:02:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5841 to 6107' 2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6016' 2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0524' 2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6107 to 6377' 2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6004' 2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0513' 2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6377 to 6651' 2025-05-06 16:02:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6001' 2025-05-06 16:02:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0528' 2025-05-06 16:02:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6651 to 6928' 2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6025' 2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0530' 2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6928 to 7209' 2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5999' 2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0516' 2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7209 to 7494' 2025-05-06 16:02:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6016' 2025-05-06 16:02:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0518' 2025-05-06 16:02:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7494 to 7783' 2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6024' 2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0545' 2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7783 to 8076' 2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5998' 2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' 2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8076 to 8372' 2025-05-06 16:02:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6050' 2025-05-06 16:02:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' 2025-05-06 16:02:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8372 to 8672' 2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6093' 2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0586' 2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8672 to 8976' 2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' 2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0575' 2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8976 to 9284' 2025-05-06 16:02:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6011' 2025-05-06 16:02:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0522' 2025-05-06 16:02:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9284 to 9596' 2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5994' 2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0532' 2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9596 to 9912' 2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5997' 2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0534' 2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9912 to 10232' 2025-05-06 16:03:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5975' 2025-05-06 16:03:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' 2025-05-06 16:03:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10232 to 10556' 2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6000' 2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0537' 2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10556 to 10883' 2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5996' 2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0527' 2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10883 to 11214' 2025-05-06 16:03:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5978' 2025-05-06 16:03:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' 2025-05-06 16:03:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11214 to 11549' 2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6035' 2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0537' 2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11549 to 11888' 2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6008' 2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0549' 2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11888 to 12231' 2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5993' 2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0530' 2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12231 to 12578' 2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6044' 2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0537' 2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12578 to 12929' 2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6021' 2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0533' 2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12929 to 13284' 2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6021' 2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0534' 2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13284 to 13643' 2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6010' 2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0530' 2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13643 to 14006' 2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5995' 2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0546' 2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14006 to 14373' 2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6020' 2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0531' 2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14373 to 14744' 2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5989' 2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0532' 2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14744 to 15119' 2025-05-06 16:03:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6014' 2025-05-06 16:03:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0533' 2025-05-06 16:03:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15119 to 15498' 2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6019' 2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0545' 2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15498 to 15881' 2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6025' 2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0524' 2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15881 to 16268' 2025-05-06 16:03:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' 2025-05-06 16:03:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0535' 2025-05-06 16:03:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16268 to 16659' 2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5998' 2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0532' 2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16659 to 17054' 2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6027' 2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0531' 2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17054 to 17454' 2025-05-06 16:03:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5989' 2025-05-06 16:03:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0529' 2025-05-06 16:03:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17454 to 17858' 2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6012' 2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0541' 2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17858 to 18267' 2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5994' 2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0540' 2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18267 to 18680' 2025-05-06 16:03:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5987' 2025-05-06 16:03:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0536' 2025-05-06 16:03:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18680 to 19098' 2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6107' 2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0619' 2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19098 to 19521' 2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6024' 2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0619' 2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19521 to 19949' 2025-05-06 16:03:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6010' 2025-05-06 16:03:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0591' 2025-05-06 16:03:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19949 to 20382' 2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5940' 2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0583' 2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20382 to 20820' 2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6184' 2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0551' 2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20820 to 21263' 2025-05-06 16:03:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6207' 2025-05-06 16:03:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0607' 2025-05-06 16:03:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21263 to 21711' 2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5943' 2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0582' 2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21711 to 22164' 2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5881' 2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0557' 2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22164 to 22622' 2025-05-06 16:03:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5879' 2025-05-06 16:03:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0557' 2025-05-06 16:03:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22622 to 23085' 2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5880' 2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0558' 2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23085 to 23553' 2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5888' 2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0602' 2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23553 to 24026' 2025-05-06 16:03:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5875' 2025-05-06 16:03:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0584' 2025-05-06 16:03:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24026 to 24504' 2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5884' 2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0610' 2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24504 to 24987' 2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5890' 2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0622' 2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24987 to 25476' 2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5895' 2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0580' 2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25476 to 25970' 2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5897' 2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0622' 2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25970 to 26470' 2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5896' 2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0656' 2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26470 to 26975' 2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5902' 2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0574' 2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26975 to 27486' 2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5877' 2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0580' 2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27486 to 28003' 2025-05-06 16:03:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5878' 2025-05-06 16:03:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0569' 2025-05-06 16:03:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28003 to 28527' 2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5885' 2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0588' 2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28527 to 29057' 2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5852' 2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0673' 2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29057 to 29593' 2025-05-06 16:03:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5947' 2025-05-06 16:03:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0650' 2025-05-06 16:03:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29593 to 30136' 2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5880' 2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0564' 2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30136 to 30686' 2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5879' 2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0568' 2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30686 to 31243' 2025-05-06 16:03:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5887' 2025-05-06 16:03:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0642' 2025-05-06 16:03:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31243 to 31806' 2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5891' 2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0628' 2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31806 to 32377' 2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5899' 2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0634' 2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32377 to 32956' 2025-05-06 16:03:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5902' 2025-05-06 16:03:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0585' 2025-05-06 16:03:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32956 to 33542' 2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5927' 2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0566' 2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33542 to 34137' 2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6025' 2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0724' 2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34137 to 34740' 2025-05-06 16:03:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5889' 2025-05-06 16:03:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0611' 2025-05-06 16:03:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34740 to 35351' 2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5936' 2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0570' 2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35351 to 35971' 2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5896' 2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0615' 2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35971 to 36600' 2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5950' 2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0560' 2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36600 to 37239' 2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5904' 2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0563' 2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37239 to 37888' 2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5910' 2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0577' 2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37888 to 38548' 2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5900' 2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0592' 2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38548 to 39219' 2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5919' 2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0610' 2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39219 to 39902' 2025-05-06 16:03:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5913' 2025-05-06 16:03:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0582' 2025-05-06 16:03:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39902 to 40598' 2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5912' 2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0634' 2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40598 to 41307' 2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6080' 2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0660' 2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41307 to 42030' 2025-05-06 16:03:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6046' 2025-05-06 16:03:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0669' 2025-05-06 16:03:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42030 to 42767' 2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6097' 2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0639' 2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42767 to 43520' 2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6099' 2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0664' 2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43520 to 44288' 2025-05-06 16:03:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6121' 2025-05-06 16:03:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' 2025-05-06 16:03:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 44288 to 45072' 2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6083' 2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0668' 2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45072 to 45876' 2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6105' 2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0667' 2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45876 to 46699' 2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6071' 2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0676' 2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46699 to 47543' 2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6083' 2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0592' 2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47543 to 48409' 2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5936' 2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0572' 2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48409 to 49300' 2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5952' 2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0587' 2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49300 to 50217' 2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5958' 2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0583' 2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50217 to 51166' 2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5973' 2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0585' 2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51166 to 52151' 2025-05-06 16:03:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5943' 2025-05-06 16:03:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0585' 2025-05-06 16:03:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52151 to 53173' 2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5986' 2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0602' 2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53173 to 54240' 2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6004' 2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0680' 2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 54240 to 55361' 2025-05-06 16:03:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5999' 2025-05-06 16:03:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' 2025-05-06 16:03:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55361 to 56549' 2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6009' 2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' 2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56549 to 57820' 2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' 2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0598' 2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 57820 to 59203' 2025-05-06 16:03:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6055' 2025-05-06 16:03:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0572' 2025-05-06 16:03:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59203 to 60751' 2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6083' 2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0605' 2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 60751 to 62628' 2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6092' 2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0568' 2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 62628 to 65536' 2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5984' 2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0461' 2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 87.2736' 2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 759694 48217857 41509540 41456316 48214387 57687 55289 45627 61938' 2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 180378335' 2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 179398100' 2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 759694' 2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0638' 2025-05-06 16:03:57 - b'INFO utils/utils.h : 152 - Real: 89.1820\tuser: 211.3668\tsys: 2.4769\tmaxrss: 147804' 2025-05-06 16:03:57 - Assemble contigs from SdBG for k = 29 2025-05-06 16:03:57 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble 2025-05-06 16:04:00 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29Done. Time elapsed: 2.494064' 2025-05-06 16:04:00 - b'INFO main_assemble.cpp : 133 - Number of Edges: 180378335; K value: 29' 2025-05-06 16:04:00 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:04:02 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 2988; time elapsed: 0.1919' 2025-05-06 16:04:03 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 8226; time elapsed: 0.3312' 2025-05-06 16:04:03 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 13554; time elapsed: 0.6646' 2025-05-06 16:04:05 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 20788; time elapsed: 1.5277' 2025-05-06 16:04:08 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 59237; time elapsed: 3.1862' 2025-05-06 16:04:13 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 58; Accumulated tips removed: 268180; time elapsed: 4.9964' 2025-05-06 16:04:13 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 13.184' 2025-05-06 16:04:29 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 533340, palindrome: 203' 2025-05-06 16:04:29 - b'INFO main_assemble.cpp : 166 - unitig graph size: 533474, time for building: 16.049' 2025-05-06 16:04:30 - b'INFO assembly/contig_stat.h : 40 - Max: 63463, Min: 30, N50: 314, number contigs: 533474, number isolated: 238899, number looped: 134, total size: 99670888,' 2025-05-06 16:04:30 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:04:30 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 21416, Time elapsed(sec): 0.437' 2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 7810, Time elapsed(sec): 0.455845' 2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 46016, time: 0.127' 2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 7983, time: 0.070' 2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 192 - Tips removed: 16837, time: 0.277' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 279, Time elapsed(sec): 0.094' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 712, Time elapsed(sec): 0.192138' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 589, time: 0.084' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 150, time: 0.051' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 192 - Tips removed: 202, time: 0.253' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.084' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 10, Time elapsed(sec): 0.165256' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 23, time: 0.083' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 6, time: 0.049' 2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 3, time: 0.231' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.081' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.160315' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 8, time: 0.083' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 2, time: 0.050' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 1, time: 0.238' 2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.081' 2025-05-06 16:04:34 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.160943' 2025-05-06 16:04:34 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 5, time: 0.083' 2025-05-06 16:04:34 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.006' 2025-05-06 16:04:34 - b'INFO assembly/contig_stat.h : 40 - Max: 75508, Min: 30, N50: 433, number contigs: 379330, number isolated: 250939, number looped: 129, total size: 93879869,' 2025-05-06 16:04:40 - b'INFO main_assemble.cpp : 267 - Time to output: 5.926184' 2025-05-06 16:04:42 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 4827, complex bubbles removed: 184, time: 2.058557' 2025-05-06 16:04:43 - b'INFO assembly/contig_stat.h : 40 - Max: 95964, Min: 30, N50: 446, number contigs: 367513, number isolated: 251751, number looped: 131, total size: 93387611,' 2025-05-06 16:04:49 - b'INFO utils/utils.h : 152 - Real: 51.5173\tuser: 437.4020\tsys: 1.7851\tmaxrss: 409628' 2025-05-06 16:04:49 - Local assembly for k = 29 2025-05-06 16:04:49 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.local.fa --kmax 39 2025-05-06 16:05:07 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 87432, index size: 7485042' 2025-05-06 16:05:07 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 17.622944' 2025-05-06 16:05:07 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 16:05:07 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 16:05:07 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.709316' 2025-05-06 16:05:08 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 183.00 sd: 123.09' 2025-05-06 16:05:08 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.697406' 2025-05-06 16:05:18 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10303999, added 1005321 reads to local assembly' 2025-05-06 16:05:18 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.747103' 2025-05-06 16:05:18 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' 2025-05-06 16:05:30 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 12.398428' 2025-05-06 16:05:30 - b'INFO utils/utils.h : 152 - Real: 41.2621\tuser: 308.0859\tsys: 3.1803\tmaxrss: 822376' 2025-05-06 16:05:30 - Extract iterative edges from k = 29 to 39 2025-05-06 16:05:30 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.bubble_seq.fa -t 10 -k 29 -s 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin 2025-05-06 16:05:30 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 8' 2025-05-06 16:05:30 - b'INFO main_iterate.cpp : 174 - Read 128391 contigs' 2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 255163' 2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 174 - Read 48695 contigs' 2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 333160' 2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 12' 2025-05-06 16:05:33 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 344732. Iterative edges: 1075926' 2025-05-06 16:05:35 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 691077. Iterative edges: 1321601' 2025-05-06 16:05:37 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 1038075. Iterative edges: 1426815' 2025-05-06 16:05:37 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 1085576. Iterative edges: 1436769' 2025-05-06 16:05:37 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 1085576. Iterative edges: 1436769' 2025-05-06 16:05:37 - b'INFO utils/utils.h : 152 - Real: 7.1443\tuser: 46.7362\tsys: 0.8244\tmaxrss: 350532' 2025-05-06 16:05:37 - Build graph for k = 39 2025-05-06 16:05:37 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 --num_cpu_threads 10 -k 39 --kmer_from 29 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.bubble_seq.fa 2025-05-06 16:05:37 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 1436769' 2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 103800659, number contigs: 514262, number multiplicity: 1951031' 2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 30064272, multiplicity vector: 1951031' 2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 1436769 edges.' 2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 30064272/1436769/57470760, multiplicity vector: 1436769/1951031' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 366871 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa.' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 56014440/1803640/150918758, multiplicity vector: 1803640/1951031' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 42601 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.bubble_seq.fa.' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 56014440/1846241/157492011, multiplicity vector: 1846241/1951031' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 4550 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.addi.fa.' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 56014440/1850791/160761635, multiplicity vector: 1850791/1951031' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 81640 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.local.fa.' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 56014440/1932431/194978118, multiplicity vector: 1932431/1951031' 2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 56014440/1932431/194978118, multiplicity vector: 1932431/1951031' 2025-05-06 16:05:38 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.5683' 2025-05-06 16:05:38 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 69673350 bytes' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 5182018, Lv2 items: 107388' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 61439798, Memory for Lv1+Lv2: 22446280' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.6075' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 265' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3543' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0870' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 265 to 666' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3809' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1134' 2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 666 to 1131' 2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3506' 2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0997' 2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1131 to 1647' 2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3516' 2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1024' 2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1647 to 2209' 2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3513' 2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1029' 2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2209 to 2815' 2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3539' 2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1031' 2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2815 to 3462' 2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3534' 2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1053' 2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3462 to 4145' 2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3623' 2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1112' 2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4145 to 4861' 2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3578' 2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1075' 2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4861 to 5611' 2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3641' 2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1080' 2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5611 to 6392' 2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3618' 2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1273' 2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6392 to 7203' 2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3584' 2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1085' 2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7203 to 8045' 2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3610' 2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1078' 2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8045 to 8918' 2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3591' 2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1083' 2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8918 to 9822' 2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3589' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1072' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9822 to 10757' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3601' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1091' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10757 to 11723' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3643' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1221' 2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11723 to 12722' 2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3645' 2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1100' 2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12722 to 13751' 2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3643' 2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1095' 2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13751 to 14812' 2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3634' 2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1098' 2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14812 to 15906' 2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3633' 2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1098' 2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15906 to 17033' 2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3671' 2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1090' 2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17033 to 18194' 2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3673' 2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1116' 2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18194 to 19392' 2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3666' 2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1175' 2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19392 to 20628' 2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3718' 2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1092' 2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20628 to 21904' 2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3695' 2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1133' 2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21904 to 23219' 2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3709' 2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1109' 2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23219 to 24575' 2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3733' 2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1114' 2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24575 to 25972' 2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3701' 2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1116' 2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25972 to 27414' 2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3719' 2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1106' 2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27414 to 28903' 2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3737' 2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1133' 2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28903 to 30442' 2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3730' 2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1108' 2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30442 to 32035' 2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3808' 2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1210' 2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32035 to 33688' 2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3774' 2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1123' 2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33688 to 35405' 2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3756' 2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1122' 2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35405 to 37192' 2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3754' 2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1113' 2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37192 to 39059' 2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3785' 2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1131' 2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39059 to 41017' 2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3795' 2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1114' 2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41017 to 43081' 2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3869' 2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1164' 2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43081 to 45266' 2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3797' 2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1117' 2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45266 to 47597' 2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3825' 2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1141' 2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47597 to 50107' 2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3845' 2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1143' 2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50107 to 52854' 2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3832' 2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1132' 2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52854 to 55946' 2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3825' 2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1132' 2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55946 to 59658' 2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3898' 2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1152' 2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59658 to 65536' 2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3834' 2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1171' 2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 22.0939' 2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 571526 44110831 37702980 37654025 44120496 16770 18428 18526 16947' 2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 164230529' 2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 163588332' 2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 571526' 2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0632' 2025-05-06 16:06:01 - b'INFO utils/utils.h : 152 - Real: 23.3406\tuser: 93.1432\tsys: 2.3035\tmaxrss: 121828' 2025-05-06 16:06:01 - Assemble contigs from SdBG for k = 39 2025-05-06 16:06:01 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble 2025-05-06 16:06:03 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39Done. Time elapsed: 2.192497' 2025-05-06 16:06:03 - b'INFO main_assemble.cpp : 133 - Number of Edges: 164230529; K value: 39' 2025-05-06 16:06:03 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:06:05 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 960; time elapsed: 0.1631' 2025-05-06 16:06:06 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 2682; time elapsed: 0.2668' 2025-05-06 16:06:06 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 4991; time elapsed: 0.5161' 2025-05-06 16:06:07 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 7679; time elapsed: 1.1512' 2025-05-06 16:06:10 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 18901; time elapsed: 2.3666' 2025-05-06 16:06:14 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 265868; time elapsed: 3.9327' 2025-05-06 16:06:17 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 78; Accumulated tips removed: 312203; time elapsed: 3.2628' 2025-05-06 16:06:17 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 13.901' 2025-05-06 16:06:30 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 219334, palindrome: 68' 2025-05-06 16:06:30 - b'INFO main_assemble.cpp : 166 - unitig graph size: 219475, time for building: 13.091' 2025-05-06 16:06:30 - b'INFO assembly/contig_stat.h : 40 - Max: 86032, Min: 40, N50: 860, number contigs: 219475, number isolated: 128393, number looped: 141, total size: 81397212,' 2025-05-06 16:06:30 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:06:30 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 7448, Time elapsed(sec): 0.176' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 4359, Time elapsed(sec): 0.288947' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 5391, time: 0.039' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1223, time: 0.026' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 192 - Tips removed: 2242, time: 0.130' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 53, Time elapsed(sec): 0.041' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 154, Time elapsed(sec): 0.102604' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 120, time: 0.033' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 36, time: 0.019' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 192 - Tips removed: 44, time: 0.121' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.032' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1, Time elapsed(sec): 0.080429' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 15, time: 0.036' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 5, time: 0.019' 2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.117' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.031' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.079786' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 3, time: 0.036' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.002' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.124' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.038' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.083874' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.036' 2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.002' 2025-05-06 16:06:32 - b'INFO assembly/contig_stat.h : 40 - Max: 86032, Min: 40, N50: 1134, number contigs: 173698, number isolated: 131632, number looped: 81, total size: 78917666,' 2025-05-06 16:06:38 - b'INFO main_assemble.cpp : 267 - Time to output: 5.657897' 2025-05-06 16:06:39 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 1521, complex bubbles removed: 80, time: 0.833683' 2025-05-06 16:06:39 - b'INFO assembly/contig_stat.h : 40 - Max: 95964, Min: 40, N50: 1162, number contigs: 169831, number isolated: 132031, number looped: 82, total size: 78708013,' 2025-05-06 16:06:45 - b'INFO utils/utils.h : 152 - Real: 43.7543\tuser: 355.1417\tsys: 1.3203\tmaxrss: 375628' 2025-05-06 16:06:45 - Local assembly for k = 39 2025-05-06 16:06:45 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.local.fa --kmax 59 2025-05-06 16:06:54 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 76139, index size: 7873666' 2025-05-06 16:06:54 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 9.163731' 2025-05-06 16:06:54 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 16:06:55 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 16:06:55 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.760834' 2025-05-06 16:06:56 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 188.00 sd: 126.72' 2025-05-06 16:06:56 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 1.376784' 2025-05-06 16:07:08 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10981391, added 710416 reads to local assembly' 2025-05-06 16:07:08 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 12.512106' 2025-05-06 16:07:08 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' 2025-05-06 16:07:22 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 13.106024' 2025-05-06 16:07:22 - b'INFO utils/utils.h : 152 - Real: 36.9918\tuser: 267.0140\tsys: 3.0394\tmaxrss: 808748' 2025-05-06 16:07:22 - Extract iterative edges from k = 39 to 59 2025-05-06 16:07:22 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.bubble_seq.fa -t 10 -k 39 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin 2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 12' 2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 174 - Read 42066 contigs' 2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 83602' 2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 174 - Read 11202 contigs' 2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 101057' 2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 16' 2025-05-06 16:07:24 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 106356. Iterative edges: 531642' 2025-05-06 16:07:26 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 212400. Iterative edges: 679690' 2025-05-06 16:07:28 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 319159. Iterative edges: 749629' 2025-05-06 16:07:28 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 333768. Iterative edges: 756029' 2025-05-06 16:07:28 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 333768. Iterative edges: 756029' 2025-05-06 16:07:28 - b'INFO utils/utils.h : 152 - Real: 6.4318\tuser: 45.8938\tsys: 0.6275\tmaxrss: 328584' 2025-05-06 16:07:28 - Build graph for k = 59 2025-05-06 16:07:28 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 --num_cpu_threads 10 -k 59 --kmer_from 39 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.bubble_seq.fa 2025-05-06 16:07:28 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 756029' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 72896007, number contigs: 240305, number multiplicity: 996334' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 20146452, multiplicity vector: 996334' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 756029 edges.' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 20146452/756029/45361740, multiplicity vector: 756029/996334' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 168136 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa.' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 38370456/924165/123978954, multiplicity vector: 924165/996334' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 9637 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.bubble_seq.fa.' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 38370456/933802/126923629, multiplicity vector: 933802/996334' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 1461 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.addi.fa.' 2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 38370456/935263/128831559, multiplicity vector: 935263/996334' 2025-05-06 16:07:29 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 53916 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.local.fa.' 2025-05-06 16:07:29 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 74818464/989179/151146934, multiplicity vector: 989179/996334' 2025-05-06 16:07:29 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 74818464/989179/151146934, multiplicity vector: 989179/996334' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.4105' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 84413552 bytes' 2025-05-06 16:07:29 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 84413552), still trying to perform sorting' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 1486489, Lv2 items: 23780' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 77991996, Memory for Lv1+Lv2: 6421556' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.4307' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 26' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2574' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0189' 2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26 to 81' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2550' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0224' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 81 to 156' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2622' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0268' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 156 to 243' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0247' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 243 to 342' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2624' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0264' 2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 342 to 451' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2588' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0260' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 451 to 569' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0284' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 569 to 695' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2581' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0277' 2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 695 to 826' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2590' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0288' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 826 to 963' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2604' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0281' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 963 to 1106' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0283' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1106 to 1254' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2606' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0285' 2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1254 to 1409' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2619' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0296' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1409 to 1569' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2600' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0296' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1569 to 1734' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2619' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0342' 2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1734 to 1904' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2575' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1904 to 2079' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2594' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0301' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2079 to 2260' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2530' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0291' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2260 to 2446' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2589' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' 2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2446 to 2637' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2571' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0313' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2637 to 2833' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2587' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0307' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2833 to 3033' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2695' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0323' 2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3033 to 3238' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2955' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0319' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3238 to 3448' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2853' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0309' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3448 to 3662' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2917' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' 2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3662 to 3880' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2897' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0341' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3880 to 4102' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2805' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0348' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4102 to 4328' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2726' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0347' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4328 to 4558' 2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2607' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0345' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4558 to 4792' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2628' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0347' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4792 to 5030' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2777' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0295' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5030 to 5272' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2658' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0289' 2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5272 to 5518' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2601' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0280' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5518 to 5768' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2608' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0278' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5768 to 6022' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2626' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0290' 2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6022 to 6279' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3024' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0281' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6279 to 6540' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3043' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0305' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6540 to 6805' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2964' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0309' 2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6805 to 7074' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2955' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0326' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7074 to 7347' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3038' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0337' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7347 to 7624' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2649' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0307' 2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7624 to 7905' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2797' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0290' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7905 to 8190' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2698' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8190 to 8478' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2781' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0290' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8478 to 8770' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2707' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0285' 2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8770 to 9066' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2993' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0285' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9066 to 9366' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2682' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0294' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9366 to 9670' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2621' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' 2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9670 to 9977' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2629' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9977 to 10289' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2610' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0295' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10289 to 10605' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2883' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0316' 2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10605 to 10924' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2741' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0308' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10924 to 11247' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2614' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0294' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11247 to 11574' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2600' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0287' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11574 to 11905' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2628' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' 2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11905 to 12240' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2676' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12240 to 12579' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2622' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12579 to 12922' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' 2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12922 to 13269' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2587' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13269 to 13620' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2615' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13620 to 13976' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2618' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0299' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13976 to 14335' 2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2621' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14335 to 14699' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2604' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0294' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14699 to 15067' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2609' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15067 to 15439' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2603' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' 2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15439 to 15815' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15815 to 16195' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2630' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16195 to 16580' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2588' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0291' 2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16580 to 16969' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2595' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16969 to 17362' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0302' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17362 to 17760' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2612' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0301' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17760 to 18163' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2598' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' 2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18163 to 18570' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2611' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18570 to 18982' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0302' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18982 to 19398' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2597' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' 2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19398 to 19820' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2623' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19820 to 20247' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2615' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0309' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20247 to 20678' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2592' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0321' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20678 to 21114' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2602' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' 2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21114 to 21556' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2611' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21556 to 22003' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2597' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22003 to 22455' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0302' 2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22455 to 22912' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2613' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0349' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22912 to 23375' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0343' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23375 to 23843' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2621' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0354' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23843 to 24317' 2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2604' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0355' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24317 to 24796' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2661' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0350' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24796 to 25280' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2617' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0363' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25280 to 25770' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2679' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0341' 2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25770 to 26265' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2622' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0312' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26265 to 26766' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2565' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0311' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26766 to 27273' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2555' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' 2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27273 to 27786' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2556' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27786 to 28305' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2554' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28305 to 28830' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2535' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0312' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28830 to 29361' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2560' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0317' 2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29361 to 29899' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2576' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0314' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29899 to 30444' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2562' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0305' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30444 to 30996' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2564' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0314' 2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30996 to 31556' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2574' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0317' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31556 to 32123' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2578' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0311' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32123 to 32698' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2527' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32698 to 33281' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2562' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' 2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33281 to 33872' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2548' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0313' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33872 to 34472' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2578' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0315' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34472 to 35081' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2563' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0308' 2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35081 to 35699' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2547' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35699 to 36326' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2547' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0314' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36326 to 36962' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2583' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36962 to 37608' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2563' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0324' 2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37608 to 38266' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2550' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38266 to 38935' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38935 to 39616' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2582' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0316' 2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39616 to 40309' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2548' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0315' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40309 to 41016' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2573' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41016 to 41738' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2549' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0317' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41738 to 42475' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2586' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' 2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42475 to 43227' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2561' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0321' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43227 to 43995' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2553' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0321' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43995 to 44780' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2571' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0325' 2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 44780 to 45583' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2570' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0316' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45583 to 46407' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2582' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0328' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46407 to 47251' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2575' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0320' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47251 to 48119' 2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2563' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0325' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48119 to 49011' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2583' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0328' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49011 to 49931' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0358' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49931 to 50882' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2731' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0332' 2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50882 to 51868' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2651' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0346' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51868 to 52895' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52895 to 53965' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2564' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' 2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53965 to 55088' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2567' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0328' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55088 to 56281' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2631' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0342' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56281 to 57557' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2602' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0329' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 57557 to 58941' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2583' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' 2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 58941 to 60483' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2612' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0337' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 60483 to 62328' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2650' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0340' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 62328 to 65536' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2609' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 40.3727' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 295111 38189263 32322028 32289518 38204929 7507 6845 5789 8094' 2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 141329084' 2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 141005738' 2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 295111' 2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0577' 2025-05-06 16:08:09 - b'INFO utils/utils.h : 152 - Real: 41.2772\tuser: 127.7826\tsys: 1.5443\tmaxrss: 90848' 2025-05-06 16:08:09 - Assemble contigs from SdBG for k = 59 2025-05-06 16:08:09 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble 2025-05-06 16:08:11 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59Done. Time elapsed: 1.939633' 2025-05-06 16:08:11 - b'INFO main_assemble.cpp : 133 - Number of Edges: 141329084; K value: 59' 2025-05-06 16:08:11 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:08:13 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 726; time elapsed: 0.1143' 2025-05-06 16:08:14 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 1808; time elapsed: 0.1918' 2025-05-06 16:08:14 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 3926; time elapsed: 0.3170' 2025-05-06 16:08:15 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 7510; time elapsed: 0.6805' 2025-05-06 16:08:16 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 11250; time elapsed: 1.3694' 2025-05-06 16:08:19 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 34982; time elapsed: 2.6588' 2025-05-06 16:08:22 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 118; Accumulated tips removed: 153685; time elapsed: 3.1563' 2025-05-06 16:08:22 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 10.293' 2025-05-06 16:08:32 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 102654, palindrome: 13' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 166 - unitig graph size: 102742, time for building: 10.984' 2025-05-06 16:08:33 - b'INFO assembly/contig_stat.h : 40 - Max: 94498, Min: 60, N50: 2016, number contigs: 102742, number isolated: 72156, number looped: 88, total size: 70480343,' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 1424, Time elapsed(sec): 0.088' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1292, Time elapsed(sec): 0.153342' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 3384, time: 0.018' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 777, time: 0.013' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 799, time: 0.058' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 13, Time elapsed(sec): 0.022' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 74, Time elapsed(sec): 0.054730' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 148, time: 0.015' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 50, time: 0.009' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 49, time: 0.050' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.013' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1, Time elapsed(sec): 0.038041' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 18, time: 0.017' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 4, time: 0.008' 2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 192 - Tips removed: 4, time: 0.047' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.013' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.036741' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.014' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.009' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.045' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.013' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.040069' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.014' 2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.001' 2025-05-06 16:08:34 - b'INFO assembly/contig_stat.h : 40 - Max: 130201, Min: 60, N50: 2362, number contigs: 88444, number isolated: 73356, number looped: 91, total size: 69364315,' 2025-05-06 16:08:39 - b'INFO main_assemble.cpp : 267 - Time to output: 4.549319' 2025-05-06 16:08:39 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 805, complex bubbles removed: 25, time: 0.228630' 2025-05-06 16:08:39 - b'INFO assembly/contig_stat.h : 40 - Max: 130201, Min: 60, N50: 2393, number contigs: 86507, number isolated: 73658, number looped: 91, total size: 69210710,' 2025-05-06 16:08:44 - b'INFO utils/utils.h : 152 - Real: 34.0912\tuser: 272.8803\tsys: 0.9958\tmaxrss: 324248' 2025-05-06 16:08:44 - Local assembly for k = 59 2025-05-06 16:08:44 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.local.fa --kmax 79 2025-05-06 16:08:59 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 69562, index size: 8019088' 2025-05-06 16:08:59 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 15.404690' 2025-05-06 16:08:59 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 16:09:00 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 16:09:00 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.707533' 2025-05-06 16:09:00 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 190.00 sd: 128.68' 2025-05-06 16:09:00 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.632208' 2025-05-06 16:09:10 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 11205948, added 486448 reads to local assembly' 2025-05-06 16:09:10 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.997708' 2025-05-06 16:09:10 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' 2025-05-06 16:09:21 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 10.888542' 2025-05-06 16:09:21 - b'INFO utils/utils.h : 152 - Real: 37.7081\tuser: 272.1432\tsys: 1.6522\tmaxrss: 800120' 2025-05-06 16:09:21 - Extract iterative edges from k = 59 to 79 2025-05-06 16:09:21 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.bubble_seq.fa -t 10 -k 59 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin 2025-05-06 16:09:21 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 16' 2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 174 - Read 15088 contigs' 2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 30026' 2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 174 - Read 2344 contigs' 2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 33815' 2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 20' 2025-05-06 16:09:23 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 24415. Iterative edges: 118804' 2025-05-06 16:09:23 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 48844. Iterative edges: 163065' 2025-05-06 16:09:24 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 73127. Iterative edges: 186588' 2025-05-06 16:09:24 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 76414. Iterative edges: 188756' 2025-05-06 16:09:24 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 76414. Iterative edges: 188756' 2025-05-06 16:09:24 - b'INFO utils/utils.h : 152 - Real: 2.5902\tuser: 18.9548\tsys: 0.4065\tmaxrss: 323236' 2025-05-06 16:09:24 - Build graph for k = 79 2025-05-06 16:09:24 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 --num_cpu_threads 10 -k 79 --kmer_from 59 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.bubble_seq.fa 2025-05-06 16:09:24 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 188756' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 31394249, number contigs: 125461, number multiplicity: 314217' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 8852260, multiplicity vector: 314217' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 188756 edges.' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 8852260/188756/15100480, multiplicity vector: 188756/314217' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 86938 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa.' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 32397952/275694/84354802, multiplicity vector: 275694/314217' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 2158 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.bubble_seq.fa.' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 32397952/277852/85968971, multiplicity vector: 277852/314217' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 778 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.addi.fa.' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 32397952/278630/87598019, multiplicity vector: 278630/314217' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 33891 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.local.fa.' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 32397952/312521/101327828, multiplicity vector: 312521/314217' 2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 32397952/312521/101327828, multiplicity vector: 312521/314217' 2025-05-06 16:09:24 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2954' 2025-05-06 16:09:24 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 39134022 bytes' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 12113847, Lv2 items: 67194' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 33818034, Memory for Lv1+Lv2: 50068044' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.2977' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 1460' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2310' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1984' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1460 to 3681' 2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2531' 2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2128' 2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3681 to 6385' 2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2639' 2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2095' 2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6385 to 9503' 2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2716' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2103' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9503 to 13035' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2789' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2109' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13035 to 16990' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2822' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2185' 2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16990 to 21401' 2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2872' 2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2197' 2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21401 to 26327' 2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2887' 2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2583' 2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26327 to 31841' 2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2873' 2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2165' 2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31841 to 38118' 2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2889' 2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2248' 2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38118 to 45528' 2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2959' 2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2212' 2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45528 to 55035' 2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2932' 2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2277' 2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55035 to 65536' 2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2296' 2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1400' 2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 6.3267' 2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 160234 34420688 28882691 28866054 34428757 3895 2662 3016 3477' 2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 126771474' 2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 126598190' 2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 160234' 2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0576' 2025-05-06 16:09:31 - b'INFO utils/utils.h : 152 - Real: 6.9835\tuser: 38.7237\tsys: 1.2927\tmaxrss: 119596' 2025-05-06 16:09:31 - Assemble contigs from SdBG for k = 79 2025-05-06 16:09:31 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble 2025-05-06 16:09:33 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79Done. Time elapsed: 1.718369' 2025-05-06 16:09:33 - b'INFO main_assemble.cpp : 133 - Number of Edges: 126771474; K value: 79' 2025-05-06 16:09:33 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 332; time elapsed: 0.0962' 2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 948; time elapsed: 0.1206' 2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 1964; time elapsed: 0.2011' 2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 3840; time elapsed: 0.3770' 2025-05-06 16:09:36 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 6356; time elapsed: 0.6926' 2025-05-06 16:09:37 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 9660; time elapsed: 1.3675' 2025-05-06 16:09:40 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 44124; time elapsed: 2.3939' 2025-05-06 16:09:42 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 158; Accumulated tips removed: 63812; time elapsed: 2.4291' 2025-05-06 16:09:42 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 9.290' 2025-05-06 16:09:52 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 62550, palindrome: 6' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 166 - unitig graph size: 62643, time for building: 9.738' 2025-05-06 16:09:52 - b'INFO assembly/contig_stat.h : 40 - Max: 165723, Min: 80, N50: 3260, number contigs: 62643, number isolated: 49149, number looped: 93, total size: 64789023,' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 427, Time elapsed(sec): 0.046' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 371, Time elapsed(sec): 0.172938' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1810, time: 0.011' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 418, time: 0.007' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 192 - Tips removed: 463, time: 0.039' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 3, Time elapsed(sec): 0.009' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 16, Time elapsed(sec): 0.051476' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 70, time: 0.010' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 13, time: 0.005' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 192 - Tips removed: 25, time: 0.035' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.008' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1, Time elapsed(sec): 0.022605' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 9, time: 0.009' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 2, time: 0.005' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 192 - Tips removed: 4, time: 0.032' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.008' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.022206' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1, time: 0.009' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' 2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.031' 2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.008' 2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.021429' 2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1, time: 0.009' 2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:09:53 - b'INFO assembly/contig_stat.h : 40 - Max: 173318, Min: 80, N50: 3550, number contigs: 57028, number isolated: 49544, number looped: 36, total size: 64210124,' 2025-05-06 16:09:56 - b'INFO main_assemble.cpp : 267 - Time to output: 3.466998' 2025-05-06 16:09:56 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 412, complex bubbles removed: 8, time: 0.114352' 2025-05-06 16:09:56 - b'INFO assembly/contig_stat.h : 40 - Max: 173318, Min: 80, N50: 3587, number contigs: 56072, number isolated: 49726, number looped: 36, total size: 64108652,' 2025-05-06 16:10:00 - b'INFO utils/utils.h : 152 - Real: 28.8418\tuser: 242.0455\tsys: 1.3001\tmaxrss: 291428' 2025-05-06 16:10:00 - Local assembly for k = 79 2025-05-06 16:10:00 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.local.fa --kmax 99 2025-05-06 16:10:14 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 54644, index size: 7769107' 2025-05-06 16:10:14 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 14.023692' 2025-05-06 16:10:14 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 16:10:15 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 16:10:15 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.715935' 2025-05-06 16:10:16 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 191.00 sd: 129.86' 2025-05-06 16:10:16 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 1.103235' 2025-05-06 16:10:25 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 11037727, added 346196 reads to local assembly' 2025-05-06 16:10:25 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.531475' 2025-05-06 16:10:25 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' 2025-05-06 16:10:34 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 8.275738' 2025-05-06 16:10:34 - b'INFO utils/utils.h : 152 - Real: 33.7174\tuser: 242.0218\tsys: 1.5519\tmaxrss: 778468' 2025-05-06 16:10:34 - Extract iterative edges from k = 79 to 99 2025-05-06 16:10:34 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.bubble_seq.fa -t 10 -k 79 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin 2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 20' 2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 174 - Read 7484 contigs' 2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 14870' 2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 174 - Read 705 contigs' 2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 16014' 2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 28' 2025-05-06 16:10:35 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 5564. Iterative edges: 8036' 2025-05-06 16:10:35 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 11005. Iterative edges: 13576' 2025-05-06 16:10:36 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 16577. Iterative edges: 17702' 2025-05-06 16:10:36 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 17330. Iterative edges: 18205' 2025-05-06 16:10:36 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 17330. Iterative edges: 18205' 2025-05-06 16:10:36 - b'INFO utils/utils.h : 152 - Real: 2.1713\tuser: 15.2928\tsys: 0.3914\tmaxrss: 319796' 2025-05-06 16:10:36 - Build graph for k = 99 2025-05-06 16:10:36 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 --num_cpu_threads 10 -k 99 --kmer_from 79 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.bubble_seq.fa 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 18205' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 13182457, number contigs: 82028, number multiplicity: 100233' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 3951848, multiplicity vector: 100233' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 18205 edges.' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 3951848/18205/1820500, multiplicity vector: 18205/100233' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 56346 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa.' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 27021160/74551/65971284, multiplicity vector: 74551/100233' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 654 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.bubble_seq.fa.' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 27021160/75205/67122816, multiplicity vector: 75205/100233' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 386 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.addi.fa.' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 27021160/75591/68264046, multiplicity vector: 75591/100233' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 23904 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.local.fa.' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 27021160/99495/77998531, multiplicity vector: 99495/100233' 2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 27021160/99495/77998531, multiplicity vector: 99495/100233' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2502' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 32601562 bytes' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 13597671, Lv2 items: 59442' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 27831018, Memory for Lv1+Lv2: 56055060' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.1752' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 1975' 2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1293' 2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2073' 2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1975 to 5033' 2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1435' 2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2218' 2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5033 to 8797' 2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1529' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2355' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8797 to 13222' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1578' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2285' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13222 to 18332' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1610' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2318' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18332 to 24210' 2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1651' 2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2323' 2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24210 to 30985' 2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1672' 2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2353' 2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30985 to 38943' 2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1700' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2441' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38943 to 48890' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1709' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2394' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48890 to 65536' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1612' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2341' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 3.8941' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 107297 32200108 26879428 26866041 32210891 1672 1495 1526 1773' 2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 118270231' 2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 118156468' 2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 107297' 2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0594' 2025-05-06 16:10:40 - b'INFO utils/utils.h : 152 - Real: 4.3849\tuser: 32.4851\tsys: 1.1647\tmaxrss: 118224' 2025-05-06 16:10:40 - Assemble contigs from SdBG for k = 99 2025-05-06 16:10:40 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble 2025-05-06 16:10:42 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99Done. Time elapsed: 1.619685' 2025-05-06 16:10:42 - b'INFO main_assemble.cpp : 133 - Number of Edges: 118270231; K value: 99' 2025-05-06 16:10:42 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 264; time elapsed: 0.0838' 2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 1566; time elapsed: 0.0996' 2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 1938; time elapsed: 0.1483' 2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 2690; time elapsed: 0.2645' 2025-05-06 16:10:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 3922; time elapsed: 0.4764' 2025-05-06 16:10:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 5788; time elapsed: 0.9305' 2025-05-06 16:10:47 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 7269; time elapsed: 1.8029' 2025-05-06 16:10:50 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 198; Accumulated tips removed: 33877; time elapsed: 2.3510' 2025-05-06 16:10:50 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 7.659' 2025-05-06 16:10:59 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 43855, palindrome: 2' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 166 - unitig graph size: 43885, time for building: 9.038' 2025-05-06 16:10:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337872, Min: 100, N50: 4405, number contigs: 43885, number isolated: 37018, number looped: 30, total size: 61052170,' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 184, Time elapsed(sec): 0.027' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 156, Time elapsed(sec): 0.086933' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 984, time: 0.007' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 193, time: 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 199, time: 0.025' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.010' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 2, Time elapsed(sec): 0.012787' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 30, time: 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 15, time: 0.004' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 6, time: 0.021' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012277' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 5, time: 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.003' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.020' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012133' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.019' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012113' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.005' 2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:10:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337934, Min: 100, N50: 4630, number contigs: 41258, number isolated: 37333, number looped: 34, total size: 60722196,' 2025-05-06 16:11:03 - b'INFO main_assemble.cpp : 267 - Time to output: 3.744675' 2025-05-06 16:11:03 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 215, complex bubbles removed: 7, time: 0.062233' 2025-05-06 16:11:03 - b'INFO assembly/contig_stat.h : 40 - Max: 337934, Min: 100, N50: 4675, number contigs: 40752, number isolated: 37431, number looped: 34, total size: 60654450,' 2025-05-06 16:11:07 - b'INFO utils/utils.h : 152 - Real: 26.4392\tuser: 214.5748\tsys: 0.8202\tmaxrss: 272912' 2025-05-06 16:11:07 - Local assembly for k = 99 2025-05-06 16:11:07 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.local.fa --kmax 119 2025-05-06 16:11:24 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 40227, index size: 7403870' 2025-05-06 16:11:24 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 16.969941' 2025-05-06 16:11:24 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 16:11:25 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 16:11:25 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.738825' 2025-05-06 16:11:26 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 192.00 sd: 130.73' 2025-05-06 16:11:26 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.873923' 2025-05-06 16:11:35 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10895260, added 253997 reads to local assembly' 2025-05-06 16:11:35 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.903153' 2025-05-06 16:11:35 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' 2025-05-06 16:11:41 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 6.011207' 2025-05-06 16:11:42 - b'INFO utils/utils.h : 152 - Real: 34.5659\tuser: 241.5755\tsys: 2.3682\tmaxrss: 757376' 2025-05-06 16:11:42 - Extract iterative edges from k = 99 to 119 2025-05-06 16:11:42 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.bubble_seq.fa -t 10 -k 99 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 28' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 174 - Read 3925 contigs' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 7825' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 174 - Read 279 contigs' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 8279' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 32' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 0. Iterative edges: 0' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 0. Iterative edges: 0' 2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 0. Iterative edges: 0' 2025-05-06 16:11:43 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 0. Iterative edges: 0' 2025-05-06 16:11:43 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 0. Iterative edges: 0' 2025-05-06 16:11:43 - b'INFO utils/utils.h : 152 - Real: 0.9760\tuser: 0.9500\tsys: 0.3598\tmaxrss: 318888' 2025-05-06 16:11:43 - Build graph for k = 119 2025-05-06 16:11:43 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 --num_cpu_threads 10 -k 119 --kmer_from 99 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.bubble_seq.fa 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 0' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 8805574, number contigs: 60352, number multiplicity: 60352' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 2684220, multiplicity vector: 60352' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 0 edges.' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 2684220/0/0, multiplicity vector: 0/60352' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 41017 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa.' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 18093992/41017/60696350, multiplicity vector: 41017/60352' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 261 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.bubble_seq.fa.' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 18093992/41278/61087454, multiplicity vector: 41278/60352' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 204 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.addi.fa.' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 18093992/41482/61705027, multiplicity vector: 41482/60352' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 18611 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.local.fa.' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 18093992/60093/69341853, multiplicity vector: 60093/60352' 2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 18093992/60093/69341853, multiplicity vector: 60093/60352' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2170' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 23230176 bytes' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 15794714, Lv2 items: 54188' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 18756456, Memory for Lv1+Lv2: 65129624' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.1615' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 2685' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1248' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2639' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2685 to 6936' 2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1405' 2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2699' 2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6936 to 12277' 2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1528' 2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2739' 2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12277 to 18726' 2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1532' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2777' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18726 to 26443' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1580' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2821' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26443 to 35759' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1576' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2806' 2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35759 to 47744' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1573' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2856' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47744 to 65536' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1359' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2405' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 3.3586' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 78300 30643082 25492789 25481862 30651391 1029 945 812 1089' 2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 112351299' 2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 112269124' 2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 78300' 2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0595' 2025-05-06 16:11:46 - b'INFO utils/utils.h : 152 - Real: 3.8031\tuser: 29.5556\tsys: 1.0094\tmaxrss: 125664' 2025-05-06 16:11:46 - Assemble contigs from SdBG for k = 119 2025-05-06 16:11:46 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len 182.0 --careful_bubble 2025-05-06 16:11:48 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119Done. Time elapsed: 1.560949' 2025-05-06 16:11:48 - b'INFO main_assemble.cpp : 133 - Number of Edges: 112351299; K value: 119' 2025-05-06 16:11:48 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:11:49 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 40; time elapsed: 0.0742' 2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 140; time elapsed: 0.0857' 2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 324; time elapsed: 0.1220' 2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 600; time elapsed: 0.2086' 2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 1230; time elapsed: 0.3832' 2025-05-06 16:11:51 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 2214; time elapsed: 0.7215' 2025-05-06 16:11:52 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 3216; time elapsed: 1.4043' 2025-05-06 16:11:54 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 182; Accumulated tips removed: 4724; time elapsed: 1.9662' 2025-05-06 16:11:54 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 6.407' 2025-05-06 16:12:04 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 41164, palindrome: 1' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 166 - unitig graph size: 41196, time for building: 10.203' 2025-05-06 16:12:05 - b'INFO assembly/contig_stat.h : 40 - Max: 337892, Min: 120, N50: 4705, number contigs: 41196, number isolated: 36769, number looped: 32, total size: 60790472,' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 112, Time elapsed(sec): 0.050' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 95, Time elapsed(sec): 0.072621' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 635, time: 0.007' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 109, time: 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 107, time: 0.020' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 5, Time elapsed(sec): 0.022146' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 13, time: 0.006' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 6, time: 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.017' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.011774' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 3, time: 0.018' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012443' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1, time: 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 1, time: 0.017' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.011982' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.004' 2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:12:05 - b'INFO assembly/contig_stat.h : 40 - Max: 337892, Min: 120, N50: 4853, number contigs: 39607, number isolated: 37026, number looped: 36, total size: 60552126,' 2025-05-06 16:12:09 - b'INFO main_assemble.cpp : 267 - Time to output: 4.032789' 2025-05-06 16:12:09 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 111, complex bubbles removed: 6, time: 0.050294' 2025-05-06 16:12:09 - b'INFO assembly/contig_stat.h : 40 - Max: 337892, Min: 120, N50: 4875, number contigs: 39336, number isolated: 37084, number looped: 36, total size: 60508994,' 2025-05-06 16:12:13 - b'INFO utils/utils.h : 152 - Real: 26.3436\tuser: 197.6748\tsys: 0.7800\tmaxrss: 259672' 2025-05-06 16:12:13 - Local assembly for k = 119 2025-05-06 16:12:13 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.local.fa --kmax 141 2025-05-06 16:12:20 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 39177, index size: 7379320' 2025-05-06 16:12:20 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 7.033600' 2025-05-06 16:12:20 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' 2025-05-06 16:12:21 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' 2025-05-06 16:12:21 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.705988' 2025-05-06 16:12:21 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 193.00 sd: 130.73' 2025-05-06 16:12:21 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.664913' 2025-05-06 16:12:32 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10702004, added 230222 reads to local assembly' 2025-05-06 16:12:32 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 10.833063' 2025-05-06 16:12:32 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' 2025-05-06 16:12:37 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 5.206776' 2025-05-06 16:12:37 - b'INFO utils/utils.h : 152 - Real: 24.5040\tuser: 175.4174\tsys: 1.5997\tmaxrss: 755072' 2025-05-06 16:12:37 - Extract iterative edges from k = 119 to 141 2025-05-06 16:12:37 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.bubble_seq.fa -t 10 -k 119 -s 22 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin 2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 32' 2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 174 - Read 2581 contigs' 2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 5145' 2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 174 - Read 207 contigs' 2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 5470' 2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 64' 2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 0. Iterative edges: 0' 2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 0. Iterative edges: 0' 2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 0. Iterative edges: 0' 2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 0. Iterative edges: 0' 2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 0. Iterative edges: 0' 2025-05-06 16:12:38 - b'INFO utils/utils.h : 152 - Real: 0.9748\tuser: 0.9102\tsys: 0.3657\tmaxrss: 318172' 2025-05-06 16:12:38 - Build graph for k = 141 2025-05-06 16:12:38 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 --num_cpu_threads 10 -k 141 --kmer_from 119 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.bubble_seq.fa 2025-05-06 16:12:38 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 0' 2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 8083978, number contigs: 57216, number multiplicity: 57216' 2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 2478732, multiplicity vector: 57216' 2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 0 edges.' 2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 2478732/0/0, multiplicity vector: 0/57216' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 39474 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa.' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 16625704/39474/60535886, multiplicity vector: 39474/57216' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 191 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.bubble_seq.fa.' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 16625704/39665/60899977, multiplicity vector: 39665/57216' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 109 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.addi.fa.' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 16625704/39774/61325148, multiplicity vector: 39774/57216' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 17292 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.local.fa.' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 32793672/57066/68291254, multiplicity vector: 57066/57216' 2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 32793672/57066/68291254, multiplicity vector: 57066/57216' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2272' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 37833532 bytes' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 12086136, Lv2 items: 52497' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 33441656, Memory for Lv1+Lv2: 50444424' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.1457' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 1934' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1003' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1889' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1934 to 4998' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1117' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2075' 2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4998 to 8786' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1190' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2161' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8786 to 13255' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1241' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2113' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13255 to 18435' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1245' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2202' 2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18435 to 24413' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1273' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2171' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24413 to 31332' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1311' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2231' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31332 to 39509' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1317' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2216' 2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39509 to 49860' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1322' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2307' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49860 to 65536' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1178' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1943' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 3.3552' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 76643 30154604 25063258 25051974 30163672 729 623 594 694' 2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 110512791' 2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 110433508' 2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 76643' 2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0580' 2025-05-06 16:12:42 - b'INFO utils/utils.h : 152 - Real: 3.7918\tuser: 29.6734\tsys: 1.0666\tmaxrss: 110768' 2025-05-06 16:12:42 - Assemble contigs from SdBG for k = 141 2025-05-06 16:12:42 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k141 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len 160.0 --is_final_round 2025-05-06 16:12:44 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141Done. Time elapsed: 1.607066' 2025-05-06 16:12:44 - b'INFO main_assemble.cpp : 133 - Number of Edges: 110512791; K value: 141' 2025-05-06 16:12:44 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-05-06 16:12:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 40; time elapsed: 0.0745' 2025-05-06 16:12:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 112; time elapsed: 0.0816' 2025-05-06 16:12:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 224; time elapsed: 0.1117' 2025-05-06 16:12:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 446; time elapsed: 0.1967' 2025-05-06 16:12:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 802; time elapsed: 0.3563' 2025-05-06 16:12:47 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 1423; time elapsed: 0.6505' 2025-05-06 16:12:48 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 2241; time elapsed: 1.2810' 2025-05-06 16:12:50 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 160; Accumulated tips removed: 2437; time elapsed: 1.5794' 2025-05-06 16:12:50 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 5.738' 2025-05-06 16:12:58 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 39996, palindrome: 0' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 166 - unitig graph size: 40027, time for building: 8.702' 2025-05-06 16:12:58 - b'INFO assembly/contig_stat.h : 40 - Max: 337914, Min: 142, N50: 4837, number contigs: 40027, number isolated: 37087, number looped: 31, total size: 60751709,' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 57, Time elapsed(sec): 0.009' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 49, Time elapsed(sec): 0.015997' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 431, time: 0.005' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 65, time: 0.004' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 192 - Tips removed: 43, time: 0.019' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 4, Time elapsed(sec): 0.013486' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 6, time: 0.004' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.003' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 192 - Tips removed: 1, time: 0.016' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012188' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.004' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.017' 2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' 2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012029' 2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.004' 2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-05-06 16:12:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337914, Min: 142, N50: 4954, number contigs: 39100, number isolated: 37344, number looped: 34, total size: 60592689,' 2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 51, complex bubbles removed: 1, time: 0.029958' 2025-05-06 16:12:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337914, Min: 142, N50: 4958, number contigs: 38987, number isolated: 37386, number looped: 34, total size: 60572523,' 2025-05-06 16:13:03 - b'INFO utils/utils.h : 152 - Real: 20.4959\tuser: 163.9754\tsys: 0.6401\tmaxrss: 255384' 2025-05-06 16:13:03 - Merging to output final contigs 2025-05-06 16:13:03 - 38818 contigs, total 60544618 bp, min 200 bp, max 337914 bp, avg 1559 bp, N50 4963 bp 2025-05-06 16:13:03 - ALL DONE. Time elapsed: 1041.009176 seconds