00000020:01000004:2.0F:1790964037.757000:0:32598:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790964037.757018:0:32598:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790964037.757847:0:32598:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000ea99b4a 00000080:02000400:2.0:1790964037.757860:0:32598:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1790964037.765205:0:32598:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790964037.765221:0:32598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790964037.765260:0:32598:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000efbf5f34) 00000020:00000080:2.0:1790964037.765288:0:32598:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1790964037.824417:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0F:1790964037.847970:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1790964037.861403:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:2.0:1790964037.861554:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 515: rc = 0 00100000:10000000:2.0:1790964037.861638:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:2.0:1790964037.861717:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 515: rc = 0 00100000:10000000:2.0:1790964037.863346:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790964037.863447:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 515: rc = 0 00100000:10000000:2.0:1790964037.863649:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:2.0:1790964037.865387:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 517: rc = 0 00100000:10000000:0.0:1790964037.881389:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 22: rc = 0 00100000:10000000:0.0:1790964037.881498:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 22: rc = 0 00100000:10000000:0.0:1790964037.887485:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 450: rc = 0 00100000:10000000:0.0:1790964037.888914:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 450: rc = 0 00100000:10000000:0.0:1790964037.890304:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 450: rc = 0 00100000:10000000:1.0:1790964037.891765:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 450: rc = 0 00100000:10000000:1.0:1790964037.893095:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 450: rc = 0 00100000:10000000:1.0:1790964037.895855:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 450: rc = 0 00100000:10000000:1.0:1790964037.897501:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 450: rc = 0 00100000:10000000:1.0:1790964037.899262:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 450: rc = 0 00100000:10000000:1.0:1790964037.900631:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 450: rc = 0 00100000:10000000:1.0:1790964037.902309:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 450: rc = 0 00100000:10000000:1.0:1790964037.906276:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 450: rc = 0 00100000:10000000:1.0:1790964037.909467:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 450: rc = 0 00100000:10000000:1.0:1790964037.912675:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 768: rc = 0 00100000:10000000:1.0:1790964037.915744:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 768: rc = 0 00100000:10000000:1.0:1790964037.917367:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 768: rc = 0 00100000:10000000:1.0:1790964037.918607:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 768: rc = 0 00100000:10000000:1.0:1790964037.921655:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 768: rc = 0 00100000:10000000:1.0:1790964037.923093:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 768: rc = 0 00100000:10000000:1.0:1790964037.925773:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 768: rc = 0 00100000:10000000:1.0:1790964037.927448:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 768: rc = 0 00100000:10000000:3.0F:1790964037.929421:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 768: rc = 0 00100000:10000000:3.0:1790964037.942262:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 768: rc = 0 00100000:10000000:3.0:1790964037.943384:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 768: rc = 0 00100000:10000000:3.0:1790964037.947287:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 768: rc = 0 00100000:10000000:3.0:1790964037.951788:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 768: rc = 0 00100000:10000000:3.0:1790964037.955096:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 768: rc = 0 00100000:10000000:3.0:1790964037.956460:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 768: rc = 0 00100000:10000000:3.0:1790964037.958027:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 768: rc = 0 00100000:10000000:3.0:1790964037.959880:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 768: rc = 0 00100000:10000000:3.0:1790964037.961347:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 768: rc = 0 00100000:10000000:3.0:1790964037.962751:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 768: rc = 0 00100000:10000000:2.0:1790964037.964325:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 768: rc = 0 00100000:10000000:3.0:1790964037.965998:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 768: rc = 0 00100000:10000000:3.0:1790964037.967380:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 768: rc = 0 00100000:10000000:3.0:1790964037.968902:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 768: rc = 0 00100000:10000000:3.0:1790964037.969940:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 768: rc = 0 00100000:10000000:3.0:1790964037.971351:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 768: rc = 0 00100000:10000000:3.0:1790964037.972937:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 768: rc = 0 00100000:10000000:3.0:1790964037.974497:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 768: rc = 0 00100000:10000000:3.0:1790964037.976332:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 768: rc = 0 00100000:10000000:3.0:1790964037.977724:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 768: rc = 0 00100000:10000000:3.0:1790964037.979354:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 768: rc = 0 00100000:10000000:2.0:1790964037.986114:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 768: rc = 0 00100000:10000000:2.0:1790964038.001846:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 768: rc = 0 00100000:10000000:2.0:1790964038.015477:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 660: rc = 0 00100000:10000000:2.0:1790964038.016995:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 660: rc = 0 00100000:10000000:3.0:1790964038.024305:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1790964038.031546:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 376: rc = 0 00100000:10000000:3.0:1790964038.034321:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1790964038.034460:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 376: rc = 0 00100000:10000000:3.0:1790964038.036517:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1790964038.036625:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 376: rc = 0 00100000:10000000:3.0:1790964038.039744:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790964038.040156:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 23: rc = 0 00100000:10000000:3.0:1790964038.042319:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790964038.042413:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 23: rc = 0 00100000:10000000:3.0:1790964038.044369:0:32598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790964038.044466:0:32598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 23: rc = 0 00000020:00000080:3.0:1790964038.045143:0:32598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790964038.045152:0:32598:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790964038.045186:0:32598:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9928545985f23d36 00000020:01000004:3.0:1790964038.045194:0:32598:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790964038.045199:0:32598:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790964038.045204:0:32598:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000ea99b4a from MGS 00000020:01000004:3.0:1790964038.045208:0:32598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790964038.045230:0:32598:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000efd7f6fc) 00000020:00000080:3.0:1790964038.045242:0:32598:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790964038.045311:0:32598:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000ea99b4a from MGS, refs=2 00080000:01000000:3.0:1790964038.045317:0:32598:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790964038.045322:0:32598:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9928545985f23d44 00000100:00100000:3.0:1790964038.045417:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790964038.045550:0:32598:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790964038.045825:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790964038.047854:0:32598:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790964038.047941:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790964038.050343:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964038.050549:0:32598:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790964038.050805:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790964038.051937:0:32598:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790964038.051947:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790964038.054744:0:32598:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790964038.054758:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790964038.056511:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964038.056516:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964038.056518:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964038.057130:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964038.057133:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964038.057135:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964038.058487:0:32598:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790964038.063838:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790964038.311298:0:32598:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2296 MB/s 00000001:01000000:3.0:1790964038.561240:0:32598:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2735 MB/s 00000001:01000000:2.0:1790964038.811677:0:32598:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 331 MB/s 00000001:01000000:0.0:1790964039.069684:0:32598:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 461 MB/s 00010000:00010000:0.0:1790964039.074713:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790964039.109103:0:32598:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790964039.109126:0:32598:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790964039.109139:0:32598:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790964039.123464:0:32607:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790964039.126407:0:32598:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790964039.126552:0:32598:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1790964039.126772:0:32598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790964039.126856:0:32598:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790964039.130774:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964039.131327:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790964039.131336:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790964039.134418:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790964039.134430:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790964039.134847:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790964039.134853:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790964039.135679:0:32598:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790964039.135699:0:32598:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.123@tcp' 00000020:01000004:0.0:1790964039.135701:0:32598:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790964039.135747:0:32598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.123@tcp (typ=mgc) 00000020:00000080:0.0:1790964039.135764:0:32598:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.123@tcp (0000000008059d3d) 00000020:00000080:0.0:1790964039.135781:0:32598:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790964039.135895:0:32598:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005c67ece7@MGC192.168.202.123@tcp: add connection 192.168.202.123@tcp at head 00010000:00010000:0.0:1790964039.139353:0:32598:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.123@tcp-0 is initialized 00000040:01000000:0.0:1790964039.139365:0:32598:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 1 is initialized 10000000:01000000:0.0:1790964039.139804:0:32613:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790964039.139843:0:32598:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.123@tcp (uuid c290d637-a468-41a2-ad47-911f0cbec690) 00000020:00000080:0.0:1790964039.139866:0:32598:0:(genops.c:1385:class_connect()) connect: client c290d637-a468-41a2-ad47-911f0cbec690, cookie 0x9928545985f23d52 00000100:00080000:0.0:1790964039.142154:0:32598:0:(import.c:545:import_select_connection()) MGC192.168.202.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790964039.142362:0:32598:0:(import.c:665:import_select_connection()) MGC192.168.202.123@tcp: import 000000005c67ece7 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1790964039.142394:0:32598:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000945d1df9 x1877961891381376/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790964039.142423:0:32598:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c290d637-a468-41a2-ad47-911f0cbec690->MGS 00000020:01000004:0.0:1790964039.142450:0:32598:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790964039.142456:0:32598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790964039.142467:0:32598:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ec3f8b4a) 00000020:00000080:0.0:1790964039.142481:0:32598:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1790964039.143365:0:32612:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1790964039.143554:0:31763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000945d1df9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c290d637-a468-41a2-ad47-911f0cbec690:31763:1877961891381376:0@lo:250: 00000100:00100000:1.0:1790964039.143630:0:31763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.143833:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891381376 00000100:00100000:3.0:1790964039.143845:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891381376 00000100:00100000:3.0:1790964039.143884:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964039.143890:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac2555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:31763:x1877961891381376:12345-0@lo:250: 00010000:00080000:3.0:1790964039.143918:0:32609:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c290d637-a468-41a2-ad47-911f0cbec690@0@lo t0 exp 0000000000000000 cur 908 last 0 00000020:00000080:3.0:1790964039.143939:0:32609:0:(genops.c:1385:class_connect()) connect: client c290d637-a468-41a2-ad47-911f0cbec690, cookie 0x9928545985f23d60 00000100:00080000:3.0:1790964039.144509:0:32609:0:(import.c:65:import_set_state_nolock()) 00000000d22d76a6 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790964039.144589:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac2555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+5:31763:x1877961891381376:12345-0@lo:250: Request processed in 697us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964039.144597:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964039.145139:0:31763:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790964039.145149:0:31763:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.123@tcp: connect to target with instance 0 00000100:00080000:0.0:1790964039.145157:0:31763:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790964039.145185:0:31763:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790964039.145188:0:31763:0:(import.c:65:import_set_state_nolock()) 000000005c67ece7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790964039.145191:0:31763:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790964039.145199:0:31763:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790964039.145203:0:31763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000945d1df9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c290d637-a468-41a2-ad47-911f0cbec690:31763:1877961891381376:0@lo:250: 00000100:00100000:3.0:1790964039.164638:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964039.164842:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790964039.164848:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790964039.167407:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790964039.167422:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790964039.168266:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790964039.168274:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790964039.168969:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964039.169354:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790964039.169362:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790964039.170461:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790964039.170473:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790964039.232154:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964039.236585:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790964039.236595:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790964039.240313:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790964039.240328:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790964039.241368:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964039.241556:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790964039.241562:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790964039.242228:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790964039.242237:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790964039.242955:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964039.243392:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790964039.243398:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790964039.253002:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790964039.253020:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790964039.254565:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964039.254760:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790964039.254767:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790964039.255858:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790964039.255868:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790964039.274535:0:32598:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964039.274740:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790964039.274747:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790964039.277077:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790964039.277092:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790964039.278131:0:32598:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790964039.278145:0:32598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790964039.279338:0:32598:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790964039.279363:0:32598:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790964039.279370:0:32598:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790964039.279498:0:32598:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790964039.279539:0:32598:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.123@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790964039.279543:0:32598:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790964039.279545:0:32598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964039.279546:0:32598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964039.279547:0:32598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964039.279549:0:32598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964039.279550:0:32598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964039.279552:0:32598:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964039.279553:0:32598:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964039.279555:0:32598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964039.279556:0:32598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790964039.279558:0:32598:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790964039.279560:0:32598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790964039.279562:0:32598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964039.279563:0:32598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964039.279564:0:32598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964039.279565:0:32598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964039.279566:0:32598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964039.279567:0:32598:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964039.279568:0:32598:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964039.279569:0:32598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964039.279570:0:32598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790964039.279595:0:32598:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790964039.279611:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381504:0@lo:253: 00000100:00100000:3.0:1790964039.279688:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.279785:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d98e01d going to sleep for 11 seconds 00000100:00100000:1.0:1790964039.279835:0:32611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891381504 00000100:00100000:1.0:1790964039.279844:0:32611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891381504 00000100:00100000:1.0:1790964039.280419:0:32611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790964039.280432:0:32611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe3a48bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+5:32598:x1877961891381504:12345-0@lo:253: 20000000:01000000:1.0:1790964039.280494:0:32611:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790964039.280497:0:32611:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790964039.280501:0:32611:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790964039.280845:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790964039.281461:0:32611:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1790964039.287570:0:32634:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790964039.287579:0:32634:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790964039.287582:0:32634:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 00000040:00080000:3.0:1790964039.287627:0:32634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 20000000:01000000:0.0:1790964039.288106:0:32611:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790964039.288119:0:32611:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790964039.320600:0:32611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe3a48bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+5:32598:x1877961891381504:12345-0@lo:253: Request processed in 40164us (40904us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964039.320615:0:32611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790964039.320720:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381504:0@lo:253: 10000000:01000000:3.0:1790964039.320750:0:32598:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790964039.320753:0:32598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790964039.320755:0:32598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964039.320757:0:32598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964039.320758:0:32598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964039.320759:0:32598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964039.320760:0:32598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964039.320761:0:32598:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964039.320763:0:32598:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964039.320764:0:32598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964039.320766:0:32598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790964039.320783:0:32598:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000ea99b4a from lustre-MDT0000 10000000:01000000:3.0:1790964039.320808:0:32598:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790964039.320811:0:32598:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790964039.320815:0:32598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88fad059cd40 10000000:01000000:3.0:1790964039.320820:0:32598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790964039.320828:0:32598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88fad059cd40 from 1 10000000:01000000:3.0:1790964039.320831:0:32598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790964039.320870:0:32598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000bb0f185b/0x9928545985f23d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.320879:0:32598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000bb0f185b/0x9928545985f23d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.320889:0:32598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000bb0f185b/0x9928545985f23d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964039.320925:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381632:0@lo:101: 00000100:00100000:3.0:1790964039.320962:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.321365:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891381632 00000100:00100000:1.0:1790964039.321372:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891381632 00000100:00100000:1.0:1790964039.321413:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790964039.321420:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090c83c90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+5:32598:x1877961891381632:12345-0@lo:101: 00010000:00010000:1.0:1790964039.321434:0:32610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964039.321448:0:32610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0abfd3e/0x9928545985f23d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9928545985f23d67 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.321469:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0abfd3e/0x9928545985f23d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9928545985f23d67 expref: 6 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.321478:0:32610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0abfd3e/0x9928545985f23d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23d67 expref: 6 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.321486:0:32610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0abfd3e, rc 0) 00000100:00100000:1.0:1790964039.321511:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090c83c90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+6:32598:x1877961891381632:12345-0@lo:101: Request processed in 92us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964039.321517:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790964039.321717:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0831452 going to sleep for 11 seconds 00000100:00100000:3.0:1790964039.321734:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381632:0@lo:101: 00010000:00010000:3.0:1790964039.321746:0:32598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000bb0f185b/0x9928545985f23d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d6e expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.321763:0:32598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000bb0f185b/0x9928545985f23d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9928545985f23d6e expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964039.321812:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381760:0@lo:501: 00000100:00100000:3.0:1790964039.321837:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.321860:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0831452 going to sleep for 11 seconds 00000100:00100000:1.0:1790964039.322024:0:32611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891381760 00000100:00100000:1.0:1790964039.322029:0:32611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891381760 00000100:00100000:1.0:1790964039.322068:0:32611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790964039.322074:0:32611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d46eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+6:32598:x1877961891381760:12345-0@lo:501: 00000100:00100000:1.0:1790964039.322321:0:32611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d46eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+6:32598:x1877961891381760:12345-0@lo:501: Request processed in 248us (484us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790964039.322330:0:32611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790964039.322473:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381760:0@lo:501: 10000000:01000000:3.0:1790964039.322497:0:32598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790964039.322517:0:32598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000bb0f185b/0x9928545985f23d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d6e expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322526:0:32598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000bb0f185b/0x9928545985f23d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d6e expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964039.322533:0:32598:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88faed0d7000 10000000:01000000:3.0:1790964039.322538:0:32598:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790964039.322542:0:32598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88faed0d7000 10000000:01000000:3.0:1790964039.322544:0:32598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790964039.322547:0:32598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88faed0d7000 from 1 10000000:01000000:3.0:1790964039.322549:0:32598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790964039.322567:0:32598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000370e04dd/0x9928545985f23d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322573:0:32598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000370e04dd/0x9928545985f23d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322579:0:32598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000370e04dd/0x9928545985f23d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964039.322597:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381888:0@lo:101: 00000100:00100000:3.0:1790964039.322623:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.322646:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0831452 going to sleep for 11 seconds 00000100:00100000:3.0:1790964039.322661:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891381888 00000100:00100000:3.0:1790964039.322665:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891381888 00000100:00100000:3.0:1790964039.322687:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790964039.322693:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed638aa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+6:32598:x1877961891381888:12345-0@lo:101: 00010000:00010000:3.0:1790964039.322701:0:32609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964039.322712:0:32609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6168f37/0x9928545985f23d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9928545985f23d75 expref: -99 pid: 32609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322728:0:32609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6168f37/0x9928545985f23d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9928545985f23d75 expref: 7 pid: 32609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322735:0:32609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6168f37/0x9928545985f23d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23d75 expref: 7 pid: 32609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322742:0:32609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6168f37, rc 0) 00000100:00100000:3.0:1790964039.322769:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed638aa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+7:32598:x1877961891381888:12345-0@lo:101: Request processed in 77us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964039.322775:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790964039.322802:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891381888:0@lo:101: 00010000:00010000:3.0:1790964039.322811:0:32598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000370e04dd/0x9928545985f23d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d7c expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322817:0:32598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000370e04dd/0x9928545985f23d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9928545985f23d7c expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964039.322837:0:32598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790964039.322841:0:32598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000370e04dd/0x9928545985f23d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d7c expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322846:0:32598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000370e04dd/0x9928545985f23d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d7c expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964039.322852:0:32598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790964039.322855:0:32598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790964039.322858:0:32598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88faed0d7000 10000000:01000000:3.0:1790964039.322860:0:32598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790964039.322863:0:32598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790964039.322865:0:32598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790964039.322887:0:32598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 0000000012aab678/0x9928545985f23d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322893:0:32598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 0000000012aab678/0x9928545985f23d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.322899:0:32598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 0000000012aab678/0x9928545985f23d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964039.323073:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382016:0@lo:101: 00000100:00100000:3.0:1790964039.323100:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.323115:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0831452 going to sleep for 11 seconds 00000100:00100000:3.0:1790964039.323129:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891382016 00000100:00100000:3.0:1790964039.323133:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891382016 00000100:00100000:3.0:1790964039.323155:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790964039.323185:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ba2c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+7:32598:x1877961891382016:12345-0@lo:101: 00010000:00010000:3.0:1790964039.323199:0:32610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964039.323206:0:32610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d0af0791/0x9928545985f23d8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9928545985f23d83 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.323219:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0af0791/0x9928545985f23d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9928545985f23d83 expref: 8 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.323226:0:32610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d0af0791/0x9928545985f23d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23d83 expref: 8 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.323233:0:32610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d0af0791, rc 0) 00000100:00100000:3.0:1790964039.323259:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ba2c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+8:32598:x1877961891382016:12345-0@lo:101: Request processed in 100us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964039.323265:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790964039.323296:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382016:0@lo:101: 00010000:00010000:3.0:1790964039.323305:0:32598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 0000000012aab678/0x9928545985f23d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d8a expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964039.323311:0:32598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 0000000012aab678/0x9928545985f23d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9928545985f23d8a expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964039.323347:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382144:0@lo:501: 00000100:00100000:3.0:1790964039.323369:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.323381:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a70f5904 going to sleep for 11 seconds 00000100:00100000:3.0:1790964039.323392:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891382144 00000100:00100000:3.0:1790964039.323395:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891382144 00000100:00100000:3.0:1790964039.323413:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790964039.323418:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a645b5d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+8:32598:x1877961891382144:12345-0@lo:501: 00000100:00100000:3.0:1790964039.323763:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a645b5d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+9:32598:x1877961891382144:12345-0@lo:501: Request processed in 345us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964039.323771:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790964039.323801:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382144:0@lo:501: 00000100:00100000:3.0:1790964039.323824:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382272:0@lo:503: 00000100:00100000:3.0:1790964039.323859:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.323873:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a70f5904 going to sleep for 11 seconds 00000100:00100000:3.0:1790964039.323899:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891382272 00000100:00100000:3.0:1790964039.323903:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891382272 00000100:00100000:3.0:1790964039.323933:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790964039.323939:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d41ef6e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+9:32598:x1877961891382272:12345-0@lo:503: 00000100:00100000:0.0:1790964039.329806:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d41ef6e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+9:32598:x1877961891382272:12345-0@lo:503: Request processed in 5856us (5936us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.329830:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790964039.330135:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382272:0@lo:503: 00000100:00100000:1.0:1790964039.330661:0:32636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32636:1877961891382400:0@lo:502: 00000100:00100000:1.0:1790964039.330713:0:32636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.330798:0:32636:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003dad7c9 going to sleep for 11 seconds 00000100:00100000:2.0:1790964039.331063:0:32611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891382400 00000100:00100000:2.0:1790964039.331071:0:32611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891382400 00000100:00100000:2.0:1790964039.331157:0:32611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790964039.331192:0:32611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec7f8f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+9:32636:x1877961891382400:12345-0@lo:502: 00000100:00100000:0.0:1790964039.332968:0:32611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec7f8f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+9:32636:x1877961891382400:12345-0@lo:502: Request processed in 1772us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.333000:0:32611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790964039.333075:0:32636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32636:1877961891382400:0@lo:502: 00000020:01000000:0.0:1790964039.333109:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790964039.333121:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964039.333124:0:32636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790964039.333129:0:32636:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790964039.333132:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790964039.333145:0:32636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c2f6018e) 00000020:00000080:0.0:1790964039.333179:0:32636:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790964039.333185:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790964039.333266:0:32636:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790964039.333272:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9928545985f23d98 00000020:00000080:0.0:1790964039.333487:0:32636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790964039.333491:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790964039.333493:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964039.333494:0:32636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790964039.333497:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790964039.333500:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964039.333501:0:32636:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790964039.333504:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790964039.333509:0:32636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001bf1f311) 00000020:00000080:0.0:1790964039.333517:0:32636:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790964039.333520:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790964039.333521:0:32636:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790964039.333524:0:32636:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790964039.333529:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790964039.333571:0:32636:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000ea99b4a from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790964039.333586:0:32636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000401d2f36) 00000020:00000080:0.0:1790964039.333594:0:32636:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790964039.333638:0:32636:0:(lod_dev.c:2309:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790964039.333644:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9928545985f23dad 00000020:00000080:0.0:1790964039.333761:0:32636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790964039.333768:0:32636:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790964039.333772:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9928545985f23db4 00080000:01000000:0.0:1790964039.333777:0:32636:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790964039.333781:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9928545985f23dbb 00010000:00010000:3.0:1790964039.398975:0:32636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790964039.400437:0:32636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934593 00000001:00080000:1.0:1790964039.400725:0:32636:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790964039.401801:0:32636:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a8493ac6) 00000020:00000080:1.0:1790964039.401829:0:32636:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790964039.401930:0:32636:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790964039.401937:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9928545985f23dc9 00000020:00000080:3.0:1790964039.408288:0:32636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790964039.413546:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9928545985f23dd0 00000020:00000080:3.0:1790964039.414645:0:32636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790964039.414656:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964039.414662:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.414664:0:32636:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790964039.414667:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964039.414672:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.414674:0:32636:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790964039.414678:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790964039.414711:0:32636:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790964039.414724:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964039.414726:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.414727:0:32636:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790964039.414729:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790964039.414731:0:32636:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1790964039.414739:0:32636:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964039.414741:0:32636:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964039.414742:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790964039.414744:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.414746:0:32636:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790964039.414748:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790964039.414750:0:32636:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790964039.414753:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.414754:0:32636:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790964039.414757:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790964039.414761:0:32636:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.123@tcp to nid 0x20000c0a8ca7b (192.168.202.123@tcp) 00000020:01000000:3.0:1790964039.414785:0:32636:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790964039.414787:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964039.414799:0:32636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (000000004f266f3a) 00000020:00000080:3.0:1790964039.414814:0:32636:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790964039.414818:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790964039.414868:0:32636:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790964039.414873:0:32636:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790964039.415067:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9928545985f23dde 00010000:00080000:3.0:1790964039.415097:0:32636:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dad64bef@lustre-OST0000-osc-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:3.0:1790964039.415479:0:32636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790964039.415780:0:32636:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790964039.415819:0:32636:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790964039.417867:0:32636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964039.418711:0:32636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1790964039.418790:0:32636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790964039.419591:0:32640:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790964039.419596:0:32640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790964039.420519:0:32636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790964039.420531:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790964039.420561:0:32636:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790964039.420579:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9928545985f23de5 00000100:00080000:3.0:1790964039.420589:0:32636:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964039.420593:0:32636:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000dad64bef using connection 192.168.202.123@tcp/0@lo 00000100:00100000:3.0:1790964039.420633:0:32636:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790964039.420695:0:31763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d8faea1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31763:1877961891382528:0@lo:8: 00000400:00000100:0.0:1790964039.420767:0:31763:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877961891382528 offset 0 length 520: 4 00000100:00080000:3.0:1790964039.420830:0:32636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790964039.420924:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964039.420929:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.420930:0:32636:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790964039.420933:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790964039.420936:0:32636:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1790964039.420938:0:32636:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964039.420939:0:32636:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964039.420940:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790964039.420943:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.420945:0:32636:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790964039.420947:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964039.420952:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.420953:0:32636:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790964039.420956:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790964039.420960:0:32636:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.123@tcp to nid 0x20000c0a8ca7b (192.168.202.123@tcp) 00000020:00000080:3.0:1790964039.420984:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964039.421073:0:32636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000ac7c5d66) 00000020:00000080:3.0:1790964039.421087:0:32636:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790964039.421094:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790964039.421155:0:32636:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790964039.421190:0:32636:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790964039.421197:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9928545985f23df3 00010000:00080000:3.0:1790964039.421231:0:32636:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001965c25d@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:3.0:1790964039.423531:0:32636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:1.0:1790964039.424697:0:32636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790964039.424710:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790964039.424742:0:32636:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790964039.424763:0:32636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9928545985f23dfa 00000100:00080000:1.0:1790964039.424775:0:32636:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964039.424781:0:32636:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000001965c25d using connection 192.168.202.123@tcp/0@lo 00000100:00100000:1.0:1790964039.424818:0:32636:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fd3362b3 x1877961891382656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790964039.424845:0:32636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1790964039.425149:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964039.425153:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964039.425155:0:32636:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790964039.425158:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1790964039.425302:0:31763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd3362b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31763:1877961891382656:0@lo:38: 00000100:00100000:0.0:1790964039.425374:0:31763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1790964039.425518:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.425521:0:32636:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790964039.425526:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790964039.425528:0:32636:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 00000100:00100000:3.0:1790964039.425551:0:32636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0000404 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32636:1877961891382784:0@lo:502: 00000100:00100000:3.0:1790964039.425600:0:32636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964039.425641:0:32636:0:(client.c:2716:ptlrpc_set_wait()) set 000000004cf1f95b going to sleep for 11 seconds 00000100:00100000:1.0:1790964039.425697:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891382784 00000100:00100000:1.0:1790964039.425709:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891382784 00000100:00100000:1.0:1790964039.425755:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790964039.425763:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041d1c4e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+9:32636:x1877961891382784:12345-0@lo:502: 00000100:00100000:1.0:1790964039.426029:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041d1c4e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+9:32636:x1877961891382784:12345-0@lo:502: Request processed in 267us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964039.426047:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790964039.426320:0:32636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0000404 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32636:1877961891382784:0@lo:502: 00000020:01000000:3.0:1790964039.426347:0:32636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964039.426352:0:32636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964039.426354:0:32636:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790964039.426356:0:32636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1790964039.426510:0:32598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:1.0:1790964039.426530:0:32598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790964039.426549:0:32598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 0000000012aab678/0x9928545985f23d83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d8a expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.426558:0:32598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 0000000012aab678/0x9928545985f23d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23d8a expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964039.426566:0:32598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88faed0d7000 from 1 10000000:01000000:1.0:1790964039.426569:0:32598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790964039.426595:0:32598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.426602:0:32598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.426611:0:32598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964039.426625:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382912:0@lo:101: 00000100:00100000:1.0:1790964039.426655:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.426678:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054cea4a1 going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.426777:0:32611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891382912 00000100:00100000:0.0:1790964039.426781:0:32611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891382912 00000100:00100000:0.0:1790964039.426803:0:32611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790964039.426809:0:32611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001617bc79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+9:32598:x1877961891382912:12345-0@lo:101: 00010000:00010000:0.0:1790964039.426817:0:32611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964039.426829:0:32611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9928545985f23e01 expref: -99 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.426849:0:32611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9928545985f23e01 expref: 10 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.426857:0:32611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23e01 expref: 10 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.426865:0:32611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003871af0, rc 0) 00000100:00100000:0.0:1790964039.426911:0:32611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001617bc79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+10:32598:x1877961891382912:12345-0@lo:101: Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.426917:0:32611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790964039.427144:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891382912:0@lo:101: 00010000:00010000:1.0:1790964039.427181:0:32598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.427190:0:32598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964039.427622:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383040:0@lo:256: 00000100:00100000:1.0:1790964039.427658:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.427678:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054cea4a1 going to sleep for 11 seconds 00000100:00100000:1.0:1790964039.427695:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383040 00000100:00100000:1.0:1790964039.427698:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383040 00000100:00100000:1.0:1790964039.427721:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790964039.427727:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f9455c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+10:32598:x1877961891383040:12345-0@lo:256: 20000000:01000000:1.0:1790964039.427740:0:32610:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790964039.427744:0:32610:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790964039.427794:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f9455c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+10:32598:x1877961891383040:12345-0@lo:256: Request processed in 67us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964039.427800:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790964039.427825:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383040:0@lo:256: 00000100:00100000:3.0:1790964039.428077:0:32621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891382656 00000100:00100000:3.0:1790964039.428082:0:32621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891382656 00000100:00100000:3.0:1790964039.428102:0:32621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964039.428105:0:32621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000945d1df9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31763:x1877961891382656:12345-0@lo:38: 00010000:00020000:3.0:1790964039.428119:0:32621:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790964039.428153:0:32621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000945d1df9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31763:x1877961891382656:12345-0@lo:38: Request processed in 47us (2779us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790964039.428158:0:32621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790964039.428224:0:31763:0:(import.c:65:import_set_state_nolock()) 000000001965c25d lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790964039.428237:0:31763:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790964039.428239:0:31763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd3362b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31763:1877961891382656:0@lo:38: 10000000:01000000:1.0:1790964039.429234:0:32598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790964039.429250:0:32598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.429262:0:32598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964039.429271:0:32598:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88faed0d7000 from 1 10000000:01000000:1.0:1790964039.429274:0:32598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790964039.429307:0:32598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000b4be94ab/0x9928545985f23e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.429314:0:32598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000b4be94ab/0x9928545985f23e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.429322:0:32598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000b4be94ab/0x9928545985f23e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964039.429336:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383168:0@lo:101: 00000100:00100000:1.0:1790964039.429375:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.429505:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5afd088 going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.429626:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383168 00000100:00100000:0.0:1790964039.429632:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383168 00000100:00100000:0.0:1790964039.429698:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790964039.429706:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009c1089b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+10:32598:x1877961891383168:12345-0@lo:101: 00010000:00010000:0.0:1790964039.429717:0:32610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964039.429730:0:32610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc3153b4/0x9928545985f23e16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9928545985f23e0f expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.429749:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc3153b4/0x9928545985f23e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9928545985f23e0f expref: 11 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.429759:0:32610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc3153b4/0x9928545985f23e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23e0f expref: 11 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.429766:0:32610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc3153b4, rc 0) 00000100:00100000:0.0:1790964039.429836:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009c1089b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:32598:x1877961891383168:12345-0@lo:101: Request processed in 132us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.429843:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790964039.430066:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383168:0@lo:101: 00010000:00010000:1.0:1790964039.430081:0:32598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000b4be94ab/0x9928545985f23e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e16 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.430089:0:32598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000b4be94ab/0x9928545985f23e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9928545985f23e16 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964039.430146:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383296:0@lo:501: 00000100:00100000:1.0:1790964039.430281:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.430338:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5afd088 going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.430393:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383296 00000100:00100000:0.0:1790964039.430398:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383296 00000100:00100000:0.0:1790964039.430424:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790964039.430430:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c733d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:32598:x1877961891383296:12345-0@lo:501: 00000100:00100000:0.0:1790964039.430821:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c733d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:32598:x1877961891383296:12345-0@lo:501: Request processed in 390us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.430829:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790964039.430947:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383296:0@lo:501: 00000100:00100000:1.0:1790964039.430974:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383424:0@lo:503: 00000100:00100000:1.0:1790964039.431021:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.431047:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5afd088 going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.431327:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383424 00000100:00100000:0.0:1790964039.431331:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383424 00000100:00100000:0.0:1790964039.431365:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790964039.431371:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c738b613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:32598:x1877961891383424:12345-0@lo:503: 00000040:00080000:0.0:1790964039.431405:0:32610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790964039.431456:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c738b613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:32598:x1877961891383424:12345-0@lo:503: Request processed in 85us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.431462:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790964039.431553:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383424:0@lo:503: 00000040:00080000:1.0:1790964039.432859:0:32644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790964039.433427:0:32598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790964039.433448:0:32598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790964039.433494:0:32598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000b4be94ab/0x9928545985f23e0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e16 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964039.433505:0:32598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000b4be94ab/0x9928545985f23e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e16 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964039.433549:0:32598:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790964039.433552:0:32598:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88faed0d7000 10000000:01000000:2.0:1790964039.433555:0:32598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88faed0d7000 10000000:01000000:2.0:1790964039.433558:0:32598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790964039.433564:0:32598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88faed0d7000 from 1 10000000:01000000:2.0:1790964039.433566:0:32598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790964039.433598:0:32598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000a8ad688e/0x9928545985f23e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964039.433616:0:32598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000a8ad688e/0x9928545985f23e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964039.433626:0:32598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000a8ad688e/0x9928545985f23e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964039.433648:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000398c1b90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383552:0@lo:101: 00000100:00100000:2.0:1790964039.433713:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964039.433788:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f3f2495 going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.433838:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383552 00000100:00100000:0.0:1790964039.433846:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383552 00000100:00100000:0.0:1790964039.434092:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790964039.434103:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac0767a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:32598:x1877961891383552:12345-0@lo:101: 00010000:00010000:0.0:1790964039.434116:0:32610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964039.434128:0:32610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3b48e60/0x9928545985f23e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9928545985f23e1d expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.434151:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3b48e60/0x9928545985f23e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9928545985f23e1d expref: 12 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.434193:0:32610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3b48e60/0x9928545985f23e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23e1d expref: 12 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.434202:0:32610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3b48e60, rc 0) 00000100:00100000:0.0:1790964039.434248:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac0767a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+12:32598:x1877961891383552:12345-0@lo:101: Request processed in 147us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.434253:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790964039.434347:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000398c1b90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383552:0@lo:101: 00010000:00010000:2.0:1790964039.434360:0:32598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000a8ad688e/0x9928545985f23e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e24 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964039.434368:0:32598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000a8ad688e/0x9928545985f23e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9928545985f23e24 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964039.434416:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000398c1b90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383680:0@lo:501: 00000100:00100000:2.0:1790964039.434441:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964039.434641:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f3f2495 going to sleep for 11 seconds 00000100:00100000:3.0:1790964039.434686:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383680 00000100:00100000:3.0:1790964039.434692:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383680 00000100:00100000:3.0:1790964039.434715:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790964039.434721:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002522d7c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:32598:x1877961891383680:12345-0@lo:501: 00000100:00100000:3.0:1790964039.435229:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002522d7c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:32598:x1877961891383680:12345-0@lo:501: Request processed in 507us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964039.435237:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790964039.435395:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000398c1b90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383680:0@lo:501: 00000100:00100000:1.0:1790964039.435430:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383808:0@lo:503: 00000100:00100000:1.0:1790964039.435472:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.435503:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ad02b58 going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.435553:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383808 00000100:00100000:0.0:1790964039.435558:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383808 00000100:00100000:0.0:1790964039.435581:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790964039.435587:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000506a7c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+12:32598:x1877961891383808:12345-0@lo:503: 00000100:00100000:0.0:1790964039.435751:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000506a7c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+12:32598:x1877961891383808:12345-0@lo:503: Request processed in 164us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.435758:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790964039.435865:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891383808:0@lo:503: 00000100:00100000:1.0:1790964039.436518:0:32645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32645:1877961891383936:0@lo:502: 00000100:00100000:1.0:1790964039.436562:0:32645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.436593:0:32645:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5625525 going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.436682:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891383936 00000100:00100000:0.0:1790964039.436693:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891383936 00000100:00100000:0.0:1790964039.436728:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790964039.436736:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010fb06fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+12:32645:x1877961891383936:12345-0@lo:502: 00000100:00100000:0.0:1790964039.437214:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010fb06fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+12:32645:x1877961891383936:12345-0@lo:502: Request processed in 479us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.437222:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790964039.437381:0:32645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32645:1877961891383936:0@lo:502: 00000020:01000004:1.0:1790964039.437446:0:32645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790964039.437461:0:32645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b3eea1e5) 00000020:00000080:1.0:1790964039.437484:0:32645:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1790964039.437559:0:32645:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000ea99b4a from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790964039.437564:0:32645:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000ea99b4a from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790964039.437566:0:32645:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000ea99b4a 4 00010000:00080000:1.0:1790964039.437605:0:32645:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000773535ae@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:3.0:1790964039.442578:0:32645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1790964039.442842:0:32645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790964039.442900:0:32645:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790964039.442918:0:32645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9928545985f23e32 00000100:00080000:3.0:1790964039.442929:0:32645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964039.442935:0:32645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000773535ae using connection 192.168.202.123@tcp/0@lo 00000100:00100000:3.0:1790964039.442974:0:32645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a0000404 x1877961891384064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790964039.444628:0:31763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0000404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31763:1877961891384064:0@lo:38: 00000100:00100000:2.0:1790964039.444713:0:31763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790964039.444819:0:32645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790964039.444927:0:32616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891384064 00000100:00100000:1.0:1790964039.444937:0:32616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891384064 00000100:00100000:1.0:1790964039.444971:0:32616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964039.444977:0:32616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6ab7d0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31763:x1877961891384064:12345-0@lo:38: 00000100:00100000:0.0:1790964039.445431:0:32645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adafe6b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32645:1877961891384192:0@lo:502: 00000100:00100000:1.0:1790964039.445449:0:32616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6ab7d0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31763:x1877961891384064:12345-0@lo:38: Request processed in 469us (735us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790964039.445459:0:32616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964039.445482:0:32645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964039.445513:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891384192 00000100:00100000:0.0:1790964039.445518:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891384192 00000100:00100000:0.0:1790964039.445566:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790964039.445573:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067aa9760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:32645:x1877961891384192:12345-0@lo:502: 00000100:00100000:2.0:1790964039.445704:0:31763:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790964039.445714:0:31763:0:(import.c:65:import_set_state_nolock()) 00000000773535ae lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964039.445719:0:31763:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790964039.445723:0:31763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0000404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31763:1877961891384064:0@lo:38: 00000100:00100000:0.0:1790964039.445826:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067aa9760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:32645:x1877961891384192:12345-0@lo:502: Request processed in 253us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.445834:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790964039.445879:0:32645:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cd0b36c going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.445892:0:32645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adafe6b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c290d637-a468-41a2-ad47-911f0cbec690:32645:1877961891384192:0@lo:502: 00000040:00080000:0.0:1790964039.445912:0:32645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790964039.445967:0:32598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1790964039.445987:0:32598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790964039.446159:0:32598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000a8ad688e/0x9928545985f23e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e24 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.446193:0:32598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000a8ad688e/0x9928545985f23e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e24 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790964039.446245:0:32598:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790964039.446252:0:32598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790964039.446253:0:32598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790964039.446255:0:32598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790964039.446256:0:32598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790964039.446257:0:32598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790964039.446258:0:32598:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790964039.446259:0:32598:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790964039.446261:0:32598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790964039.446262:0:32598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790964039.446266:0:32598:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790964039.446268:0:32598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790964039.446269:0:32598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790964039.446271:0:32598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790964039.446271:0:32598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790964039.446272:0:32598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790964039.446273:0:32598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790964039.446274:0:32598:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790964039.446276:0:32598:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790964039.446276:0:32598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790964039.446277:0:32598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790964039.446291:0:32598:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790964039.446300:0:32598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adafe6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891384320:0@lo:253: 00000100:00100000:0.0:1790964039.446333:0:32598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964039.446354:0:32598:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067fbf49f going to sleep for 11 seconds 00000100:00100000:3.0:1790964039.446748:0:32611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891384320 00000100:00100000:3.0:1790964039.446755:0:32611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891384320 00000100:00100000:3.0:1790964039.446797:0:32611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790964039.446806:0:32611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3c731c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+12:32598:x1877961891384320:12345-0@lo:253: 20000000:01000000:3.0:1790964039.446834:0:32611:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790964039.446850:0:32611:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790964039.497504:0:32611:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790964039.497526:0:32611:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790964039.497563:0:32632:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790964039.497569:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790964039.497594:0:32632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.497633:0:32632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23e01 expref: 12 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.497641:0:32632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.497689:0:32632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9928545985f23e01 expref: 12 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.497703:0:32632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9928545985f23e01 expref: 12 pid: 32611 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964039.497717:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32632:1877961891384448:0@lo:104: 00000100:00100000:1.0:1790964039.497787:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964039.497895:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bcf2c56a going to sleep for 11 seconds 00000100:00100000:0.0:1790964039.497926:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891384448 00000100:00100000:0.0:1790964039.497934:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891384448 00000100:00100000:0.0:1790964039.497991:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964039.498124:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e99a109f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c290d637-a468-41a2-ad47-911f0cbec690+3:32632:x1877961891384448:12345-0@lo:104: 00010000:00010000:0.0:1790964039.498138:0:32599:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964039.498219:0:32599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790964039.498225:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e99a109f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c290d637-a468-41a2-ad47-911f0cbec690+3:32632:x1877961891384448:12345-0@lo:104: Request processed in 105us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.498239:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790964039.498402:0:32604:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790964039.498408:0:32604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.498416:0:32604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afa7495d already unused, calling callback (000000000fe9e971) 10000000:00010000:1.0:1790964039.498419:0:32604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.498428:0:32604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790964039.498435:0:32604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964039.498450:0:32604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790964039.498485:0:32604:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.498492:0:32604:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790964039.498518:0:32604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.498524:0:32604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: 00000000afa7495d/0x9928545985f23e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9928545985f23e08 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.498543:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964039.498545:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964039.498547:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964039.498598:0:31764:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790964039.498606:0:31764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f860f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c290d637-a468-41a2-ad47-911f0cbec690:31764:1877961891384576:0@lo:103: 00000100:00100000:1.0:1790964039.498637:0:31764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964039.499569:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404e9a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32632:1877961891384448:0@lo:104: 00010000:00010000:2.0:1790964039.499604:0:32632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964039.511243:0:32601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891384576 00000100:00100000:1.0:1790964039.511262:0:32601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891384576 00010000:00010000:1.0:1790964039.511306:0:32601:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9928545985f23e01 expref: 13 pid: 32611 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964039.511354:0:32601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964039.511364:0:32601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009081513a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c290d637-a468-41a2-ad47-911f0cbec690+13:31764:x1877961891384576:12345-0@lo:103: 00010000:00010000:1.0:1790964039.511380:0:32601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790964039.511384:0:32601:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9928545985f23e01 expref: 13 pid: 32611 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511403:0:32601:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9928545985f23e01 expref: 13 pid: 32611 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511430:0:32601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003871af0/0x9928545985f23e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9928545985f23e01 expref: 13 pid: 32611 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511447:0:32601:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511455:0:32601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790964039.511475:0:32601:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013907563s 00010000:00010000:1.0:1790964039.511480:0:32601:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511486:0:32601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511492:0:32601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511497:0:32601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511503:0:32601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000022f5ae2 already unused, calling callback (00000000b3a9955e) 00010000:00010000:1.0:1790964039.511507:0:32601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511514:0:32601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511531:0:32601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511549:0:32601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790964039.511616:0:32601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009081513a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c290d637-a468-41a2-ad47-911f0cbec690+12:31764:x1877961891384576:12345-0@lo:103: Request processed in 254us (12978us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964039.511624:0:32601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964039.511674:0:31764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f860f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c290d637-a468-41a2-ad47-911f0cbec690:31764:1877961891384576:0@lo:103: 00010000:00010000:1.0:1790964039.511702:0:32632:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511710:0:32632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964039.511714:0:32632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000022f5ae2/0x9928545985f23e39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964039.519859:0:32611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3c731c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+11:32598:x1877961891384320:12345-0@lo:253: Request processed in 73047us (73518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964039.519875:0:32611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790964039.520127:0:32598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adafe6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c290d637-a468-41a2-ad47-911f0cbec690:32598:1877961891384320:0@lo:253: 10000000:01000000:1.0:1790964039.520145:0:32598:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790964039.520149:0:32598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790964039.520150:0:32598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964039.520151:0:32598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964039.520153:0:32598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964039.520154:0:32598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964039.520155:0:32598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964039.520157:0:32598:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964039.520158:0:32598:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964039.520177:0:32598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964039.520179:0:32598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790964039.520192:0:32598:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790964039.528905:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964039.529101:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964039.529447:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964039.529605:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964039.529867:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964039.530029:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964039.538859:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964039.540117:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964039.540976:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964039.541286:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964039.543062:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964039.543269:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:1.0:1790964039.583474:0:32598:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000004:02000000:1.0:1790964039.583481:0:32598:0:(lod_dev.c:733:lod_sub_init_llog()) *** cfs_fail_loc=2405, val=0*** 00000020:00080000:0.0:1790964039.583632:0:32651:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1790964039.583637:0:32651:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790964039.588588:0:32652:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790964039.589280:0:32598:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1790964039.589759:0:32652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1790964039.591295:0:32653:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@00000000a15b0e3b x1877961891384704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964039.591312:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00000040:01000000:1.0:1790964039.594337:0:32598:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790964039.594472:0:32598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964039.595669:0:32652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790964039.595736:0:32652:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1790964039.596854:0:32598:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790964039.597731:0:32598:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790964039.598226:0:32598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790964039.599639:0:32598:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790964039.601564:0:32598:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790964039.601624:0:32598:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790964039.602056:0:32598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790964039.603659:0:32598:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1790964039.615509:0:32598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1790964039.651779:0:32598:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790964039.651829:0:32598:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9c7f03ef7988 00100000:10000000:0.0:1790964039.651839:0:32598:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790964039.652867:0:32598:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790964039.652896:0:32598:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790964039.652910:0:32598:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790964039.652934:0:32598:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790964040.101584:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964040.607492:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00010000:00010000:1.0:1790964041.119346:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964041.632345:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00010000:00010000:0.0:1790964042.145075:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964042.655279:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00010000:00010000:1.0:1790964043.167681:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964043.687692:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00010000:00010000:1.0:1790964044.196040:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790964044.402738:0:32896:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all 00000400:00000001:1.0:1790964044.484007:0:32898:0:(debug.c:305:cfs_str2mask()) Process entered 00000100:00000040:3.0:1790964044.705331:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c290d637-a468-41a2-ad47-911f0cbec690->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1790964044.705344:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1790964044.705351:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000a0000404. 00000020:00000040:3.0:1790964044.705357:0:8:0:(genops.c:1210:class_import_get()) import 000000005c67ece7 refcount=4 obd=MGC192.168.202.123@tcp 00000100:00000001:3.0:1790964044.705363:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964044.705366:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964044.705371:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964044.705381:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000fb942eea. 00000100:00000001:3.0:1790964044.705388:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.705396:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c290d637-a468-41a2-ad47-911f0cbec690->MGS req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1790964044.705421:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964044.705424:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.705428:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a0000404] to pc [ptlrpcd_00_02+2] req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.705452:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:3.0:1790964044.705466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790964044.705470:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00000001:3.0:1790964044.705472:0:8:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:3.0:1790964044.705474:0:8:0:(import.c:65:import_set_state_nolock()) 00000000773535ae lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:3.0:1790964044.705477:0:8:0:(import.c:520:import_select_connection()) Process entered 00000100:00000040:3.0:1790964044.705480:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 13 to 0@lo 00000100:00000001:3.0:1790964044.705483:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964044.705484:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 14 to 0@lo 00000100:00000001:3.0:1790964044.705486:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000020:00000001:3.0:1790964044.705489:0:8:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964044.705491:0:8:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23e32 00000020:00000001:3.0:1790964044.705493:0:8:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964044.705496:0:8:0:(lustre_handles.c:148:class_handle2object()) GET export 000000008b4f75f0 refcount=7 00000020:00000001:3.0:1790964044.705498:0:8:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613209788346368 : -130863921205248 : ffff88fade767000) 00000020:00000001:3.0:1790964044.705500:0:8:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613209788346368 : -130863921205248 : ffff88fade767000) 00000100:00000040:3.0:1790964044.705503:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 13 to 0@lo 00000100:00000001:3.0:1790964044.705505:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964044.705506:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 14 to 0@lo 00000100:00000001:3.0:1790964044.705508:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000020:00000040:3.0:1790964044.705510:0:8:0:(genops.c:879:class_export_put()) PUTting export 000000008b4f75f0 : new refcount 6 00000100:00080000:3.0:1790964044.705513:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000773535ae using connection 192.168.202.123@tcp/0@lo 00000100:00000001:3.0:1790964044.705516:0:8:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964044.705518:0:8:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 00000100:00000001:2.0:1790964044.705788:0:31763:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964044.705797:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964044.705799:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964044.705801:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964044.705804:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964044.705806:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964044.705809:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964044.706146:0:32653:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964044.706150:0:32653:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964044.706152:0:32653:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964044.706154:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00000100:00000001:0.0:1790964044.706157:0:32653:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964044.706191:0:32653:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964044.706195:0:32653:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964044.706197:0:32653:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964044.706199:0:32653:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964044.706625:0:8:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964044.706636:0:8:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.706639:0:8:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:3.0:1790964044.706642:0:8:0:(obd_class.h:895:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964044.706646:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000005c75e991. 00000020:00000040:3.0:1790964044.706650:0:8:0:(genops.c:1210:class_import_get()) import 00000000773535ae refcount=3 obd=lustre-MDT0000-lwp-MDT0000 02000000:00000001:3.0:1790964044.706653:0:8:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:3.0:1790964044.706654:0:8:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.706657:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964044.706659:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964044.706661:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964044.706666:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 00000000be03f07a. 00000100:00000001:3.0:1790964044.706672:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964044.706679:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1790964044.706689:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964044.706691:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.706694:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005c75e991] to pc [ptlrpcd_rcv+-1] req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.706711:0:8:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.706716:0:8:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (918) 00000100:00000001:3.0:1790964044.706727:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964044.706729:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964044.706731:0:31763:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964044.706734:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.706741:0:31763:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964044.706742:0:31763:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964044.706745:0:31763:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964044.706747:0:31763:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964044.706749:0:31763:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964044.706752:0:31763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31763:1877961891384960:0@lo:38: 00000100:00000001:3.0:1790964044.706756:0:31763:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964044.706760:0:31763:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964044.706762:0:31763:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964044.706770:0:31763:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964044.706773:0:31763:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a885b3c8. 02000000:00000001:3.0:1790964044.706776:0:31763:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964044.706781:0:31763:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000e3f53987. 00000400:00000010:3.0:1790964044.706788:0:31763:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000d945d0b7. 00000100:00000200:3.0:1790964044.706794:0:31763:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961891384960, portal 10 00000100:00000001:3.0:1790964044.706796:0:31763:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964044.706797:0:31763:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613209793133440 : -130863916418176 : ffff88fadebf7b80) 00000020:00000010:3.0:1790964044.706804:0:31763:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000007855cc4c. 00000100:00000040:3.0:1790964044.706810:0:31763:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964054 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.706817:0:31763:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964044.706819:0:31763:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964044.706821:0:31763:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000a0786b8d. 00000100:00000200:3.0:1790964044.706824:0:31763:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1877961891384960, offset 0 00000400:00000200:3.0:1790964044.706830:0:31763:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964044.706842:0:31763:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964044.706850:0:31763:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 12 MB=0x6abff13700e80 00000400:00000200:3.0:1790964044.706856:0:31763:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 520/520 into md 0x229 [64] + 520 00000400:00000200:3.0:1790964044.706864:0:31763:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964044.706867:0:31763:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964044.706873:0:31763:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964044.706874:0:31763:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:3.0:1790964044.706877:0:31763:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000031bf33f7. 00000100:00000040:3.0:1790964044.706879:0:31763:0:(events.c:341:request_in_callback()) incoming req@0000000031bf33f7 x1877961891384960 msgsize 520 00000100:00100000:3.0:1790964044.706882:0:31763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:3.0:1790964044.706894:0:31763:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964044.706901:0:31763:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000a0786b8d 00000400:00000010:3.0:1790964044.706903:0:31763:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000a0786b8d. 00000100:00000001:3.0:1790964044.706907:0:31763:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964044.706909:0:31763:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964054 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.706915:0:31763:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964044.706922:0:31763:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964054 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.706928:0:31763:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.706930:0:31763:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964044.706935:0:31763:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.706939:0:31763:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 3182 usecs (4 jiffies) 00000100:00000001:3.0:1790964044.706942:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295581191 00000100:00000010:3.0:1790964044.706946:0:31763:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000005c038cc5. 00000100:00000001:3.0:1790964044.706952:0:31763:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 0 00000100:00000001:3.0:1790964044.706957:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295581191 00000100:00000010:3.0:1790964044.706960:0:31763:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000d14eca9a. 00000100:00000001:3.0:1790964044.706962:0:31763:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 1 00000100:00000001:3.0:1790964044.706965:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295581191 00000100:00000010:3.0:1790964044.706967:0:31763:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000b2b088db. 00000100:00000001:3.0:1790964044.706969:0:31763:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 2 00000100:00000001:3.0:1790964044.706972:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295581191 00000100:00000010:3.0:1790964044.706974:0:31763:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000194bffa9. 00000100:00000001:3.0:1790964044.706976:0:31763:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 3 00000100:00000001:3.0:1790964044.706979:0:31763:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964044.706981:0:31763:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.706984:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.706996:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964044.707003:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964044.707004:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964044.707005:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964044.707006:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964044.707007:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.707009:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.707240:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:1.0:1790964044.707249:0:31766:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 00000000bd98447a. 00000020:00000010:1.0:1790964044.707255:0:31766:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 00000000b04667e1. 80000000:00000010:1.0:1790964044.707259:0:31766:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 00000000d638b0d1. 40000000:00000010:1.0:1790964044.707263:0:31766:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 0000000049cbaa8f. 00000008:00000010:1.0:1790964044.707267:0:31766:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 000000005ee77722. 00020000:00000010:1.0:1790964044.707272:0:31766:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 000000004e4a4bc7. 00008000:00000010:1.0:1790964044.707276:0:31766:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 000000002e42f683. 00100000:00000010:1.0:1790964044.707281:0:31766:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 000000004fb77fb3. 00040000:00000010:1.0:1790964044.707285:0:31766:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 00000000f7e9fce8. 00040000:00000010:1.0:1790964044.707289:0:31766:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 000000001a3a3033. 00040000:00000010:1.0:1790964044.707293:0:31766:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 000000005b8b1df0. 00080000:00000010:1.0:1790964044.707297:0:31766:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 000000001a3d311d. 00000004:00000010:1.0:1790964044.707302:0:31766:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 000000005509243a. 00000004:00000010:1.0:1790964044.707307:0:31766:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 00000000505bd1ed. 00000004:00000010:1.0:1790964044.707312:0:31766:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 0000000033e029b3. 00002000:00000010:1.0:1790964044.707316:0:31766:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 00000000a39d86af. 00000004:00000010:1.0:1790964044.707319:0:31766:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 00000000d7f0ef7a. 00000080:00000010:1.0:1790964044.707326:0:31766:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 000000003f477ab4. 00000080:00000010:1.0:1790964044.707330:0:31766:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 0000000072339479. 00000008:00000010:1.0:1790964044.707336:0:31766:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 00000000f037b9b8. 00020000:00000010:1.0:1790964044.707339:0:31766:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 00000000bee164eb. 00008000:00000010:1.0:1790964044.707343:0:31766:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 0000000001868889. 00000080:00000010:1.0:1790964044.707347:0:31766:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 000000006e3449e0. 00000100:00000001:1.0:1790964044.707349:0:31766:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964044.707358:0:31766:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964044.707362:0:31766:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.707370:0:31766:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964044.707372:0:31766:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964044.707374:0:31766:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964044.707376:0:31766:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964044.707378:0:31766:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964044.707380:0:31766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0000404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c290d637-a468-41a2-ad47-911f0cbec690:31766:1877961891384832:0@lo:400: 00000100:00000001:1.0:1790964044.707384:0:31766:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964044.707388:0:31766:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964044.707389:0:31766:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964044.707391:0:31766:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964044.707394:0:31766:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 000000006b67fade. 02000000:00000001:1.0:1790964044.707395:0:31766:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964044.707398:0:31766:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000d931bdac. 00000400:00000010:1.0:1790964044.707402:0:31766:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000ae553c76. 00000100:00000200:1.0:1790964044.707405:0:31766:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961891384832, portal 25 00000100:00000001:1.0:1790964044.707406:0:31766:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964044.707407:0:31766:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613209793123584 : -130863916428032 : ffff88fadebf5500) 00000100:00000040:1.0:1790964044.707410:0:31766:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.707416:0:31766:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964044.707418:0:31766:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964044.707420:0:31766:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007bbfcc94. 00000100:00000200:1.0:1790964044.707421:0:31766:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877961891384832, offset 0 00000400:00000200:1.0:1790964044.707425:0:31766:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964044.707431:0:31766:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964044.707436:0:31766:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff13700e00 00000400:00000200:1.0:1790964044.707440:0:31766:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x161 [2] + 0 00000400:00000010:1.0:1790964044.707444:0:31766:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000007d885d59. 00000400:00000200:1.0:1790964044.707446:0:31766:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 0000000093036f7c 00000400:00000200:1.0:1790964044.707450:0:31766:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964044.707472:0:31766:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964044.707475:0:31766:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000093036f7c 00000400:00000010:1.0:1790964044.707477:0:31766:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 0000000093036f7c. 00000100:00000001:1.0:1790964044.707482:0:31766:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964044.707483:0:31766:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964044.707485:0:31766:0:(events.c:341:request_in_callback()) incoming req@000000007b3eae6c x1877961891384832 msgsize 224 00000100:00100000:1.0:1790964044.707488:0:31766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964044.707490:0:31766:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964044.707498:0:31766:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964044.707503:0:31766:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007bbfcc94 00000400:00000010:1.0:1790964044.707504:0:31766:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007bbfcc94. 00000100:00000001:1.0:1790964044.707506:0:31766:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964044.707509:0:31766:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.707516:0:31766:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964044.707518:0:31766:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:00000010:0.0:1790964044.707802:0:32618:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000a2db86f1. 00000100:00000001:0.0:1790964044.707809:0:32618:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964044.707812:0:32618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891384960 02000000:00000001:0.0:1790964044.707813:0:32618:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964044.707816:0:32618:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964044.707818:0:32618:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964044.707823:0:32618:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964044.707827:0:32618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891384960 00000020:00000001:0.0:1790964044.707829:0:32618:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964044.707831:0:32618:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:0.0:1790964044.707834:0:32618:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:0.0:1790964044.707836:0:32618:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964044.707838:0:32618:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964044.707850:0:32618:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000833ccd3e. 00000020:00000010:0.0:1790964044.707854:0:32618:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000000ad9ca6e. 00000020:00000010:0.0:1790964044.707859:0:32618:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000ad360dc5. 00000100:00000001:0.0:1790964044.707864:0:32618:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964044.707865:0:32618:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964044.707869:0:32618:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964044.707876:0:32618:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964044.707925:0:32618:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964044.707937:0:32618:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964044.707939:0:32618:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964044.707945:0:32618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964044.707948:0:32618:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446613209793120000 : -130863916431616 : ffff88fadebf4700) 00000100:00000040:0.0:1790964044.707953:0:32618:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@0000000031bf33f7 x1877961891384960/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964064 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964044.707962:0:32618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031bf33f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:31763:x1877961891384960:12345-0@lo:38: 00000100:00000200:0.0:1790964044.707965:0:32618:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961891384960 00000020:00000001:0.0:1790964044.707968:0:32618:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:0.0:1790964044.707971:0:32618:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000040:0.0:1790964044.707983:0:32618:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000001bf1f311) now 4 - find 00000020:00000001:0.0:1790964044.707996:0:32618:0:(genops.c:655:class_str2obd()) Process leaving (rc=18446613209551568896 : -130864157982720 : ffff88fad0598000) 00000100:00000001:0.0:1790964044.708002:0:32618:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964044.708004:0:32618:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1790964044.708016:0:32618:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 712 at 00000000cf62c9de. 02000000:00000001:0.0:1790964044.708019:0:32618:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964044.708021:0:32618:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964044.708023:0:32618:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401047000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1790964044.708029:0:32618:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 913 last 0 00010000:00000001:0.0:1790964044.708033:0:32618:0:(obd_class.h:859:obd_connect()) Process entered 00000004:00000001:0.0:1790964044.708036:0:32618:0:(mdt_handler.c:7495:mdt_obd_connect()) Process entered 00000020:00000001:0.0:1790964044.708038:0:32618:0:(genops.c:1375:class_connect()) Process entered 00000020:00000001:0.0:1790964044.708040:0:32618:0:(genops.c:931:__class_new_export()) Process entered 00000020:00000010:0.0:1790964044.708043:0:32618:0:(genops.c:933:__class_new_export()) kmalloced '(export)': 1208 at 000000008632dcd6. 00000020:00000001:0.0:1790964044.708045:0:32618:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:0.0:1790964044.708053:0:32618:0:(lustre_handles.c:93:class_handle_hash()) added object 000000008632dcd6 with handle 0x9928545985f23e40 to hash 00000020:00000001:0.0:1790964044.708055:0:32618:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00000020:00000001:0.0:1790964044.708058:0:32618:0:(obd_class.h:1015:obd_init_export()) Process entered 00000004:00000001:0.0:1790964044.708061:0:32618:0:(mdt_handler.c:7614:mdt_init_export()) Process entered 00000004:00000010:0.0:1790964044.708064:0:32618:0:(mdt_handler.c:7623:mdt_init_export()) kmalloced '(exp->exp_used_slots)': 64 at 00000000ad726446. 00000001:00000001:0.0:1790964044.708067:0:32618:0:(tgt_lastrcvd.c:423:tgt_client_alloc()) Process entered 00000001:00000010:0.0:1790964044.708079:0:32618:0:(tgt_lastrcvd.c:431:tgt_client_alloc()) kmalloced '(exp->u.eu_target_data.ted_lcd)': 128 at 00000000e4ce6028. 00000001:00000001:0.0:1790964044.708083:0:32618:0:(tgt_lastrcvd.c:438:tgt_client_alloc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964044.708085:0:32618:0:(ldlm_lockd.c:3138:ldlm_init_export()) Process entered 00000001:00000001:0.0:1790964044.708088:0:32618:0:(hash.c:1038:cfs_hash_create()) Process entered 00000001:00000010:0.0:1790964044.708091:0:32618:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 000000005ea229d6. 00000001:00000010:0.0:1790964044.708096:0:32618:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 000000000c465e15. 00000001:00000010:0.0:1790964044.708099:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000ef3db43a. 00000001:00000010:0.0:1790964044.708102:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000a3e5f401. 00000001:00000010:0.0:1790964044.708105:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000c2b72472. 00000001:00000010:0.0:1790964044.708107:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000ef5d631a. 00000001:00000001:0.0:1790964044.708109:0:32618:0:(hash.c:1038:cfs_hash_create()) Process entered 00000001:00000010:0.0:1790964044.708111:0:32618:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 00000000edabf776. 00000001:00000010:0.0:1790964044.708113:0:32618:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 000000007c012ee2. 00000001:00000010:0.0:1790964044.708115:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000009f662a67. 00000001:00000010:0.0:1790964044.708119:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000770a38c4. 00000001:00000010:0.0:1790964044.708121:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000ff6dde5e. 00000001:00000010:0.0:1790964044.708123:0:32618:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000002740e78d. 00010000:00000001:0.0:1790964044.708124:0:32618:0:(ldlm_flock.c:1138:ldlm_init_flock_export()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964044.708127:0:32618:0:(ldlm_lockd.c:3157:ldlm_init_export()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964044.708128:0:32618:0:(mdt_handler.c:7640:mdt_init_export()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964044.708130:0:32618:0:(obd_class.h:1019:obd_init_export()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1790964044.708133:0:32618:0:(genops.c:868:class_export_get()) GET export 000000008632dcd6 refcount=3 00000020:00000040:0.0:1790964044.708136:0:32618:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000001bf1f311) now 5 - export 00000020:00000001:0.0:1790964044.708138:0:32618:0:(genops.c:1001:__class_new_export()) Process leaving (rc=18446613209349081088 : -130864360470528 : ffff88fac447c800) 00000020:00000040:0.0:1790964044.708140:0:32618:0:(genops.c:879:class_export_put()) PUTting export 000000008632dcd6 : new refcount 2 00000020:00000080:0.0:1790964044.708141:0:32618:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9928545985f23e40 00000020:00000001:0.0:1790964044.708143:0:32618:0:(genops.c:1386:class_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964044.708145:0:32618:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964044.708150:0:32618:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23e40 00000020:00000001:0.0:1790964044.708152:0:32618:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964044.708153:0:32618:0:(lustre_handles.c:148:class_handle2object()) GET export 000000008632dcd6 refcount=3 00000020:00000001:0.0:1790964044.708156:0:32618:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613209349081088 : -130864360470528 : ffff88fac447c800) 00000020:00000001:0.0:1790964044.708157:0:32618:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613209349081088 : -130864360470528 : ffff88fac447c800) 00000001:00000001:0.0:1790964044.708176:0:32618:0:(nodemap_handler.c:735:nodemap_add_member()) Process entered 00000001:00000001:0.0:1790964044.708180:0:32618:0:(nodemap_handler.c:520:nodemap_classify_nid()) Process entered 00000001:00000040:0.0:1790964044.708189:0:32618:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.123@tcp 00000001:00000040:0.0:1790964044.708193:0:32618:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=00000000e91b9745) : new refcount 5 00000001:00000001:0.0:1790964044.708196:0:32618:0:(nodemap_handler.c:558:nodemap_classify_nid()) Process leaving (rc=18446613209334461440 : -130864375090176 : ffff88fac368b400) 00000001:00000001:0.0:1790964044.708199:0:32618:0:(nodemap_member.c:132:nm_member_add()) Process entered 00000020:00000040:0.0:1790964044.708201:0:32618:0:(genops.c:868:class_export_get()) GET export 000000008632dcd6 refcount=4 00000001:00000040:0.0:1790964044.708202:0:32618:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=00000000e91b9745) : new refcount 6 00000020:00000010:0.0:1790964044.708209:0:32618:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at 000000001426c2ae. 00000020:00000010:0.0:1790964044.708213:0:32618:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 2752 at 00000000f15073ea. 00000001:00000001:0.0:1790964044.708242:0:32618:0:(nodemap_member.c:170:nm_member_add()) Process leaving (rc=0 : 0 : 0) 00000001:08000000:0.0:1790964044.708245:0:32618:0:(nodemap_handler.c:809:nodemap_add_member()) lustre-MDT0000: adding NID 0@lo to nodemap default 00000001:00000040:0.0:1790964044.708248:0:32618:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=00000000e91b9745) : new refcount 5 00000001:00000001:0.0:1790964044.708250:0:32618:0:(nodemap_handler.c:815:nodemap_add_member()) Process leaving (rc=0 : 0 : 0) 00000004:00100000:0.0:1790964044.708254:0:32618:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000001:0.0:1790964044.708257:0:32618:0:(tgt_lastrcvd.c:1061:tgt_client_new()) Process entered 00000001:00000001:0.0:1790964044.708259:0:32618:0:(tgt_lastrcvd.c:1068:tgt_client_new()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964044.708262:0:32618:0:(mdt_fs.c:50:mdt_export_stats_init()) Process entered 00000020:00000001:0.0:1790964044.708264:0:32618:0:(lprocfs_status_server.c:708:lprocfs_exp_setup()) Process entered 00000020:00000010:0.0:1790964044.708268:0:32618:0:(lprocfs_status_server.c:729:lprocfs_exp_setup()) kmalloced '(new_stat)': 96 at 00000000c7feb66b. 00000020:00000040:0.0:1790964044.708274:0:32618:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats 00000000c7feb66b for nid 0@lo - ref 2 00000020:00000001:0.0:1790964044.708356:0:32618:0:(lprocfs_status_server.c:781:lprocfs_exp_setup()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964044.708362:0:32618:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 0000000081f2cb84. 00000020:00000010:0.0:1790964044.708365:0:32618:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 1728 at 00000000928d25a3. 00000020:00000010:0.0:1790964044.708368:0:32618:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 1080 at 000000009c2e824f. 00000020:00000010:0.0:1790964044.708389:0:32618:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 0000000063c59fb6. 00000020:00000010:0.0:1790964044.708392:0:32618:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 448 at 00000000333d3487. 00000020:00000010:0.0:1790964044.708400:0:32618:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 280 at 00000000359a94a0. 00000004:00000001:0.0:1790964044.708411:0:32618:0:(mdt_fs.c:75:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964044.708413:0:32618:0:(mdt_handler.c:7562:mdt_obd_connect()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964044.708416:0:32618:0:(obd_class.h:875:obd_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964044.708420:0:32618:0:(genops.c:1264:class_new_import()) kmalloced '(imp)': 1720 at 000000004c7a5823. 00000020:00000040:0.0:1790964044.708422:0:32618:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000001bf1f311) now 6 - import 00000020:00000001:0.0:1790964044.708428:0:32618:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964044.708429:0:32618:0:(genops.c:1223:class_import_put()) import 000000004c7a5823 refcount=1 obd=lustre-MDT0000 00000020:00000001:0.0:1790964044.708431:0:32618:0:(genops.c:1230:class_import_put()) Process leaving 00000020:00000040:0.0:1790964044.708434:0:32618:0:(genops.c:868:class_export_get()) GET export 000000008632dcd6 refcount=5 00000100:00000040:0.0:1790964044.708436:0:32618:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export 000000008632dcd6 : new rpc_count 1 00000100:00000001:0.0:1790964044.708438:0:32618:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:0.0:1790964044.708441:0:32618:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964044.708444:0:32618:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 15 to 0@lo 00000100:00000001:0.0:1790964044.708446:0:32618:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000100:00000001:0.0:1790964044.708448:0:32618:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446613210346682688 : -130863362868928 : 0xffff88faffbdf940) 00000100:00000040:0.0:1790964044.708451:0:32618:0:(connection.c:150:ptlrpc_connection_get()) conn=00000000b0a5732a refcount 15 to 0@lo 00000020:00000040:0.0:1790964044.708453:0:32618:0:(genops.c:868:class_export_get()) GET export 000000008632dcd6 refcount=6 00000100:00000001:0.0:1790964044.708469:0:32618:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964044.708471:0:32618:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 16 to 0@lo 00000100:00000001:0.0:1790964044.708473:0:32618:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 02000000:00000001:0.0:1790964044.708478:0:32618:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:0.0:1790964044.708482:0:32618:0:(sec.c:1444:sptlrpc_sec_create()) Process entered 02000000:08000000:0.0:1790964044.708484:0:32618:0:(sec.c:1452:sptlrpc_sec_create()) mdt lustre-MDT0000: reverse sec using flavor null 02000000:00000001:0.0:1790964044.708487:0:32618:0:(sec.c:1483:sptlrpc_sec_create()) Process leaving (rc=18446744072660350368 : -1049201248 : ffffffffc17675a0) 02000000:00000001:0.0:1790964044.708490:0:32618:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964044.708491:0:32618:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000100:00000001:0.0:1790964044.708494:0:32618:0:(recover.c:149:ptlrpc_resend()) Process entered 00000100:00000001:0.0:1790964044.708496:0:32618:0:(recover.c:178:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:0.0:1790964044.708498:0:32618:0:(import.c:65:import_set_state_nolock()) 000000004c7a5823 : changing import state from RECOVER to FULL 00000100:00000001:0.0:1790964044.708501:0:32618:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:0.0:1790964044.708502:0:32618:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:0.0:1790964044.708504:0:32618:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1790964044.708506:0:32618:0:(genops.c:879:class_export_put()) PUTting export 000000008632dcd6 : new refcount 5 00000020:00000040:0.0:1790964044.708515:0:32618:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (000000001bf1f311) now 6 - find 00010000:00000001:0.0:1790964044.708517:0:32618:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964044.708520:0:32618:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1790964044.708531:0:32618:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669973456 : -1039578160 : ffffffffc2094bd0) 00000020:00000001:0.0:1790964044.708535:0:32618:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1790964044.708536:0:32618:0:(tgt_handler.c:559:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1790964044.708538:0:32618:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1790964044.708540:0:32618:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1790964044.708543:0:32618:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964044.708546:0:32618:0:(tgt_handler.c:1061:tgt_connect()) Process entered 00000001:00000001:0.0:1790964044.708551:0:32618:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:0.0:1790964044.708553:0:32618:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:0.0:1790964044.708554:0:32618:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:0.0:1790964044.708555:0:32618:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964044.708557:0:32618:0:(tgt_handler.c:1130:tgt_connect()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964044.708559:0:32618:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961891384960 00010000:00000001:0.0:1790964044.708562:0:32618:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:0.0:1790964044.708566:0:32618:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@0000000031bf33f7 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964064 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964044.708573:0:32618:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964044.708576:0:32618:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964044.708579:0:32618:0:(import.c:2195:obd_at_measure()) add 1 to 00000000fe546ede time=1790964044 v=10 (0 0 0 0) 00000100:00001000:0.0:1790964044.708581:0:32618:0:(import.c:2261:obd_at_measure()) AT 00000000fe546ede change: old=10 new=5 delta=-5 (val=1) hist 1 0 0 0 00000100:00001000:0.0:1790964044.708584:0:32618:0:(niobuf.c:566:ptlrpc_at_set_reply()) @@@ svc mdt changed estimate from 10 to 5 req@0000000031bf33f7 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964064 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00001000:0.0:1790964044.708591:0:32618:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x200 magic=bd00bd3/bd00bd3 len=416 00000100:00000001:0.0:1790964044.708593:0:32618:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964044.708594:0:32618:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 17 to 0@lo 00000100:00000001:0.0:1790964044.708596:0:32618:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 02000000:00000001:0.0:1790964044.708598:0:32618:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964044.708600:0:32618:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964044.708602:0:32618:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964044.708604:0:32618:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964044.708615:0:32618:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000001332afee. 00000100:00000200:0.0:1790964044.708618:0:32618:0:(niobuf.c:94:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1877961891384960, offset 0 00000400:00000200:0.0:1790964044.708624:0:32618:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964044.708632:0:32618:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964044.708638:0:32618:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 416 into portal 10 MB=0x6abff13700e80 00000400:00000200:0.0:1790964044.708643:0:32618:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 416/416 into md 0xaa9 [1] + 0 00000400:00000200:0.0:1790964044.708651:0:32618:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964044.708654:0:32618:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964044.708659:0:32618:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964044.708662:0:32618:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964054 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964044.708671:0:32618:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964054 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964044.708687:0:32618:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964044.708696:0:32618:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000001332afee 00000400:00000010:0.0:1790964044.708697:0:32618:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000001332afee. 00000100:00000001:0.0:1790964044.708700:0:32618:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964044.708702:0:32618:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964044.708706:0:32618:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964044.708708:0:32618:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 16 to 0@lo 00010000:00000001:0.0:1790964044.708710:0:32618:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:0.0:1790964044.708711:0:32618:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964044.708713:0:32618:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1790964044.708716:0:32618:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000031bf33f7 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964064 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964044.708723:0:32618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031bf33f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:31763:x1877961891384960:12345-0@lo:38: Request processed in 762us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964044.708730:0:32618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000040:0.0:1790964044.708733:0:32618:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008632dcd6 : new rpc_count 0 00000100:00000001:0.0:1790964044.708735:0:32618:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964044.708737:0:32618:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964044.708742:0:32618:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000000ad9ca6e. 00000020:00000010:0.0:1790964044.708746:0:32618:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000ad360dc5. 00000020:00000010:0.0:1790964044.708760:0:32618:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000833ccd3e. 00000020:00000040:0.0:1790964044.708765:0:32618:0:(genops.c:879:class_export_put()) PUTting export 000000008632dcd6 : new refcount 4 00000100:00000001:0.0:1790964044.708767:0:32618:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964044.708819:0:31766:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.708821:0:31766:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964044.708827:0:31766:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.708831:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 0 is 4295581191 00000100:00000001:1.0:1790964044.708834:0:31766:0:(niobuf.c:692:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 0, keep current deadline 4295581191 00000100:00000001:1.0:1790964044.708836:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 1 is 4295581191 00000100:00000001:1.0:1790964044.708838:0:31766:0:(niobuf.c:692:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 1, keep current deadline 4295581191 00000100:00000001:1.0:1790964044.708839:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 2 is 4295581191 00000100:00000001:1.0:1790964044.708841:0:31766:0:(niobuf.c:692:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 2, keep current deadline 4295581191 00000100:00000001:1.0:1790964044.708843:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 3 is 4295581191 00000100:00000001:1.0:1790964044.708844:0:31766:0:(niobuf.c:692:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 3, keep current deadline 4295581191 00000100:00000001:1.0:1790964044.708846:0:31766:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964044.708848:0:31766:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.708851:0:31766:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.708854:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964044.708864:0:31766:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964044.708866:0:31766:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1790964044.708868:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964044.708870:0:31766:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964044.708871:0:31766:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.708873:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.708885:0:31767:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:1.0:1790964044.708891:0:31767:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 0000000051021bad. 00000020:00000010:1.0:1790964044.708895:0:31767:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 0000000052159f1b. 80000000:00000010:1.0:1790964044.708900:0:31767:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 00000000edb51861. 40000000:00000010:1.0:1790964044.708903:0:31767:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 0000000063af97b6. 00000008:00000010:1.0:1790964044.708907:0:31767:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 000000009aadef23. 00020000:00000010:1.0:1790964044.708911:0:31767:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 0000000006ae3266. 00008000:00000010:1.0:1790964044.708916:0:31767:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 00000000f04fc391. 00100000:00000010:1.0:1790964044.708919:0:31767:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 000000005ed3da4d. 00040000:00000010:1.0:1790964044.708922:0:31767:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 000000005e1bd1ee. 00040000:00000010:1.0:1790964044.708926:0:31767:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 000000006edfcbec. 00040000:00000010:1.0:1790964044.708929:0:31767:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 000000004e70aa51. 00080000:00000010:1.0:1790964044.708933:0:31767:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 00000000b20a1879. 00000004:00000010:1.0:1790964044.708936:0:31767:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 00000000e882d91c. 00000004:00000010:1.0:1790964044.708951:0:31767:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 0000000001084536. 00000004:00000010:1.0:1790964044.708956:0:31767:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 00000000b93190e0. 00002000:00000010:1.0:1790964044.708960:0:31767:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 0000000015734202. 00000004:00000010:1.0:1790964044.708962:0:31767:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 00000000abb12b33. 00000080:00000010:1.0:1790964044.708966:0:31767:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 0000000041bafa3e. 00000080:00000010:1.0:1790964044.708971:0:31767:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 000000001216e808. 00000008:00000010:1.0:1790964044.708976:0:31767:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 000000004aee1c04. 00020000:00000010:1.0:1790964044.708979:0:31767:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 000000004c11a915. 00008000:00000010:1.0:1790964044.708982:0:31767:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 000000009e90cc42. 00000080:00000010:1.0:1790964044.708998:0:31767:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 00000000292cf5c1. 00000100:00000001:1.0:1790964044.709001:0:31767:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.709033:0:32610:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964044.709035:0:32610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891384832 02000000:00000001:1.0:1790964044.709038:0:32610:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964044.709040:0:32610:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964044.709048:0:32610:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964044.709052:0:32610:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964044.709055:0:32610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891384832 00000020:00000001:1.0:1790964044.709057:0:32610:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964044.709058:0:32610:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23d60 00000020:00000001:1.0:1790964044.709061:0:32610:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964044.709062:0:32610:0:(lustre_handles.c:148:class_handle2object()) GET export 000000009a31e7fe refcount=11 00000020:00000001:1.0:1790964044.709065:0:32610:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000020:00000001:1.0:1790964044.709066:0:32610:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000100:00000001:1.0:1790964044.709071:0:32610:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964044.709074:0:32610:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000041630313. 00000100:00000001:1.0:1790964044.709077:0:32610:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964044.709080:0:32610:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000041630313. 00000020:00000010:1.0:1790964044.709085:0:32610:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009fbb6359. 00000020:00000010:1.0:1790964044.709088:0:32610:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000008e544f43. 00000020:00000010:1.0:1790964044.709092:0:32610:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000004eaaf81f. 00000100:00000040:1.0:1790964044.709099:0:32610:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964044.709103:0:32610:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964044.709104:0:32610:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964044.709105:0:32610:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.709111:0:32610:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.709122:0:32610:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964044.709129:0:32610:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964044.709131:0:32610:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964044.709134:0:32610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00000040:1.0:1790964044.709137:0:32610:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000009a31e7fe : new rpc_count 1 00000100:00000001:1.0:1790964044.709139:0:32610:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446613209796443216 : -130863913108400 : ffff88fadef1fc50) 00000100:00000040:1.0:1790964044.709142:0:32610:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000007b3eae6c x1877961891384832/t0(0) o400->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:620/0 lens 224/0 e 0 to 0 dl 1790964055 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.709150:0:32610:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964044.709153:0:32610:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000041630313. 00000100:00000001:1.0:1790964044.709155:0:32610:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964044.709157:0:32610:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000041630313. 00000100:00100000:1.0:1790964044.709188:0:32610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b3eae6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:31766:x1877961891384832:12345-0@lo:400: 00000100:00000200:1.0:1790964044.709191:0:32610:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961891384832 00000020:00000001:1.0:1790964044.709194:0:32610:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964044.709196:0:32610:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964044.709198:0:32610:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964044.709200:0:32610:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964044.709201:0:32610:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667990208 : -1041561408 : ffffffffc1eb08c0) 00000020:00000001:1.0:1790964044.709204:0:32610:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964044.709205:0:32610:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964044.709207:0:32610:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964044.709208:0:32610:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964044.709210:0:32610:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964044.709212:0:32610:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:1.0:1790964044.709214:0:32610:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964044.709216:0:32610:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964044.709220:0:32610:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 000000001ec78155. 02000000:00000001:1.0:1790964044.709222:0:32610:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.709223:0:32610:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964044.709225:0:32610:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964044.709227:0:32610:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961891384832 00010000:00000001:1.0:1790964044.709229:0:32610:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964044.709232:0:32610:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000007b3eae6c x1877961891384832/t0(0) o400->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:620/0 lens 224/224 e 0 to 0 dl 1790964055 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964044.709238:0:32610:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964044.709240:0:32610:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964044.709242:0:32610:0:(import.c:2195:obd_at_measure()) add 1 to 000000000eace963 time=5 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964044.709245:0:32610:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964044.709246:0:32610:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 17 to 0@lo 00000100:00000001:1.0:1790964044.709248:0:32610:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 02000000:00000001:1.0:1790964044.709250:0:32610:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964044.709251:0:32610:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.709253:0:32610:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964044.709255:0:32610:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964044.709258:0:32610:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007bbfcc94. 00000100:00000200:1.0:1790964044.709261:0:32610:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877961891384832, offset 224 00000400:00000200:1.0:1790964044.709273:0:32610:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964044.709279:0:32610:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964044.709284:0:32610:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff13700e00 00000400:00000200:1.0:1790964044.709290:0:32610:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xab1 [1] + 224 00000400:00000200:1.0:1790964044.709294:0:32610:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964044.709297:0:32610:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964044.709300:0:32610:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964044.709304:0:32610:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964044.709312:0:32610:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.709321:0:32610:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964044.709326:0:32610:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007bbfcc94 00000400:00000010:1.0:1790964044.709328:0:32610:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007bbfcc94. 00000100:00000001:1.0:1790964044.709330:0:32610:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964044.709331:0:32610:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964044.709333:0:32610:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964044.709335:0:32610:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 16 to 0@lo 00010000:00000001:1.0:1790964044.709337:0:32610:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964044.709339:0:32610:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964044.709341:0:32610:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964044.709344:0:32610:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000007b3eae6c x1877961891384832/t0(0) o400->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:620/0 lens 224/224 e 0 to 0 dl 1790964055 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964044.709352:0:32610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b3eae6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c290d637-a468-41a2-ad47-911f0cbec690+11:31766:x1877961891384832:12345-0@lo:400: Request processed in 201us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964044.709358:0:32610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00000040:1.0:1790964044.709360:0:32610:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a31e7fe : new rpc_count 0 00000100:00000001:1.0:1790964044.709362:0:32610:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964044.709363:0:32610:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964044.709366:0:32610:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000008e544f43. 00000020:00000010:1.0:1790964044.709369:0:32610:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000004eaaf81f. 00000020:00000010:1.0:1790964044.709371:0:32610:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009fbb6359. 00000020:00000040:1.0:1790964044.709380:0:32610:0:(genops.c:879:class_export_put()) PUTting export 000000009a31e7fe : new refcount 10 02000000:00000001:1.0:1790964044.709384:0:32610:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964044.709386:0:32610:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 000000001ec78155. 02000000:00000001:1.0:1790964044.709390:0:32610:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964044.709392:0:32610:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964044.709396:0:32610:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964044.709401:0:32610:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000b9f75820. 00000400:00000010:1.0:1790964044.709408:0:32610:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000b08d1254. 00000100:00000001:1.0:1790964044.709423:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964044.709425:0:31766:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964044.709429:0:31766:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964044.709431:0:31766:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964044.709433:0:31766:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000d931bdac. 00000400:00000200:1.0:1790964044.709435:0:31766:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000ae553c76 00000400:00000010:1.0:1790964044.709437:0:31766:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000ae553c76. 00000100:00000001:1.0:1790964044.709439:0:31766:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964044.709442:0:31766:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964044.709448:0:31766:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.709454:0:31766:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964044.709456:0:31766:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964044.709458:0:31766:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964044.709460:0:31766:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964044.709461:0:31766:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964044.709463:0:31766:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964044.709464:0:31766:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964044.709468:0:31766:0:(import.c:2195:obd_at_measure()) add 5 to 00000000a85d97ae time=5 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964044.709471:0:31766:0:(import.c:2195:obd_at_measure()) add 1 to 000000003079e642 time=5 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964044.709473:0:31766:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964044.709475:0:31766:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964044.709477:0:31766:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1790964044.709479:0:31766:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.709482:0:31766:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964044.709485:0:31766:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.709500:0:31766:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964044.709503:0:31766:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964044.709504:0:31766:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964044.709507:0:31766:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964044.709513:0:31766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0000404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c290d637-a468-41a2-ad47-911f0cbec690:31766:1877961891384832:0@lo:400: 00000100:00000001:1.0:1790964044.709517:0:31766:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964044.709519:0:31766:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964044.709521:0:31766:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000a0000404 x1877961891384832/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964044.709526:0:31766:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964044.709529:0:31766:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964044.709531:0:31766:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 000000006b67fade. 02000000:00000001:1.0:1790964044.709538:0:31766:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964044.709539:0:31766:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964044.709541:0:31766:0:(genops.c:1223:class_import_put()) import 000000005c67ece7 refcount=3 obd=MGC192.168.202.123@tcp 00000020:00000001:1.0:1790964044.709543:0:31766:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964044.709545:0:31766:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000fb942eea. 02000000:00000001:1.0:1790964044.709548:0:31766:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964044.709550:0:31766:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964044.709552:0:31766:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000a0000404. 00000100:00000001:1.0:1790964044.709555:0:31766:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964044.709556:0:31766:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964044.709558:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964044.709562:0:31766:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964044.709563:0:31766:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964044.709564:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964044.709566:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.710386:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964044.710391:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964044.710396:0:31763:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964044.710398:0:31763:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964044.710400:0:31763:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000e3f53987. 00000400:00000200:3.0:1790964044.710412:0:31763:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000d945d0b7 00000400:00000010:3.0:1790964044.710413:0:31763:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000d945d0b7. 00000100:00000001:3.0:1790964044.710418:0:31763:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964044.710424:0:31763:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964054 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964044.710432:0:31763:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964054 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.710438:0:31763:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964044.710439:0:31763:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964044.710441:0:31763:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964044.710443:0:31763:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964044.710445:0:31763:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964044.710446:0:31763:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964044.710448:0:31763:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964044.710455:0:31763:0:(import.c:2195:obd_at_measure()) add 5 to 000000004c2f0a13 time=1790964044 v=5 (0 0 0 0) 00000100:00001000:3.0:1790964044.710458:0:31763:0:(import.c:2195:obd_at_measure()) add 1 to 00000000b260e820 time=5 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964044.710460:0:31763:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964044.710461:0:31763:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964044.710464:0:31763:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1790964044.710467:0:31763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964044.710473:0:31763:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.710477:0:31763:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1790964044.710478:0:31763:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:3.0:1790964044.710480:0:31763:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1790964044.710482:0:31763:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.710484:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.710490:0:31763:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964044.710492:0:31763:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964044.710493:0:31763:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964044.710495:0:31763:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00080000:3.0:1790964044.710501:0:31763:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000020:00000001:3.0:1790964044.710503:0:31763:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964044.710509:0:31763:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23e32 00000020:00000001:3.0:1790964044.710512:0:31763:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964044.710514:0:31763:0:(lustre_handles.c:148:class_handle2object()) GET export 000000008b4f75f0 refcount=7 00000020:00000001:3.0:1790964044.710516:0:31763:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613209788346368 : -130863921205248 : ffff88fade767000) 00000020:00000001:3.0:1790964044.710518:0:31763:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613209788346368 : -130863921205248 : ffff88fade767000) 00000100:00001000:3.0:1790964044.710521:0:31763:0:(import.c:2195:obd_at_measure()) add 1 to 00000000b260e820 time=1790964044 v=0 (0 0 0 0) 00000100:00001000:3.0:1790964044.710524:0:31763:0:(import.c:2261:obd_at_measure()) AT 00000000b260e820 change: old=0 new=5 delta=5 (val=1) hist 1 0 0 0 00000100:00080000:3.0:1790964044.710530:0:31763:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000020:00000040:3.0:1790964044.710533:0:31763:0:(genops.c:879:class_export_put()) PUTting export 000000008b4f75f0 : new refcount 6 00000100:00000001:3.0:1790964044.710535:0:31763:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:3.0:1790964044.710538:0:31763:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00080000:3.0:1790964044.710539:0:31763:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790964044.710542:0:31763:0:(import.c:65:import_set_state_nolock()) 00000000773535ae lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000001:3.0:1790964044.710544:0:31763:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:3.0:1790964044.710545:0:31763:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:3.0:1790964044.710546:0:31763:0:(import.c:1285:ptlrpc_connect_interpret()) Process leaving via finish (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964044.710549:0:31763:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000100:00000001:3.0:1790964044.710552:0:31763:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.710554:0:31763:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.710557:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964054 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964044.710563:0:31763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c75e991 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31763:1877961891384960:0@lo:38: 00000100:00000001:3.0:1790964044.710566:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.710568:0:31763:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964044.710570:0:31763:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000005c75e991 x1877961891384960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964054 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964044.710575:0:31763:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964044.710577:0:31763:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964044.710579:0:31763:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a885b3c8. 02000000:00000001:3.0:1790964044.710582:0:31763:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964044.710583:0:31763:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964044.710584:0:31763:0:(genops.c:1223:class_import_put()) import 00000000773535ae refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:3.0:1790964044.710592:0:31763:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964044.710594:0:31763:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 00000000be03f07a. 02000000:00000001:3.0:1790964044.710596:0:31763:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964044.710598:0:31763:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964044.710599:0:31763:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000005c75e991. 00000100:00000001:3.0:1790964044.710602:0:31763:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964044.710603:0:31763:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964044.710605:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.710606:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964044.710608:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964044.710609:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964044.710611:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964044.711352:0:33:0:(connection.c:75:cpu_latency_work()) work item of 0000000048c58409 (cpu 3) has reached its deadline 4295581191, at 4295581192 00000100:00000010:3.0:1790964044.711366:0:33:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000194bffa9. 00000100:00000040:0.0:1790964044.712640:0:1100:0:(connection.c:75:cpu_latency_work()) work item of 00000000a22dbd09 (cpu 0) has reached its deadline 4295581191, at 4295581193 00000100:00000010:0.0:1790964044.712654:0:1100:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000005c038cc5. 00000100:00000040:2.0:1790964044.713151:0:11733:0:(connection.c:75:cpu_latency_work()) work item of 00000000ceedfbcb (cpu 2) has reached its deadline 4295581191, at 4295581193 00000100:00000010:2.0:1790964044.713159:0:11733:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000b2b088db. 00000100:00000040:1.0:1790964044.713715:0:26684:0:(connection.c:75:cpu_latency_work()) work item of 000000009cab77b5 (cpu 1) has reached its deadline 4295581191, at 4295581194 00000100:00000010:1.0:1790964044.713723:0:26684:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000d14eca9a. 00080000:00000001:3.0:1790964045.099143:0:32911:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964045.099371:0:32911:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964045.099378:0:32911:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964045.215847:0:33:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:3.0:1790964045.215856:0:33:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964045.215861:0:33:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:3.0:1790964045.215863:0:33:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964045.216013:0:32604:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1790964045.216017:0:32604:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1790964045.216020:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:1.0:1790964045.730347:0:31763:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964045.730362:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964045.730365:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964045.730384:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964045.730386:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964045.730389:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964045.730391:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964045.735335:0:32603:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000008966a824. 00000100:00000001:3.0:1790964045.735356:0:32603:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:3.0:1790964045.735359:0:32603:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964045.737826:0:32653:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964045.737834:0:32653:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964045.737836:0:32653:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964045.737840:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00000100:00000001:2.0:1790964045.737845:0:32653:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964045.737848:0:32653:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964045.737851:0:32653:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964045.737854:0:32653:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964045.737857:0:32653:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964045.737905:0:32599:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000342924e8. 00000100:00000001:3.0:1790964045.737914:0:32599:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:3.0:1790964045.737916:0:32599:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:1.0:1790964046.186642:0:32961:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964046.186660:0:32961:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964046.186665:0:32961:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964046.241804:0:33:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:3.0:1790964046.241813:0:33:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964046.241818:0:33:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:3.0:1790964046.241820:0:33:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964046.241860:0:32605:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964046.241864:0:32605:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964046.241867:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00000001:0.0:1790964046.242446:0:32613:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:0.0:1790964046.242449:0:32613:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000b3c41770) refs 2 10000000:00000001:0.0:1790964046.242453:0:32613:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:0.0:1790964046.242456:0:32613:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000001:0.0:1790964046.242457:0:32613:0:(mgc_request.c:120:config_log_put()) Process leaving 10000000:00000001:0.0:1790964046.242458:0:32613:0:(mgc_request.c:601:do_requeue()) Process entered 10000000:01000000:0.0:1790964046.242460:0:32613:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:00000001:0.0:1790964046.242461:0:32613:0:(mgc_request.c:1783:mgc_process_log()) Process entered 10000000:01000000:0.0:1790964046.242463:0:32613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88faed0d7000 from 9 10000000:00000001:0.0:1790964046.242465:0:32613:0:(mgc_request.c:990:mgc_enqueue()) Process entered 10000000:01000000:0.0:1790964046.242467:0:32613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00000010:0.0:1790964046.242474:0:32613:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000d44646e4. 00000020:00000040:0.0:1790964046.242477:0:32613:0:(genops.c:1210:class_import_get()) import 000000005c67ece7 refcount=4 obd=MGC192.168.202.123@tcp 00000100:00000001:0.0:1790964046.242481:0:32613:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1790964046.242484:0:32613:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1790964046.242488:0:32613:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1790964046.242494:0:32613:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000bebbf8d7. 00000100:00000001:0.0:1790964046.242500:0:32613:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964046.242504:0:32613:0:(ldlm_request.c:1064:ldlm_cli_enqueue()) Process entered 00010000:00000001:0.0:1790964046.242507:0:32613:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:0.0:1790964046.242513:0:32613:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000649d4138. 00010000:00000001:0.0:1790964046.242517:0:32613:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:0.0:1790964046.242520:0:32613:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 000000006e856977. 00000020:00000010:0.0:1790964046.242524:0:32613:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 128 at 0000000033977fca. 00000020:00000001:0.0:1790964046.242527:0:32613:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:0.0:1790964046.242529:0:32613:0:(lustre_handles.c:93:class_handle_hash()) added object 000000006e856977 with handle 0x9928545985f23e47 to hash 00000020:00000001:0.0:1790964046.242531:0:32613:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:0.0:1790964046.242532:0:32613:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000001:0.0:1790964046.242535:0:32613:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000001:0.0:1790964046.242539:0:32613:0:(ldlm_lock.c:261:ldlm_lock_remove_from_lru_check()) Process entered 00010000:00000001:0.0:1790964046.242548:0:32613:0:(ldlm_lock.c:280:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1790964046.242551:0:32613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 000000006e856977/0x9928545985f23e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964046.242559:0:32613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 000000006e856977/0x9928545985f23e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964046.242569:0:32613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 000000006e856977/0x9928545985f23e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000001:0.0:1790964046.242574:0:32613:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:0.0:1790964046.242576:0:32613:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:0.0:1790964046.242582:0:32613:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 000000004d1b42a3. 00000100:00000001:0.0:1790964046.242584:0:32613:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446613209435414080 : -130864274137536 : ffff88fac96d1e40) 00000100:00000001:0.0:1790964046.242586:0:32613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964046.242587:0:32613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613210319592448 : -130863389959168 : ffff88fafe209c00) 00000100:00000001:0.0:1790964046.242591:0:32613:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1790964046.242594:0:32613:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964046.242596:0:32613:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:0.0:1790964046.242598:0:32613:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1790964046.242606:0:32613:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964046.242614:0:32613:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964046.242616:0:32613:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964046.242619:0:32613:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1790964046.242621:0:32613:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964046.242623:0:32613:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964046.242625:0:32613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d44646e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c290d637-a468-41a2-ad47-911f0cbec690:32613:1877961891385088:0@lo:101: 00000100:00000001:0.0:1790964046.242629:0:32613:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1790964046.242635:0:32613:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1790964046.242637:0:32613:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964046.242640:0:32613:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1790964046.242643:0:32613:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004da0ad6a. 02000000:00000001:0.0:1790964046.242645:0:32613:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1790964046.242656:0:32613:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000f9ca1252. 00000400:00000010:0.0:1790964046.242663:0:32613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000001332afee. 00000100:00000200:0.0:1790964046.242669:0:32613:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961891385088, portal 25 00000100:00000001:0.0:1790964046.242670:0:32613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964046.242671:0:32613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613210319592448 : -130863389959168 : ffff88fafe209c00) 00000100:00000040:0.0:1790964046.242676:0:32613:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964046.242683:0:32613:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964046.242686:0:32613:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964046.242688:0:32613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000087f54be2. 00000100:00000200:0.0:1790964046.242690:0:32613:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1877961891385088, offset 0 00000400:00000200:0.0:1790964046.242695:0:32613:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964046.242709:0:32613:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964046.242719:0:32613:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 328 into portal 26 MB=0x6abff13700f00 00000400:00000200:0.0:1790964046.242724:0:32613:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 328/328 into md 0x165 [2] + 0 00000400:00000010:0.0:1790964046.242729:0:32613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000000ce7364b. 00000400:00000200:0.0:1790964046.242733:0:32613:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000c198032f 00000400:00000200:0.0:1790964046.242741:0:32613:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964046.242744:0:32613:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:0.0:1790964046.242749:0:32613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c198032f 00000400:00000010:0.0:1790964046.242752:0:32613:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000c198032f. 00000100:00000001:0.0:1790964046.242757:0:32613:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:0.0:1790964046.242758:0:32613:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:0.0:1790964046.242762:0:32613:0:(events.c:341:request_in_callback()) incoming req@000000003d9dbcb9 x1877961891385088 msgsize 328 00000100:00100000:0.0:1790964046.242765:0:32613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1790964046.242767:0:32613:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:0.0:1790964046.242786:0:32613:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1790964046.242794:0:32613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000087f54be2 00000400:00000010:0.0:1790964046.242796:0:32613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000087f54be2. 00000100:00000001:0.0:1790964046.242799:0:32613:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:0.0:1790964046.242802:0:32613:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964046.242812:0:32613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964046.242814:0:32613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964046.242826:0:32613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964046.242827:0:32613:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1790964046.242835:0:32613:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964046.242839:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 0 is 4295582727 00000100:00000010:0.0:1790964046.242843:0:32613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000009542302a. 00000100:00000001:0.0:1790964046.242851:0:32613:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 0 00000100:00000001:0.0:1790964046.242857:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 1 is 4295582727 00000100:00000010:0.0:1790964046.242859:0:32613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000234fb580. 00000100:00000001:0.0:1790964046.242861:0:32613:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 1 00000100:00000001:0.0:1790964046.242864:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 2 is 4295582727 00000100:00000010:0.0:1790964046.242865:0:32613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000f664caa8. 00000100:00000001:0.0:1790964046.242868:0:32613:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1790964046.242871:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 3 is 4295582727 00000100:00000010:0.0:1790964046.242872:0:32613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000b341e901. 00000100:00000001:0.0:1790964046.242875:0:32613:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1790964046.242877:0:32613:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964046.242880:0:32613:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964046.242882:0:32613:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964046.242884:0:32613:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:0.0:1790964046.242886:0:32613:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d1b42a3 going to sleep for 11 seconds 00000100:00000001:0.0:1790964046.242888:0:32613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964046.242891:0:32613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.243394:0:32611:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964046.243398:0:32611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891385088 02000000:00000001:1.0:1790964046.243401:0:32611:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964046.243404:0:32611:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964046.243406:0:32611:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964046.243410:0:32611:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964046.243414:0:32611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891385088 00000020:00000001:1.0:1790964046.243416:0:32611:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964046.243418:0:32611:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23d60 00000020:00000001:1.0:1790964046.243420:0:32611:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964046.243423:0:32611:0:(lustre_handles.c:148:class_handle2object()) GET export 000000009a31e7fe refcount=11 00000020:00000001:1.0:1790964046.243426:0:32611:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000020:00000001:1.0:1790964046.243428:0:32611:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000100:00000001:1.0:1790964046.243432:0:32611:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964046.243437:0:32611:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000046b0e36a. 00000100:00000001:1.0:1790964046.243440:0:32611:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964046.243443:0:32611:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000046b0e36a. 00000020:00000010:1.0:1790964046.243449:0:32611:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f461b5a8. 00000020:00000010:1.0:1790964046.243454:0:32611:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000c5255798. 00000020:00000010:1.0:1790964046.243458:0:32611:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000004eaaf81f. 00000100:00000040:1.0:1790964046.243468:0:32611:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964046.243471:0:32611:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964046.243472:0:32611:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964046.243474:0:32611:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.243480:0:32611:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.243507:0:32611:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964046.243525:0:32611:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964046.243527:0:32611:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964046.243531:0:32611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964046.243535:0:32611:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000009a31e7fe : new rpc_count 1 00000100:00000001:1.0:1790964046.243537:0:32611:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446613209796428880 : -130863913122736 : ffff88fadef1c450) 00000100:00000040:1.0:1790964046.243542:0:32611:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000003d9dbcb9 x1877961891385088/t0(0) o101->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:622/0 lens 328/0 e 0 to 0 dl 1790964057 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.243551:0:32611:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964046.243553:0:32611:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000046b0e36a. 00000100:00000001:1.0:1790964046.243555:0:32611:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964046.243557:0:32611:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000046b0e36a. 00000100:00100000:1.0:1790964046.243561:0:32611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d9dbcb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+11:32613:x1877961891385088:12345-0@lo:101: 00000100:00000200:1.0:1790964046.243564:0:32611:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961891385088 00000020:00000001:1.0:1790964046.243568:0:32611:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964046.243571:0:32611:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964046.243573:0:32611:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964046.243576:0:32611:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964046.243578:0:32611:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667990144 : -1041561472 : ffffffffc1eb0880) 00000020:00000001:1.0:1790964046.243581:0:32611:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964046.243583:0:32611:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964046.243584:0:32611:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964046.243586:0:32611:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964046.243590:0:32611:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964046.243592:0:32611:0:(tgt_handler.c:1471:tgt_enqueue()) Process entered 00010000:00000001:1.0:1790964046.243594:0:32611:0:(ldlm_lockd.c:1263:ldlm_handle_enqueue()) Process entered 00010000:00010000:1.0:1790964046.243596:0:32611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000001:1.0:1790964046.243598:0:32611:0:(ldlm_lockd.c:1725:ldlm_request_cancel()) Process entered 00010000:00000001:1.0:1790964046.243600:0:32611:0:(ldlm_lockd.c:1734:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.243606:0:32611:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:1.0:1790964046.243611:0:32611:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000339b6f9f. 00010000:00000001:1.0:1790964046.243614:0:32611:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:1.0:1790964046.243617:0:32611:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 00000000b67bb61b. 00000020:00000001:1.0:1790964046.243620:0:32611:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:1.0:1790964046.243627:0:32611:0:(lustre_handles.c:93:class_handle_hash()) added object 00000000b67bb61b with handle 0x9928545985f23e4e to hash 00000020:00000001:1.0:1790964046.243629:0:32611:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:1.0:1790964046.243630:0:32611:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446613210197852160 : -130863511699456 : ffff88faf6df0000) 00010000:00000001:1.0:1790964046.243633:0:32611:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446613210197852160 : -130863511699456 : ffff88faf6df0000) 00010000:00010000:1.0:1790964046.243635:0:32611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b67bb61b/0x9928545985f23e4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9928545985f23e47 expref: -99 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1790964046.243644:0:32611:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export 000000009a31e7fe : new locks_count 6 00000020:00000040:1.0:1790964046.243646:0:32611:0:(genops.c:868:class_export_get()) GET export 000000009a31e7fe refcount=12 00000100:00000001:1.0:1790964046.243655:0:32611:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964046.243657:0:32611:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964046.243661:0:32611:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 640 at 00000000af3befd3. 02000000:00000001:1.0:1790964046.243664:0:32611:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.243667:0:32611:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.243669:0:32611:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:1.0:1790964046.243672:0:32611:0:(ldlm_lock.c:1758:ldlm_lock_enqueue_helper()) Process entered 00010000:00000001:1.0:1790964046.243675:0:32611:0:(ldlm_plain.c:119:ldlm_process_plain_lock()) Process entered 00010000:00000001:1.0:1790964046.243676:0:32611:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964046.243678:0:32611:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964046.243680:0:32611:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964046.243681:0:32611:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964046.243683:0:32611:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:1.0:1790964046.243685:0:32611:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:1.0:1790964046.243687:0:32611:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:1.0:1790964046.243688:0:32611:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:1.0:1790964046.243690:0:32611:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000339b6f9f) refcount = 1 00010000:00010000:1.0:1790964046.243695:0:32611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b67bb61b/0x9928545985f23e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9928545985f23e47 expref: 12 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964046.243701:0:32611:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:1.0:1790964046.243702:0:32611:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:1.0:1790964046.243704:0:32611:0:(ldlm_plain.c:146:ldlm_process_plain_lock()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964046.243706:0:32611:0:(ldlm_lock.c:1769:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.243707:0:32611:0:(ldlm_lock.c:1928:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:1.0:1790964046.243711:0:32611:0:(ldlm_lockd.c:1494:ldlm_handle_enqueue()) Process leaving 00010000:00010000:1.0:1790964046.243720:0:32611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b67bb61b/0x9928545985f23e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9928545985f23e47 expref: 12 pid: 32611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964046.243728:0:32611:0:(ldlm_lock.c:2393:__ldlm_reprocess_all()) Process entered 00010000:00000001:1.0:1790964046.243729:0:32611:0:(ldlm_lock.c:1970:ldlm_reprocess_queue()) Process entered 00010000:00000001:1.0:1790964046.243732:0:32611:0:(ldlm_lock.c:2019:ldlm_reprocess_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964046.243734:0:32611:0:(ldlm_lock.c:2323:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.243735:0:32611:0:(ldlm_lock.c:2427:__ldlm_reprocess_all()) Process leaving 00010000:00000001:1.0:1790964046.243737:0:32611:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964046.243738:0:32611:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:1.0:1790964046.243739:0:32611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b67bb61b, rc 0) 00000020:00000001:1.0:1790964046.243741:0:32611:0:(tgt_handler.c:1496:tgt_enqueue()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964046.243744:0:32611:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961891385088 00010000:00000001:1.0:1790964046.243747:0:32611:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964046.243751:0:32611:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000003d9dbcb9 x1877961891385088/t0(0) o101->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:622/0 lens 328/344 e 0 to 0 dl 1790964057 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964046.243759:0:32611:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964046.243761:0:32611:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964046.243765:0:32611:0:(import.c:2195:obd_at_measure()) add 1 to 000000000eace963 time=7 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964046.243769:0:32611:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964046.243772:0:32611:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 17 to 0@lo 00000100:00000001:1.0:1790964046.243773:0:32611:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 02000000:00000001:1.0:1790964046.243776:0:32611:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964046.243778:0:32611:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.243781:0:32611:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964046.243782:0:32611:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964046.243788:0:32611:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000ae553c76. 00000100:00000200:1.0:1790964046.243793:0:32611:0:(niobuf.c:94:ptl_send_buf()) Sending 344 bytes to portal 25, xid 1877961891385088, offset 224 00000400:00000200:1.0:1790964046.243797:0:32611:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964046.243806:0:32611:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964046.243814:0:32611:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 344 into portal 25 MB=0x6abff13700f00 00000400:00000200:1.0:1790964046.243819:0:32611:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 344/344 into md 0xac5 [1] + 224 00000400:00000200:1.0:1790964046.243825:0:32611:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964046.243829:0:32611:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964046.243839:0:32611:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964046.243843:0:32611:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964046.243851:0:32611:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.243866:0:32611:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964046.243871:0:32611:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000ae553c76 00000400:00000010:1.0:1790964046.243873:0:32611:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000ae553c76. 00000100:00000001:1.0:1790964046.243875:0:32611:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964046.243877:0:32611:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964046.243880:0:32611:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964046.243882:0:32611:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 16 to 0@lo 00010000:00000001:1.0:1790964046.243884:0:32611:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964046.243885:0:32611:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964046.243887:0:32611:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964046.243890:0:32611:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000003d9dbcb9 x1877961891385088/t0(0) o101->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:622/0 lens 328/344 e 0 to 0 dl 1790964057 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964046.243897:0:32611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d9dbcb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c290d637-a468-41a2-ad47-911f0cbec690+12:32613:x1877961891385088:12345-0@lo:101: Request processed in 346us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964046.243902:0:32611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964046.243905:0:32611:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a31e7fe : new rpc_count 0 00000100:00000001:1.0:1790964046.243907:0:32611:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964046.243908:0:32611:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964046.243912:0:32611:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000c5255798. 00000020:00000010:1.0:1790964046.243915:0:32611:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000004eaaf81f. 00000020:00000010:1.0:1790964046.243918:0:32611:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f461b5a8. 00000020:00000040:1.0:1790964046.243925:0:32611:0:(genops.c:879:class_export_put()) PUTting export 000000009a31e7fe : new refcount 11 02000000:00000001:1.0:1790964046.243928:0:32611:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964046.243930:0:32611:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 640 at 00000000af3befd3. 02000000:00000001:1.0:1790964046.243934:0:32611:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964046.243936:0:32611:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964046.243939:0:32611:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964046.243943:0:32611:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000d931bdac. 00000400:00000010:1.0:1790964046.243954:0:32611:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 000000009b5b85bb. 00000100:00000001:1.0:1790964046.243969:0:32613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964046.243989:0:32613:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964046.243990:0:32613:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964046.243992:0:32613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000f9ca1252. 00000400:00000200:1.0:1790964046.243995:0:32613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000001332afee 00000400:00000010:1.0:1790964046.243997:0:32613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000001332afee. 00000100:00000001:1.0:1790964046.243999:0:32613:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964046.244002:0:32613:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964046.244009:0:32613:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244015:0:32613:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964046.244017:0:32613:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964046.244020:0:32613:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964046.244022:0:32613:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964046.244023:0:32613:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964046.244025:0:32613:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964046.244027:0:32613:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964046.244031:0:32613:0:(import.c:2195:obd_at_measure()) add 5 to 00000000a85d97ae time=7 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964046.244034:0:32613:0:(import.c:2195:obd_at_measure()) add 1 to 000000003079e642 time=7 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964046.244037:0:32613:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964046.244038:0:32613:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.244041:0:32613:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1790964046.244042:0:32613:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244045:0:32613:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964046.244048:0:32613:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244055:0:32613:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964046.244057:0:32613:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964046.244060:0:32613:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964046.244063:0:32613:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964046.244069:0:32613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d44646e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c290d637-a468-41a2-ad47-911f0cbec690:32613:1877961891385088:0@lo:101: 00000100:00000001:1.0:1790964046.244080:0:32613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964046.244083:0:32613:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244084:0:32613:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:1.0:1790964046.244086:0:32613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964046.244089:0:32613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244094:0:32613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:1.0:1790964046.244096:0:32613:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 000000004d1b42a3. 00000100:00000001:1.0:1790964046.244100:0:32613:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:1.0:1790964046.244101:0:32613:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.244104:0:32613:0:(ldlm_request.c:661:ldlm_cli_enqueue_fini()) Process entered 00010000:00000001:1.0:1790964046.244106:0:32613:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:1.0:1790964046.244108:0:32613:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964046.244109:0:32613:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 000000006e856977 refcount=4 00000020:00000001:1.0:1790964046.244111:0:32613:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000001:1.0:1790964046.244113:0:32613:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000040:1.0:1790964046.244118:0:32613:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: 000000006e856977, remote cookie: 0x9928545985f23e4e, flags: 0x0 00010000:00000001:1.0:1790964046.244121:0:32613:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:1.0:1790964046.244123:0:32613:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:1.0:1790964046.244124:0:32613:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:1.0:1790964046.244125:0:32613:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:1.0:1790964046.244126:0:32613:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:1.0:1790964046.244127:0:32613:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000649d4138) refcount = 1 00010000:00010000:1.0:1790964046.244129:0:32613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 000000006e856977/0x9928545985f23e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e4e expref: -99 pid: 32613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964046.244135:0:32613:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:1.0:1790964046.244136:0:32613:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:1.0:1790964046.244137:0:32613:0:(ldlm_lock.c:1914:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:1.0:1790964046.244140:0:32613:0:(ldlm_request.c:286:ldlm_completion_ast()) Process entered 00010000:00000001:1.0:1790964046.244142:0:32613:0:(ldlm_request.c:295:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964046.244144:0:32613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 000000006e856977/0x9928545985f23e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9928545985f23e4e expref: -99 pid: 32613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964046.244179:0:32613:0:(ldlm_request.c:842:ldlm_cli_enqueue_fini()) Process leaving 00010000:00000001:1.0:1790964046.244181:0:32613:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964046.244182:0:32613:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1790964046.244183:0:32613:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964046.244184:0:32613:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1790964046.244185:0:32613:0:(ldlm_request.c:1218:ldlm_cli_enqueue()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244187:0:32613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964046.244190:0:32613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000d44646e4 x1877961891385088/t0(0) o101->MGC192.168.202.123@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964062 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244197:0:32613:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964046.244199:0:32613:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964046.244202:0:32613:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004da0ad6a. 02000000:00000001:1.0:1790964046.244206:0:32613:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964046.244207:0:32613:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964046.244214:0:32613:0:(genops.c:1223:class_import_put()) import 000000005c67ece7 refcount=3 obd=MGC192.168.202.123@tcp 00000020:00000001:1.0:1790964046.244216:0:32613:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964046.244218:0:32613:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000bebbf8d7. 02000000:00000001:1.0:1790964046.244221:0:32613:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964046.244223:0:32613:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964046.244224:0:32613:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000d44646e4. 00000100:00000001:1.0:1790964046.244230:0:32613:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964046.244231:0:32613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000001:1.0:1790964046.244234:0:32613:0:(mgc_request.c:1023:mgc_enqueue()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964046.244237:0:32613:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:1.0:1790964046.244238:0:32613:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000b3c41770) refs 3 10000000:00000001:1.0:1790964046.244241:0:32613:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.244243:0:32613:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:1.0:1790964046.244244:0:32613:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964046.244246:0:32613:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 000000006e856977 refcount=3 00000020:00000001:1.0:1790964046.244247:0:32613:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000001:1.0:1790964046.244249:0:32613:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000001:1.0:1790964046.244251:0:32613:0:(ldlm_lock.c:2547:ldlm_lock_set_data()) Process entered 00010000:00000001:1.0:1790964046.244252:0:32613:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964046.244253:0:32613:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1790964046.244260:0:32613:0:(ldlm_lock.c:2556:ldlm_lock_set_data()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964046.244262:0:32613:0:(mgc_request.c:1520:mgc_process_recover_log()) Process entered 10000000:00000010:1.0:1790964046.244264:0:32613:0:(mgc_request.c:1532:mgc_process_recover_log()) kmalloced '(folios)': 32 at 0000000029620bfb. 00000100:00000010:1.0:1790964046.244277:0:32613:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000006f860f81. 00000020:00000040:1.0:1790964046.244281:0:32613:0:(genops.c:1210:class_import_get()) import 000000005c67ece7 refcount=4 obd=MGC192.168.202.123@tcp 00000100:00000001:1.0:1790964046.244284:0:32613:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964046.244287:0:32613:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964046.244290:0:32613:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964046.244294:0:32613:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000f461b5a8. 00000100:00000001:1.0:1790964046.244298:0:32613:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244302:0:32613:0:(client.c:227:ptlrpc_prep_bulk_imp()) Process entered 00000100:00000010:1.0:1790964046.244305:0:32613:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 00000000af3befd3. 00000100:00000010:1.0:1790964046.244307:0:32613:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 64 at 0000000046b0e36a. 00000020:00000040:1.0:1790964046.244310:0:32613:0:(genops.c:1210:class_import_get()) import 000000005c67ece7 refcount=5 obd=MGC192.168.202.123@tcp 00000100:00000001:1.0:1790964046.244313:0:32613:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:1.0:1790964046.244314:0:32613:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:1.0:1790964046.244320:0:32613:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 00000000cca6e33c. 00000100:00000001:1.0:1790964046.244322:0:32613:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446613209372264128 : -130864337287488 : ffff88fac5a986c0) 00000100:00000001:1.0:1790964046.244324:0:32613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964046.244326:0:32613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613209758186368 : -130863951365248 : ffff88fadcaa3b80) 00000100:00000001:1.0:1790964046.244328:0:32613:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964046.244331:0:32613:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244332:0:32613:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:1.0:1790964046.244333:0:32613:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964046.244336:0:32613:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244341:0:32613:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964046.244342:0:32613:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964046.244345:0:32613:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964046.244347:0:32613:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964046.244349:0:32613:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964046.244350:0:32613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f860f81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c290d637-a468-41a2-ad47-911f0cbec690:32613:1877961891385216:0@lo:256: 00000100:00000001:1.0:1790964046.244354:0:32613:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964046.244358:0:32613:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964046.244365:0:32613:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244367:0:32613:0:(niobuf.c:346:ptlrpc_register_bulk()) Process entered 00000400:00000010:1.0:1790964046.244371:0:32613:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000f1b4342a. 00000400:00000010:1.0:1790964046.244375:0:32613:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at 00000000bdff9e60. 00000100:00000200:1.0:1790964046.244378:0:32613:0:(niobuf.c:453:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 4 pages 16384 bytes, mbits x0x6abff13700f80-0x6abff13700f80, portal 33 00000100:00000001:1.0:1790964046.244381:0:32613:0:(niobuf.c:455:ptlrpc_register_bulk()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964046.244383:0:32613:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964046.244386:0:32613:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 000000006b67fade. 02000000:00000001:1.0:1790964046.244387:0:32613:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964046.244390:0:32613:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000052e5d77e. 00000400:00000010:1.0:1790964046.244392:0:32613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000ae553c76. 00000100:00000200:1.0:1790964046.244394:0:32613:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961891385216, portal 25 00000100:00000001:1.0:1790964046.244396:0:32613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964046.244397:0:32613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613209758186368 : -130863951365248 : ffff88fadcaa3b80) 00000100:00000040:1.0:1790964046.244401:0:32613:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244407:0:32613:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964046.244408:0:32613:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964046.244410:0:32613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007bbfcc94. 00000100:00000200:1.0:1790964046.244412:0:32613:0:(niobuf.c:94:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1877961891385216, offset 0 00000400:00000200:1.0:1790964046.244416:0:32613:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964046.244423:0:32613:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964046.244429:0:32613:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 304 into portal 26 MB=0x6abff13700f80 00000400:00000200:1.0:1790964046.244433:0:32613:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 304/304 into md 0x169 [2] + 0 00000400:00000010:1.0:1790964046.244436:0:32613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000c129a38c. 00000400:00000200:1.0:1790964046.244439:0:32613:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000008e5aca4b 00000400:00000200:1.0:1790964046.244442:0:32613:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964046.244445:0:32613:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964046.244448:0:32613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008e5aca4b 00000400:00000010:1.0:1790964046.244450:0:32613:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000008e5aca4b. 00000100:00000001:1.0:1790964046.244452:0:32613:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964046.244453:0:32613:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964046.244456:0:32613:0:(events.c:341:request_in_callback()) incoming req@00000000d6b23ede x1877961891385216 msgsize 304 00000100:00100000:1.0:1790964046.244458:0:32613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964046.244465:0:32613:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964046.244474:0:32613:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964046.244480:0:32613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007bbfcc94 00000400:00000010:1.0:1790964046.244481:0:32613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007bbfcc94. 00000100:00000001:1.0:1790964046.244483:0:32613:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964046.244486:0:32613:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244500:0:32613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964046.244503:0:32613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244509:0:32613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244510:0:32613:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964046.244514:0:32613:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244517:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 0 is 4295582728 00000100:00000001:1.0:1790964046.244524:0:32613:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4295582727 00000100:00000001:1.0:1790964046.244528:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 1 is 4295582728 00000100:00000001:1.0:1790964046.244531:0:32613:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295582727 00000100:00000001:1.0:1790964046.244533:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 2 is 4295582728 00000100:00000001:1.0:1790964046.244536:0:32613:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4295582727 00000100:00000001:1.0:1790964046.244538:0:32613:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 3 is 4295582728 00000100:00000001:1.0:1790964046.244541:0:32613:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4295582727 00000100:00000001:1.0:1790964046.244544:0:32613:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964046.244546:0:32613:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244548:0:32613:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964046.244549:0:32613:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:1.0:1790964046.244551:0:32613:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cca6e33c going to sleep for 11 seconds 00000100:00000001:1.0:1790964046.244553:0:32613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964046.244554:0:32613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244571:0:32609:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964046.244573:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891385216 02000000:00000001:1.0:1790964046.244575:0:32609:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964046.244576:0:32609:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964046.244583:0:32609:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964046.244587:0:32609:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964046.244589:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891385216 00000020:00000001:1.0:1790964046.244591:0:32609:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964046.244592:0:32609:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23d60 00000020:00000001:1.0:1790964046.244594:0:32609:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964046.244596:0:32609:0:(lustre_handles.c:148:class_handle2object()) GET export 000000009a31e7fe refcount=12 00000020:00000001:1.0:1790964046.244598:0:32609:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000020:00000001:1.0:1790964046.244600:0:32609:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000100:00000001:1.0:1790964046.244602:0:32609:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964046.244604:0:32609:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000f4f9ac8f. 00000100:00000001:1.0:1790964046.244606:0:32609:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964046.244608:0:32609:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000f4f9ac8f. 00000020:00000010:1.0:1790964046.244612:0:32609:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c31661c4. 00000020:00000010:1.0:1790964046.244615:0:32609:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000c5255798. 00000020:00000010:1.0:1790964046.244619:0:32609:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000004eaaf81f. 00000100:00000040:1.0:1790964046.244623:0:32609:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964046.244625:0:32609:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964046.244626:0:32609:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964046.244628:0:32609:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244633:0:32609:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244639:0:32609:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964046.244647:0:32609:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964046.244649:0:32609:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964046.244652:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00000040:1.0:1790964046.244655:0:32609:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000009a31e7fe : new rpc_count 1 00000100:00000001:1.0:1790964046.244656:0:32609:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446613209796432976 : -130863913118640 : ffff88fadef1d450) 00000100:00000040:1.0:1790964046.244659:0:32609:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000d6b23ede x1877961891385216/t0(0) o256->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:622/0 lens 304/0 e 0 to 0 dl 1790964057 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244666:0:32609:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964046.244668:0:32609:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000f4f9ac8f. 00000100:00000001:1.0:1790964046.244670:0:32609:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964046.244672:0:32609:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000f4f9ac8f. 00000100:00100000:1.0:1790964046.244680:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6b23ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:32613:x1877961891385216:12345-0@lo:256: 00000100:00000200:1.0:1790964046.244684:0:32609:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961891385216 00000020:00000001:1.0:1790964046.244686:0:32609:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964046.244688:0:32609:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964046.244689:0:32609:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964046.244691:0:32609:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964046.244692:0:32609:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667990560 : -1041561056 : ffffffffc1eb0a20) 00000020:00000001:1.0:1790964046.244695:0:32609:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964046.244696:0:32609:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964046.244698:0:32609:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964046.244700:0:32609:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964046.244702:0:32609:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244704:0:32609:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964046.244706:0:32609:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964046.244709:0:32609:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 536 at 00000000bd766daa. 02000000:00000001:1.0:1790964046.244711:0:32609:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244712:0:32609:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 20000000:00000001:1.0:1790964046.244716:0:32609:0:(mgs_handler.c:690:mgs_config_read()) Process entered 20000000:00000001:1.0:1790964046.244720:0:32609:0:(mgs_nids.c:889:mgs_get_ir_logs()) Process entered 20000000:01000000:1.0:1790964046.244723:0:32609:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000010:1.0:1790964046.244726:0:32609:0:(mgs_nids.c:917:mgs_get_ir_logs()) kmalloced '(folios)': 32 at 0000000057c9fa82. 20000000:00000001:1.0:1790964046.244728:0:32609:0:(mgs_nids.c:188:mgs_nidtbl_read()) Process entered 20000000:00000040:1.0:1790964046.244736:0:32609:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1790964046.244743:0:32609:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790964046.244745:0:32609:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 20000000:00000001:1.0:1790964046.244747:0:32609:0:(mgs_nids.c:321:mgs_nidtbl_read()) Process leaving (rc=44 : 44 : 2c) 00000100:00000001:1.0:1790964046.244749:0:32609:0:(niobuf.c:145:ptlrpc_prep_bulk_exp()) Process entered 00000100:00000010:1.0:1790964046.244752:0:32609:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 00000000003a1dab. 00000100:00000010:1.0:1790964046.244755:0:32609:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 16 at 000000004de09150. 00000020:00000040:1.0:1790964046.244757:0:32609:0:(genops.c:868:class_export_get()) GET export 000000009a31e7fe refcount=13 00010000:00000001:1.0:1790964046.244760:0:32609:0:(ldlm_lib.c:3582:target_bulk_io()) Process entered 00000100:00000001:1.0:1790964046.244762:0:32609:0:(niobuf.c:184:ptlrpc_start_bulk_transfer()) Process entered 00000400:00000010:1.0:1790964046.244765:0:32609:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007bbfcc94. 00000400:00000010:1.0:1790964046.244770:0:32609:0:(lib-lnet.h:449:lnet_rspt_alloc()) alloc 'rspt': 64 at 00000000357f152b. 00000400:00000200:1.0:1790964046.244773:0:32609:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964046.244786:0:32609:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964046.244792:0:32609:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 44 into portal 33 MB=0x6abff13700f80 00000400:00000200:1.0:1790964046.244795:0:32609:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 21 from 12345-0@lo of length 44/44 into md 0xad5 [4] + 0 00000400:00000010:1.0:1790964046.244798:0:32609:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000f1b4342a. 00000400:00000200:1.0:1790964046.244801:0:32609:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000bdff9e60 00000400:00000200:1.0:1790964046.244803:0:32609:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964046.244806:0:32609:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964046.244808:0:32609:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000bdff9e60 00000400:00000010:1.0:1790964046.244810:0:32609:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 184 at 00000000bdff9e60. 00000100:00000001:1.0:1790964046.244813:0:32609:0:(events.c:177:client_bulk_callback()) Process entered 00000100:00000200:1.0:1790964046.244814:0:32609:0:(events.c:195:client_bulk_callback()) event type 2, status 0, req 000000006f860f81 desc 00000000af3befd3 mbits 1877961891385216 00000100:00000001:1.0:1790964046.244821:0:32609:0:(events.c:220:client_bulk_callback()) Process leaving 00000400:00000200:1.0:1790964046.244824:0:32609:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md 0000000000000000 with offset 0 00000400:00000200:1.0:1790964046.244828:0:32609:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : ACK - for me 00000400:00000200:1.0:1790964046.244834:0:32609:0:(lib-move.c:4532:lnet_parse_ack()) 0@lo: ACK from 12345-0@lo into md 0xae1 00000400:00000200:1.0:1790964046.244837:0:32609:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964046.244839:0:32609:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: ACK: OK 00000100:00000001:1.0:1790964046.244842:0:32609:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:1.0:1790964046.244844:0:32609:0:(events.c:464:server_bulk_callback()) event type 4, status 0, desc 00000000003a1dab 00000100:00000001:1.0:1790964046.244846:0:32609:0:(events.c:491:server_bulk_callback()) Process leaving 00000400:00000200:1.0:1790964046.244850:0:32609:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007bbfcc94 00000400:00000010:1.0:1790964046.244851:0:32609:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007bbfcc94. 00000100:00000001:1.0:1790964046.244853:0:32609:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:1.0:1790964046.244854:0:32609:0:(events.c:464:server_bulk_callback()) event type 5, status 0, desc 00000000003a1dab 00000100:00000001:1.0:1790964046.244856:0:32609:0:(events.c:491:server_bulk_callback()) Process leaving 00000100:00000200:1.0:1790964046.244859:0:32609:0:(niobuf.c:279:ptlrpc_start_bulk_transfer()) Transferring 1 pages 44 bytes via portal 33 id 12345-0@lo mbits 0x6abff13700f80-0x6abff13700f80 00000100:00000001:1.0:1790964046.244862:0:32609:0:(niobuf.c:281:ptlrpc_start_bulk_transfer()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.244866:0:32609:0:(ldlm_lib.c:3674:target_bulk_io()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244868:0:32609:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000040:1.0:1790964046.244870:0:32609:0:(genops.c:879:class_export_put()) PUTting export 000000009a31e7fe : new refcount 12 00000100:00000010:1.0:1790964046.244872:0:32609:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 16 at 000000004de09150. 00000100:00000010:1.0:1790964046.244879:0:32609:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 00000000003a1dab. 00000100:00000001:1.0:1790964046.244883:0:32609:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 20000000:00000001:1.0:1790964046.244884:0:32609:0:(mgs_nids.c:953:mgs_get_ir_logs()) Process leaving via out (rc=0 : 0 : 0x0) 20000000:00000010:1.0:1790964046.244893:0:32609:0:(mgs_nids.c:964:mgs_get_ir_logs()) kvfree 'folios': 32 at 0000000057c9fa82. 20000000:00000001:1.0:1790964046.244901:0:32609:0:(mgs_handler.c:713:mgs_config_read()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964046.244903:0:32609:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961891385216 00010000:00000001:1.0:1790964046.244905:0:32609:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964046.244908:0:32609:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000d6b23ede x1877961891385216/t0(0) o256->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:622/0 lens 304/240 e 0 to 0 dl 1790964057 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964046.244915:0:32609:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964046.244916:0:32609:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964046.244919:0:32609:0:(import.c:2195:obd_at_measure()) add 1 to 000000000eace963 time=7 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964046.244922:0:32609:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964046.244924:0:32609:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 17 to 0@lo 00000100:00000001:1.0:1790964046.244926:0:32609:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 02000000:00000001:1.0:1790964046.244928:0:32609:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964046.244930:0:32609:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.244931:0:32609:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964046.244933:0:32609:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964046.244936:0:32609:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007bbfcc94. 00000100:00000200:1.0:1790964046.244939:0:32609:0:(niobuf.c:94:ptl_send_buf()) Sending 240 bytes to portal 25, xid 1877961891385216, offset 224 00000400:00000200:1.0:1790964046.244942:0:32609:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964046.244947:0:32609:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964046.244951:0:32609:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 240 into portal 25 MB=0x6abff13700f80 00000400:00000200:1.0:1790964046.244955:0:32609:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 240/240 into md 0xad9 [1] + 224 00000400:00000200:1.0:1790964046.244959:0:32609:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964046.244961:0:32609:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964046.244963:0:32609:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964046.244965:0:32609:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964046.244984:0:32609:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.244992:0:32609:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964046.244996:0:32609:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007bbfcc94 00000400:00000010:1.0:1790964046.244997:0:32609:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007bbfcc94. 00000100:00000001:1.0:1790964046.244999:0:32609:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964046.245000:0:32609:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964046.245011:0:32609:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964046.245014:0:32609:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 16 to 0@lo 00010000:00000001:1.0:1790964046.245016:0:32609:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964046.245017:0:32609:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964046.245019:0:32609:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964046.245023:0:32609:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000d6b23ede x1877961891385216/t0(0) o256->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:622/0 lens 304/240 e 0 to 0 dl 1790964057 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964046.245030:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6b23ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:32613:x1877961891385216:12345-0@lo:256: Request processed in 363us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964046.245035:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00000040:1.0:1790964046.245037:0:32609:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a31e7fe : new rpc_count 0 00000100:00000001:1.0:1790964046.245039:0:32609:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964046.245041:0:32609:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964046.245043:0:32609:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000c5255798. 00000020:00000010:1.0:1790964046.245046:0:32609:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000004eaaf81f. 00000020:00000010:1.0:1790964046.245048:0:32609:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c31661c4. 00000020:00000040:1.0:1790964046.245053:0:32609:0:(genops.c:879:class_export_put()) PUTting export 000000009a31e7fe : new refcount 11 02000000:00000001:1.0:1790964046.245055:0:32609:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964046.245057:0:32609:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 536 at 00000000bd766daa. 02000000:00000001:1.0:1790964046.245059:0:32609:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964046.245061:0:32609:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964046.245064:0:32609:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964046.245067:0:32609:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000f1b4342a. 00000400:00000010:1.0:1790964046.245071:0:32609:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000bdff9e60. 00000100:00000001:1.0:1790964046.245085:0:32613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964046.245088:0:32613:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964046.245090:0:32613:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964046.245091:0:32613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000052e5d77e. 00000400:00000200:1.0:1790964046.245093:0:32613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000ae553c76 00000400:00000010:1.0:1790964046.245094:0:32613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000ae553c76. 00000100:00000001:1.0:1790964046.245096:0:32613:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964046.245099:0:32613:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964046.245105:0:32613:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.245115:0:32613:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964046.245116:0:32613:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964046.245118:0:32613:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964046.245121:0:32613:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964046.245122:0:32613:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964046.245123:0:32613:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964046.245125:0:32613:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964046.245128:0:32613:0:(import.c:2195:obd_at_measure()) add 5 to 00000000a85d97ae time=7 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964046.245131:0:32613:0:(import.c:2195:obd_at_measure()) add 1 to 000000003079e642 time=7 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964046.245133:0:32613:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964046.245134:0:32613:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964046.245137:0:32613:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1790964046.245138:0:32613:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.245140:0:32613:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964046.245142:0:32613:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964046.245148:0:32613:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.245154:0:32613:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964046.245156:0:32613:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964046.245159:0:32613:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964046.245188:0:32613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f860f81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c290d637-a468-41a2-ad47-911f0cbec690:32613:1877961891385216:0@lo:256: 00000100:00000001:1.0:1790964046.245191:0:32613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964046.245195:0:32613:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.245197:0:32613:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:1.0:1790964046.245198:0:32613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964046.245201:0:32613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.245208:0:32613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:1.0:1790964046.245210:0:32613:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 00000000cca6e33c. 00000100:00000001:1.0:1790964046.245212:0:32613:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:1.0:1790964046.245219:0:32613:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 10000000:00000040:1.0:1790964046.245223:0:32613:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 9, more 0. 10000000:00000001:1.0:1790964046.245226:0:32613:0:(mgc_request.c:1308:mgc_apply_recover_logs()) Process entered 10000000:00000010:1.0:1790964046.245231:0:32613:0:(mgc_request.c:1331:mgc_apply_recover_logs()) kmalloced '(nidlist)': 640 at 00000000bd766daa. 10000000:00000010:1.0:1790964046.245234:0:32613:0:(mgc_request.c:1343:mgc_apply_recover_logs()) kmalloced '(obdname)': 128 at 00000000c5255798. 10000000:00000200:1.0:1790964046.245239:0:32613:0:(mgc_request.c:1241:mgc_build_nidlist()) use 1 from 1 NIDs 10000000:00000040:1.0:1790964046.245241:0:32613:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-MDT0000-mdc-MDT0000 10000000:00000040:1.0:1790964046.245248:0:32613:0:(mgc_request.c:1445:mgc_apply_recover_logs()) MGC192.168.202.123@tcp: cannot find OBD lustre-MDT0000-mdc-MDT0000 10000000:00000010:1.0:1790964046.245250:0:32613:0:(mgc_request.c:1492:mgc_apply_recover_logs()) kfreed 'obdname': 128 at 00000000c5255798. 10000000:00000010:1.0:1790964046.245253:0:32613:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'nidlist': 640 at 00000000bd766daa. 10000000:00000001:1.0:1790964046.245255:0:32613:0:(mgc_request.c:1496:mgc_apply_recover_logs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.245258:0:32613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964046.245261:0:32613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000006f860f81 x1877961891385216/t0(0) o256->MGC192.168.202.123@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964062 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964046.245267:0:32613:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964046.245269:0:32613:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964046.245271:0:32613:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 000000006b67fade. 02000000:00000001:1.0:1790964046.245274:0:32613:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964046.245276:0:32613:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964046.245277:0:32613:0:(genops.c:1223:class_import_put()) import 000000005c67ece7 refcount=4 obd=MGC192.168.202.123@tcp 00000020:00000001:1.0:1790964046.245279:0:32613:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000001:1.0:1790964046.245280:0:32613:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000001:1.0:1790964046.245281:0:32613:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964046.245281:0:32613:0:(genops.c:1223:class_import_put()) import 000000005c67ece7 refcount=3 obd=MGC192.168.202.123@tcp 00000020:00000001:1.0:1790964046.245283:0:32613:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000010:1.0:1790964046.245284:0:32613:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 64 at 0000000046b0e36a. 00000100:00000010:1.0:1790964046.245286:0:32613:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 00000000af3befd3. 00000100:00000001:1.0:1790964046.245291:0:32613:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 02000000:00000010:1.0:1790964046.245293:0:32613:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000f461b5a8. 02000000:00000001:1.0:1790964046.245295:0:32613:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964046.245297:0:32613:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964046.245298:0:32613:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000006f860f81. 00000100:00000001:1.0:1790964046.245301:0:32613:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964046.245302:0:32613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000010:1.0:1790964046.245314:0:32613:0:(mgc_request.c:1652:mgc_process_recover_log()) kvfree 'folios': 32 at 0000000029620bfb. 10000000:01000000:1.0:1790964046.245319:0:32613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 10000000:00000001:1.0:1790964046.245327:0:32613:0:(mgc_request.c:1029:mgc_cancel()) Process entered 00010000:00000001:1.0:1790964046.245329:0:32613:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:1.0:1790964046.245330:0:32613:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964046.245332:0:32613:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 000000006e856977 refcount=3 00000020:00000001:1.0:1790964046.245334:0:32613:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000001:1.0:1790964046.245336:0:32613:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446613210288472064 : -130863421079552 : ffff88fafc45c000) 00010000:00000001:1.0:1790964046.245338:0:32613:0:(ldlm_lock.c:854:ldlm_lock_decref_internal()) Process entered 00010000:00010000:1.0:1790964046.245341:0:32613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 000000006e856977/0x9928545985f23e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e4e expref: -99 pid: 32613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964046.245348:0:32613:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964046.245349:0:32613:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:1.0:1790964046.245351:0:32613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 000000006e856977/0x9928545985f23e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9928545985f23e4e expref: -99 pid: 32613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964046.245356:0:32613:0:(ldlm_lock.c:923:ldlm_lock_decref_internal()) Process leaving 00010000:00000001:1.0:1790964046.245357:0:32613:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964046.245358:0:32613:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 10000000:00000001:1.0:1790964046.245359:0:32613:0:(mgc_request.c:1033:mgc_cancel()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964046.245361:0:32613:0:(mgc_request.c:1907:mgc_process_log()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964046.245363:0:32613:0:(mgc_request.c:621:do_requeue()) Process leaving 10000000:00000001:1.0:1790964046.245366:0:32613:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000040:1.0:1790964046.245367:0:32613:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(00000000b3c41770) refs 3 10000000:00000001:1.0:1790964046.245370:0:32613:0:(mgc_request.c:147:config_log_put()) Process leaving 00000100:00000040:0.0:1790964046.248568:0:1100:0:(connection.c:75:cpu_latency_work()) work item of 00000000a22dbd09 (cpu 0) has reached its deadline 4295582728, at 4295582729 00000100:00000010:0.0:1790964046.248585:0:1100:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000009542302a. 00000100:00000040:1.0:1790964046.249084:0:808:0:(connection.c:75:cpu_latency_work()) work item of 000000009cab77b5 (cpu 1) has reached its deadline 4295582728, at 4295582729 00000100:00000010:1.0:1790964046.249093:0:808:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000234fb580. 00000100:00000040:3.0:1790964046.249195:0:33:0:(connection.c:75:cpu_latency_work()) work item of 0000000048c58409 (cpu 3) has reached its deadline 4295582728, at 4295582729 00000100:00000010:3.0:1790964046.249202:0:33:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000b341e901. 00000100:00000040:2.0:1790964046.250959:0:11733:0:(connection.c:75:cpu_latency_work()) work item of 00000000ceedfbcb (cpu 2) has reached its deadline 4295582728, at 4295582731 00000100:00000010:2.0:1790964046.250983:0:11733:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000f664caa8. 00000100:00000001:2.0:1790964046.751282:0:32653:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964046.751282:0:31763:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964046.751291:0:32653:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964046.751294:0:32653:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964046.751298:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00100000:2.0:1790964046.751299:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00000100:00000001:1.0:1790964046.751301:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964046.751307:0:32653:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964046.751307:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964046.751310:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964046.751313:0:32653:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964046.751314:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964046.751317:0:32653:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964046.751319:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964046.751320:0:32653:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964046.751324:0:32653:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964047.263648:0:33:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:3.0:1790964047.263658:0:33:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964047.263667:0:33:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:3.0:1790964047.263687:0:33:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964047.264210:0:32604:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1790964047.264214:0:32604:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1790964047.264217:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:1.0:1790964047.775395:0:31763:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964047.775409:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964047.775411:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964047.775447:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964047.775449:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964047.775452:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964047.775454:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964047.778596:0:32653:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964047.778605:0:32653:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964047.778607:0:32653:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964047.778611:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00000100:00000001:3.0:1790964047.778615:0:32653:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964047.778619:0:32653:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964047.778622:0:32653:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964047.778624:0:32653:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964047.778626:0:32653:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:1.0:1790964047.898035:0:33010:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964047.898052:0:33010:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964047.898057:0:33010:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964048.287375:0:33:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:3.0:1790964048.287384:0:33:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964048.287391:0:33:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:3.0:1790964048.287393:0:33:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964048.296751:0:32605:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964048.296760:0:32605:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964048.296765:0:32605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000001:2.0:1790964048.316652:0:33047:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:2.0:1790964048.316660:0:33047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: conf-sanity test_167: @@@@@@ FAIL: mds1 mounted without a remote update llog 00000001:00000001:2.0:1790964048.324061:0:33047:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00000100:00000001:1.0:1790964048.799290:0:31763:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964048.799305:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964048.799308:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964048.799313:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964048.799316:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964048.799319:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964048.799322:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964048.799904:0:32653:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964048.799908:0:32653:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964048.799910:0:32653:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964048.799912:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00000100:00000001:3.0:1790964048.799916:0:32653:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964048.799919:0:32653:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964048.799922:0:32653:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964048.799924:0:32653:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964048.799926:0:32653:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964049.311315:0:33:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:3.0:1790964049.311326:0:33:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964049.311334:0:33:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:3.0:1790964049.311337:0:33:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:3.0:1790964049.311339:0:33:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:3.0:1790964049.311343:0:33:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964049.311346:0:33:0:(ldlm_lockd.c:2241:ldlm_bl_to_thread()) Process entered 00010000:00000001:3.0:1790964049.311350:0:33:0:(ldlm_lockd.c:2244:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964049.311352:0:33:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964049.311354:0:33:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964049.315394:0:32604:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964049.315403:0:32604:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964049.315408:0:32604:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:2.0:1790964049.649604:0:33059:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:2.0:1790964049.649622:0:33059:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964049.649628:0:33059:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.825873:0:32653:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964049.825883:0:32653:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964049.825885:0:32653:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964049.825889:0:32653:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073ddfc4 going to sleep for 0 seconds 00000100:00000001:3.0:1790964049.825894:0:32653:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964049.825916:0:32653:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.825918:0:32653:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964049.825920:0:32653:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.825922:0:32653:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c290d637-a468-41a2-ad47-911f0cbec690->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1790964049.826422:0:37:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1790964049.826428:0:37:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000007b373377. 00000020:00000040:0.0:1790964049.826433:0:37:0:(genops.c:1210:class_import_get()) import 000000005c67ece7 refcount=4 obd=MGC192.168.202.123@tcp 00000100:00000001:0.0:1790964049.826437:0:37:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1790964049.826439:0:37:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1790964049.826450:0:37:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1790964049.826457:0:37:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e31d9e3b. 00000100:00000001:0.0:1790964049.826463:0:37:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826471:0:37:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c290d637-a468-41a2-ad47-911f0cbec690->MGS req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1790964049.826482:0:37:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1790964049.826485:0:37:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826490:0:37:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007b373377] to pc [ptlrpcd_00_03+3] req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.826512:0:37:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:0.0:1790964049.826514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790964049.826517:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00000001:0.0:1790964049.826519:0:37:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:0.0:1790964049.826521:0:37:0:(import.c:65:import_set_state_nolock()) 000000001965c25d lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:0.0:1790964049.826525:0:37:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:0.0:1790964049.826528:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 908 00000100:00001000:0.0:1790964049.826533:0:37:0:(import.c:2195:obd_at_measure()) add 10 to 00000000102044c4 time=10 v=5 (1 0 0 0) 00000100:00001000:0.0:1790964049.826536:0:37:0:(import.c:2261:obd_at_measure()) AT 00000000102044c4 change: old=5 new=10 delta=5 (val=10) hist 10 0 0 0 00000100:00080000:0.0:1790964049.826539:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:0.0:1790964049.826542:0:37:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 15 to 0@lo 00000100:00000001:0.0:1790964049.826544:0:37:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964049.826547:0:37:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 16 to 0@lo 00000100:00000001:0.0:1790964049.826561:0:37:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000020:00000001:0.0:1790964049.826570:0:37:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964049.826572:0:37:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23dfa 00000020:00000001:0.0:1790964049.826576:0:37:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964049.826579:0:37:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000139d0b48 refcount=4 00000020:00000001:0.0:1790964049.826581:0:37:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613210045777920 : -130863663773696 : ffff88faedce8800) 00000020:00000001:0.0:1790964049.826583:0:37:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613210045777920 : -130863663773696 : ffff88faedce8800) 00000100:00000040:0.0:1790964049.826586:0:37:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 15 to 0@lo 00000100:00000001:0.0:1790964049.826588:0:37:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964049.826597:0:37:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 16 to 0@lo 00000100:00000001:0.0:1790964049.826599:0:37:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000020:00000040:0.0:1790964049.826601:0:37:0:(genops.c:879:class_export_put()) PUTting export 00000000139d0b48 : new refcount 3 00000100:00080000:0.0:1790964049.826604:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000001965c25d using connection 192.168.202.123@tcp/0@lo 00000100:00000001:0.0:1790964049.826606:0:37:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964049.826608:0:37:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:0.0:1790964049.826613:0:37:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964049.826616:0:37:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.826619:0:37:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:0.0:1790964049.826621:0:37:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:0.0:1790964049.826624:0:37:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000c3186084. 00000020:00000040:0.0:1790964049.826627:0:37:0:(genops.c:1210:class_import_get()) import 000000001965c25d refcount=4 obd=lustre-MDT0001-osp-MDT0000 02000000:00000001:0.0:1790964049.826629:0:37:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:0.0:1790964049.826631:0:37:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.826633:0:37:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1790964049.826635:0:37:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1790964049.826636:0:37:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1790964049.826640:0:37:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 000000009ce30b32. 00000100:00000001:0.0:1790964049.826643:0:37:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964049.826648:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1790964049.826664:0:37:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1790964049.826666:0:37:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826669:0:37:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c3186084] to pc [ptlrpcd_rcv+-1] req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.826683:0:37:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1790964049.826688:0:37:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1790964049.826691:0:37:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000017c05dab. 00000020:00000040:0.0:1790964049.826694:0:37:0:(genops.c:1210:class_import_get()) import 00000000773535ae refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000001:0.0:1790964049.826695:0:37:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1790964049.826697:0:37:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1790964049.826706:0:37:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1790964049.826709:0:37:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000cb2d6ff6. 00000100:00000001:0.0:1790964049.826713:0:37:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826716:0:37:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1790964049.826721:0:37:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1790964049.826723:0:37:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826725:0:37:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000017c05dab] to pc [ptlrpcd_00_00+0] req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.826739:0:37:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.826744:0:37:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (924) 00000100:00000001:0.0:1790964049.826752:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:0.0:1790964049.826756:0:31766:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:0.0:1790964049.826758:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.826765:0:31766:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964049.826767:0:31766:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.826768:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964049.826769:0:31766:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964049.826771:0:31766:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1790964049.826774:0:31766:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.826781:0:31766:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964049.826782:0:31766:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964049.826786:0:31766:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1790964049.826788:0:31766:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964049.826790:0:31766:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964049.826792:0:31766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b373377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c290d637-a468-41a2-ad47-911f0cbec690:31766:1877961891385344:0@lo:400: 00000100:00000001:0.0:1790964049.826796:0:31766:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1790964049.826802:0:31766:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1790964049.826805:0:31766:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964049.826808:0:31766:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1790964049.826811:0:31766:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000c943108f. 02000000:00000001:0.0:1790964049.826814:0:31766:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1790964049.826819:0:31766:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000001cab3ff6. 00000400:00000010:0.0:1790964049.826833:0:31766:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000087f54be2. 00000100:00000200:0.0:1790964049.826839:0:31766:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961891385344, portal 25 00000100:00000001:0.0:1790964049.826842:0:31766:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964049.826843:0:31766:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613210319595136 : -130863389956480 : ffff88fafe20a680) 00000100:00000040:0.0:1790964049.826847:0:31766:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.826854:0:31766:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964049.826856:0:31766:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964049.826858:0:31766:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000cd9d280e. 00000100:00000200:0.0:1790964049.826860:0:31766:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877961891385344, offset 0 00000400:00000200:0.0:1790964049.826866:0:31766:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964049.826879:0:31766:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964049.826890:0:31766:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff13701000 00000400:00000200:0.0:1790964049.826896:0:31766:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x16d [2] + 0 00000400:00000010:0.0:1790964049.826900:0:31766:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000aeb05b96. 00000400:00000200:0.0:1790964049.826915:0:31766:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000003f39cfe8 00000400:00000200:0.0:1790964049.826924:0:31766:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964049.826928:0:31766:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:0.0:1790964049.826934:0:31766:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000003f39cfe8 00000400:00000010:0.0:1790964049.826936:0:31766:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000003f39cfe8. 00000100:00000001:0.0:1790964049.826951:0:31766:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:0.0:1790964049.826953:0:31766:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:0.0:1790964049.826956:0:31766:0:(events.c:341:request_in_callback()) incoming req@000000004250ee5d x1877961891385344 msgsize 224 00000100:00100000:0.0:1790964049.826959:0:31766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1790964049.826961:0:31766:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:0.0:1790964049.826969:0:31766:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1790964049.826976:0:31766:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000cd9d280e 00000400:00000010:0.0:1790964049.826978:0:31766:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000cd9d280e. 00000100:00000001:0.0:1790964049.826981:0:31766:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:0.0:1790964049.826984:0:31766:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.826992:0:31766:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964049.826994:0:31766:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.827012:0:31766:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.827014:0:31766:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1790964049.827020:0:31766:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.827024:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 0 is 4295586311 00000100:00000010:0.0:1790964049.827027:0:31766:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000f8df6c28. 00000100:00000001:0.0:1790964049.827033:0:31766:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 0 00000100:00000001:0.0:1790964049.827038:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 1 is 4295586311 00000100:00000010:0.0:1790964049.827041:0:31766:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000002ab2a910. 00000100:00000001:0.0:1790964049.827043:0:31766:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 1 00000100:00000001:3.0:1790964049.827631:0:31767:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964049.827635:0:31767:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.827642:0:31765:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:3.0:1790964049.827645:0:31765:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000001:3.0:1790964049.827646:0:31765:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.827651:0:31765:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964049.827660:0:31765:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.827663:0:31765:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964049.827664:0:31765:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964049.827666:0:31765:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964049.827670:0:31765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.827678:0:31765:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964049.827679:0:31765:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964049.827681:0:31765:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964049.827683:0:31765:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964049.827685:0:31765:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964049.827687:0:31765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017c05dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:31765:1877961891385600:0@lo:400: 00000100:00000001:3.0:1790964049.827691:0:31765:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964049.827694:0:31765:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964049.827696:0:31765:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964049.827697:0:31765:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964049.827701:0:31765:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000f9db21cb. 02000000:00000001:3.0:1790964049.827703:0:31765:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964049.827708:0:31765:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000e3f53987. 00000400:00000010:3.0:1790964049.827712:0:31765:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000d945d0b7. 00000100:00000200:3.0:1790964049.827715:0:31765:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961891385600, portal 10 00000100:00000001:3.0:1790964049.827717:0:31765:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964049.827718:0:31765:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613210319591552 : -130863389960064 : ffff88fafe209880) 00000100:00000040:3.0:1790964049.827723:0:31765:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.827730:0:31765:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964049.827737:0:31765:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964049.827739:0:31765:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000a0786b8d. 00000100:00000200:3.0:1790964049.827742:0:31765:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1877961891385600, offset 0 00000400:00000200:3.0:1790964049.827747:0:31765:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964049.827754:0:31765:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964049.827760:0:31765:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6abff13701100 00000400:00000200:3.0:1790964049.827765:0:31765:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x229 [64] + 1040 00000400:00000200:3.0:1790964049.827771:0:31765:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964049.827774:0:31765:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964049.827779:0:31765:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964049.827781:0:31765:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:3.0:1790964049.827784:0:31765:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000005c75e991. 00000100:00000040:3.0:1790964049.827787:0:31765:0:(events.c:341:request_in_callback()) incoming req@000000005c75e991 x1877961891385600 msgsize 224 00000100:00100000:3.0:1790964049.827790:0:31765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:3.0:1790964049.827800:0:31765:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964049.827806:0:31765:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000a0786b8d 00000400:00000010:3.0:1790964049.827807:0:31765:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000a0786b8d. 00000100:00000001:3.0:1790964049.827810:0:31765:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964049.827813:0:31765:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.827820:0:31765:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964049.827823:0:31765:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.827828:0:31765:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.827830:0:31765:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964049.827833:0:31765:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964049.827836:0:31765:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 3927 usecs (4 jiffies) 00000100:00000001:3.0:1790964049.827839:0:31765:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295586312 00000100:00000001:3.0:1790964049.827844:0:31765:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295586311 00000100:00000001:3.0:1790964049.827848:0:31765:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295586312 00000100:00000001:1.0:1790964049.839195:0:31764:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964049.839203:0:31764:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964049.839215:0:31763:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964049.839219:0:31763:0:(client.c:2486:ptlrpc_expire_one_request()) Process entered 00000100:00100000:1.0:1790964049.839230:0:31763:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790964039/real 1790964039] req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000400:00000001:1.0:1790964049.839249:0:31763:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964049.839251:0:31763:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964049.839253:0:31763:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000004fc45135. 00000400:00000200:1.0:1790964049.839257:0:31763:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000f7d657f5 00000400:00000010:1.0:1790964049.839260:0:31763:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000f7d657f5. 00000100:00000001:1.0:1790964049.839264:0:31763:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964049.839266:0:31763:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964049.839275:0:31763:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.839282:0:31763:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964049.839294:0:31763:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964049.839297:0:31763:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964049.839299:0:31763:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:1.0:1790964049.839303:0:31763:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.839309:0:31763:0:(client.c:2540:ptlrpc_expire_one_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964049.839315:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964049.839317:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964049.839319:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964049.839321:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964049.839324:0:31763:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964049.839327:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.839334:0:31763:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964049.839336:0:31763:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964049.839339:0:31763:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964049.839343:0:31763:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964049.839346:0:31763:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964049.839348:0:31763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3186084 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31763:1877961891385472:0@lo:38: 00000100:00000001:1.0:1790964049.839352:0:31763:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964049.839358:0:31763:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964049.839360:0:31763:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964049.839363:0:31763:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964049.839368:0:31763:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000247a87c9. 02000000:00000001:1.0:1790964049.839370:0:31763:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964049.839375:0:31763:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000052e5d77e. 00000400:00000010:1.0:1790964049.839380:0:31763:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000ae553c76. 00000100:00000200:1.0:1790964049.839388:0:31763:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961891385472, portal 4 00000100:00000001:1.0:1790964049.839391:0:31763:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964049.839392:0:31763:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613210319585280 : -130863389966336 : ffff88fafe208000) 00000020:00000010:1.0:1790964049.839399:0:31763:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000c6bb5821. 00000100:00000040:1.0:1790964049.839406:0:31763:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964064 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.839477:0:31763:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964049.839485:0:31763:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964049.839487:0:31763:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007bbfcc94. 00000100:00000200:1.0:1790964049.839491:0:31763:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 24, xid 1877961891385472, offset 0 00000400:00000200:1.0:1790964049.839497:0:31763:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964049.839514:0:31763:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964049.839523:0:31763:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 24 MB=0x6abff13701080 00000400:00000200:1.0:1790964049.839529:0:31763:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 520/520 into md 0x429 [256] + 520 00000400:00000200:1.0:1790964049.839539:0:31763:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964049.839543:0:31763:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964049.839550:0:31763:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964049.839552:0:31763:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 00000100:00000010:1.0:1790964049.839556:0:31763:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000006f860f81. 00000100:00000040:1.0:1790964049.839559:0:31763:0:(events.c:341:request_in_callback()) incoming req@000000006f860f81 x1877961891385472 msgsize 520 00000100:00100000:1.0:1790964049.839624:0:31763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1790964049.839636:0:31763:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964049.839643:0:31763:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007bbfcc94 00000400:00000010:1.0:1790964049.839645:0:31763:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007bbfcc94. 00000100:00000001:1.0:1790964049.839648:0:31763:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964049.839650:0:31763:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964064 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.839659:0:31763:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964049.839661:0:31763:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964064 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.839668:0:31763:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964049.839669:0:31763:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964049.839674:0:31763:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964049.839679:0:31763:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4216 usecs (5 jiffies) 00000100:00000001:1.0:1790964049.839682:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295586313 00000100:00000001:1.0:1790964049.839689:0:31763:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295586312 00000100:00000001:1.0:1790964049.839693:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295586313 00000100:00000001:0.0:1790964049.839820:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 2 is 4295586324 00000100:00000010:0.0:1790964049.839827:0:31766:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000b1bb2375. 00000100:00000001:0.0:1790964049.839834:0:31766:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1790964049.839837:0:31766:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS new deadline estimation for cpu 3 is 4295586324 00000100:00000010:0.0:1790964049.839839:0:31766:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000009542302a. 00000100:00000001:0.0:1790964049.839842:0:31766:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.123@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1790964049.839844:0:31766:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964049.839847:0:31766:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.839851:0:31766:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.839854:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.839873:0:32609:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964049.839876:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891385344 02000000:00000001:0.0:1790964049.839879:0:32609:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964049.839881:0:32609:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964049.839883:0:32609:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964049.839887:0:32609:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964049.839891:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891385344 00000020:00000001:0.0:1790964049.839893:0:32609:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964049.839895:0:32609:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23d60 00000020:00000001:0.0:1790964049.839898:0:32609:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964049.839901:0:32609:0:(lustre_handles.c:148:class_handle2object()) GET export 000000009a31e7fe refcount=12 00000020:00000001:0.0:1790964049.839903:0:32609:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000020:00000001:0.0:1790964049.839906:0:32609:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613205078943744 : -130868630607872 : ffff88f9c5c2a800) 00000100:00000001:0.0:1790964049.839916:0:32609:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964049.839920:0:32609:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000117c9ec3. 00000100:00000001:0.0:1790964049.839922:0:32609:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964049.839925:0:32609:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000117c9ec3. 00000020:00000010:0.0:1790964049.839934:0:32609:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097d300f6. 00000020:00000010:0.0:1790964049.839949:0:32609:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000d3ba538e. 00000020:00000010:0.0:1790964049.839954:0:32609:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000ad360dc5. 00000100:00000040:0.0:1790964049.839963:0:32609:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:0.0:1790964049.839966:0:32609:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964049.839968:0:32609:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964049.839970:0:32609:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.839977:0:32609:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.839985:0:32609:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.839994:0:32609:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964049.839995:0:32609:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964049.839999:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00000040:0.0:1790964049.840003:0:32609:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000009a31e7fe : new rpc_count 1 00000100:00000001:0.0:1790964049.840004:0:32609:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446613209796438096 : -130863913113520 : ffff88fadef1e850) 00000100:00000040:0.0:1790964049.840009:0:32609:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000004250ee5d x1877961891385344/t0(0) o400->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:625/0 lens 224/0 e 0 to 0 dl 1790964060 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.840017:0:32609:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964049.840019:0:32609:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000117c9ec3. 00000100:00000001:0.0:1790964049.840021:0:32609:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964049.840023:0:32609:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000117c9ec3. 00000100:00100000:0.0:1790964049.840026:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004250ee5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:31766:x1877961891385344:12345-0@lo:400: 00000100:00000200:0.0:1790964049.840030:0:32609:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961891385344 00000020:00000001:0.0:1790964049.840033:0:32609:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:0.0:1790964049.840038:0:32609:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:0.0:1790964049.840041:0:32609:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964049.840043:0:32609:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1790964049.840045:0:32609:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667990208 : -1041561408 : ffffffffc1eb08c0) 00000020:00000001:0.0:1790964049.840049:0:32609:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1790964049.840056:0:32609:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1790964049.840058:0:32609:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1790964049.840060:0:32609:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1790964049.840063:0:32609:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964049.840066:0:32609:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1790964049.840069:0:32609:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964049.840071:0:32609:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1790964049.840074:0:32609:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000ded9fd1a. 02000000:00000001:0.0:1790964049.840076:0:32609:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.840079:0:32609:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964049.840081:0:32609:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964049.840083:0:32609:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961891385344 00010000:00000001:0.0:1790964049.840086:0:32609:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:0.0:1790964049.840090:0:32609:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000004250ee5d x1877961891385344/t0(0) o400->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:625/0 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964049.840098:0:32609:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964049.840100:0:32609:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964049.840104:0:32609:0:(import.c:2195:obd_at_measure()) add 1 to 000000000eace963 time=10 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964049.840108:0:32609:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964049.840110:0:32609:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 17 to 0@lo 00000100:00000001:0.0:1790964049.840112:0:32609:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 02000000:00000001:0.0:1790964049.840114:0:32609:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964049.840116:0:32609:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.840118:0:32609:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964049.840120:0:32609:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964049.840123:0:32609:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000cd9d280e. 00000100:00000200:0.0:1790964049.840126:0:32609:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877961891385344, offset 224 00000400:00000200:0.0:1790964049.840130:0:32609:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964049.840136:0:32609:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964049.840142:0:32609:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff13701000 00000400:00000200:0.0:1790964049.840147:0:32609:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xaed [1] + 224 00000400:00000200:0.0:1790964049.840153:0:32609:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964049.840155:0:32609:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964049.840177:0:32609:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964049.840181:0:32609:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964049.840195:0:32609:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.840206:0:32609:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964049.840213:0:32609:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000cd9d280e 00000400:00000010:0.0:1790964049.840215:0:32609:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000cd9d280e. 00000100:00000001:0.0:1790964049.840217:0:32609:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964049.840219:0:32609:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964049.840223:0:32609:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.840225:0:32609:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 16 to 0@lo 00010000:00000001:0.0:1790964049.840228:0:32609:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:0.0:1790964049.840229:0:32609:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964049.840231:0:32609:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1790964049.840234:0:32609:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000004250ee5d x1877961891385344/t0(0) o400->c290d637-a468-41a2-ad47-911f0cbec690@0@lo:625/0 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964049.840242:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004250ee5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c290d637-a468-41a2-ad47-911f0cbec690+12:31766:x1877961891385344:12345-0@lo:400: Request processed in 224us (13284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964049.840250:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00000040:0.0:1790964049.840252:0:32609:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a31e7fe : new rpc_count 0 00000100:00000001:0.0:1790964049.840254:0:32609:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964049.840256:0:32609:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964049.840260:0:32609:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000d3ba538e. 00000020:00000010:0.0:1790964049.840263:0:32609:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000ad360dc5. 00000020:00000010:0.0:1790964049.840268:0:32609:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097d300f6. 00000020:00000040:0.0:1790964049.840274:0:32609:0:(genops.c:879:class_export_put()) PUTting export 000000009a31e7fe : new refcount 11 02000000:00000001:0.0:1790964049.840277:0:32609:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:0.0:1790964049.840280:0:32609:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 00000000ded9fd1a. 02000000:00000001:0.0:1790964049.840282:0:32609:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:0.0:1790964049.840284:0:32609:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1790964049.840289:0:32609:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:0.0:1790964049.840293:0:32609:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000006571851a. 00000400:00000010:0.0:1790964049.840297:0:32609:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 000000004ad02b58. 00000100:00000040:0.0:1790964049.840318:0:1100:0:(connection.c:75:cpu_latency_work()) work item of 00000000a22dbd09 (cpu 0) has reached its deadline 4295586313, at 4295586321 00000100:00000010:0.0:1790964049.840330:0:1100:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000f8df6c28. 00000100:00000001:0.0:1790964049.840339:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964049.840341:0:31766:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1790964049.840345:0:31766:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964049.840346:0:31766:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964049.840348:0:31766:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000001cab3ff6. 00000400:00000200:0.0:1790964049.840350:0:31766:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000087f54be2 00000400:00000010:0.0:1790964049.840351:0:31766:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000087f54be2. 00000100:00000001:0.0:1790964049.840353:0:31766:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964049.840357:0:31766:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964049.840364:0:31766:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.840371:0:31766:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964049.840372:0:31766:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.840374:0:31766:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1790964049.840377:0:31766:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1790964049.840378:0:31766:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964049.840380:0:31766:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964049.840382:0:31766:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964049.840386:0:31766:0:(import.c:2195:obd_at_measure()) add 5 to 00000000a85d97ae time=10 v=5 (5 0 0 0) 00000100:00001000:0.0:1790964049.840389:0:31766:0:(import.c:2195:obd_at_measure()) add 1 to 000000003079e642 time=10 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964049.840392:0:31766:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1790964049.840393:0:31766:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964049.840396:0:31766:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1790964049.840398:0:31766:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.840401:0:31766:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.840403:0:31766:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.840422:0:31766:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964049.840425:0:31766:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964049.840426:0:31766:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1790964049.840428:0:31766:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964049.840436:0:31766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b373377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c290d637-a468-41a2-ad47-911f0cbec690:31766:1877961891385344:0@lo:400: 00000100:00000001:0.0:1790964049.840447:0:31766:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.840450:0:31766:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964049.840452:0:31766:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000007b373377 x1877961891385344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.840459:0:31766:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964049.840461:0:31766:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964049.840464:0:31766:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000c943108f. 02000000:00000001:0.0:1790964049.840467:0:31766:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964049.840469:0:31766:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964049.840471:0:31766:0:(genops.c:1223:class_import_put()) import 000000005c67ece7 refcount=3 obd=MGC192.168.202.123@tcp 00000020:00000001:0.0:1790964049.840473:0:31766:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964049.840475:0:31766:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000e31d9e3b. 02000000:00000001:0.0:1790964049.840487:0:31766:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964049.840489:0:31766:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964049.840491:0:31766:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000007b373377. 00000100:00000001:0.0:1790964049.840502:0:31766:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964049.840503:0:31766:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.840505:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.840509:0:31766:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964049.840510:0:31766:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.840512:0:31766:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964049.840514:0:31766:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964049.840538:0:32621:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000002738da3a. 00000100:00000001:0.0:1790964049.840541:0:32621:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964049.840543:0:32621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891385472 02000000:00000001:0.0:1790964049.840544:0:32621:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964049.840546:0:32621:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964049.840548:0:32621:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964049.840550:0:32621:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964049.840552:0:32621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891385472 00000020:00000001:0.0:1790964049.840553:0:32621:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964049.840554:0:32621:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:0.0:1790964049.840556:0:32621:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:0.0:1790964049.840558:0:32621:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964049.840559:0:32621:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964049.841056:0:32621:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097d300f6. 00000020:00000010:0.0:1790964049.841068:0:32621:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000d3ba538e. 00000020:00000010:0.0:1790964049.841071:0:32621:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000ad360dc5. 00000100:00000001:0.0:1790964049.841075:0:32621:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964049.841077:0:32621:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964049.841078:0:32621:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.841082:0:32621:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.841092:0:32621:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.841100:0:32621:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964049.841102:0:32621:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964049.841105:0:32621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964049.841108:0:32621:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446613209758186368 : -130863951365248 : ffff88fadcaa3b80) 00000100:00000040:0.0:1790964049.841111:0:32621:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000006f860f81 x1877961891385472/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964069 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964049.841119:0:32621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f860f81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31763:x1877961891385472:12345-0@lo:38: 00000100:00000200:0.0:1790964049.841122:0:32621:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961891385472 00000020:00000001:0.0:1790964049.841125:0:32621:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:0.0:1790964049.841128:0:32621:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000001:0.0:1790964049.841140:0:32621:0:(genops.c:655:class_str2obd()) Process leaving (rc=0 : 0 : 0) 00010000:00020000:0.0:1790964049.841143:0:32621:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000001:3.0:1790964049.843557:0:31765:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295586311 00000100:00000001:3.0:1790964049.843585:0:31765:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295586326 00000100:00000001:3.0:1790964049.843608:0:31765:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295586324 00000100:00000001:3.0:1790964049.843610:0:31765:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295586326 00000100:00000001:3.0:1790964049.843613:0:31765:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295586324 00000100:00000001:3.0:1790964049.843615:0:31765:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964049.843620:0:31765:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.843624:0:31765:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.843629:0:31765:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964049.843713:0:32616:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 0000000079f56452. 00000100:00000001:3.0:1790964049.843722:0:32616:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964049.843724:0:32616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961891385600 02000000:00000001:3.0:1790964049.843727:0:32616:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964049.843730:0:32616:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964049.843732:0:32616:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964049.843737:0:32616:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964049.843756:0:32616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961891385600 00000020:00000001:3.0:1790964049.843759:0:32616:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964049.843761:0:32616:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23e40 00000020:00000001:3.0:1790964049.843764:0:32616:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964049.843767:0:32616:0:(lustre_handles.c:148:class_handle2object()) GET export 000000008632dcd6 refcount=5 00000020:00000001:3.0:1790964049.843770:0:32616:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613209349081088 : -130864360470528 : ffff88fac447c800) 00000020:00000001:3.0:1790964049.843772:0:32616:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613209349081088 : -130864360470528 : ffff88fac447c800) 00000100:00000001:3.0:1790964049.843776:0:32616:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964049.843781:0:32616:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000474dcb32. 00000100:00000001:3.0:1790964049.843784:0:32616:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964049.843787:0:32616:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000474dcb32. 00000020:00000010:3.0:1790964049.843793:0:32616:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e55f6530. 00000020:00000010:3.0:1790964049.843799:0:32616:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000d7f28b8e. 00000020:00000010:3.0:1790964049.843804:0:32616:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000001f3f7771. 00000100:00000040:3.0:1790964049.843813:0:32616:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000001:3.0:1790964049.843816:0:32616:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964049.843817:0:32616:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1790964049.843820:0:32616:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.843827:0:32616:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:3.0:1790964049.843835:0:32616:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:3.0:1790964049.843836:0:32616:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.843848:0:32616:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.843860:0:32616:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964049.843862:0:32616:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964049.843867:0:32616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00000040:3.0:1790964049.843871:0:32616:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000008632dcd6 : new rpc_count 1 00000100:00000001:3.0:1790964049.843873:0:32616:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446613209793133440 : -130863916418176 : ffff88fadebf7b80) 00000100:00000040:3.0:1790964049.843880:0:32616:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000005c75e991 x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:625/0 lens 224/0 e 0 to 0 dl 1790964060 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.843900:0:32616:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964049.843909:0:32616:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000474dcb32. 00000100:00000001:3.0:1790964049.843911:0:32616:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964049.843913:0:32616:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000474dcb32. 00000100:00100000:3.0:1790964049.843917:0:32616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c75e991 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:31765:x1877961891385600:12345-0@lo:400: 00000100:00000200:3.0:1790964049.843920:0:32616:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961891385600 00000020:00000001:3.0:1790964049.843923:0:32616:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1790964049.843926:0:32616:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1790964049.843928:0:32616:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964049.843930:0:32616:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1790964049.843932:0:32616:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072660102848 : -1049448768 : ffffffffc172aec0) 00000020:00000001:3.0:1790964049.843936:0:32616:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1790964049.843947:0:32616:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964049.843949:0:32616:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1790964049.843951:0:32616:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1790964049.843954:0:32616:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964049.843955:0:32616:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:3.0:1790964049.843959:0:32616:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964049.843962:0:32616:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1790964049.843966:0:32616:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000a885b3c8. 02000000:00000001:3.0:1790964049.843968:0:32616:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.843970:0:32616:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964049.843972:0:32616:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1790964049.843974:0:32616:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961891385600 00010000:00000001:3.0:1790964049.843982:0:32616:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:3.0:1790964049.843986:0:32616:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000005c75e991 x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:625/0 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964049.843994:0:32616:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964049.843996:0:32616:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964049.844000:0:32616:0:(import.c:2195:obd_at_measure()) add 1 to 00000000fe546ede time=5 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964049.844005:0:32616:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964049.844007:0:32616:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 17 to 0@lo 00000100:00000001:3.0:1790964049.844009:0:32616:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 02000000:00000001:3.0:1790964049.844012:0:32616:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964049.844014:0:32616:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.844016:0:32616:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964049.844019:0:32616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964049.844025:0:32616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000a0786b8d. 00000100:00000200:3.0:1790964049.844031:0:32616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1877961891385600, offset 224 00000400:00000200:3.0:1790964049.844037:0:32616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964049.844050:0:32616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964049.844059:0:32616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6abff13701100 00000400:00000200:3.0:1790964049.844065:0:32616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0xaf5 [1] + 224 00000400:00000200:3.0:1790964049.844074:0:32616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964049.844078:0:32616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964049.844083:0:32616:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964049.844087:0:32616:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964049.844095:0:32616:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.844107:0:32616:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964049.844116:0:32616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000a0786b8d 00000400:00000010:3.0:1790964049.844118:0:32616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000a0786b8d. 00000100:00000001:3.0:1790964049.844121:0:32616:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964049.844123:0:32616:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1790964049.844127:0:32616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964049.844129:0:32616:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 16 to 0@lo 00010000:00000001:3.0:1790964049.844131:0:32616:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:3.0:1790964049.844140:0:32616:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964049.844142:0:32616:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1790964049.844145:0:32616:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000005c75e991 x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:625/0 lens 224/224 e 0 to 0 dl 1790964060 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964049.844153:0:32616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c75e991 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:31765:x1877961891385600:12345-0@lo:400: Request processed in 252us (16364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964049.844177:0:32616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00000040:3.0:1790964049.844181:0:32616:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008632dcd6 : new rpc_count 0 00000100:00000001:3.0:1790964049.844183:0:32616:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964049.844185:0:32616:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1790964049.844190:0:32616:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000d7f28b8e. 00000020:00000010:3.0:1790964049.844194:0:32616:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000001f3f7771. 00000020:00000010:3.0:1790964049.844198:0:32616:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e55f6530. 00000020:00000040:3.0:1790964049.844202:0:32616:0:(genops.c:879:class_export_put()) PUTting export 000000008632dcd6 : new refcount 4 00000100:00000001:3.0:1790964049.844204:0:32616:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.844306:0:31765:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964049.844310:0:31765:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964049.844314:0:31765:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964049.844316:0:31765:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964049.844318:0:31765:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000e3f53987. 00000400:00000200:3.0:1790964049.844321:0:31765:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000d945d0b7 00000400:00000010:3.0:1790964049.844323:0:31765:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000d945d0b7. 00000100:00000001:3.0:1790964049.844325:0:31765:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964049.844328:0:31765:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964049.844336:0:31765:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.844341:0:31765:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964049.844343:0:31765:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.844345:0:31765:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964049.844347:0:31765:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964049.844348:0:31765:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964049.844350:0:31765:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964049.844352:0:31765:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964049.844363:0:31765:0:(import.c:2195:obd_at_measure()) add 5 to 000000004c2f0a13 time=5 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964049.844367:0:31765:0:(import.c:2195:obd_at_measure()) add 1 to 00000000b260e820 time=5 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964049.844369:0:31765:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964049.844371:0:31765:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964049.844373:0:31765:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1790964049.844377:0:31765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964049.844383:0:31765:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.844386:0:31765:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1790964049.844388:0:31765:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:3.0:1790964049.844390:0:31765:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1790964049.844391:0:31765:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964049.844395:0:31765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.844400:0:31765:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964049.844403:0:31765:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964049.844405:0:31765:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964049.844408:0:31765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964049.844975:0:31765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017c05dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:31765:1877961891385600:0@lo:400: 00000100:00000001:3.0:1790964049.844982:0:31765:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.844986:0:31765:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964049.844988:0:31765:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000017c05dab x1877961891385600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964065 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.844995:0:31765:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964049.844998:0:31765:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964049.845001:0:31765:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000f9db21cb. 02000000:00000001:3.0:1790964049.845005:0:31765:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964049.845007:0:31765:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964049.845008:0:31765:0:(genops.c:1223:class_import_put()) import 00000000773535ae refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:3.0:1790964049.845011:0:31765:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964049.845013:0:31765:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000cb2d6ff6. 02000000:00000001:3.0:1790964049.845017:0:31765:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964049.845026:0:31765:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964049.845029:0:31765:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000017c05dab. 00000100:00000001:3.0:1790964049.845037:0:31765:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964049.845038:0:31765:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.845040:0:31765:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.845045:0:31765:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964049.845047:0:31765:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.845049:0:31765:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964049.845051:0:31765:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964049.845816:0:31763:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295586312 00000100:00000001:1.0:1790964049.845825:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295586327 00000100:00000001:1.0:1790964049.845840:0:31763:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295586326 00000100:00000001:1.0:1790964049.845843:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295586327 00000100:00000001:1.0:1790964049.845845:0:31763:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295586326 00000100:00000001:1.0:1790964049.845860:0:31763:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964049.845864:0:31763:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964049.845869:0:31763:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964049.845876:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964049 ref 1 fl Rpc:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.845884:0:31763:0:(client.c:2143:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00000001:1.0:1790964049.845886:0:31763:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964049.845887:0:31763:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964049.845889:0:31763:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964049.846308:0:31763:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:1.0:1790964049.846311:0:31763:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00080000:1.0:1790964049.846315:0:31763:0:(import.c:65:import_set_state_nolock()) 00000000dad64bef lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790964049.846334:0:31763:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00000001:1.0:1790964049.846338:0:31763:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551506 : -110 : ffffffffffffff92) 00000100:00000040:1.0:1790964049.846342:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964049 ref 1 fl Interpret:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964049.846351:0:31763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d8faea1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31763:1877961891382528:0@lo:8: 00000100:00000001:1.0:1790964049.846356:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964049.846358:0:31763:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964049.846361:0:31763:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000002d8faea1 x1877961891382528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964049 ref 1 fl Complete:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964049.846368:0:31763:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964049.846370:0:31763:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964049.846373:0:31763:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002adec2ae. 02000000:00000001:1.0:1790964049.846377:0:31763:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964049.846378:0:31763:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964049.846385:0:31763:0:(genops.c:1223:class_import_put()) import 00000000dad64bef refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000001:1.0:1790964049.846387:0:31763:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964049.846389:0:31763:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 000000005bacd6a7. 02000000:00000001:1.0:1790964049.846394:0:31763:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964049.846396:0:31763:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964049.846397:0:31763:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000002d8faea1. 00000100:00000001:1.0:1790964049.846400:0:31763:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964049.846401:0:31763:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964049.846403:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964049.846472:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964049.846474:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:1.0:1790964049.846477:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964049.846478:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964049.846480:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964049.846482:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:3.0:1790964049.846823:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790964049.846829:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00000001:3.0:1790964049.846831:0:8:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:3.0:1790964049.846833:0:8:0:(import.c:65:import_set_state_nolock()) 00000000dad64bef lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:3.0:1790964049.846836:0:8:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:3.0:1790964049.846839:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 908 00000100:00001000:3.0:1790964049.846843:0:8:0:(import.c:2195:obd_at_measure()) add 10 to 00000000f4ca0d40 time=1790964049 v=0 (0 0 0 0) 00000100:00001000:3.0:1790964049.846847:0:8:0:(import.c:2261:obd_at_measure()) AT 00000000f4ca0d40 change: old=0 new=10 delta=10 (val=10) hist 10 0 0 0 00000100:00080000:3.0:1790964049.846850:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:3.0:1790964049.846852:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 15 to 0@lo 00000100:00000001:3.0:1790964049.846854:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964049.846856:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 16 to 0@lo 00000100:00000001:3.0:1790964049.846858:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000020:00000001:3.0:1790964049.846860:0:8:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964049.846862:0:8:0:(genops.c:804:class_conn2export()) looking for export cookie 0x9928545985f23de5 00000020:00000001:3.0:1790964049.846864:0:8:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964049.846867:0:8:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000c2361f5b refcount=4 00000020:00000001:3.0:1790964049.846869:0:8:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446613210045794304 : -130863663757312 : ffff88faedcec800) 00000020:00000001:3.0:1790964049.846871:0:8:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446613210045794304 : -130863663757312 : ffff88faedcec800) 00000100:00000040:3.0:1790964049.846874:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 15 to 0@lo 00000100:00000001:3.0:1790964049.846875:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964049.846877:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 16 to 0@lo 00000100:00000001:3.0:1790964049.846878:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000020:00000040:3.0:1790964049.846880:0:8:0:(genops.c:879:class_export_put()) PUTting export 00000000c2361f5b : new refcount 3 00000100:00080000:3.0:1790964049.846890:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000dad64bef using connection 192.168.202.123@tcp/0@lo 00000100:00000001:3.0:1790964049.846892:0:8:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964049.846894:0:8:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:3.0:1790964049.846900:0:8:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964049.846903:0:8:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.846905:0:8:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:3.0:1790964049.846908:0:8:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964049.846912:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000390de163. 00000020:00000040:3.0:1790964049.846915:0:8:0:(genops.c:1210:class_import_get()) import 00000000dad64bef refcount=3 obd=lustre-OST0000-osc-MDT0000 02000000:00000001:3.0:1790964049.846918:0:8:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:3.0:1790964049.846920:0:8:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.846922:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964049.846925:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964049.846928:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964049.846935:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 000000001df740a0. 00000100:00000001:3.0:1790964049.846951:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964049.846956:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000390de163 x1877961891385728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1790964049.846964:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964049.846966:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964049.846969:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000390de163] to pc [ptlrpcd_rcv+-1] req@00000000390de163 x1877961891385728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.846985:0:8:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964049.846990:0:8:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (924) 00000100:00000001:3.0:1790964049.847002:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964049.847004:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964049.847005:0:31763:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964049.847008:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000390de163 x1877961891385728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.847014:0:31763:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964049.847016:0:31763:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964049.847018:0:31763:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964049.847021:0:31763:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964049.847023:0:31763:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964049.847031:0:31763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000390de163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31763:1877961891385728:0@lo:8: 00000100:00000001:3.0:1790964049.847034:0:31763:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964049.847039:0:31763:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964049.847041:0:31763:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964049.847044:0:31763:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964049.847048:0:31763:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e587b7d6. 02000000:00000001:3.0:1790964049.847051:0:31763:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964049.847057:0:31763:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000e3f53987. 00000400:00000010:3.0:1790964049.847063:0:31763:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000d945d0b7. 00000100:00000200:3.0:1790964049.847069:0:31763:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961891385728, portal 4 00000100:00000001:3.0:1790964049.847072:0:31763:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964049.847073:0:31763:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446613209793118208 : -130863916433408 : ffff88fadebf4000) 00000020:00000010:3.0:1790964049.847080:0:31763:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000006140fad0. 00000100:00000040:3.0:1790964049.847085:0:31763:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000390de163 x1877961891385728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964064 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.847092:0:31763:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964049.847094:0:31763:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964049.847096:0:31763:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000a0786b8d. 00000100:00000200:3.0:1790964049.847099:0:31763:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 28, xid 1877961891385728, offset 0 00000400:00000200:3.0:1790964049.847105:0:31763:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964049.847117:0:31763:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964049.847127:0:31763:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 28 MB=0x6abff13701180 00000400:00000100:3.0:1790964049.847131:0:31763:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877961891385728 offset 0 length 520: 4 00000400:00000200:3.0:1790964049.847135:0:31763:0:(lib-msg.c:1116:lnet_is_health_check()) Msg 0000000020ace37b is in inconsistent state, don't perform health checking (-2, 0) 00000400:00000200:3.0:1790964049.847138:0:31763:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 0, status = -2, hstatus = 0 00000400:00000200:3.0:1790964049.847150:0:31763:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000a0786b8d 00000400:00000010:3.0:1790964049.847152:0:31763:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000a0786b8d. 00000100:00000001:3.0:1790964049.847157:0:31763:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964049.847179:0:31763:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000390de163 x1877961891385728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964064 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.847187:0:31763:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964049.847190:0:31763:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000390de163 x1877961891385728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964064 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964049.847206:0:31763:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.847208:0:31763:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964049.847216:0:31763:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964049.847220:0:31763:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000001:3.0:1790964049.847223:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295586331 00000100:00000010:3.0:1790964049.847226:0:31763:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000fbcd33c3. 00000100:00000001:3.0:1790964049.847233:0:31763:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 0 00000100:00000001:3.0:1790964049.847238:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295586331 00000100:00000001:3.0:1790964049.847241:0:31763:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295586313 00000100:00000001:3.0:1790964049.847244:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295586331 00000100:00000001:3.0:1790964049.847246:0:31763:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295586327 00000100:00000001:3.0:1790964049.847249:0:31763:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295586331 00000100:00000001:3.0:1790964049.847251:0:31763:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295586327 00000100:00000001:3.0:1790964049.847253:0:31763:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964049.847255:0:31763:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.847257:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.847259:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964049.847265:0:31763:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964049.847266:0:31763:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:3.0:1790964049.847268:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964049.847269:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964049.847270:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964049.847272:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964049.886835:0:11733:0:(connection.c:75:cpu_latency_work()) work item of 00000000ceedfbcb (cpu 2) has reached its deadline 4295586331, at 4295586366 00000100:00000010:2.0:1790964049.886853:0:11733:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000b1bb2375. 00000100:00000040:3.0:1790964049.886998:0:33:0:(connection.c:75:cpu_latency_work()) work item of 0000000048c58409 (cpu 3) has reached its deadline 4295586331, at 4295586366 00000100:00000010:3.0:1790964049.887005:0:33:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000009542302a. 00000100:00000040:1.0:1790964049.888028:0:808:0:(connection.c:75:cpu_latency_work()) work item of 000000009cab77b5 (cpu 1) has reached its deadline 4295586331, at 4295586366 00000100:00000010:1.0:1790964049.888041:0:808:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000002ab2a910. 00010000:00000001:0.0:1790964049.905388:0:32621:0:(ldlm_lib.c:1191:target_handle_connect()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00010000:00000001:0.0:1790964049.905401:0:32621:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:0.0:1790964049.905406:0:32621:0:(niobuf.c:816:ptlrpc_send_error()) Process entered 00000100:00000001:0.0:1790964049.905410:0:32621:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964049.905413:0:32621:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000040:0.0:1790964049.905434:0:1100:0:(connection.c:75:cpu_latency_work()) work item of 00000000a22dbd09 (cpu 0) has reached its deadline 4295586331, at 4295586386 00000100:00000010:0.0:1790964049.905445:0:1100:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000fbcd33c3. 02000000:00000010:0.0:1790964049.905461:0:32621:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000ded9fd1a. 02000000:00000001:0.0:1790964049.905464:0:32621:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.905468:0:32621:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964049.905472:0:32621:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964049.905474:0:32621:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964049.905478:0:32621:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x0 req_flags=0x200 magic=bd00bd3/bd00bd3 len=224 00000100:00000001:0.0:1790964049.905488:0:32621:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:0.0:1790964049.905491:0:32621:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964049.905496:0:32621:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000b0a5732a refcount 17 to 0@lo 00000100:00000001:0.0:1790964049.905498:0:32621:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446613210346682688 : -130863362868928 : ffff88faffbdf940) 00000100:00000001:0.0:1790964049.905501:0:32621:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446613210346682688 : -130863362868928 : 0xffff88faffbdf940) 00000100:00000040:0.0:1790964049.905503:0:32621:0:(connection.c:150:ptlrpc_connection_get()) conn=00000000b0a5732a refcount 17 to 0@lo 02000000:00000001:0.0:1790964049.905505:0:32621:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964049.905507:0:32621:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.905510:0:32621:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964049.905513:0:32621:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964049.905517:0:32621:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000087f54be2. 00000100:00000200:0.0:1790964049.905524:0:32621:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1877961891385472, offset 0 00000400:00000200:0.0:1790964049.905530:0:32621:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964049.905544:0:32621:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964049.905553:0:32621:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6abff13701080 00000400:00000200:0.0:1790964049.905561:0:32621:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0xafd [1] + 0 00000400:00000200:0.0:1790964049.905572:0:32621:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964049.905576:0:32621:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964049.905585:0:32621:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964049.905591:0:32621:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964064 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964049.905601:0:32621:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964064 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.905620:0:32621:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964049.905630:0:32621:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000087f54be2 00000400:00000010:0.0:1790964049.905632:0:32621:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000087f54be2. 00000100:00000001:0.0:1790964049.905636:0:32621:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964049.905638:0:32621:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964049.905643:0:32621:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964049.905646:0:32621:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000b0a5732a refcount 16 to 0@lo 00000100:00000001:0.0:1790964049.905648:0:32621:0:(niobuf.c:837:ptlrpc_send_error()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964049.905651:0:32621:0:(tgt_handler.c:789:tgt_request_handle()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000040:0.0:1790964049.905656:0:32621:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000006f860f81 x1877961891385472/t0(0) o38->@:0/0 lens 520/224 e 0 to 0 dl 1790964069 ref 1 fl Interpret:/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964049.905672:0:32621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f860f81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31763:x1877961891385472:12345-0@lo:38: Request processed in 64552us (66111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790964049.905683:0:32621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964049.905686:0:32621:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964049.905688:0:32621:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964049.905695:0:32621:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000d3ba538e. 00000020:00000010:0.0:1790964049.905701:0:32621:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000ad360dc5. 00000020:00000010:0.0:1790964049.905706:0:32621:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097d300f6. 00000100:00000001:0.0:1790964049.905711:0:32621:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.905736:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964049.905740:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1790964049.905748:0:31763:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964049.905751:0:31763:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964049.905753:0:31763:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000052e5d77e. 00000400:00000200:0.0:1790964049.905756:0:31763:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000ae553c76 00000400:00000010:0.0:1790964049.905758:0:31763:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000ae553c76. 00000100:00000001:0.0:1790964049.905761:0:31763:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964049.905765:0:31763:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964064 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964049.905773:0:31763:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964064 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.905779:0:31763:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964049.905780:0:31763:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.905782:0:31763:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1790964049.905785:0:31763:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1790964049.905787:0:31763:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964049.905789:0:31763:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964049.905792:0:31763:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964049.905801:0:31763:0:(import.c:2195:obd_at_measure()) add 0 to 000000002e33eefc time=1790964049 v=5 (0 0 0 0) 00000100:00001000:0.0:1790964049.905805:0:31763:0:(import.c:2195:obd_at_measure()) add 1 to 00000000102044c4 time=10 v=10 (10 0 0 0) 00000100:00000001:0.0:1790964049.905808:0:31763:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1790964049.905810:0:31763:0:(client.c:1506:ptlrpc_check_status()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:0.0:1790964049.905812:0:31763:0:(client.c:1712:after_reply()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:0.0:1790964049.905822:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964064 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.905828:0:31763:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00000001:0.0:1790964049.905831:0:31763:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964049.905833:0:31763:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.905835:0:31763:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:0.0:1790964049.905837:0:31763:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00080000:0.0:1790964049.905840:0:31763:0:(import.c:65:import_set_state_nolock()) 000000001965c25d lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790964049.905844:0:31763:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00000001:0.0:1790964049.905847:0:31763:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:0.0:1790964049.905850:0:31763:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964064 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964049.905857:0:31763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3186084 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31763:1877961891385472:0@lo:38: 00000100:00000001:0.0:1790964049.905863:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.905866:0:31763:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964049.905870:0:31763:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000c3186084 x1877961891385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964064 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964049.905877:0:31763:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964049.905879:0:31763:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964049.905882:0:31763:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000247a87c9. 02000000:00000001:0.0:1790964049.905887:0:31763:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964049.905889:0:31763:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964049.905891:0:31763:0:(genops.c:1223:class_import_put()) import 000000001965c25d refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000020:00000001:0.0:1790964049.905894:0:31763:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964049.905896:0:31763:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 000000009ce30b32. 02000000:00000001:0.0:1790964049.905899:0:31763:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964049.905902:0:31763:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964049.905903:0:31763:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000c3186084. 00000100:00000001:0.0:1790964049.905906:0:31763:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964049.905908:0:31763:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964049.905910:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.905912:0:31763:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964049.905919:0:31763:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964049.905920:0:31763:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964049.905922:0:31763:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) Debug log: 3350 lines, 3350 kept, 0 dropped, 0 bad.