00000020:01000004:1.0F:1790964068.290934:0:32646:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790964068.290949:0:32646:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790964068.291079:0:32646:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000714ae1fe 00000080:02000400:1.0:1790964068.291091:0:32646:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1790964068.296502:0:32646:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790964068.296518:0:32646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790964068.296562:0:32646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a2804998) 00000020:00000080:1.0:1790964068.296582:0:32646:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0F:1790964068.369333:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0F:1790964068.386959:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1790964068.389399:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 471: rc = 0 00100000:10000000:3.0:1790964068.389810:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 471: rc = 0 00100000:10000000:3.0:1790964068.389938:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 471: rc = 0 00100000:10000000:3.0:1790964068.390738:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 471: rc = 0 00100000:10000000:2.0:1790964068.401362:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 471: rc = 0 00100000:10000000:2.0:1790964068.406607:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790964068.406716:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 471: rc = 0 00100000:10000000:2.0:1790964068.408018:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 473: rc = 0 00100000:10000000:2.0:1790964068.432135:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 516: rc = 0 00100000:10000000:2.0:1790964068.432259:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 516: rc = 0 00100000:10000000:3.0:1790964068.438179:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1790964068.439675:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 521: rc = 0 00100000:10000000:3.0:1790964068.441078:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1790964068.442466:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 521: rc = 0 00100000:10000000:3.0:1790964068.454370:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 521: rc = 0 00100000:10000000:2.0:1790964068.468133:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 521: rc = 0 00100000:10000000:2.0:1790964068.474291:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 521: rc = 0 00100000:10000000:2.0:1790964068.479388:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 521: rc = 0 00100000:10000000:2.0:1790964068.481087:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 521: rc = 0 00100000:10000000:2.0:1790964068.486334:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 521: rc = 0 00100000:10000000:2.0:1790964068.488612:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 521: rc = 0 00100000:10000000:2.0:1790964068.490626:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1790964068.502320:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 546: rc = 0 00100000:10000000:3.0:1790964068.504242:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 546: rc = 0 00100000:10000000:2.0:1790964068.519504:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 546: rc = 0 00100000:10000000:2.0:1790964068.524722:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 546: rc = 0 00100000:10000000:2.0:1790964068.527517:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 546: rc = 0 00100000:10000000:2.0:1790964068.529842:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 546: rc = 0 00100000:10000000:2.0:1790964068.531735:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 546: rc = 0 00100000:10000000:0.0F:1790964068.538012:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 546: rc = 0 00100000:10000000:0.0:1790964068.551631:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 546: rc = 0 00100000:10000000:0.0:1790964068.555871:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 546: rc = 0 00100000:10000000:0.0:1790964068.565096:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 546: rc = 0 00100000:10000000:0.0:1790964068.576420:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 546: rc = 0 00100000:10000000:0.0:1790964068.587668:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 546: rc = 0 00100000:10000000:0.0:1790964068.603405:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 546: rc = 0 00100000:10000000:0.0:1790964068.606434:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 546: rc = 0 00100000:10000000:0.0:1790964068.608629:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 546: rc = 0 00100000:10000000:0.0:1790964068.621781:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 546: rc = 0 00100000:10000000:0.0:1790964068.633815:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 546: rc = 0 00100000:10000000:0.0:1790964068.638104:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 546: rc = 0 00100000:10000000:0.0:1790964068.645060:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 546: rc = 0 00100000:10000000:0.0:1790964068.656651:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 546: rc = 0 00100000:10000000:0.0:1790964068.658265:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 546: rc = 0 00100000:10000000:1.0:1790964068.661447:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 546: rc = 0 00100000:10000000:0.0:1790964068.665002:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 546: rc = 0 00100000:10000000:0.0:1790964068.670024:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 546: rc = 0 00100000:10000000:0.0:1790964068.672067:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 546: rc = 0 00100000:10000000:0.0:1790964068.678960:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 546: rc = 0 00100000:10000000:0.0:1790964068.685603:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 546: rc = 0 00100000:10000000:0.0:1790964068.693748:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 546: rc = 0 00100000:10000000:0.0:1790964068.695114:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 546: rc = 0 00100000:10000000:0.0:1790964068.700683:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 546: rc = 0 00100000:10000000:0.0:1790964068.702075:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 546: rc = 0 00100000:10000000:0.0:1790964068.705534:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 535: rc = 0 00100000:10000000:0.0:1790964068.707327:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 535: rc = 0 00100000:10000000:2.0:1790964068.729356:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790964068.730410:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 517: rc = 0 00100000:10000000:2.0:1790964068.732024:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790964068.732105:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 517: rc = 0 00100000:10000000:2.0:1790964068.735965:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790964068.740140:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 517: rc = 0 00100000:10000000:2.0:1790964068.743244:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790964068.743739:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 369: rc = 0 00100000:10000000:1.0:1790964068.745818:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1790964068.745974:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 369: rc = 0 00100000:10000000:1.0:1790964068.748772:0:32646:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1790964068.750003:0:32646:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 369: rc = 0 00000020:00000080:1.0:1790964068.755497:0:32646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790964068.755508:0:32646:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790964068.755520:0:32646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x67c8b7dde5cd191e 00000020:01000004:1.0:1790964068.755529:0:32646:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790964068.755533:0:32646:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790964068.755538:0:32646:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000714ae1fe from MGS 00000020:01000004:1.0:1790964068.755543:0:32646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790964068.756772:0:32646:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000085bdfddc) 00000020:00000080:1.0:1790964068.756800:0:32646:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790964068.757400:0:32646:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000714ae1fe from MGS, refs=2 00080000:01000000:1.0:1790964068.757410:0:32646:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790964068.757416:0:32646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x67c8b7dde5cd192c 00000100:00100000:1.0:1790964068.758453:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790964068.759113:0:32646:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790964068.759120:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790964068.762732:0:32646:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790964068.762760:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790964068.765374:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964068.767394:0:32646:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790964068.767407:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790964068.769129:0:32646:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790964068.769142:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790964068.770655:0:32646:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790964068.770669:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790964068.777888:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964068.777900:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964068.777902:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964068.778792:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964068.778795:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964068.778797:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964068.779547:0:32646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790964068.796008:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1790964069.031144:0:32646:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3039 MB/s 00000001:01000000:3.0:1790964069.280876:0:32646:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1919 MB/s 00000001:01000000:2.0:1790964069.530962:0:32646:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 399 MB/s 00000001:01000000:1.0:1790964069.783092:0:32646:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 619 MB/s 00010000:00010000:0.0:1790964069.796031:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790964069.846594:0:32646:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790964069.846632:0:32646:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790964069.846635:0:32646:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790964069.849074:0:32655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790964069.849241:0:32646:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790964069.849337:0:32646:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1790964069.849542:0:32646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790964069.849635:0:32646:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790964069.850420:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964069.850750:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790964069.850757:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790964069.854622:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790964069.854636:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790964069.855617:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790964069.855626:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1790964069.865005:0:32660:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1790964069.865098:0:32646:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790964069.865119:0:32646:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.155@tcp' 00000020:01000004:1.0:1790964069.865121:0:32646:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790964069.865177:0:32646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.155@tcp (typ=mgc) 00000020:00000080:1.0:1790964069.865188:0:32646:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.155@tcp (00000000122008bd) 00000020:00000080:1.0:1790964069.865202:0:32646:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790964069.865281:0:32646:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dba633d2@MGC192.168.201.155@tcp: add connection 192.168.201.155@tcp at head 00010000:00010000:1.0:1790964069.865426:0:32646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.155@tcp-0 is initialized 00000040:01000000:1.0:1790964069.865432:0:32646:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790964069.872020:0:32661:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790964069.872496:0:32646:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.155@tcp (uuid 85a36975-6290-450b-9820-3830c7db4a1f) 00000020:00000080:1.0:1790964069.872521:0:32646:0:(genops.c:1385:class_connect()) connect: client 85a36975-6290-450b-9820-3830c7db4a1f, cookie 0x67c8b7dde5cd193a 00000100:00080000:1.0:1790964069.872544:0:32646:0:(import.c:545:import_select_connection()) MGC192.168.201.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964069.872550:0:32646:0:(import.c:665:import_select_connection()) MGC192.168.201.155@tcp: import 00000000dba633d2 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:1.0:1790964069.872582:0:32646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aac9f576 x1877961922838656/t0(0) o250->MGC192.168.201.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790964069.872658:0:31815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85a36975-6290-450b-9820-3830c7db4a1f:31815:1877961922838656:0@lo:250: 00000100:00100000:1.0:1790964069.872740:0:31815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964069.872810:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922838656 00000100:00080000:0.0:1790964069.872889:0:32646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 85a36975-6290-450b-9820-3830c7db4a1f->MGS 00000020:01000004:0.0:1790964069.872918:0:32646:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790964069.872924:0:32646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790964069.872944:0:32646:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000be008c5e) 00000020:00000080:0.0:1790964069.872981:0:32646:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790964069.873372:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922838656 00000100:00100000:1.0:1790964069.873413:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964069.873419:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f122e65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:31815:x1877961922838656:12345-0@lo:250: 00010000:00080000:1.0:1790964069.873441:0:32656:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 85a36975-6290-450b-9820-3830c7db4a1f@0@lo t0 exp 0000000000000000 cur 930 last 0 00000020:00000080:1.0:1790964069.873471:0:32656:0:(genops.c:1385:class_connect()) connect: client 85a36975-6290-450b-9820-3830c7db4a1f, cookie 0x67c8b7dde5cd1948 00000100:00080000:1.0:1790964069.873616:0:32656:0:(import.c:65:import_set_state_nolock()) 0000000006ff91dd : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790964069.873670:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f122e65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+5:31815:x1877961922838656:12345-0@lo:250: Request processed in 249us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964069.873677:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964069.873732:0:31815:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790964069.873741:0:31815:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.155@tcp: connect to target with instance 0 00000100:00080000:1.0:1790964069.873746:0:31815:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790964069.873750:0:31815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790964069.873753:0:31815:0:(import.c:65:import_set_state_nolock()) 00000000dba633d2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790964069.873755:0:31815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790964069.873763:0:31815:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790964069.873767:0:31815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85a36975-6290-450b-9820-3830c7db4a1f:31815:1877961922838656:0@lo:250: 00000100:00100000:0.0:1790964069.885507:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964069.895580:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790964069.895588:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790964069.905639:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790964069.905661:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790964069.915404:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790964069.915427:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790964069.918648:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964069.918904:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790964069.918911:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790964069.920368:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790964069.920379:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790964069.999952:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964070.005193:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790964070.005203:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790964070.017410:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790964070.017425:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790964070.018136:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964070.018647:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790964070.018653:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790964070.019365:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790964070.019373:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790964070.021277:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964070.021474:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790964070.021481:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790964070.022278:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790964070.022287:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790964070.029866:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964070.030310:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790964070.030317:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790964070.033071:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790964070.033092:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790964070.066743:0:32646:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964070.066983:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790964070.066990:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790964070.071744:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790964070.071763:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790964070.072675:0:32646:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790964070.072685:0:32646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790964070.073776:0:32646:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790964070.073799:0:32646:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790964070.073806:0:32646:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790964070.074171:0:32646:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790964070.074205:0:32646:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.155@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790964070.074348:0:32646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790964070.074350:0:32646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964070.074352:0:32646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964070.074353:0:32646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964070.074354:0:32646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964070.074355:0:32646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964070.074356:0:32646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964070.074358:0:32646:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964070.074359:0:32646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964070.074360:0:32646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790964070.074363:0:32646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790964070.074365:0:32646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790964070.074366:0:32646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964070.074367:0:32646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964070.074368:0:32646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964070.074369:0:32646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964070.074369:0:32646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964070.074370:0:32646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964070.074371:0:32646:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964070.074372:0:32646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964070.074372:0:32646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790964070.074406:0:32646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790964070.074424:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb081558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922838784:0@lo:253: 00000100:00100000:3.0:1790964070.074522:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964070.074604:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4067965 going to sleep for 11 seconds 00000100:00100000:1.0:1790964070.074655:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922838784 00000100:00100000:1.0:1790964070.074662:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922838784 00000100:00100000:1.0:1790964070.074752:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790964070.074768:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000088ee598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+5:32646:x1877961922838784:12345-0@lo:253: 20000000:01000000:1.0:1790964070.074811:0:32659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790964070.074814:0:32659:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790964070.074857:0:32659:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790964070.075205:0:32680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790964070.075734:0:32659:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1790964070.087045:0:32682:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790964070.087056:0:32682:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790964070.087059:0:32682:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 00000040:00080000:3.0:1790964070.087116:0:32682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 20000000:01000000:3.0:1790964070.087370:0:32659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790964070.087381:0:32659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790964070.125549:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000088ee598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+5:32646:x1877961922838784:12345-0@lo:253: Request processed in 50775us (51020us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964070.125570:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790964070.125581:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb081558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922838784:0@lo:253: 10000000:01000000:1.0:1790964070.125598:0:32646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790964070.125600:0:32646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790964070.125602:0:32646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964070.125604:0:32646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964070.125605:0:32646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964070.125606:0:32646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964070.125607:0:32646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964070.125691:0:32646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964070.125693:0:32646:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964070.125695:0:32646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964070.125696:0:32646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790964070.125716:0:32646:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000714ae1fe from lustre-MDT0000 10000000:01000000:1.0:1790964070.125742:0:32646:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790964070.125745:0:32646:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790964070.125749:0:32646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa074b5464d40 10000000:01000000:1.0:1790964070.125752:0:32646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790964070.125759:0:32646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa074b5464d40 from 1 10000000:01000000:1.0:1790964070.125762:0:32646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790964070.125796:0:32646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000905b8194/0x67c8b7dde5cd194f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.125806:0:32646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000905b8194/0x67c8b7dde5cd194f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.125814:0:32646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000905b8194/0x67c8b7dde5cd194f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.125871:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922838912:0@lo:101: 00000100:00100000:1.0:1790964070.125903:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964070.125951:0:32657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922838912 00000100:00100000:3.0:1790964070.125959:0:32657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922838912 00000100:00100000:3.0:1790964070.126266:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790964070.126276:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e811fd70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+5:32646:x1877961922838912:12345-0@lo:101: 00010000:00010000:3.0:1790964070.126289:0:32657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964070.126303:0:32657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085769c96/0x67c8b7dde5cd1956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67c8b7dde5cd194f expref: -99 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964070.126325:0:32657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085769c96/0x67c8b7dde5cd1956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x67c8b7dde5cd194f expref: 6 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964070.126335:0:32657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085769c96/0x67c8b7dde5cd1956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd194f expref: 6 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964070.126342:0:32657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085769c96, rc 0) 00000100:00100000:3.0:1790964070.126385:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e811fd70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+6:32646:x1877961922838912:12345-0@lo:101: Request processed in 112us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964070.126392:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790964070.126442:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f676aca8 going to sleep for 11 seconds 00000100:00100000:1.0:1790964070.126468:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922838912:0@lo:101: 00010000:00010000:1.0:1790964070.126481:0:32646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000905b8194/0x67c8b7dde5cd194f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1956 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.126489:0:32646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000905b8194/0x67c8b7dde5cd194f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x67c8b7dde5cd1956 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.126532:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839040:0@lo:501: 00000100:00100000:1.0:1790964070.126557:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.127249:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f676aca8 going to sleep for 11 seconds 00000100:00100000:0.0:1790964070.127253:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922839040 00000100:00100000:0.0:1790964070.127259:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922839040 00000100:00100000:0.0:1790964070.127331:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790964070.127338:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018864599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+6:32646:x1877961922839040:12345-0@lo:501: 00000100:00100000:0.0:1790964070.127601:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018864599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+6:32646:x1877961922839040:12345-0@lo:501: Request processed in 263us (1043us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790964070.127609:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790964070.127675:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839040:0@lo:501: 10000000:01000000:1.0:1790964070.127708:0:32646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790964070.127729:0:32646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 00000000905b8194/0x67c8b7dde5cd194f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1956 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.127738:0:32646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 00000000905b8194/0x67c8b7dde5cd194f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1956 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964070.127746:0:32646:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0748720b000 10000000:01000000:1.0:1790964070.127751:0:32646:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790964070.127755:0:32646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0748720b000 10000000:01000000:1.0:1790964070.127758:0:32646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790964070.127761:0:32646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0748720b000 from 1 10000000:01000000:1.0:1790964070.127770:0:32646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790964070.127793:0:32646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 000000001dd910cf/0x67c8b7dde5cd195d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.127800:0:32646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 000000001dd910cf/0x67c8b7dde5cd195d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.127808:0:32646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 000000001dd910cf/0x67c8b7dde5cd195d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.127847:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839168:0@lo:101: 00000100:00100000:1.0:1790964070.127878:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.128190:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f676aca8 going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.128311:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922839168 00000100:00100000:2.0:1790964070.128317:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922839168 00000100:00100000:2.0:1790964070.128355:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790964070.128361:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fda925b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+6:32646:x1877961922839168:12345-0@lo:101: 00010000:00010000:2.0:1790964070.128371:0:32656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790964070.128382:0:32656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000feb6e739/0x67c8b7dde5cd1964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67c8b7dde5cd195d expref: -99 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.128401:0:32656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000feb6e739/0x67c8b7dde5cd1964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x67c8b7dde5cd195d expref: 7 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.128410:0:32656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000feb6e739/0x67c8b7dde5cd1964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd195d expref: 7 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.128430:0:32656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000feb6e739, rc 0) 00000100:00100000:2.0:1790964070.128488:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fda925b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+7:32646:x1877961922839168:12345-0@lo:101: Request processed in 127us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.128494:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790964070.128644:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839168:0@lo:101: 00010000:00010000:1.0:1790964070.128655:0:32646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 000000001dd910cf/0x67c8b7dde5cd195d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1964 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.128663:0:32646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 000000001dd910cf/0x67c8b7dde5cd195d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x67c8b7dde5cd1964 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964070.128676:0:32646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790964070.128691:0:32646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 000000001dd910cf/0x67c8b7dde5cd195d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1964 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.128698:0:32646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 000000001dd910cf/0x67c8b7dde5cd195d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1964 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964070.128704:0:32646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790964070.128708:0:32646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790964070.128712:0:32646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0748720b000 10000000:01000000:1.0:1790964070.128721:0:32646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790964070.128725:0:32646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790964070.128727:0:32646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790964070.128745:0:32646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000e2cea7bd/0x67c8b7dde5cd196b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.128751:0:32646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000e2cea7bd/0x67c8b7dde5cd196b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.128757:0:32646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000e2cea7bd/0x67c8b7dde5cd196b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.128770:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839296:0@lo:101: 00000100:00100000:1.0:1790964070.128800:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.128814:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f676aca8 going to sleep for 11 seconds 00000100:00100000:0.0:1790964070.128885:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922839296 00000100:00100000:0.0:1790964070.128889:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922839296 00000100:00100000:0.0:1790964070.128912:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790964070.128919:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb43d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+7:32646:x1877961922839296:12345-0@lo:101: 00010000:00010000:0.0:1790964070.128927:0:32659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964070.128936:0:32659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbb14664/0x67c8b7dde5cd1972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x67c8b7dde5cd196b expref: -99 pid: 32659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964070.129414:0:32659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbb14664/0x67c8b7dde5cd1972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x67c8b7dde5cd196b expref: 8 pid: 32659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964070.129422:0:32659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbb14664/0x67c8b7dde5cd1972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd196b expref: 8 pid: 32659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964070.129428:0:32659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbb14664, rc 0) 00000100:00100000:0.0:1790964070.129486:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb43d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+8:32646:x1877961922839296:12345-0@lo:101: Request processed in 567us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964070.129493:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790964070.129587:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839296:0@lo:101: 00010000:00010000:1.0:1790964070.129600:0:32646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000e2cea7bd/0x67c8b7dde5cd196b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1972 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.129608:0:32646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000e2cea7bd/0x67c8b7dde5cd196b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x67c8b7dde5cd1972 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.129661:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839424:0@lo:501: 00000100:00100000:1.0:1790964070.129690:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.129717:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f676aca8 going to sleep for 11 seconds 00000100:00100000:0.0:1790964070.129770:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922839424 00000100:00100000:0.0:1790964070.129774:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922839424 00000100:00100000:0.0:1790964070.129792:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790964070.129798:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075286e81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+8:32646:x1877961922839424:12345-0@lo:501: 00000100:00100000:0.0:1790964070.130617:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075286e81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+9:32646:x1877961922839424:12345-0@lo:501: Request processed in 818us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964070.130627:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790964070.130752:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839424:0@lo:501: 00000100:00100000:1.0:1790964070.130785:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839552:0@lo:503: 00000100:00100000:1.0:1790964070.130917:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.131010:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f676aca8 going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.131194:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922839552 00000100:00100000:2.0:1790964070.131200:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922839552 00000100:00100000:2.0:1790964070.131280:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790964070.131288:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a7b89a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+9:32646:x1877961922839552:12345-0@lo:503: 00000100:00100000:2.0:1790964070.134302:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a7b89a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+9:32646:x1877961922839552:12345-0@lo:503: Request processed in 3008us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.134318:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790964070.134472:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922839552:0@lo:503: 00000100:00100000:3.0:1790964070.135300:0:32684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a833cbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32684:1877961922839680:0@lo:502: 00000100:00100000:3.0:1790964070.135362:0:32684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964070.135435:0:32684:0:(client.c:2716:ptlrpc_set_wait()) set 00000000067cd8ec going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.135492:0:32657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922839680 00000100:00100000:2.0:1790964070.135499:0:32657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922839680 00000100:00100000:2.0:1790964070.135575:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790964070.135585:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d712c66f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+9:32684:x1877961922839680:12345-0@lo:502: 00000100:00100000:2.0:1790964070.150675:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d712c66f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+9:32684:x1877961922839680:12345-0@lo:502: Request processed in 15082us (15303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.150692:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790964070.156463:0:32684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a833cbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32684:1877961922839680:0@lo:502: 00000020:01000000:3.0:1790964070.156524:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964070.156539:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964070.156542:0:32684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790964070.156550:0:32684:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790964070.156553:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964070.156585:0:32684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000de1dae69) 00000020:00000080:3.0:1790964070.156607:0:32684:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790964070.156619:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790964070.156757:0:32684:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790964070.156765:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x67c8b7dde5cd1980 00000020:00000080:3.0:1790964070.157520:0:32684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790964070.157527:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790964070.160938:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964070.161311:0:32684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790964070.161328:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790964070.161338:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964070.161339:0:32684:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790964070.161346:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790964070.161362:0:32684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000378bd5e5) 00000020:00000080:0.0:1790964070.161386:0:32684:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790964070.161392:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790964070.161393:0:32684:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790964070.161396:0:32684:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790964070.161405:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790964070.161509:0:32684:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000714ae1fe from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790964070.161524:0:32684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000765a9e46) 00000020:00000080:0.0:1790964070.161546:0:32684:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790964070.161604:0:32684:0:(lod_dev.c:2309:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790964070.161610:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x67c8b7dde5cd1995 00000020:00000080:0.0:1790964070.161745:0:32684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790964070.161751:0:32684:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790964070.161755:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x67c8b7dde5cd199c 00080000:01000000:0.0:1790964070.161760:0:32684:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790964070.161763:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x67c8b7dde5cd19a3 00010000:00010000:2.0:1790964070.241680:0:32684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790964070.243626:0:32684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934593 00000001:00080000:2.0:1790964070.244238:0:32684:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790964070.244926:0:32684:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005637fe38) 00000020:00000080:2.0:1790964070.245078:0:32684:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790964070.245222:0:32684:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790964070.245231:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x67c8b7dde5cd19b1 00000020:00000080:2.0:1790964070.246461:0:32684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790964070.266940:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x67c8b7dde5cd19b8 00000020:00000080:2.0:1790964070.269492:0:32684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790964070.269508:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790964070.269514:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964070.269516:0:32684:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790964070.269519:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790964070.269522:0:32684:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1790964070.269523:0:32684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790964070.269525:0:32684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790964070.269526:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790964070.269528:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964070.269529:0:32684:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790964070.269532:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790964070.269536:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964070.269538:0:32684:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790964070.269542:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790964070.269583:0:32684:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790964070.269599:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790964070.269602:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964070.269604:0:32684:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790964070.269606:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790964070.269608:0:32684:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790964070.269612:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964070.269613:0:32684:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790964070.269616:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790964070.269621:0:32684:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.155@tcp to nid 0x20000c0a8c99b (192.168.201.155@tcp) 00000020:01000000:2.0:1790964070.269646:0:32684:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790964070.269648:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790964070.269662:0:32684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (0000000020445ce7) 00000020:00000080:2.0:1790964070.269677:0:32684:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790964070.269682:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790964070.269751:0:32684:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790964070.269757:0:32684:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790964070.269771:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x67c8b7dde5cd19c6 00010000:00080000:2.0:1790964070.269802:0:32684:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000008e13ac7@lustre-OST0000-osc-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:2.0:1790964070.274478:0:32684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1790964070.277703:0:32684:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790964070.277783:0:32684:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790964070.294341:0:32684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790964070.295494:0:32684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790964070.295605:0:32684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1790964070.296285:0:32688:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790964070.296290:0:32688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790964070.300523:0:32684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790964070.300537:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790964070.300572:0:32684:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790964070.300591:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x67c8b7dde5cd19cd 00000100:00080000:1.0:1790964070.300601:0:32684:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964070.300606:0:32684:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 0000000008e13ac7 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:1.0:1790964070.300642:0:32684:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790964070.300674:0:32684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790964070.300729:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964070.300733:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964070.300735:0:32684:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790964070.300738:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790964070.300740:0:32684:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1790964070.300742:0:32684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790964070.300743:0:32684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790964070.300744:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790964070.300746:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964070.300747:0:32684:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790964070.300750:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790964070.300753:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964070.300754:0:32684:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790964070.300756:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790964070.300760:0:32684:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.155@tcp to nid 0x20000c0a8c99b (192.168.201.155@tcp) 00000020:00000080:1.0:1790964070.300782:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790964070.300792:0:32684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000bac67430) 00000020:00000080:1.0:1790964070.300802:0:32684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790964070.300806:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790964070.300895:0:32684:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790964070.300907:0:32684:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790964070.300913:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x67c8b7dde5cd19db 00010000:00080000:1.0:1790964070.300954:0:32684:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c787eafa@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.155@tcp at head 00000100:00100000:2.0:1790964070.301095:0:31815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31815:1877961922839808:0@lo:8: 00000400:00000100:2.0:1790964070.301158:0:31815:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877961922839808 offset 0 length 520: 4 00010000:00010000:0.0:1790964070.310234:0:32684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:0.0:1790964070.319093:0:32684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790964070.319109:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790964070.319166:0:32684:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790964070.319188:0:32684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x67c8b7dde5cd19e2 00000100:00080000:0.0:1790964070.319198:0:32684:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790964070.319202:0:32684:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c787eafa using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1790964070.319237:0:32684:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000051531b81 x1877961922839936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790964070.319263:0:32684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1790964070.319326:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790964070.319330:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964070.319331:0:32684:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790964070.319335:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790964070.319340:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964070.319341:0:32684:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790964070.319344:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790964070.319346:0:32684:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 00000100:00100000:0.0:1790964070.319374:0:32684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb3e4e85 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32684:1877961922840064:0@lo:502: 00000100:00100000:0.0:1790964070.319471:0:32684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964070.319534:0:32684:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c090afc going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.319755:0:31815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000051531b81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31815:1877961922839936:0@lo:38: 00000100:00100000:2.0:1790964070.319804:0:31815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964070.319872:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840064 00000100:00100000:2.0:1790964070.319878:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840064 00000100:00100000:2.0:1790964070.319927:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790964070.319936:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c601da27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+9:32684:x1877961922840064:12345-0@lo:502: 00000100:00100000:2.0:1790964070.320214:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c601da27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+9:32684:x1877961922840064:12345-0@lo:502: Request processed in 279us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.320222:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790964070.320377:0:32684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb3e4e85 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32684:1877961922840064:0@lo:502: 00000020:01000000:1.0:1790964070.320414:0:32684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964070.320420:0:32684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964070.320421:0:32684:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790964070.320426:0:32684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1790964070.321163:0:32646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:2.0:1790964070.321187:0:32646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790964070.321206:0:32646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 00000000e2cea7bd/0x67c8b7dde5cd196b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1972 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.321217:0:32646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 00000000e2cea7bd/0x67c8b7dde5cd196b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1972 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964070.321226:0:32646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0748720b000 from 1 10000000:01000000:2.0:1790964070.321229:0:32646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790964070.321258:0:32646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.321273:0:32646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.321281:0:32646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964070.321295:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea2559a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840192:0@lo:101: 00000100:00100000:2.0:1790964070.321332:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964070.321354:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011b71382 going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.321370:0:32657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840192 00000100:00100000:2.0:1790964070.321374:0:32657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840192 00000100:00100000:2.0:1790964070.321397:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790964070.321403:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019c1b720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+9:32646:x1877961922840192:12345-0@lo:101: 00010000:00010000:2.0:1790964070.321412:0:32657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790964070.321423:0:32657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67c8b7dde5cd19e9 expref: -99 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.321441:0:32657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 10 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.321461:0:32657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 10 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.321469:0:32657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dbe1df45, rc 0) 00000100:00100000:2.0:1790964070.321509:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019c1b720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+10:32646:x1877961922840192:12345-0@lo:101: Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.321515:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790964070.321594:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea2559a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840192:0@lo:101: 00010000:00010000:1.0:1790964070.321606:0:32646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.321614:0:32646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.322153:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840320:0@lo:256: 00000100:00100000:1.0:1790964070.322189:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.322207:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4792dfb going to sleep for 11 seconds 00000100:00100000:0.0:1790964070.322473:0:32669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922839936 00000100:00100000:0.0:1790964070.322479:0:32669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922839936 00000100:00100000:2.0:1790964070.322562:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840320 00000100:00100000:2.0:1790964070.322572:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840320 00000100:00100000:2.0:1790964070.322596:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790964070.322601:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afc03e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+10:32646:x1877961922840320:12345-0@lo:256: 20000000:01000000:2.0:1790964070.322615:0:32659:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790964070.322620:0:32659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790964070.322689:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afc03e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+10:32646:x1877961922840320:12345-0@lo:256: Request processed in 88us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.322696:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790964070.322756:0:32669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964070.322760:0:32669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a689382 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31815:x1877961922839936:12345-0@lo:38: 00010000:00020000:0.0:1790964070.322773:0:32669:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790964070.322816:0:32669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a689382 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31815:x1877961922839936:12345-0@lo:38: Request processed in 55us (3013us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790964070.322846:0:32669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790964070.322914:0:31815:0:(import.c:65:import_set_state_nolock()) 00000000c787eafa lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964070.322930:0:31815:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790964070.322933:0:31815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000051531b81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31815:1877961922839936:0@lo:38: 00000100:00100000:1.0:1790964070.323419:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840320:0@lo:256: 10000000:01000000:1.0:1790964070.324059:0:32646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790964070.324074:0:32646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.324084:0:32646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964070.324091:0:32646:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0748720b000 from 1 10000000:01000000:1.0:1790964070.324094:0:32646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790964070.324280:0:32646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000556f7483/0x67c8b7dde5cd19f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.324288:0:32646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000556f7483/0x67c8b7dde5cd19f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.324297:0:32646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000556f7483/0x67c8b7dde5cd19f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.324315:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840448:0@lo:101: 00000100:00100000:1.0:1790964070.324365:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.324390:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4792dfb going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.324480:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840448 00000100:00100000:2.0:1790964070.324486:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840448 00000100:00100000:2.0:1790964070.324520:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790964070.324526:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9485a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+10:32646:x1877961922840448:12345-0@lo:101: 00010000:00010000:2.0:1790964070.324537:0:32656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790964070.324550:0:32656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000872d8edd/0x67c8b7dde5cd19fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67c8b7dde5cd19f7 expref: -99 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.324570:0:32656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000872d8edd/0x67c8b7dde5cd19fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x67c8b7dde5cd19f7 expref: 11 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.324579:0:32656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000872d8edd/0x67c8b7dde5cd19fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd19f7 expref: 11 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.324587:0:32656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000872d8edd, rc 0) 00000100:00100000:2.0:1790964070.324629:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9485a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+11:32646:x1877961922840448:12345-0@lo:101: Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.324646:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790964070.326142:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840448:0@lo:101: 00010000:00010000:1.0:1790964070.326164:0:32646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000556f7483/0x67c8b7dde5cd19f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd19fe expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.326174:0:32646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000556f7483/0x67c8b7dde5cd19f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x67c8b7dde5cd19fe expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.326245:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840576:0@lo:501: 00000100:00100000:1.0:1790964070.326298:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.326326:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4792dfb going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.326468:0:32657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840576 00000100:00100000:2.0:1790964070.326475:0:32657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840576 00000100:00100000:2.0:1790964070.326514:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790964070.326521:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f7f75aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+11:32646:x1877961922840576:12345-0@lo:501: 00000100:00100000:2.0:1790964070.326937:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f7f75aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+11:32646:x1877961922840576:12345-0@lo:501: Request processed in 416us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.327216:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790964070.327834:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840576:0@lo:501: 00000100:00100000:1.0:1790964070.327877:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840704:0@lo:503: 00000100:00100000:1.0:1790964070.327925:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.327960:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4792dfb going to sleep for 11 seconds 00000100:00100000:3.0:1790964070.328053:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840704 00000100:00100000:3.0:1790964070.328059:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840704 00000100:00100000:3.0:1790964070.328092:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790964070.328099:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec77941b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+11:32646:x1877961922840704:12345-0@lo:503: 00000040:00080000:3.0:1790964070.328157:0:32659:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790964070.328212:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec77941b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+11:32646:x1877961922840704:12345-0@lo:503: Request processed in 113us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964070.328218:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790964070.328405:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840704:0@lo:503: 00000040:00080000:1.0:1790964070.329577:0:32692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790964070.329797:0:32646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790964070.329817:0:32646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790964070.329881:0:32646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 00000000556f7483/0x67c8b7dde5cd19f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd19fe expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.329892:0:32646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 00000000556f7483/0x67c8b7dde5cd19f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd19fe expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964070.329934:0:32646:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790964070.329937:0:32646:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0748720b000 10000000:01000000:2.0:1790964070.329940:0:32646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0748720b000 10000000:01000000:2.0:1790964070.329954:0:32646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790964070.329961:0:32646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0748720b000 from 1 10000000:01000000:2.0:1790964070.329964:0:32646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790964070.329994:0:32646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000018974ad/0x67c8b7dde5cd1a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.330001:0:32646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000018974ad/0x67c8b7dde5cd1a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.330009:0:32646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000018974ad/0x67c8b7dde5cd1a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964070.330033:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee6bc813 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840832:0@lo:101: 00000100:00100000:2.0:1790964070.330085:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964070.330118:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038982a2f going to sleep for 11 seconds 00000100:00100000:1.0:1790964070.330507:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840832 00000100:00100000:1.0:1790964070.330514:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840832 00000100:00100000:1.0:1790964070.330559:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790964070.330567:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e0ebf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+11:32646:x1877961922840832:12345-0@lo:101: 00010000:00010000:1.0:1790964070.330579:0:32656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964070.330592:0:32656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002338d520/0x67c8b7dde5cd1a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x67c8b7dde5cd1a05 expref: -99 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.330614:0:32656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002338d520/0x67c8b7dde5cd1a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x67c8b7dde5cd1a05 expref: 12 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.330625:0:32656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002338d520/0x67c8b7dde5cd1a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd1a05 expref: 12 pid: 32656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.330632:0:32656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002338d520, rc 0) 00000100:00100000:1.0:1790964070.330680:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e0ebf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+12:32646:x1877961922840832:12345-0@lo:101: Request processed in 114us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964070.330686:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790964070.330866:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee6bc813 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840832:0@lo:101: 00010000:00010000:0.0:1790964070.330879:0:32646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000018974ad/0x67c8b7dde5cd1a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1a0c expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964070.330887:0:32646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000018974ad/0x67c8b7dde5cd1a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x67c8b7dde5cd1a0c expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964070.330940:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032a7e326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840960:0@lo:501: 00000100:00100000:0.0:1790964070.330986:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964070.331005:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 000000006ff2ae5f going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.331380:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922840960 00000100:00100000:2.0:1790964070.331385:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922840960 00000100:00100000:2.0:1790964070.331422:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790964070.331428:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e4b9591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+12:32646:x1877961922840960:12345-0@lo:501: 00000100:00100000:2.0:1790964070.331693:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e4b9591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+12:32646:x1877961922840960:12345-0@lo:501: Request processed in 264us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.331701:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790964070.331791:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032a7e326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922840960:0@lo:501: 00000100:00100000:0.0:1790964070.331840:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032a7e326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922841088:0@lo:503: 00000100:00100000:0.0:1790964070.331879:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964070.331906:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 000000006ff2ae5f going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.332154:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922841088 00000100:00100000:2.0:1790964070.332159:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922841088 00000100:00100000:2.0:1790964070.332191:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790964070.332197:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000417e58b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+12:32646:x1877961922841088:12345-0@lo:503: 00000100:00100000:2.0:1790964070.332344:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000417e58b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+12:32646:x1877961922841088:12345-0@lo:503: Request processed in 147us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.332350:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790964070.332558:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032a7e326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922841088:0@lo:503: 00000100:00100000:1.0:1790964070.336890:0:32693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32693:1877961922841216:0@lo:502: 00000100:00100000:1.0:1790964070.336991:0:32693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.337042:0:32693:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4792dfb going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.337275:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922841216 00000100:00100000:2.0:1790964070.337284:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922841216 00000100:00100000:2.0:1790964070.337334:0:32659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790964070.337342:0:32659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045130f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+12:32693:x1877961922841216:12345-0@lo:502: 00000100:00100000:2.0:1790964070.337616:0:32659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045130f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85a36975-6290-450b-9820-3830c7db4a1f+12:32693:x1877961922841216:12345-0@lo:502: Request processed in 274us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964070.337624:0:32659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790964070.337767:0:32693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32693:1877961922841216:0@lo:502: 00000020:01000004:1.0:1790964070.337864:0:32693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790964070.337888:0:32693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000008fdb0a7) 00000020:00000080:1.0:1790964070.337908:0:32693:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1790964070.338010:0:32693:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000714ae1fe from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790964070.338015:0:32693:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000714ae1fe from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790964070.338017:0:32693:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000714ae1fe 4 00010000:00080000:1.0:1790964070.338047:0:32693:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009a50b310@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:1.0:1790964070.342579:0:32693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1790964070.342894:0:32693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790964070.342937:0:32693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790964070.343069:0:32693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x67c8b7dde5cd1a1a 00000100:00080000:1.0:1790964070.343080:0:32693:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964070.343085:0:32693:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009a50b310 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:1.0:1790964070.343121:0:32693:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000afed4eb x1877961922841344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790964070.343160:0:32693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790964070.345324:0:31815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31815:1877961922841344:0@lo:38: 00000100:00100000:3.0:1790964070.345411:0:31815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964070.345529:0:32664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922841344 00000100:00100000:3.0:1790964070.345537:0:32664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922841344 00000100:00100000:3.0:1790964070.345571:0:32664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964070.345577:0:32664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a833cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31815:x1877961922841344:12345-0@lo:38: 00000100:00100000:3.0:1790964070.345632:0:32664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a833cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31815:x1877961922841344:12345-0@lo:38: Request processed in 53us (222us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790964070.345639:0:32664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964070.345680:0:31815:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790964070.345688:0:31815:0:(import.c:65:import_set_state_nolock()) 000000009a50b310 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790964070.345692:0:31815:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790964070.345695:0:31815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000afed4eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31815:1877961922841344:0@lo:38: 00000100:00100000:3.0:1790964070.346553:0:32693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb081558 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32693:1877961922841472:0@lo:502: 00000100:00100000:3.0:1790964070.346604:0:32693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964070.346631:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922841472 00000100:00100000:3.0:1790964070.346636:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922841472 00000100:00100000:3.0:1790964070.346666:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790964070.346672:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f703343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+12:32693:x1877961922841472:12345-0@lo:502: 00000100:00100000:3.0:1790964070.346931:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f703343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+12:32693:x1877961922841472:12345-0@lo:502: Request processed in 259us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964070.346939:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790964070.349120:0:32693:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c130921 going to sleep for 11 seconds 00000100:00100000:3.0:1790964070.349220:0:32693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb081558 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85a36975-6290-450b-9820-3830c7db4a1f:32693:1877961922841472:0@lo:502: 00000040:00080000:3.0:1790964070.349256:0:32693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790964070.364114:0:32646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1790964070.364165:0:32646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790964070.364185:0:32646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 00000000018974ad/0x67c8b7dde5cd1a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1a0c expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.364199:0:32646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 00000000018974ad/0x67c8b7dde5cd1a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1a0c expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790964070.364260:0:32646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790964070.364263:0:32646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964070.364265:0:32646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964070.364266:0:32646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964070.364267:0:32646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964070.364268:0:32646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964070.364269:0:32646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964070.364271:0:32646:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964070.364272:0:32646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964070.364273:0:32646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790964070.364276:0:32646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790964070.364279:0:32646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790964070.364280:0:32646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964070.364281:0:32646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964070.364281:0:32646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964070.364286:0:32646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964070.364287:0:32646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964070.364288:0:32646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964070.364288:0:32646:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964070.364289:0:32646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964070.364290:0:32646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790964070.364313:0:32646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790964070.364328:0:32646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e0f5189 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922841600:0@lo:253: 00000100:00100000:1.0:1790964070.364407:0:32646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964070.364464:0:32646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006c0956e going to sleep for 11 seconds 00000100:00100000:2.0:1790964070.364766:0:32657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922841600 00000100:00100000:2.0:1790964070.364775:0:32657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922841600 00000100:00100000:2.0:1790964070.366073:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790964070.366090:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a17d4ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+12:32646:x1877961922841600:12345-0@lo:253: 20000000:01000000:2.0:1790964070.366124:0:32657:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790964070.366206:0:32657:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790964070.468969:0:32657:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790964070.468991:0:32657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790964070.469750:0:32680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790964070.469756:0:32680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790964070.469778:0:32680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.469797:0:32680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 12 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.469805:0:32680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.469878:0:32680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 12 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.469895:0:32680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 12 pid: 32657 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964070.469909:0:32680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004728da70 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32680:1877961922841728:0@lo:104: 00000100:00100000:2.0:1790964070.469992:0:32680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964070.470059:0:32680:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e9eafe7 going to sleep for 11 seconds 00000100:00100000:0.0:1790964070.470208:0:32647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922841728 00000100:00100000:0.0:1790964070.470228:0:32647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922841728 00000100:00100000:0.0:1790964070.470280:0:32647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964070.470287:0:32647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfca4515 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85a36975-6290-450b-9820-3830c7db4a1f+3:32680:x1877961922841728:12345-0@lo:104: 00010000:00010000:0.0:1790964070.470298:0:32647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964070.470342:0:32647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790964070.470347:0:32647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfca4515 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85a36975-6290-450b-9820-3830c7db4a1f+3:32680:x1877961922841728:12345-0@lo:104: Request processed in 61us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964070.470353:0:32647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790964070.470505:0:32652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790964070.470510:0:32652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.470517:0:32652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058573207 already unused, calling callback (0000000007fc7be9) 10000000:00010000:1.0:1790964070.470520:0:32652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.470527:0:32652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790964070.470532:0:32652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964070.470538:0:32652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790964070.470564:0:32652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.470570:0:32652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790964070.470582:0:32652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.470597:0:32652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: 0000000058573207/0x67c8b7dde5cd19e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x67c8b7dde5cd19f0 expref: -99 pid: 32646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.470612:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964070.470613:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964070.470615:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790964070.471212:0:31817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc95f102 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85a36975-6290-450b-9820-3830c7db4a1f:31817:1877961922841856:0@lo:103: 00000100:00100000:2.0:1790964070.471253:0:31817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964070.471368:0:32680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004728da70 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32680:1877961922841728:0@lo:104: 00010000:00010000:2.0:1790964070.471386:0:32680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.471523:0:32649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922841856 00000100:00100000:1.0:1790964070.471529:0:32649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922841856 00010000:00010000:1.0:1790964070.471551:0:32649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 13 pid: 32657 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.471585:0:32649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964070.471593:0:32649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e804b9bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85a36975-6290-450b-9820-3830c7db4a1f+13:31817:x1877961922841856:12345-0@lo:103: 00010000:00010000:1.0:1790964070.471603:0:32649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790964070.471607:0:32649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 13 pid: 32657 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471616:0:32649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 13 pid: 32657 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471630:0:32649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dbe1df45/0x67c8b7dde5cd19f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x67c8b7dde5cd19e9 expref: 13 pid: 32657 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471642:0:32649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471650:0:32649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790964070.471673:0:32649:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001918185s 00010000:00010000:1.0:1790964070.471677:0:32649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471684:0:32649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471689:0:32649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471695:0:32649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471700:0:32649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a5c92f7c already unused, calling callback (00000000f938a6ae) 00010000:00010000:1.0:1790964070.471703:0:32649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471710:0:32649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471720:0:32649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964070.471729:0:32649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790964070.471761:0:32649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e804b9bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85a36975-6290-450b-9820-3830c7db4a1f+12:31817:x1877961922841856:12345-0@lo:103: Request processed in 169us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964070.471768:0:32649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790964070.473364:0:31817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc95f102 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85a36975-6290-450b-9820-3830c7db4a1f:31817:1877961922841856:0@lo:103: 00010000:00010000:2.0:1790964070.473398:0:32680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.473407:0:32680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964070.473413:0:32680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a5c92f7c/0x67c8b7dde5cd1a21 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964070.494542:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a17d4ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+11:32646:x1877961922841600:12345-0@lo:253: Request processed in 128451us (130128us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964070.494558:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790964070.494686:0:32646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e0f5189 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85a36975-6290-450b-9820-3830c7db4a1f:32646:1877961922841600:0@lo:253: 10000000:01000000:0.0:1790964070.494702:0:32646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790964070.494705:0:32646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790964070.494707:0:32646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790964070.494708:0:32646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790964070.494709:0:32646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790964070.494710:0:32646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790964070.494711:0:32646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790964070.494712:0:32646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790964070.494714:0:32646:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790964070.494715:0:32646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790964070.494717:0:32646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790964070.494731:0:32646:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790964070.504336:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964070.504528:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964070.504817:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964070.505648:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964070.506360:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964070.506554:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964070.507574:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964070.507719:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964070.508372:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964070.508559:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964070.508933:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964070.509537:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:1.0:1790964070.552993:0:32646:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000004:02000000:1.0:1790964070.553001:0:32646:0:(lod_dev.c:733:lod_sub_init_llog()) *** cfs_fail_loc=2405, val=0*** 00000020:00080000:3.0:1790964070.558974:0:32700:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790964070.558983:0:32700:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790964070.560777:0:32701:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790964070.561379:0:32646:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1790964070.562509:0:32702:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@0000000005a758d4 x1877961922841984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964070.562522:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00000040:01000000:0.0:1790964070.564646:0:32646:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790964070.564778:0:32646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790964070.570548:0:32646:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790964070.570732:0:32646:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790964070.571094:0:32646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790964070.572061:0:32646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790964070.572583:0:32646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790964070.572616:0:32646:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790964070.572850:0:32646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964070.578519:0:32701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790964070.584799:0:32646:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000040:00080000:3.0:1790964070.586361:0:32701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790964070.586426:0:32701:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:2.0:1790964070.601710:0:32646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1790964070.675556:0:32646:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790964070.675598:0:32646:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbeae42b5f988 00100000:10000000:1.0:1790964070.675608:0:32646:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790964070.676865:0:32646:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790964070.676901:0:32646:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790964070.676922:0:32646:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790964070.676950:0:32646:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1790964070.823240:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964071.590199:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00010000:00010000:2.0:1790964071.849643:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790964072.614040:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00010000:00010000:0.0:1790964072.878104:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790964073.638741:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00010000:00010000:2.0:1790964073.893415:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790964074.662476:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00010000:00010000:3.0:1790964074.915954:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790964075.493176:0:31818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032a7e326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85a36975-6290-450b-9820-3830c7db4a1f:31818:1877961922842112:0@lo:400: 00000100:00100000:2.0:1790964075.493269:0:31818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790964075.493374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790964075.493380:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790964075.493384:0:36:0:(import.c:65:import_set_state_nolock()) 000000009a50b310 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790964075.493393:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009a50b310 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1790964075.493423:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000face1570 x1877961922842240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790964075.493455:0:31815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000face1570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31815:1877961922842240:0@lo:38: 00000100:00100000:0.0:1790964075.493506:0:31815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964075.493728:0:32656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922842112 00000100:00100000:3.0:1790964075.493736:0:32656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922842112 00000100:00100000:3.0:1790964075.493859:0:32656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790964075.493869:0:32656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a82b743b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+11:31818:x1877961922842112:12345-0@lo:400: 00000100:00100000:3.0:1790964075.493935:0:32656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a82b743b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85a36975-6290-450b-9820-3830c7db4a1f+11:31818:x1877961922842112:12345-0@lo:400: Request processed in 68us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964075.493953:0:32656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790964075.494036:0:31818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032a7e326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85a36975-6290-450b-9820-3830c7db4a1f:31818:1877961922842112:0@lo:400: 00000100:00100000:3.0:1790964075.498329:0:32666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922842240 00000100:00100000:3.0:1790964075.498345:0:32666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922842240 00000100:00100000:3.0:1790964075.498390:0:32666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790964075.498397:0:32666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d13e7a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:31815:x1877961922842240:12345-0@lo:38: 00010000:00080000:3.0:1790964075.498423:0:32666:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 936 last 0 00000020:00000080:3.0:1790964075.498459:0:32666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x67c8b7dde5cd1a28 00000004:00100000:3.0:1790964075.498546:0:32666:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790964075.498659:0:32666:0:(import.c:65:import_set_state_nolock()) 00000000ad4e078a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790964075.498792:0:32666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d13e7a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:31815:x1877961922842240:12345-0@lo:38: Request processed in 394us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964075.498800:0:32666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790964075.499434:0:31815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000face1570 x1877961922842240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790964075.499452:0:31815:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790964075.499460:0:31815:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790964075.499464:0:31815:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790964075.499466:0:31815:0:(import.c:65:import_set_state_nolock()) 000000009a50b310 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790964075.499472:0:31815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000face1570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31815:1877961922842240:0@lo:38: 00000100:00100000:3.0:1790964075.685590:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00000001:02000400:0.0:1790964075.753729:0:32944:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all 00000400:00000001:1.0:1790964075.795613:0:32946:0:(debug.c:305:cfs_str2mask()) Process entered 00010000:00000001:2.0:1790964075.970125:0:54:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964075.970132:0:54:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964075.970138:0:54:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964075.970139:0:54:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964075.970270:0:32652:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1790964075.970272:0:32652:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1790964075.970275:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:3.0:1790964076.296521:0:32959:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964076.296537:0:32959:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964076.296542:0:32959:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964076.516867:0:32647:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:0.0:1790964076.516875:0:32647:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964076.517003:0:32661:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:1.0:1790964076.517007:0:32661:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000be094547) refs 2 10000000:00000001:1.0:1790964076.517011:0:32661:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964076.517013:0:32661:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000001:1.0:1790964076.517014:0:32661:0:(mgc_request.c:120:config_log_put()) Process leaving 10000000:00000001:1.0:1790964076.517015:0:32661:0:(mgc_request.c:601:do_requeue()) Process entered 10000000:01000000:1.0:1790964076.517018:0:32661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:00000001:1.0:1790964076.517020:0:32661:0:(mgc_request.c:1783:mgc_process_log()) Process entered 10000000:01000000:1.0:1790964076.517021:0:32661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0748720b000 from 9 10000000:00000001:1.0:1790964076.517024:0:32661:0:(mgc_request.c:990:mgc_enqueue()) Process entered 10000000:01000000:1.0:1790964076.517026:0:32661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00000010:1.0:1790964076.517034:0:32661:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000b9295d5c. 00000020:00000040:1.0:1790964076.517038:0:32661:0:(genops.c:1210:class_import_get()) import 00000000dba633d2 refcount=4 obd=MGC192.168.201.155@tcp 00000100:00000001:1.0:1790964076.517043:0:32661:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964076.517047:0:32661:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964076.517051:0:32661:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964076.517058:0:32661:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000f3ed3a08. 00000100:00000001:1.0:1790964076.517065:0:32661:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964076.517070:0:32661:0:(ldlm_request.c:1064:ldlm_cli_enqueue()) Process entered 00010000:00000001:1.0:1790964076.517073:0:32661:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:1.0:1790964076.517081:0:32661:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 000000003d9f5da7. 00010000:00000001:1.0:1790964076.517093:0:32661:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:1.0:1790964076.517096:0:32661:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 00000000f8aba9d8. 00000020:00000001:1.0:1790964076.517100:0:32661:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:1.0:1790964076.517102:0:32661:0:(lustre_handles.c:93:class_handle_hash()) added object 00000000f8aba9d8 with handle 0x67c8b7dde5cd1a2f to hash 00000020:00000001:1.0:1790964076.517105:0:32661:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:1.0:1790964076.517106:0:32661:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000001:1.0:1790964076.517109:0:32661:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000001:1.0:1790964076.517112:0:32661:0:(ldlm_lock.c:261:ldlm_lock_remove_from_lru_check()) Process entered 00010000:00000001:1.0:1790964076.517116:0:32661:0:(ldlm_lock.c:280:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964076.517118:0:32661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000f8aba9d8/0x67c8b7dde5cd1a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964076.517128:0:32661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000f8aba9d8/0x67c8b7dde5cd1a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964076.517138:0:32661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000f8aba9d8/0x67c8b7dde5cd1a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000001:1.0:1790964076.517145:0:32661:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:1.0:1790964076.517147:0:32661:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:1.0:1790964076.517154:0:32661:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 00000000e17aac6e. 00000100:00000001:1.0:1790964076.517156:0:32661:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446639021045168192 : -105052664383424 : ffffa0748541b840) 00000100:00000001:1.0:1790964076.517159:0:32661:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964076.517160:0:32661:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639022059890304 : -105051649661312 : ffffa074c1bd2680) 00000100:00000001:1.0:1790964076.517165:0:32661:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964076.517167:0:32661:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517169:0:32661:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:1.0:1790964076.517171:0:32661:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964076.517180:0:32661:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.517189:0:32661:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964076.517191:0:32661:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964076.517195:0:32661:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964076.517204:0:32661:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964076.517206:0:32661:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964076.517210:0:32661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9295d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85a36975-6290-450b-9820-3830c7db4a1f:32661:1877961922842368:0@lo:101: 00000100:00000001:1.0:1790964076.517214:0:32661:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964076.517219:0:32661:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964076.517221:0:32661:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964076.517223:0:32661:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964076.517228:0:32661:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000020bbc1db. 02000000:00000001:1.0:1790964076.517230:0:32661:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964076.517236:0:32661:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000057c63f16. 00000400:00000010:1.0:1790964076.517244:0:32661:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007c9a6a8b. 00000100:00000200:1.0:1790964076.517251:0:32661:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961922842368, portal 25 00000100:00000001:1.0:1790964076.517253:0:32661:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964076.517254:0:32661:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639022059890304 : -105051649661312 : ffffa074c1bd2680) 00000100:00000040:1.0:1790964076.517259:0:32661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.517267:0:32661:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964076.517269:0:32661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964076.517272:0:32661:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002676d1c5. 00000100:00000200:1.0:1790964076.517275:0:32661:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1877961922842368, offset 0 00000400:00000200:1.0:1790964076.517281:0:32661:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964076.517295:0:32661:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964076.517306:0:32661:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 328 into portal 26 MB=0x6abff15500f00 00000400:00000200:1.0:1790964076.517311:0:32661:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 328/328 into md 0x165 [2] + 0 00000400:00000010:1.0:1790964076.517315:0:32661:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000006f6f01f6. 00000400:00000200:1.0:1790964076.517318:0:32661:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 0000000031e7f402 00000400:00000200:1.0:1790964076.517326:0:32661:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964076.517329:0:32661:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964076.517335:0:32661:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000031e7f402 00000400:00000010:1.0:1790964076.517337:0:32661:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 0000000031e7f402. 00000100:00000001:1.0:1790964076.517353:0:32661:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964076.517355:0:32661:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964076.517358:0:32661:0:(events.c:341:request_in_callback()) incoming req@00000000ba21e74e x1877961922842368 msgsize 328 00000100:00100000:1.0:1790964076.517362:0:32661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964076.517370:0:32661:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000020:00000010:0.0:1790964076.517459:0:32651:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000ed7d6cc6. 00000100:00000001:0.0:1790964076.517467:0:32651:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:0.0:1790964076.517468:0:32651:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517497:0:32661:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964076.517504:0:32661:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002676d1c5 00000400:00000010:1.0:1790964076.517506:0:32661:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002676d1c5. 00000100:00000001:1.0:1790964076.517509:0:32661:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964076.517512:0:32661:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.517522:0:32661:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964076.517525:0:32661:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.517531:0:32661:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517533:0:32661:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964076.517538:0:32661:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517542:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 0 is 4295604740 00000100:00000010:1.0:1790964076.517546:0:32661:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000772f4efc. 00000100:00000001:1.0:1790964076.517552:0:32661:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1790964076.517557:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 1 is 4295604740 00000100:00000010:1.0:1790964076.517560:0:32661:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000b9c13e1c. 00000100:00000001:1.0:1790964076.517563:0:32661:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 1 00000100:00000001:1.0:1790964076.517566:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 2 is 4295604740 00000100:00000010:1.0:1790964076.517569:0:32661:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000009bd15d88. 00000100:00000001:1.0:1790964076.517572:0:32661:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1790964076.517574:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 3 is 4295604740 00000100:00000010:1.0:1790964076.517577:0:32661:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000b655ac01. 00000100:00000001:1.0:1790964076.517580:0:32661:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1790964076.517582:0:32661:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964076.517585:0:32661:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517587:0:32661:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964076.517589:0:32661:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:1.0:1790964076.517591:0:32661:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e17aac6e going to sleep for 11 seconds 00000100:00000001:1.0:1790964076.517593:0:32661:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964076.517596:0:32661:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517620:0:32657:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964076.517623:0:32657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922842368 02000000:00000001:1.0:1790964076.517625:0:32657:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964076.517627:0:32657:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964076.517629:0:32657:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964076.517633:0:32657:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964076.517637:0:32657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922842368 00000020:00000001:1.0:1790964076.517639:0:32657:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964076.517641:0:32657:0:(genops.c:804:class_conn2export()) looking for export cookie 0x67c8b7dde5cd1948 00000020:00000001:1.0:1790964076.517643:0:32657:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964076.517646:0:32657:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000a02e7c3f refcount=11 00000020:00000001:1.0:1790964076.517648:0:32657:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021969041408 : -105051740510208 : ffffa074bc52e800) 00000020:00000001:1.0:1790964076.517651:0:32657:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446639021969041408 : -105051740510208 : ffffa074bc52e800) 00000100:00000001:1.0:1790964076.517654:0:32657:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964076.517657:0:32657:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000b4406c35. 00000100:00000001:1.0:1790964076.517660:0:32657:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964076.517662:0:32657:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000b4406c35. 00000020:00000010:1.0:1790964076.517667:0:32657:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000728a60fe. 00000020:00000010:1.0:1790964076.517672:0:32657:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 0000000089cb205d. 00000020:00000010:1.0:1790964076.517676:0:32657:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000046d37ea9. 00000100:00000040:1.0:1790964076.517685:0:32657:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964076.517688:0:32657:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964076.517689:0:32657:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964076.517691:0:32657:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517698:0:32657:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517744:0:32657:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964076.517752:0:32657:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964076.517754:0:32657:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964076.517757:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964076.517760:0:32657:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000a02e7c3f : new rpc_count 1 00000100:00000001:1.0:1790964076.517762:0:32657:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446639021109859408 : -105052599692208 : ffffa074891cd450) 00000100:00000040:1.0:1790964076.517767:0:32657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000ba21e74e x1877961922842368/t0(0) o101->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:652/0 lens 328/0 e 0 to 0 dl 1790964087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.517777:0:32657:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964076.517785:0:32657:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000b4406c35. 00000100:00000001:1.0:1790964076.517787:0:32657:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964076.517789:0:32657:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000b4406c35. 00000100:00100000:1.0:1790964076.517793:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba21e74e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+11:32661:x1877961922842368:12345-0@lo:101: 00000100:00000200:1.0:1790964076.517797:0:32657:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961922842368 00000020:00000001:1.0:1790964076.517801:0:32657:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964076.517804:0:32657:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964076.517806:0:32657:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.517807:0:31815:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000020:00000001:1.0:1790964076.517809:0:32657:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964076.517813:0:32657:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669366400 : -1040185216 : ffffffffc2000880) 00000020:00000001:1.0:1790964076.517816:0:32657:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964076.517818:0:32657:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.517833:0:31815:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964076.517836:0:31815:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.517839:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964076.517841:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964076.517843:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.517846:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964076.517851:0:32657:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964076.517855:0:32657:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964076.517859:0:32657:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964076.517861:0:32657:0:(tgt_handler.c:1471:tgt_enqueue()) Process entered 00010000:00000001:1.0:1790964076.517863:0:32657:0:(ldlm_lockd.c:1263:ldlm_handle_enqueue()) Process entered 00010000:00010000:1.0:1790964076.517865:0:32657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000001:1.0:1790964076.517867:0:32657:0:(ldlm_lockd.c:1725:ldlm_request_cancel()) Process entered 00010000:00000001:1.0:1790964076.517869:0:32657:0:(ldlm_lockd.c:1734:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964076.517874:0:32657:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:1.0:1790964076.517880:0:32657:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000602e6a13. 00010000:00000001:1.0:1790964076.517883:0:32657:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:1.0:1790964076.517885:0:32657:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 000000004e6ed811. 00000020:00000001:1.0:1790964076.517887:0:32657:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:1.0:1790964076.517889:0:32657:0:(lustre_handles.c:93:class_handle_hash()) added object 000000004e6ed811 with handle 0x67c8b7dde5cd1a36 to hash 00000020:00000001:1.0:1790964076.517890:0:32657:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:1.0:1790964076.517891:0:32657:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446639021738646016 : -105051970905600 : ffffa074ae975a00) 00010000:00000001:1.0:1790964076.517893:0:32657:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446639021738646016 : -105051970905600 : ffffa074ae975a00) 00010000:00010000:1.0:1790964076.517895:0:32657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e6ed811/0x67c8b7dde5cd1a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67c8b7dde5cd1a2f expref: -99 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1790964076.517902:0:32657:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export 00000000a02e7c3f : new locks_count 6 00000020:00000040:1.0:1790964076.517905:0:32657:0:(genops.c:868:class_export_get()) GET export 00000000a02e7c3f refcount=12 00000100:00000001:1.0:1790964076.517917:0:32657:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964076.517919:0:32657:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964076.517923:0:32657:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 640 at 0000000050148870. 02000000:00000001:1.0:1790964076.517925:0:32657:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.517927:0:32657:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964076.517929:0:32657:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:1.0:1790964076.517933:0:32657:0:(ldlm_lock.c:1758:ldlm_lock_enqueue_helper()) Process entered 00010000:00000001:1.0:1790964076.517934:0:32657:0:(ldlm_plain.c:119:ldlm_process_plain_lock()) Process entered 00010000:00000001:1.0:1790964076.517936:0:32657:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964076.517938:0:32657:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964076.517939:0:32657:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964076.517940:0:32657:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964076.517942:0:32657:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:1.0:1790964076.517944:0:32657:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:1.0:1790964076.517945:0:32657:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:1.0:1790964076.517947:0:32657:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:1.0:1790964076.517948:0:32657:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000602e6a13) refcount = 1 00010000:00010000:1.0:1790964076.517953:0:32657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e6ed811/0x67c8b7dde5cd1a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x67c8b7dde5cd1a2f expref: 12 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964076.517959:0:32657:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:1.0:1790964076.517961:0:32657:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:1.0:1790964076.517962:0:32657:0:(ldlm_plain.c:146:ldlm_process_plain_lock()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964076.517964:0:32657:0:(ldlm_lock.c:1769:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964076.517965:0:32657:0:(ldlm_lock.c:1928:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:1.0:1790964076.517969:0:32657:0:(ldlm_lockd.c:1494:ldlm_handle_enqueue()) Process leaving 00010000:00010000:1.0:1790964076.517971:0:32657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e6ed811/0x67c8b7dde5cd1a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x67c8b7dde5cd1a2f expref: 12 pid: 32657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964076.517977:0:32657:0:(ldlm_lock.c:2393:__ldlm_reprocess_all()) Process entered 00010000:00000001:1.0:1790964076.517979:0:32657:0:(ldlm_lock.c:1970:ldlm_reprocess_queue()) Process entered 00010000:00000001:1.0:1790964076.517981:0:32657:0:(ldlm_lock.c:2019:ldlm_reprocess_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964076.517983:0:32657:0:(ldlm_lock.c:2323:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964076.517985:0:32657:0:(ldlm_lock.c:2427:__ldlm_reprocess_all()) Process leaving 00010000:00000001:1.0:1790964076.517986:0:32657:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964076.517988:0:32657:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:1.0:1790964076.517989:0:32657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e6ed811, rc 0) 00000020:00000001:1.0:1790964076.517997:0:32657:0:(tgt_handler.c:1496:tgt_enqueue()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964076.518000:0:32657:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961922842368 00010000:00000001:1.0:1790964076.518002:0:32657:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964076.518007:0:32657:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000ba21e74e x1877961922842368/t0(0) o101->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:652/0 lens 328/344 e 0 to 0 dl 1790964087 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964076.518015:0:32657:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964076.518017:0:32657:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964076.518020:0:32657:0:(import.c:2195:obd_at_measure()) add 1 to 00000000f7baa2ca time=7 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964076.518024:0:32657:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964076.518026:0:32657:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 17 to 0@lo 00000100:00000001:1.0:1790964076.518028:0:32657:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 02000000:00000001:1.0:1790964076.518030:0:32657:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964076.518032:0:32657:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.518034:0:32657:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964076.518036:0:32657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964076.518039:0:32657:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002676d1c5. 00000100:00000200:1.0:1790964076.518042:0:32657:0:(niobuf.c:94:ptl_send_buf()) Sending 344 bytes to portal 25, xid 1877961922842368, offset 224 00000400:00000200:1.0:1790964076.518046:0:32657:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964076.518053:0:32657:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964076.518059:0:32657:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 344 into portal 25 MB=0x6abff15500f00 00000400:00000200:1.0:1790964076.518063:0:32657:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 344/344 into md 0xac5 [1] + 224 00000400:00000200:1.0:1790964076.518068:0:32657:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964076.518070:0:32657:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964076.518073:0:32657:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964076.518077:0:32657:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964076.518085:0:32657:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.518106:0:32657:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964076.518111:0:32657:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002676d1c5 00000400:00000010:1.0:1790964076.518113:0:32657:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002676d1c5. 00000100:00000001:1.0:1790964076.518115:0:32657:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964076.518116:0:32657:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964076.518125:0:32657:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964076.518128:0:32657:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 16 to 0@lo 00010000:00000001:1.0:1790964076.518130:0:32657:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964076.518131:0:32657:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964076.518133:0:32657:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964076.518136:0:32657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000ba21e74e x1877961922842368/t0(0) o101->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:652/0 lens 328/344 e 0 to 0 dl 1790964087 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964076.518143:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba21e74e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+12:32661:x1877961922842368:12345-0@lo:101: Request processed in 366us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964076.518149:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964076.518151:0:32657:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a02e7c3f : new rpc_count 0 00000100:00000001:1.0:1790964076.518154:0:32657:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964076.518155:0:32657:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964076.518159:0:32657:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 0000000089cb205d. 00000020:00000010:1.0:1790964076.518162:0:32657:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000046d37ea9. 00000020:00000010:1.0:1790964076.518165:0:32657:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000728a60fe. 00000020:00000040:1.0:1790964076.518168:0:32657:0:(genops.c:879:class_export_put()) PUTting export 00000000a02e7c3f : new refcount 11 02000000:00000001:1.0:1790964076.518172:0:32657:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964076.518174:0:32657:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 640 at 0000000050148870. 02000000:00000001:1.0:1790964076.518176:0:32657:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964076.518178:0:32657:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964076.518182:0:32657:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964076.518185:0:32657:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000abb26637. 00000400:00000010:1.0:1790964076.518190:0:32657:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 0000000019477f67. 00000100:00000001:3.0:1790964076.518297:0:32661:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964076.518303:0:32661:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964076.518306:0:32661:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964076.518307:0:32661:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000057c63f16. 00000400:00000200:3.0:1790964076.518311:0:32661:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007c9a6a8b 00000400:00000010:3.0:1790964076.518313:0:32661:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007c9a6a8b. 00000100:00000001:3.0:1790964076.518316:0:32661:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964076.518319:0:32661:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964076.518340:0:32661:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.518357:0:32661:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964076.518359:0:32661:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.518362:0:32661:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964076.518364:0:32661:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964076.518366:0:32661:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964076.518367:0:32661:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964076.518369:0:32661:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964076.518373:0:32661:0:(import.c:2195:obd_at_measure()) add 5 to 00000000b7619987 time=7 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964076.518376:0:32661:0:(import.c:2195:obd_at_measure()) add 1 to 0000000059b2f512 time=7 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964076.518379:0:32661:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964076.518381:0:32661:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964076.518383:0:32661:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1790964076.518385:0:32661:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.518387:0:32661:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964076.518390:0:32661:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.518397:0:32661:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964076.518399:0:32661:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964076.518401:0:32661:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964076.518404:0:32661:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964076.518411:0:32661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9295d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85a36975-6290-450b-9820-3830c7db4a1f:32661:1877961922842368:0@lo:101: 00000100:00000001:3.0:1790964076.518415:0:32661:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.518418:0:32661:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.518420:0:32661:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:3.0:1790964076.518421:0:32661:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964076.518423:0:32661:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.518429:0:32661:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964076.518431:0:32661:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 00000000e17aac6e. 00000100:00000001:3.0:1790964076.518439:0:32661:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:3.0:1790964076.518441:0:32661:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964076.518443:0:32661:0:(ldlm_request.c:661:ldlm_cli_enqueue_fini()) Process entered 00010000:00000001:3.0:1790964076.518446:0:32661:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964076.518447:0:32661:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964076.518449:0:32661:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000f8aba9d8 refcount=4 00000020:00000001:3.0:1790964076.518451:0:32661:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000001:3.0:1790964076.518454:0:32661:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000040:3.0:1790964076.518458:0:32661:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: 00000000f8aba9d8, remote cookie: 0x67c8b7dde5cd1a36, flags: 0x0 00010000:00000001:3.0:1790964076.518461:0:32661:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:3.0:1790964076.518463:0:32661:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:3.0:1790964076.518464:0:32661:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:3.0:1790964076.518465:0:32661:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:3.0:1790964076.518466:0:32661:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:3.0:1790964076.518468:0:32661:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (000000003d9f5da7) refcount = 1 00010000:00010000:3.0:1790964076.518470:0:32661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000f8aba9d8/0x67c8b7dde5cd1a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1a36 expref: -99 pid: 32661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964076.518477:0:32661:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:3.0:1790964076.518478:0:32661:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:3.0:1790964076.518480:0:32661:0:(ldlm_lock.c:1914:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:3.0:1790964076.518482:0:32661:0:(ldlm_request.c:286:ldlm_completion_ast()) Process entered 00010000:00000001:3.0:1790964076.518484:0:32661:0:(ldlm_request.c:295:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964076.518487:0:32661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000f8aba9d8/0x67c8b7dde5cd1a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x67c8b7dde5cd1a36 expref: -99 pid: 32661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964076.518493:0:32661:0:(ldlm_request.c:842:ldlm_cli_enqueue_fini()) Process leaving 00010000:00000001:3.0:1790964076.518495:0:32661:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964076.518496:0:32661:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964076.518497:0:32661:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964076.518498:0:32661:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964076.518499:0:32661:0:(ldlm_request.c:1218:ldlm_cli_enqueue()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.518501:0:32661:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964076.518503:0:32661:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000b9295d5c x1877961922842368/t0(0) o101->MGC192.168.201.155@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964092 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.518518:0:32661:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964076.518520:0:32661:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964076.518522:0:32661:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000020bbc1db. 02000000:00000001:3.0:1790964076.518525:0:32661:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964076.518526:0:32661:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964076.518528:0:32661:0:(genops.c:1223:class_import_put()) import 00000000dba633d2 refcount=3 obd=MGC192.168.201.155@tcp 00000020:00000001:3.0:1790964076.518530:0:32661:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964076.518531:0:32661:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000f3ed3a08. 02000000:00000001:3.0:1790964076.518534:0:32661:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964076.518536:0:32661:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964076.518537:0:32661:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000b9295d5c. 00000100:00000001:3.0:1790964076.518540:0:32661:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964076.518541:0:32661:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000001:3.0:1790964076.518544:0:32661:0:(mgc_request.c:1023:mgc_enqueue()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964076.518546:0:32661:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:3.0:1790964076.518548:0:32661:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000be094547) refs 3 10000000:00000001:3.0:1790964076.518550:0:32661:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964076.518552:0:32661:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964076.518553:0:32661:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964076.518554:0:32661:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000f8aba9d8 refcount=3 00000020:00000001:3.0:1790964076.518556:0:32661:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000001:3.0:1790964076.518558:0:32661:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000001:3.0:1790964076.518560:0:32661:0:(ldlm_lock.c:2547:ldlm_lock_set_data()) Process entered 00010000:00000001:3.0:1790964076.518562:0:32661:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964076.518563:0:32661:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964076.518564:0:32661:0:(ldlm_lock.c:2556:ldlm_lock_set_data()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964076.518566:0:32661:0:(mgc_request.c:1520:mgc_process_recover_log()) Process entered 10000000:00000010:3.0:1790964076.518569:0:32661:0:(mgc_request.c:1532:mgc_process_recover_log()) kmalloced '(folios)': 32 at 00000000e6d6c99f. 00000100:00000010:3.0:1790964076.518584:0:32661:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000bb081558. 00000020:00000040:3.0:1790964076.518587:0:32661:0:(genops.c:1210:class_import_get()) import 00000000dba633d2 refcount=4 obd=MGC192.168.201.155@tcp 00000100:00000001:3.0:1790964076.518590:0:32661:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964076.518593:0:32661:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964076.518596:0:32661:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964076.518600:0:32661:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 0000000060123c41. 00000100:00000001:3.0:1790964076.518604:0:32661:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.518613:0:32661:0:(client.c:227:ptlrpc_prep_bulk_imp()) Process entered 00000100:00000010:3.0:1790964076.518616:0:32661:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 0000000037694522. 00000100:00000010:3.0:1790964076.518619:0:32661:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 64 at 000000005494a1a6. 00000020:00000040:3.0:1790964076.518622:0:32661:0:(genops.c:1210:class_import_get()) import 00000000dba633d2 refcount=5 obd=MGC192.168.201.155@tcp 00000100:00000001:3.0:1790964076.518626:0:32661:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:3.0:1790964076.518627:0:32661:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:3.0:1790964076.518631:0:32661:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 0000000050403aca. 00000100:00000001:3.0:1790964076.518632:0:32661:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446639021065878336 : -105052643673280 : ffffa074867dbb40) 00000100:00000001:3.0:1790964076.518635:0:32661:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964076.518636:0:32661:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639021748522496 : -105051961029120 : ffffa074af2e0e00) 00000100:00000001:3.0:1790964076.518639:0:32661:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964076.518640:0:32661:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.518642:0:32661:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:3.0:1790964076.518643:0:32661:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964076.518646:0:32661:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.518652:0:32661:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964076.518654:0:32661:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964076.518656:0:32661:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964076.518658:0:32661:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964076.518660:0:32661:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964076.518662:0:32661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb081558 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85a36975-6290-450b-9820-3830c7db4a1f:32661:1877961922842496:0@lo:256: 00000100:00000001:3.0:1790964076.518665:0:32661:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964076.518668:0:32661:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964076.518670:0:32661:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.518672:0:32661:0:(niobuf.c:346:ptlrpc_register_bulk()) Process entered 00000400:00000010:3.0:1790964076.518677:0:32661:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000005f093520. 00000400:00000010:3.0:1790964076.518681:0:32661:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at 000000009889095e. 00000100:00000200:3.0:1790964076.518699:0:32661:0:(niobuf.c:453:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 4 pages 16384 bytes, mbits x0x6abff15500f80-0x6abff15500f80, portal 33 00000100:00000001:3.0:1790964076.518703:0:32661:0:(niobuf.c:455:ptlrpc_register_bulk()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964076.518705:0:32661:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964076.518708:0:32661:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000d8d1822a. 02000000:00000001:3.0:1790964076.518710:0:32661:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964076.518713:0:32661:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000862a5b10. 00000400:00000010:3.0:1790964076.518722:0:32661:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000038ed8b00. 00000100:00000200:3.0:1790964076.518725:0:32661:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961922842496, portal 25 00000100:00000001:3.0:1790964076.518727:0:32661:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964076.518728:0:32661:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639021748522496 : -105051961029120 : ffffa074af2e0e00) 00000100:00000040:3.0:1790964076.518732:0:32661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.518738:0:32661:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964076.518740:0:32661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964076.518741:0:32661:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000034b29436. 00000100:00000200:3.0:1790964076.518743:0:32661:0:(niobuf.c:94:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1877961922842496, offset 0 00000400:00000200:3.0:1790964076.518747:0:32661:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964076.518755:0:32661:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964076.518773:0:32661:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 304 into portal 26 MB=0x6abff15500f80 00000400:00000200:3.0:1790964076.518778:0:32661:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 304/304 into md 0x169 [2] + 0 00000400:00000010:3.0:1790964076.518780:0:32661:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000033aaa720. 00000400:00000200:3.0:1790964076.518783:0:32661:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 0000000042906f39 00000400:00000200:3.0:1790964076.518787:0:32661:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964076.518789:0:32661:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964076.518792:0:32661:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000042906f39 00000400:00000010:3.0:1790964076.518794:0:32661:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 0000000042906f39. 00000100:00000001:3.0:1790964076.518796:0:32661:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964076.518797:0:32661:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:3.0:1790964076.518800:0:32661:0:(events.c:341:request_in_callback()) incoming req@000000009082410c x1877961922842496 msgsize 304 00000100:00100000:3.0:1790964076.518803:0:32661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1790964076.518805:0:32661:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:0.0:1790964076.519186:0:32659:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000001:1.0:1790964076.519358:0:32657:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000001:3.0:1790964076.519613:0:32661:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964076.519622:0:32661:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000034b29436 00000400:00000010:3.0:1790964076.519625:0:32661:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000034b29436. 00000100:00000001:3.0:1790964076.519628:0:32661:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964076.519632:0:32661:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.519640:0:32661:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964076.519642:0:32661:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964076.519651:0:32659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922842496 02000000:00000001:0.0:1790964076.519655:0:32659:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964076.519659:0:32659:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964076.519662:0:32659:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.519663:0:32661:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.519666:0:32661:0:(events.c:69:request_out_callback()) Process leaving 02000000:00000001:0.0:1790964076.519667:0:32659:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964076.519671:0:32659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922842496 00000100:00000001:3.0:1790964076.519673:0:32661:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964076.519674:0:32659:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964076.519677:0:32659:0:(genops.c:804:class_conn2export()) looking for export cookie 0x67c8b7dde5cd1948 00000100:00000001:3.0:1790964076.519678:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 0 is 4295604743 00000020:00000001:0.0:1790964076.519681:0:32659:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964076.519684:0:32659:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000a02e7c3f refcount=12 00000020:00000001:0.0:1790964076.519694:0:32659:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021969041408 : -105051740510208 : ffffa074bc52e800) 00000020:00000001:0.0:1790964076.519697:0:32659:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446639021969041408 : -105051740510208 : ffffa074bc52e800) 00000100:00000001:3.0:1790964076.519699:0:32661:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4295604740 00000100:00000001:0.0:1790964076.519701:0:32659:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:3.0:1790964076.519705:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 1 is 4295604743 00000020:00000010:0.0:1790964076.519706:0:32659:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000ecc2a45c. 00000100:00000001:3.0:1790964076.519709:0:32661:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295604740 00000100:00000001:0.0:1790964076.519710:0:32659:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964076.519715:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 2 is 4295604743 00000020:00000010:0.0:1790964076.519716:0:32659:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000ecc2a45c. 00000100:00000001:3.0:1790964076.519722:0:32661:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4295604740 00000020:00000010:0.0:1790964076.519725:0:32659:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c301081c. 00000100:00000001:3.0:1790964076.519726:0:32661:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 3 is 4295604743 00000100:00000001:3.0:1790964076.519731:0:32661:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4295604740 00000020:00000010:0.0:1790964076.519733:0:32659:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000cdb5c14a. 00000100:00000001:3.0:1790964076.519734:0:32661:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964076.519739:0:32661:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964076.519740:0:32659:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000008e08f4d1. 00000100:00000001:3.0:1790964076.519742:0:32661:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964076.519745:0:32661:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:3.0:1790964076.519748:0:32661:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050403aca going to sleep for 11 seconds 00000100:00000001:3.0:1790964076.519751:0:32661:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000040:0.0:1790964076.519752:0:32659:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:3.0:1790964076.519754:0:32661:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964076.519756:0:32659:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964076.519759:0:32659:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964076.519761:0:32659:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964076.519768:0:32659:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.519792:0:32657:0:(service.c:2287:ptlrpc_server_handle_req_in()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.519803:0:32657:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964076.519805:0:32657:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964076.519808:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00000040:1.0:1790964076.519811:0:32657:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000a02e7c3f : new rpc_count 1 00000100:00000001:1.0:1790964076.519813:0:32657:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446639021109856336 : -105052599695280 : ffffa074891cc850) 00000100:00000040:1.0:1790964076.519817:0:32657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000009082410c x1877961922842496/t0(0) o256->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:652/0 lens 304/0 e 0 to 0 dl 1790964087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.519976:0:32657:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964076.519977:0:32657:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000b4406c35. 00000100:00000001:1.0:1790964076.519979:0:32657:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964076.519981:0:32657:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000b4406c35. 00000100:00100000:1.0:1790964076.519985:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009082410c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+12:32661:x1877961922842496:12345-0@lo:256: 00000100:00000200:1.0:1790964076.519989:0:32657:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961922842496 00000020:00000001:1.0:1790964076.519991:0:32657:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964076.519994:0:32657:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964076.519995:0:32657:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964076.519998:0:32657:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964076.519999:0:32657:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669366816 : -1040184800 : ffffffffc2000a20) 00000020:00000001:1.0:1790964076.520002:0:32657:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964076.520004:0:32657:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964076.520005:0:32657:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964076.520007:0:32657:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964076.520010:0:32657:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.520014:0:32657:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964076.520016:0:32657:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964076.520019:0:32657:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 536 at 0000000050148870. 02000000:00000001:1.0:1790964076.520021:0:32657:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.520023:0:32657:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 20000000:00000001:1.0:1790964076.520025:0:32657:0:(mgs_handler.c:690:mgs_config_read()) Process entered 20000000:00000001:1.0:1790964076.520029:0:32657:0:(mgs_nids.c:889:mgs_get_ir_logs()) Process entered 20000000:01000000:1.0:1790964076.520032:0:32657:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000010:1.0:1790964076.520034:0:32657:0:(mgs_nids.c:917:mgs_get_ir_logs()) kmalloced '(folios)': 32 at 0000000023ff8c09. 20000000:00000001:1.0:1790964076.520037:0:32657:0:(mgs_nids.c:188:mgs_nidtbl_read()) Process entered 20000000:00000040:1.0:1790964076.520046:0:32657:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1790964076.520052:0:32657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790964076.520055:0:32657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 20000000:00000001:1.0:1790964076.520057:0:32657:0:(mgs_nids.c:321:mgs_nidtbl_read()) Process leaving (rc=44 : 44 : 2c) 00000100:00000001:1.0:1790964076.520059:0:32657:0:(niobuf.c:145:ptlrpc_prep_bulk_exp()) Process entered 00000100:00000010:1.0:1790964076.520062:0:32657:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 00000000a3df9e13. 00000100:00000010:1.0:1790964076.520065:0:32657:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 16 at 000000007aa582c8. 00000020:00000040:1.0:1790964076.520071:0:32657:0:(genops.c:868:class_export_get()) GET export 00000000a02e7c3f refcount=13 00010000:00000001:1.0:1790964076.520075:0:32657:0:(ldlm_lib.c:3582:target_bulk_io()) Process entered 00000100:00000001:1.0:1790964076.520078:0:32657:0:(niobuf.c:184:ptlrpc_start_bulk_transfer()) Process entered 00000400:00000010:1.0:1790964076.520081:0:32657:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002676d1c5. 00000400:00000010:1.0:1790964076.520087:0:32657:0:(lib-lnet.h:449:lnet_rspt_alloc()) alloc 'rspt': 64 at 000000008303d6cf. 00000400:00000200:1.0:1790964076.520091:0:32657:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964076.520100:0:32657:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964076.520108:0:32657:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 44 into portal 33 MB=0x6abff15500f80 00000400:00000200:1.0:1790964076.520113:0:32657:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 21 from 12345-0@lo of length 44/44 into md 0xad5 [4] + 0 00000400:00000010:1.0:1790964076.520116:0:32657:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000005f093520. 00000400:00000200:1.0:1790964076.520119:0:32657:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000009889095e 00000400:00000200:1.0:1790964076.520123:0:32657:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964076.520126:0:32657:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964076.520129:0:32657:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009889095e 00000400:00000010:1.0:1790964076.520130:0:32657:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 184 at 000000009889095e. 00000100:00000001:1.0:1790964076.520134:0:32657:0:(events.c:177:client_bulk_callback()) Process entered 00000100:00000200:1.0:1790964076.520135:0:32657:0:(events.c:195:client_bulk_callback()) event type 2, status 0, req 00000000bb081558 desc 0000000037694522 mbits 1877961922842496 00000100:00000001:1.0:1790964076.520150:0:32657:0:(events.c:220:client_bulk_callback()) Process leaving 00000400:00000200:1.0:1790964076.520153:0:32657:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md 0000000000000000 with offset 0 00000400:00000200:1.0:1790964076.520158:0:32657:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : ACK - for me 00000400:00000200:1.0:1790964076.520163:0:32657:0:(lib-move.c:4532:lnet_parse_ack()) 0@lo: ACK from 12345-0@lo into md 0xae1 00000400:00000200:1.0:1790964076.520166:0:32657:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964076.520169:0:32657:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: ACK: OK 00000100:00000001:1.0:1790964076.520172:0:32657:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:1.0:1790964076.520173:0:32657:0:(events.c:464:server_bulk_callback()) event type 4, status 0, desc 00000000a3df9e13 00000100:00000001:1.0:1790964076.520175:0:32657:0:(events.c:491:server_bulk_callback()) Process leaving 00000400:00000200:1.0:1790964076.520180:0:32657:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002676d1c5 00000400:00000010:1.0:1790964076.520181:0:32657:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002676d1c5. 00000100:00000001:1.0:1790964076.520183:0:32657:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:1.0:1790964076.520184:0:32657:0:(events.c:464:server_bulk_callback()) event type 5, status 0, desc 00000000a3df9e13 00000100:00000001:1.0:1790964076.520185:0:32657:0:(events.c:491:server_bulk_callback()) Process leaving 00000100:00000200:1.0:1790964076.520188:0:32657:0:(niobuf.c:279:ptlrpc_start_bulk_transfer()) Transferring 1 pages 44 bytes via portal 33 id 12345-0@lo mbits 0x6abff15500f80-0x6abff15500f80 00000100:00000001:1.0:1790964076.520190:0:32657:0:(niobuf.c:281:ptlrpc_start_bulk_transfer()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964076.520193:0:32657:0:(ldlm_lib.c:3674:target_bulk_io()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.520195:0:32657:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000040:1.0:1790964076.520200:0:32657:0:(genops.c:879:class_export_put()) PUTting export 00000000a02e7c3f : new refcount 12 00000100:00000010:1.0:1790964076.520202:0:32657:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 16 at 000000007aa582c8. 00000100:00000010:1.0:1790964076.520204:0:32657:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 00000000a3df9e13. 00000100:00000001:1.0:1790964076.520206:0:32657:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 20000000:00000001:1.0:1790964076.520207:0:32657:0:(mgs_nids.c:953:mgs_get_ir_logs()) Process leaving via out (rc=0 : 0 : 0x0) 20000000:00000010:1.0:1790964076.520212:0:32657:0:(mgs_nids.c:964:mgs_get_ir_logs()) kvfree 'folios': 32 at 0000000023ff8c09. 20000000:00000001:1.0:1790964076.520213:0:32657:0:(mgs_handler.c:713:mgs_config_read()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964076.520216:0:32657:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961922842496 00010000:00000001:1.0:1790964076.520217:0:32657:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964076.520220:0:32657:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000009082410c x1877961922842496/t0(0) o256->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:652/0 lens 304/240 e 0 to 0 dl 1790964087 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964076.520225:0:32657:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964076.520226:0:32657:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964076.520228:0:32657:0:(import.c:2195:obd_at_measure()) add 1 to 00000000f7baa2ca time=7 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964076.520231:0:32657:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964076.520232:0:32657:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 17 to 0@lo 00000100:00000001:1.0:1790964076.520234:0:32657:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 02000000:00000001:1.0:1790964076.520235:0:32657:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964076.520237:0:32657:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964076.520239:0:32657:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964076.520240:0:32657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964076.520241:0:32657:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002676d1c5. 00000100:00000200:1.0:1790964076.520243:0:32657:0:(niobuf.c:94:ptl_send_buf()) Sending 240 bytes to portal 25, xid 1877961922842496, offset 224 00000400:00000200:1.0:1790964076.520245:0:32657:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964076.520248:0:32657:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964076.520251:0:32657:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 240 into portal 25 MB=0x6abff15500f80 00000400:00000200:1.0:1790964076.520254:0:32657:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 240/240 into md 0xad9 [1] + 224 00000400:00000200:1.0:1790964076.520257:0:32657:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964076.520259:0:32657:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964076.520261:0:32657:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964076.520262:0:32657:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964076.520267:0:32657:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964076.520278:0:32657:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964076.520280:0:32657:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002676d1c5 00000400:00000010:1.0:1790964076.520281:0:32657:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002676d1c5. 00000100:00000001:1.0:1790964076.520283:0:32657:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964076.520284:0:32657:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964076.520285:0:32657:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964076.520287:0:32657:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 16 to 0@lo 00010000:00000001:1.0:1790964076.520288:0:32657:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964076.520289:0:32657:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964076.520291:0:32657:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964076.520292:0:32657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000009082410c x1877961922842496/t0(0) o256->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:652/0 lens 304/240 e 0 to 0 dl 1790964087 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964076.520297:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009082410c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+12:32661:x1877961922842496:12345-0@lo:256: Request processed in 322us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964076.520302:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00000040:1.0:1790964076.520304:0:32657:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a02e7c3f : new rpc_count 0 00000100:00000001:1.0:1790964076.520305:0:32657:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964076.520306:0:32657:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964076.520309:0:32657:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000cdb5c14a. 00000020:00000010:1.0:1790964076.520311:0:32657:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000008e08f4d1. 00000020:00000010:1.0:1790964076.520313:0:32657:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c301081c. 00000020:00000040:1.0:1790964076.520315:0:32657:0:(genops.c:879:class_export_put()) PUTting export 00000000a02e7c3f : new refcount 11 02000000:00000001:1.0:1790964076.520318:0:32657:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964076.520319:0:32657:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 536 at 0000000050148870. 02000000:00000001:1.0:1790964076.520321:0:32657:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964076.520322:0:32657:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964076.520324:0:32657:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964076.520326:0:32657:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000002c28f780. 00000400:00000010:1.0:1790964076.520330:0:32657:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000e17aac6e. 00000100:00000001:0.0:1790964076.520584:0:32659:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.520917:0:32661:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964076.520923:0:32661:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964076.520924:0:32661:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964076.520926:0:32661:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000862a5b10. 00000400:00000200:3.0:1790964076.520929:0:32661:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000038ed8b00 00000400:00000010:3.0:1790964076.520930:0:32661:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000038ed8b00. 00000100:00000001:3.0:1790964076.520933:0:32661:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964076.520936:0:32661:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964076.520943:0:32661:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.520948:0:32661:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964076.520950:0:32661:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.520960:0:32661:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964076.521492:0:32661:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964076.521496:0:32661:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964076.521498:0:32661:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964076.521500:0:32661:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964076.521505:0:32661:0:(import.c:2195:obd_at_measure()) add 5 to 00000000b7619987 time=7 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964076.521509:0:32661:0:(import.c:2195:obd_at_measure()) add 1 to 0000000059b2f512 time=7 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964076.521511:0:32661:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964076.521513:0:32661:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964076.521515:0:32661:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1790964076.521517:0:32661:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.521520:0:32661:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964076.521523:0:32661:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964076.521532:0:32661:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.521538:0:32661:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964076.521539:0:32661:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964076.521541:0:32661:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964076.521547:0:32661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb081558 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85a36975-6290-450b-9820-3830c7db4a1f:32661:1877961922842496:0@lo:256: 00000100:00000001:3.0:1790964076.521550:0:32661:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.521553:0:32661:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.521555:0:32661:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:3.0:1790964076.521556:0:32661:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964076.521558:0:32661:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.521563:0:32661:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964076.521565:0:32661:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 0000000050403aca. 00000100:00000001:3.0:1790964076.521568:0:32661:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:3.0:1790964076.521570:0:32661:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 10000000:00000040:3.0:1790964076.521574:0:32661:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 9, more 0. 10000000:00000001:3.0:1790964076.521577:0:32661:0:(mgc_request.c:1308:mgc_apply_recover_logs()) Process entered 10000000:00000010:3.0:1790964076.521587:0:32661:0:(mgc_request.c:1331:mgc_apply_recover_logs()) kmalloced '(nidlist)': 640 at 00000000f72e144e. 10000000:00000010:3.0:1790964076.521591:0:32661:0:(mgc_request.c:1343:mgc_apply_recover_logs()) kmalloced '(obdname)': 128 at 0000000022a2f4b1. 10000000:00000200:3.0:1790964076.521594:0:32661:0:(mgc_request.c:1241:mgc_build_nidlist()) use 1 from 1 NIDs 10000000:00000040:3.0:1790964076.521597:0:32661:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-MDT0000-mdc-MDT0000 10000000:00000040:3.0:1790964076.521603:0:32661:0:(mgc_request.c:1445:mgc_apply_recover_logs()) MGC192.168.201.155@tcp: cannot find OBD lustre-MDT0000-mdc-MDT0000 10000000:00000010:3.0:1790964076.521605:0:32661:0:(mgc_request.c:1492:mgc_apply_recover_logs()) kfreed 'obdname': 128 at 0000000022a2f4b1. 10000000:00000010:3.0:1790964076.521607:0:32661:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'nidlist': 640 at 00000000f72e144e. 10000000:00000001:3.0:1790964076.521610:0:32661:0:(mgc_request.c:1496:mgc_apply_recover_logs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964076.521612:0:32661:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964076.521614:0:32661:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000bb081558 x1877961922842496/t0(0) o256->MGC192.168.201.155@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964092 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964076.521621:0:32661:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964076.521623:0:32661:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964076.521625:0:32661:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000d8d1822a. 02000000:00000001:3.0:1790964076.521630:0:32661:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964076.521632:0:32661:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964076.521634:0:32661:0:(genops.c:1223:class_import_put()) import 00000000dba633d2 refcount=4 obd=MGC192.168.201.155@tcp 00000020:00000001:3.0:1790964076.521635:0:32661:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000001:3.0:1790964076.521637:0:32661:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000001:3.0:1790964076.521638:0:32661:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964076.521639:0:32661:0:(genops.c:1223:class_import_put()) import 00000000dba633d2 refcount=3 obd=MGC192.168.201.155@tcp 00000020:00000001:3.0:1790964076.521641:0:32661:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000010:3.0:1790964076.521642:0:32661:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 64 at 000000005494a1a6. 00000100:00000010:3.0:1790964076.521645:0:32661:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 0000000037694522. 00000100:00000001:3.0:1790964076.521647:0:32661:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 02000000:00000010:3.0:1790964076.521648:0:32661:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 0000000060123c41. 02000000:00000001:3.0:1790964076.521652:0:32661:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964076.521654:0:32661:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964076.521655:0:32661:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000bb081558. 00000100:00000001:3.0:1790964076.521658:0:32661:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964076.521659:0:32661:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000010:3.0:1790964076.521672:0:32661:0:(mgc_request.c:1652:mgc_process_recover_log()) kvfree 'folios': 32 at 00000000e6d6c99f. 10000000:01000000:3.0:1790964076.521675:0:32661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 10000000:00000001:3.0:1790964076.521678:0:32661:0:(mgc_request.c:1029:mgc_cancel()) Process entered 00010000:00000001:3.0:1790964076.521680:0:32661:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964076.521686:0:32661:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964076.521689:0:32661:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000f8aba9d8 refcount=3 00000020:00000001:3.0:1790964076.521690:0:32661:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000001:3.0:1790964076.521693:0:32661:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446639021738641408 : -105051970910208 : ffffa074ae974800) 00010000:00000001:3.0:1790964076.521695:0:32661:0:(ldlm_lock.c:854:ldlm_lock_decref_internal()) Process entered 00010000:00010000:3.0:1790964076.521698:0:32661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 00000000f8aba9d8/0x67c8b7dde5cd1a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1a36 expref: -99 pid: 32661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964076.521705:0:32661:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964076.521706:0:32661:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:3.0:1790964076.521707:0:32661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 00000000f8aba9d8/0x67c8b7dde5cd1a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x67c8b7dde5cd1a36 expref: -99 pid: 32661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964076.521712:0:32661:0:(ldlm_lock.c:923:ldlm_lock_decref_internal()) Process leaving 00010000:00000001:3.0:1790964076.521713:0:32661:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964076.521713:0:32661:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 10000000:00000001:3.0:1790964076.521715:0:32661:0:(mgc_request.c:1033:mgc_cancel()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964076.521716:0:32661:0:(mgc_request.c:1907:mgc_process_log()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964076.521719:0:32661:0:(mgc_request.c:621:do_requeue()) Process leaving 10000000:00000001:3.0:1790964076.521721:0:32661:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000040:3.0:1790964076.521723:0:32661:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(00000000be094547) refs 3 10000000:00000001:3.0:1790964076.521725:0:32661:0:(mgc_request.c:147:config_log_put()) Process leaving 00000100:00000040:1.0:1790964076.524027:0:418:0:(connection.c:75:cpu_latency_work()) work item of 00000000af6df018 (cpu 1) has reached its deadline 4295604743, at 4295604744 00000100:00000010:1.0:1790964076.524045:0:418:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000b9c13e1c. 00000100:00000040:0.0:1790964076.524649:0:11726:0:(connection.c:75:cpu_latency_work()) work item of 0000000036c02849 (cpu 0) has reached its deadline 4295604743, at 4295604744 00000100:00000010:0.0:1790964076.524656:0:11726:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000772f4efc. 00000100:00000040:3.0:1790964076.524723:0:24449:0:(connection.c:75:cpu_latency_work()) work item of 00000000be9ddb98 (cpu 3) has reached its deadline 4295604743, at 4295604744 00000100:00000010:3.0:1790964076.524729:0:24449:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000b655ac01. 00000100:00000040:2.0:1790964076.525103:0:54:0:(connection.c:75:cpu_latency_work()) work item of 000000000c5ba90e (cpu 2) has reached its deadline 4295604743, at 4295604745 00000100:00000010:2.0:1790964076.525111:0:54:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000009bd15d88. 00000100:00000001:3.0:1790964076.708023:0:32702:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964076.708031:0:32702:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964076.708033:0:32702:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964076.708036:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00000100:00000001:3.0:1790964076.708041:0:32702:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964076.708044:0:32702:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.708047:0:32702:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964076.708049:0:32702:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964076.708051:0:32702:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964077.035292:0:54:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964077.035311:0:54:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964077.035317:0:54:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964077.035319:0:54:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964077.037725:0:32653:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964077.037732:0:32653:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964077.037736:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:3.0:1790964077.221549:0:33010:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964077.221566:0:33010:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964077.221570:0:33010:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964077.542782:0:31815:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964077.542794:0:31815:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964077.542796:0:31815:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964077.542800:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964077.542802:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964077.542805:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964077.542807:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964077.731952:0:32702:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964077.731962:0:32702:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964077.731963:0:32702:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964077.731968:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00000100:00000001:3.0:1790964077.731972:0:32702:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964077.731976:0:32702:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964077.731978:0:32702:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964077.731980:0:32702:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964077.731983:0:32702:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964078.053269:0:54:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964078.053276:0:54:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964078.053282:0:54:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964078.053283:0:54:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964078.053304:0:32652:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1790964078.053306:0:32652:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1790964078.053309:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:0.0:1790964078.564001:0:31815:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964078.564014:0:31815:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964078.564017:0:31815:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964078.564021:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964078.564023:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964078.564026:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964078.564028:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964078.756051:0:32702:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964078.756059:0:32702:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964078.756061:0:32702:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964078.756065:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00000100:00000001:3.0:1790964078.756069:0:32702:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964078.756073:0:32702:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964078.756075:0:32702:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964078.756078:0:32702:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964078.756080:0:32702:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964079.076036:0:54:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964079.076044:0:54:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964079.076049:0:54:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964079.076051:0:54:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964079.076146:0:32653:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964079.076149:0:32653:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964079.076152:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:0.0:1790964079.588154:0:31815:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964079.588170:0:31815:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964079.588172:0:31815:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964079.588176:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964079.588179:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964079.588200:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964079.588203:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:1.0:1790964079.672675:0:33060:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964079.672695:0:33060:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964079.672700:0:33060:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.781362:0:32702:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964079.781383:0:32702:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964079.781385:0:32702:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964079.781390:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00000100:00000001:2.0:1790964079.781395:0:32702:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964079.781398:0:32702:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.781400:0:32702:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964079.781402:0:32702:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.781405:0:32702:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.109042:0:54:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964080.109051:0:54:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.109057:0:54:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964080.109059:0:54:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:2.0:1790964080.109062:0:54:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:2.0:1790964080.109064:0:54:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.109067:0:54:0:(ldlm_lockd.c:2241:ldlm_bl_to_thread()) Process entered 00010000:00000001:2.0:1790964080.109069:0:54:0:(ldlm_lockd.c:2244:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.109071:0:54:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.109073:0:54:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964080.113302:0:32652:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964080.113309:0:32652:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964080.113312:0:32652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000001:3.0:1790964080.151351:0:33096:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:3.0:1790964080.151358:0:33096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: conf-sanity test_167: @@@@@@ FAIL: mds1 mounted without a remote update llog 00000001:00000001:3.0:1790964080.158547:0:33096:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00000100:00000001:0.0:1790964080.611997:0:31815:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964080.612008:0:31815:0:(client.c:2486:ptlrpc_expire_one_request()) Process entered 00000100:00100000:0.0:1790964080.612020:0:31815:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790964070/real 1790964070] req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000400:00000001:0.0:1790964080.612040:0:31815:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964080.612042:0:31815:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964080.612046:0:31815:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000439c546d. 00000400:00000200:0.0:1790964080.612071:0:31815:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000ccf34c4b 00000400:00000010:0.0:1790964080.612074:0:31815:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000ccf34c4b. 00000100:00000001:0.0:1790964080.612079:0:31815:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964080.612083:0:31815:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964080.612091:0:31815:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.612098:0:31815:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964080.612101:0:31815:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.612104:0:31815:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964080.612106:0:31815:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:0.0:1790964080.612108:0:31815:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.612114:0:31815:0:(client.c:2540:ptlrpc_expire_one_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.612122:0:31815:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964080.612124:0:31815:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.612126:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964080.612128:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964080.612130:0:31815:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1790964080.612133:0:31815:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964080 ref 1 fl Rpc:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.612138:0:31815:0:(client.c:2143:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00000001:0.0:1790964080.612141:0:31815:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.612142:0:31815:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964080.612160:0:31815:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.612162:0:31815:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:0.0:1790964080.612164:0:31815:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00080000:0.0:1790964080.612167:0:31815:0:(import.c:65:import_set_state_nolock()) 0000000008e13ac7 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790964080.612176:0:31815:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00000001:0.0:1790964080.612179:0:31815:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551506 : -110 : ffffffffffffff92) 00000100:00000040:0.0:1790964080.612182:0:31815:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964080 ref 1 fl Interpret:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964080.612188:0:31815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac9f576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31815:1877961922839808:0@lo:8: 00000100:00000001:0.0:1790964080.612192:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.612195:0:31815:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964080.612197:0:31815:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000aac9f576 x1877961922839808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964080 ref 1 fl Complete:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.612431:0:31815:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964080.612434:0:31815:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964080.612438:0:31815:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000061a2a9a5. 02000000:00000001:0.0:1790964080.612442:0:31815:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964080.612444:0:31815:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964080.612445:0:31815:0:(genops.c:1223:class_import_put()) import 0000000008e13ac7 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000001:0.0:1790964080.612448:0:31815:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964080.612451:0:31815:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 00000000d59af811. 02000000:00000001:0.0:1790964080.612454:0:31815:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964080.612456:0:31815:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964080.612457:0:31815:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000aac9f576. 00000100:00000001:0.0:1790964080.612460:0:31815:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964080.612461:0:31815:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.612464:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.612467:0:31815:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964080.612468:0:31815:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.612470:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964080.612471:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.613910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 85a36975-6290-450b-9820-3830c7db4a1f->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1790964080.613920:0:36:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1790964080.613929:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000004728da70. 00000020:00000040:2.0:1790964080.613944:0:36:0:(genops.c:1210:class_import_get()) import 00000000dba633d2 refcount=4 obd=MGC192.168.201.155@tcp 00000100:00000001:2.0:1790964080.613948:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964080.613950:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964080.613955:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964080.613963:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000c2e2b57d. 00000100:00000001:2.0:1790964080.613970:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.613976:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 85a36975-6290-450b-9820-3830c7db4a1f->MGS req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964080.613986:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964080.613988:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.613993:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004728da70] to pc [ptlrpcd_00_03+3] req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.614025:0:36:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1790964080.614027:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790964080.614043:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00000001:2.0:1790964080.614046:0:36:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:2.0:1790964080.614047:0:36:0:(import.c:65:import_set_state_nolock()) 0000000008e13ac7 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:2.0:1790964080.614051:0:36:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:2.0:1790964080.614054:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 931 00000100:00001000:2.0:1790964080.614058:0:36:0:(import.c:2195:obd_at_measure()) add 10 to 00000000550180e1 time=1790964080 v=0 (0 0 0 0) 00000100:00001000:2.0:1790964080.614061:0:36:0:(import.c:2261:obd_at_measure()) AT 00000000550180e1 change: old=0 new=10 delta=10 (val=10) hist 10 0 0 0 00000100:00080000:2.0:1790964080.614063:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1790964080.614066:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 15 to 0@lo 00000100:00000001:2.0:1790964080.614068:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964080.614070:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 16 to 0@lo 00000100:00000001:2.0:1790964080.614072:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 00000020:00000001:2.0:1790964080.614075:0:36:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964080.614076:0:36:0:(genops.c:804:class_conn2export()) looking for export cookie 0x67c8b7dde5cd19cd 00000020:00000001:2.0:1790964080.614079:0:36:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964080.614082:0:36:0:(lustre_handles.c:148:class_handle2object()) GET export 000000003efcd132 refcount=4 00000020:00000001:2.0:1790964080.614084:0:36:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021866598400 : -105051842953216 : ffffa074b637c000) 00000020:00000001:2.0:1790964080.614086:0:36:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446639021866598400 : -105051842953216 : ffffa074b637c000) 00000100:00000040:2.0:1790964080.614088:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 15 to 0@lo 00000100:00000001:2.0:1790964080.614090:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964080.614092:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 16 to 0@lo 00000100:00000001:2.0:1790964080.614093:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 00000020:00000040:2.0:1790964080.614096:0:36:0:(genops.c:879:class_export_put()) PUTting export 000000003efcd132 : new refcount 3 00000100:00080000:2.0:1790964080.614098:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 0000000008e13ac7 using connection 192.168.201.155@tcp/0@lo 00000100:00000001:2.0:1790964080.614100:0:36:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964080.614102:0:36:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:2.0:1790964080.614108:0:36:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964080.614111:0:36:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.614113:0:36:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:2.0:1790964080.614115:0:36:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964080.614119:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000098c49786. 00000020:00000040:2.0:1790964080.614126:0:36:0:(genops.c:1210:class_import_get()) import 0000000008e13ac7 refcount=3 obd=lustre-OST0000-osc-MDT0000 02000000:00000001:2.0:1790964080.614129:0:36:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:2.0:1790964080.614131:0:36:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.614133:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964080.614135:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964080.614137:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964080.614142:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 0000000031d69721. 00000100:00000001:2.0:1790964080.614146:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964080.614150:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000098c49786 x1877961922842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964080.614156:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964080.614158:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.614160:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000098c49786] to pc [ptlrpcd_rcv+-1] req@0000000098c49786 x1877961922842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.614172:0:36:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1790964080.614174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790964080.614177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00000001:2.0:1790964080.614178:0:36:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:2.0:1790964080.614179:0:36:0:(import.c:65:import_set_state_nolock()) 00000000c787eafa lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:2.0:1790964080.614182:0:36:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:2.0:1790964080.614183:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 931 00000100:00001000:2.0:1790964080.614186:0:36:0:(import.c:2195:obd_at_measure()) add 10 to 00000000712c2b4e time=10 v=5 (1 0 0 0) 00000100:00001000:2.0:1790964080.614188:0:36:0:(import.c:2261:obd_at_measure()) AT 00000000712c2b4e change: old=5 new=10 delta=5 (val=10) hist 10 0 0 0 00000100:00080000:2.0:1790964080.614190:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1790964080.614193:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 15 to 0@lo 00000100:00000001:2.0:1790964080.614194:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964080.614195:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 16 to 0@lo 00000100:00000001:2.0:1790964080.614197:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 00000020:00000001:2.0:1790964080.614585:0:36:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964080.614586:0:36:0:(genops.c:804:class_conn2export()) looking for export cookie 0x67c8b7dde5cd19e2 00000020:00000001:2.0:1790964080.614588:0:36:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964080.614594:0:36:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000e533cf00 refcount=4 00000020:00000001:2.0:1790964080.614596:0:36:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021960722432 : -105051748829184 : ffffa074bbd3f800) 00000020:00000001:2.0:1790964080.614597:0:36:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446639021960722432 : -105051748829184 : ffffa074bbd3f800) 00000100:00000040:2.0:1790964080.614607:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 15 to 0@lo 00000100:00000001:2.0:1790964080.614609:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964080.614609:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 16 to 0@lo 00000100:00000001:2.0:1790964080.614611:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 00000020:00000040:2.0:1790964080.614612:0:36:0:(genops.c:879:class_export_put()) PUTting export 00000000e533cf00 : new refcount 3 00000100:00080000:2.0:1790964080.614614:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c787eafa using connection 192.168.201.155@tcp/0@lo 00000100:00000001:2.0:1790964080.614616:0:36:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964080.614618:0:36:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:2.0:1790964080.614621:0:36:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964080.614623:0:36:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.614625:0:36:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:2.0:1790964080.614626:0:36:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964080.614629:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000008351da65. 00000020:00000040:2.0:1790964080.614631:0:36:0:(genops.c:1210:class_import_get()) import 00000000c787eafa refcount=4 obd=lustre-MDT0001-osp-MDT0000 02000000:00000001:2.0:1790964080.614634:0:36:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:2.0:1790964080.614635:0:36:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.614636:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964080.614638:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964080.614639:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964080.614643:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 0000000083488634. 00000100:00000001:2.0:1790964080.614647:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964080.614650:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964080.614656:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964080.614658:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.614660:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008351da65] to pc [ptlrpcd_rcv+-1] req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.614667:0:36:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.614669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1790964080.614678:0:36:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1790964080.614680:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000bee5c664. 00000020:00000040:2.0:1790964080.614681:0:36:0:(genops.c:1210:class_import_get()) import 000000009a50b310 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000001:2.0:1790964080.614683:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964080.614684:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964080.614685:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964080.614688:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b8ed1dea. 00000100:00000001:2.0:1790964080.614690:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.614692:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964080.614697:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964080.614697:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.614699:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bee5c664] to pc [ptlrpcd_00_00+0] req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.614714:0:36:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.614722:0:31816:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964080.614724:0:31816:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964080.614726:0:31816:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964080.614729:0:31816:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.614733:0:31816:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964080.614734:0:31816:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964080.614737:0:31816:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:3.0:1790964080.614835:0:31819:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964080.614838:0:31819:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964080.614840:0:31819:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964080.614843:0:31819:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964080.614848:0:31819:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964080.614849:0:31819:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964080.614850:0:31819:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964080.614851:0:31819:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964080.614857:0:31819:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964080.614859:0:31819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004728da70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85a36975-6290-450b-9820-3830c7db4a1f:31819:1877961922842624:0@lo:400: 00000100:00000001:3.0:1790964080.614862:0:31819:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964080.614867:0:31819:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964080.614876:0:31819:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964080.614877:0:31819:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964080.614880:0:31819:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 000000004d6c573f. 02000000:00000001:3.0:1790964080.614881:0:31819:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964080.614886:0:31819:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000862a5b10. 00000400:00000010:3.0:1790964080.614891:0:31819:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000038ed8b00. 00000100:00000200:3.0:1790964080.614896:0:31819:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961922842624, portal 25 00000100:00000001:3.0:1790964080.614898:0:31819:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964080.614899:0:31819:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639016716031232 : -105056993520384 : ffffa07383385500) 00000100:00000040:3.0:1790964080.614902:0:31819:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964080.614906:0:31819:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964080.614908:0:31819:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964080.614910:0:31819:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000034b29436. 00000100:00000200:3.0:1790964080.614912:0:31819:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877961922842624, offset 0 00000400:00000200:3.0:1790964080.614918:0:31819:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964080.614940:0:31819:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964080.614950:0:31819:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff15501000 00000400:00000200:3.0:1790964080.614956:0:31819:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x16d [2] + 0 00000400:00000010:3.0:1790964080.614959:0:31819:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000eea0499a. 00000400:00000200:3.0:1790964080.614965:0:31819:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000000bbd9676 00000400:00000200:3.0:1790964080.614973:0:31819:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964080.614977:0:31819:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964080.614981:0:31819:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000bbd9676 00000400:00000010:3.0:1790964080.614983:0:31819:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000000bbd9676. 00000100:00000001:3.0:1790964080.614988:0:31819:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964080.614990:0:31819:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:3.0:1790964080.614993:0:31819:0:(events.c:341:request_in_callback()) incoming req@000000002661de00 x1877961922842624 msgsize 224 00000100:00100000:3.0:1790964080.614996:0:31819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1790964080.614998:0:31819:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:3.0:1790964080.615011:0:31819:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964080.615018:0:31819:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000034b29436 00000400:00000010:3.0:1790964080.615020:0:31819:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000034b29436. 00000100:00000001:3.0:1790964080.615023:0:31819:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964080.615027:0:31819:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964080.615035:0:31819:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964080.615037:0:31819:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964080.615042:0:31819:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.615043:0:31819:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964080.615048:0:31819:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.615052:0:31819:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 0 is 4295608839 00000100:00000010:3.0:1790964080.615056:0:31819:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000b9b2a36a. 00000100:00000001:3.0:1790964080.615063:0:31819:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 0 00000100:00000001:3.0:1790964080.615076:0:31819:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 1 is 4295608839 00000100:00000010:3.0:1790964080.615079:0:31819:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000002888562. 00000100:00000001:3.0:1790964080.615081:0:31819:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 1 00000100:00000001:3.0:1790964080.615085:0:31819:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 2 is 4295608839 00000100:00000010:3.0:1790964080.615087:0:31819:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000c16feb8b. 00000100:00000001:3.0:1790964080.615089:0:31819:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 2 00000100:00000001:3.0:1790964080.615090:0:31819:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS new deadline estimation for cpu 3 is 4295608839 00000100:00000010:3.0:1790964080.615092:0:31819:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000007dc37bf9. 00000100:00000001:3.0:1790964080.615093:0:31819:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.155@tcp: PM QoS request now active for cpu 3 00000100:00000001:3.0:1790964080.615095:0:31819:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964080.615096:0:31819:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.615098:0:31819:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.615100:0:31819:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964080.615104:0:31819:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964080.615105:0:31819:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1790964080.615107:0:31819:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964080.615107:0:31819:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964080.615108:0:31819:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.615113:0:31819:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964080.615136:0:36:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (946) 00000100:00000001:3.0:1790964080.615145:0:31817:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964080.615146:0:31817:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.615977:0:32657:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964080.615983:0:32657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922842624 02000000:00000001:1.0:1790964080.615986:0:32657:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964080.615988:0:32657:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964080.615990:0:32657:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964080.615995:0:32657:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964080.615999:0:32657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922842624 00000020:00000001:1.0:1790964080.616002:0:32657:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964080.616003:0:32657:0:(genops.c:804:class_conn2export()) looking for export cookie 0x67c8b7dde5cd1948 00000020:00000001:1.0:1790964080.616006:0:32657:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964080.616009:0:32657:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000a02e7c3f refcount=12 00000020:00000001:1.0:1790964080.616011:0:32657:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021969041408 : -105051740510208 : ffffa074bc52e800) 00000020:00000001:1.0:1790964080.616013:0:32657:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446639021969041408 : -105051740510208 : ffffa074bc52e800) 00000100:00000001:1.0:1790964080.616017:0:32657:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964080.616023:0:32657:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000006b38df09. 00000100:00000001:1.0:1790964080.616026:0:32657:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964080.616029:0:32657:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000006b38df09. 00000020:00000010:1.0:1790964080.616037:0:32657:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006640ae91. 00000020:00000010:1.0:1790964080.616043:0:32657:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000003077a484. 00000020:00000010:1.0:1790964080.616048:0:32657:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000046d37ea9. 00000100:00000040:1.0:1790964080.616057:0:32657:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964080.616060:0:32657:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964080.616062:0:32657:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964080.616063:0:32657:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.616072:0:32657:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.616090:0:32657:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964080.616101:0:32657:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964080.616103:0:32657:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964080.616108:0:32657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00000040:1.0:1790964080.616111:0:32657:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000a02e7c3f : new rpc_count 1 00000100:00000001:1.0:1790964080.616122:0:32657:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446639021109862480 : -105052599689136 : ffffa074891ce050) 00000100:00000040:1.0:1790964080.616126:0:32657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000002661de00 x1877961922842624/t0(0) o400->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:656/0 lens 224/0 e 0 to 0 dl 1790964091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964080.616136:0:32657:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964080.616138:0:32657:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000006b38df09. 00000100:00000001:1.0:1790964080.616140:0:32657:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964080.616141:0:32657:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000006b38df09. 00000100:00100000:1.0:1790964080.616145:0:32657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002661de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+12:31819:x1877961922842624:12345-0@lo:400: 00000100:00000200:1.0:1790964080.616148:0:32657:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961922842624 00000020:00000001:1.0:1790964080.616151:0:32657:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964080.616155:0:32657:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964080.616157:0:32657:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964080.616160:0:32657:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964080.616162:0:32657:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669366464 : -1040185152 : ffffffffc20008c0) 00000020:00000001:1.0:1790964080.616165:0:32657:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964080.616167:0:32657:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964080.616169:0:32657:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964080.616172:0:32657:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964080.616182:0:32657:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964080.616184:0:32657:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:1.0:1790964080.616187:0:32657:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964080.616188:0:32657:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964080.616191:0:32657:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 0000000050148870. 02000000:00000001:1.0:1790964080.616193:0:32657:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.616194:0:32657:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964080.616196:0:32657:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964080.616198:0:32657:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961922842624 02000000:00000001:2.0:1790964080.616393:0:31816:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964080.616398:0:31816:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964080.616402:0:31816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bee5c664 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:31816:1877961922843008:0@lo:400: 00000100:00000001:2.0:1790964080.616407:0:31816:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964080.616410:0:31816:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964080.616412:0:31816:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964080.616414:0:31816:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1790964080.616418:0:31816:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000011887f48. 02000000:00000001:2.0:1790964080.616420:0:31816:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1790964080.616425:0:31816:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000008f6e1f6e. 00000400:00000010:2.0:1790964080.616436:0:31816:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000003ededbfd. 00000100:00000200:2.0:1790964080.616441:0:31816:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961922843008, portal 10 00000100:00000001:2.0:1790964080.616443:0:31816:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964080.616445:0:31816:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639016716035712 : -105056993515904 : ffffa07383386680) 00000020:00000010:2.0:1790964080.616451:0:31816:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000b6547e9f. 00000100:00000040:2.0:1790964080.616457:0:31816:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.616463:0:31816:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964080.616465:0:31816:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964080.616467:0:31816:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000f941e24e. 00000100:00000200:2.0:1790964080.616470:0:31816:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1877961922843008, offset 0 00000400:00000200:2.0:1790964080.616474:0:31816:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964080.616484:0:31816:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964080.616492:0:31816:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6abff15501180 00000400:00000200:2.0:1790964080.616497:0:31816:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x229 [64] + 1040 00000400:00000200:2.0:1790964080.616503:0:31816:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964080.616507:0:31816:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964080.616513:0:31816:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1790964080.616514:0:31816:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:2.0:1790964080.616519:0:31816:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000ee6bc813. 00000100:00000040:2.0:1790964080.616522:0:31816:0:(events.c:341:request_in_callback()) incoming req@00000000ee6bc813 x1877961922843008 msgsize 224 00000100:00100000:2.0:1790964080.616525:0:31816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:2.0:1790964080.616535:0:31816:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:2.0:1790964080.616541:0:31816:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000f941e24e 00000400:00000010:2.0:1790964080.616543:0:31816:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000f941e24e. 00000100:00000001:2.0:1790964080.616545:0:31816:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964080.616547:0:31816:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.616555:0:31816:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964080.616557:0:31816:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.616564:0:31816:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.616565:0:31816:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964080.616576:0:31816:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.616580:0:31816:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 5320 usecs (6 jiffies) 00000100:00000001:2.0:1790964080.616583:0:31816:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295608842 00000100:00000001:2.0:1790964080.616587:0:31816:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295608839 00000100:00000001:2.0:1790964080.616590:0:31816:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295608842 00000100:00000001:2.0:1790964080.616593:0:31816:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295608839 00000100:00000001:2.0:1790964080.616595:0:31816:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295608842 00000100:00000001:2.0:1790964080.616597:0:31816:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295608839 00000100:00000001:2.0:1790964080.616619:0:31816:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295608842 00000100:00000001:2.0:1790964080.616622:0:31816:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295608839 00000100:00000001:2.0:1790964080.616625:0:31816:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964080.616627:0:31816:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.616630:0:31816:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.616633:0:31816:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.616638:0:31816:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964080.616640:0:31816:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1790964080.616642:0:31816:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964080.616643:0:31816:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964080.616645:0:31816:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.616646:0:31816:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1790964080.616664:0:32665:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 0000000005ff60fd. 00000100:00000001:2.0:1790964080.616669:0:32665:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:2.0:1790964080.616670:0:32665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922843008 02000000:00000001:2.0:1790964080.616671:0:32665:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1790964080.616673:0:32665:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964080.616674:0:32665:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964080.616676:0:32665:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964080.616679:0:32665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922843008 00000020:00000001:2.0:1790964080.616680:0:32665:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964080.616682:0:32665:0:(genops.c:804:class_conn2export()) looking for export cookie 0x67c8b7dde5cd1a28 00000020:00000001:2.0:1790964080.616683:0:32665:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964080.616686:0:32665:0:(lustre_handles.c:148:class_handle2object()) GET export 000000004a8bc7c9 refcount=5 00000020:00000001:2.0:1790964080.616688:0:32665:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446639021860579328 : -105051848972288 : ffffa074b5dbe800) 00000020:00000001:2.0:1790964080.616695:0:32665:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446639021860579328 : -105051848972288 : ffffa074b5dbe800) 00000100:00000001:2.0:1790964080.616698:0:32665:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964080.616701:0:32665:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000009c295486. 00000100:00000001:2.0:1790964080.616703:0:32665:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964080.616704:0:32665:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000009c295486. 00000020:00000010:2.0:1790964080.616708:0:32665:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058841206. 00000020:00000010:2.0:1790964080.616712:0:32665:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000004c69f636. 00000020:00000010:2.0:1790964080.616715:0:32665:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000005d21b529. 00000100:00000040:2.0:1790964080.616720:0:32665:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000001:2.0:1790964080.616722:0:32665:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1790964080.616723:0:32665:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1790964080.616725:0:32665:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.616730:0:32665:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:2.0:1790964080.616732:0:32665:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:2.0:1790964080.616734:0:32665:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.616739:0:32665:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.616746:0:32665:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1790964080.616748:0:32665:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1790964080.616751:0:32665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00000040:2.0:1790964080.616753:0:32665:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000004a8bc7c9 : new rpc_count 1 00000100:00000001:2.0:1790964080.616754:0:32665:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446639016716033920 : -105056993517696 : ffffa07383385f80) 00000100:00000040:2.0:1790964080.616758:0:32665:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000ee6bc813 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:656/0 lens 224/0 e 0 to 0 dl 1790964091 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.616774:0:32665:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964080.616777:0:32665:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000009c295486. 00000100:00000001:2.0:1790964080.616778:0:32665:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964080.616780:0:32665:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000009c295486. 00000100:00100000:2.0:1790964080.616783:0:32665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee6bc813 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31816:x1877961922843008:12345-0@lo:400: 00000100:00000200:2.0:1790964080.616786:0:32665:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961922843008 00000020:00000001:2.0:1790964080.616788:0:32665:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1790964080.616790:0:32665:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:2.0:1790964080.616791:0:32665:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964080.616798:0:32665:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1790964080.616800:0:32665:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072661479104 : -1048072512 : ffffffffc187aec0) 00000020:00000001:2.0:1790964080.616802:0:32665:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:2.0:1790964080.616805:0:32665:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1790964080.616806:0:32665:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1790964080.616808:0:32665:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:2.0:1790964080.616810:0:32665:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964080.616811:0:32665:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:2.0:1790964080.616814:0:32665:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1790964080.616815:0:32665:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:2.0:1790964080.616837:0:32665:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000ced94659. 02000000:00000001:2.0:1790964080.616840:0:32665:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.616842:0:32665:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964080.616843:0:32665:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:2.0:1790964080.616845:0:32665:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961922843008 00010000:00000001:2.0:1790964080.616847:0:32665:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:2.0:1790964080.616851:0:32665:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000ee6bc813 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1790964091 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1790964080.616859:0:32665:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:2.0:1790964080.616861:0:32665:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964080.616864:0:32665:0:(import.c:2195:obd_at_measure()) add 1 to 00000000034ccfbd time=5 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964080.616868:0:32665:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964080.616870:0:32665:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 17 to 0@lo 00000100:00000001:2.0:1790964080.616872:0:32665:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 02000000:00000001:2.0:1790964080.616874:0:32665:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:2.0:1790964080.616875:0:32665:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.616878:0:32665:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964080.616880:0:32665:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964080.616882:0:32665:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000f941e24e. 00000100:00000200:2.0:1790964080.616885:0:32665:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1877961922843008, offset 224 00000400:00000200:2.0:1790964080.616888:0:32665:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964080.616894:0:32665:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964080.616899:0:32665:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6abff15501180 00000400:00000200:2.0:1790964080.616903:0:32665:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0xaf5 [1] + 224 00000400:00000200:2.0:1790964080.616907:0:32665:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964080.616927:0:32665:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964080.616932:0:32665:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964080.616935:0:32665:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1790964080.616942:0:32665:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.616952:0:32665:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1790964080.616966:0:32665:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000f941e24e 00000400:00000010:2.0:1790964080.616968:0:32665:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000f941e24e. 00000100:00000001:2.0:1790964080.616970:0:32665:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1790964080.616971:0:32665:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1790964080.616974:0:32665:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.616977:0:32665:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 16 to 0@lo 00010000:00000001:2.0:1790964080.616979:0:32665:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:2.0:1790964080.616981:0:32665:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964080.616983:0:32665:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1790964080.616985:0:32665:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000ee6bc813 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1790964091 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964080.616993:0:32665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee6bc813 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31816:x1877961922843008:12345-0@lo:400: Request processed in 219us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964080.617000:0:32665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00000040:2.0:1790964080.617002:0:32665:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004a8bc7c9 : new rpc_count 0 00000100:00000001:2.0:1790964080.617004:0:32665:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1790964080.617014:0:32665:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1790964080.617018:0:32665:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000004c69f636. 00000020:00000010:2.0:1790964080.617022:0:32665:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000005d21b529. 00000020:00000010:2.0:1790964080.617025:0:32665:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058841206. 00000020:00000040:2.0:1790964080.617028:0:32665:0:(genops.c:879:class_export_put()) PUTting export 000000004a8bc7c9 : new refcount 4 00000100:00000001:2.0:1790964080.617031:0:32665:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.617043:0:31816:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964080.617045:0:31816:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1790964080.617049:0:31816:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964080.617051:0:31816:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964080.617058:0:31816:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000008f6e1f6e. 00000400:00000200:2.0:1790964080.617062:0:31816:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000003ededbfd 00000400:00000010:2.0:1790964080.617063:0:31816:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000003ededbfd. 00000100:00000001:2.0:1790964080.617066:0:31816:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964080.617069:0:31816:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964080.617076:0:31816:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.617081:0:31816:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964080.617082:0:31816:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.617084:0:31816:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964080.617087:0:31816:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964080.617088:0:31816:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964080.617089:0:31816:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964080.617091:0:31816:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964080.617096:0:31816:0:(import.c:2195:obd_at_measure()) add 5 to 00000000258b1690 time=5 v=5 (5 0 0 0) 00000100:00001000:2.0:1790964080.617099:0:31816:0:(import.c:2195:obd_at_measure()) add 1 to 00000000227d929b time=5 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964080.617101:0:31816:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964080.617103:0:31816:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.617105:0:31816:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1790964080.617108:0:31816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1790964080.617114:0:31816:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.617116:0:31816:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1790964080.617118:0:31816:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:2.0:1790964080.617120:0:31816:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1790964080.617121:0:31816:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.617124:0:31816:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.617130:0:31816:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964080.617133:0:31816:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964080.617134:0:31816:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1790964080.617137:0:31816:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964080.617153:0:31816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bee5c664 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:31816:1877961922843008:0@lo:400: 00000100:00000001:2.0:1790964080.617157:0:31816:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.617159:0:31816:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964080.617161:0:31816:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000bee5c664 x1877961922843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.617166:0:31816:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964080.617168:0:31816:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964080.617170:0:31816:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000011887f48. 02000000:00000001:2.0:1790964080.617173:0:31816:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964080.617174:0:31816:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964080.617176:0:31816:0:(genops.c:1223:class_import_put()) import 000000009a50b310 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:2.0:1790964080.617178:0:31816:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964080.617180:0:31816:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000b8ed1dea. 02000000:00000001:2.0:1790964080.617185:0:31816:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964080.617187:0:31816:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964080.617188:0:31816:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000bee5c664. 00000100:00000001:2.0:1790964080.617191:0:31816:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964080.617191:0:31816:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.617193:0:31816:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.617197:0:31816:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964080.617198:0:31816:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.617199:0:31816:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964080.617200:0:31816:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617424:0:31818:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964080.617427:0:31818:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617433:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964080.617441:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964080.617443:0:31815:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1790964080.617447:0:31815:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000098c49786 x1877961922842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617454:0:31815:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964080.617456:0:31815:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964080.617458:0:31815:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1790964080.617460:0:31815:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964080.617461:0:31815:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964080.617464:0:31815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098c49786 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31815:1877961922842752:0@lo:8: 00000100:00000001:0.0:1790964080.617467:0:31815:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1790964080.617470:0:31815:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1790964080.617471:0:31815:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964080.617473:0:31815:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1790964080.617476:0:31815:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001d51f6e0. 02000000:00000001:0.0:1790964080.617478:0:31815:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1790964080.617482:0:31815:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000875a1209. 00000400:00000010:0.0:1790964080.617486:0:31815:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000034b33511. 00000100:00000200:0.0:1790964080.617489:0:31815:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961922842752, portal 4 00000100:00000001:0.0:1790964080.617492:0:31815:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964080.617493:0:31815:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639016716025856 : -105056993525760 : ffffa07383384000) 00000020:00000010:0.0:1790964080.617499:0:31815:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000948277a8. 00000100:00000040:0.0:1790964080.617503:0:31815:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000098c49786 x1877961922842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964095 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617509:0:31815:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964080.617510:0:31815:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964080.617512:0:31815:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000000bfa20a8. 00000100:00000200:0.0:1790964080.617514:0:31815:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 28, xid 1877961922842752, offset 0 00000400:00000200:0.0:1790964080.617518:0:31815:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964080.617524:0:31815:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964080.617529:0:31815:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 28 MB=0x6abff15501080 00000400:00000100:0.0:1790964080.617533:0:31815:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877961922842752 offset 0 length 520: 4 00000400:00000200:0.0:1790964080.617536:0:31815:0:(lib-msg.c:1116:lnet_is_health_check()) Msg 000000001243a11c is in inconsistent state, don't perform health checking (-2, 0) 00000400:00000200:0.0:1790964080.617543:0:31815:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 0, status = -2, hstatus = 0 00000400:00000200:0.0:1790964080.617549:0:31815:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000bfa20a8 00000400:00000010:0.0:1790964080.617550:0:31815:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000000bfa20a8. 00000100:00000001:0.0:1790964080.617552:0:31815:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:0.0:1790964080.617555:0:31815:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000098c49786 x1877961922842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964095 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617562:0:31815:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964080.617564:0:31815:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000098c49786 x1877961922842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964095 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617569:0:31815:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617571:0:31815:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1790964080.617573:0:31815:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964080.617576:0:31815:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000001:0.0:1790964080.617578:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295608843 00000100:00000001:0.0:1790964080.617582:0:31815:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295608842 00000100:00000001:0.0:1790964080.617585:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295608843 00000100:00000001:0.0:1790964080.617588:0:31815:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295608842 00000100:00000001:0.0:1790964080.617590:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295608843 00000100:00000001:0.0:1790964080.617592:0:31815:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295608842 00000100:00000001:0.0:1790964080.617593:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295608843 00000100:00000001:0.0:1790964080.617595:0:31815:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295608842 00000100:00000001:0.0:1790964080.617597:0:31815:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964080.617611:0:31815:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617613:0:31815:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1790964080.617616:0:31815:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617622:0:31815:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964080.617623:0:31815:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964080.617626:0:31815:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1790964080.617627:0:31815:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964080.617634:0:31815:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964080.617637:0:31815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008351da65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31815:1877961922842880:0@lo:38: 00000100:00000001:0.0:1790964080.617640:0:31815:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1790964080.617642:0:31815:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1790964080.617643:0:31815:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964080.617645:0:31815:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1790964080.617647:0:31815:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b7257324. 02000000:00000001:0.0:1790964080.617649:0:31815:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1790964080.617653:0:31815:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000052b4625c. 00000400:00000010:0.0:1790964080.617656:0:31815:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000000bfa20a8. 00000100:00000200:0.0:1790964080.617659:0:31815:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961922842880, portal 4 00000100:00000001:0.0:1790964080.617660:0:31815:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964080.617661:0:31815:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446639016716037504 : -105056993514112 : ffffa07383386d80) 00000020:00000010:0.0:1790964080.617676:0:31815:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000008d86e3fa. 00000100:00000040:0.0:1790964080.617682:0:31815:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964095 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617688:0:31815:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964080.617689:0:31815:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964080.617692:0:31815:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000032de582c. 00000100:00000200:0.0:1790964080.617694:0:31815:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 24, xid 1877961922842880, offset 0 00000400:00000200:0.0:1790964080.617697:0:31815:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964080.617702:0:31815:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964080.617706:0:31815:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 24 MB=0x6abff15501100 00000400:00000200:0.0:1790964080.617747:0:31815:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 520/520 into md 0x429 [256] + 520 00000400:00000200:0.0:1790964080.617771:0:31815:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964080.617775:0:31815:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964080.617779:0:31815:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:0.0:1790964080.617780:0:31815:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 00000100:00000010:0.0:1790964080.617784:0:31815:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000face1570. 00000100:00000040:0.0:1790964080.617786:0:31815:0:(events.c:341:request_in_callback()) incoming req@00000000face1570 x1877961922842880 msgsize 520 00000100:00100000:0.0:1790964080.617789:0:31815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:0.0:1790964080.617804:0:31815:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1790964080.617808:0:31815:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000032de582c 00000400:00000010:0.0:1790964080.617816:0:31815:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000032de582c. 00000100:00000001:0.0:1790964080.617848:0:31815:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:0.0:1790964080.617851:0:31815:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964095 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617858:0:31815:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964080.617860:0:31815:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964095 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964080.617866:0:31815:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617867:0:31815:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1790964080.617872:0:31815:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964080.617875:0:31815:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4567 usecs (5 jiffies) 00000100:00000001:0.0:1790964080.617877:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295608843 00000100:00000001:0.0:1790964080.617879:0:31815:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 0, keep current deadline 4295608843 00000100:00000001:0.0:1790964080.617880:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295608843 00000100:00000001:0.0:1790964080.617882:0:31815:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 1, keep current deadline 4295608843 00000100:00000001:0.0:1790964080.617883:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295608843 00000100:00000001:0.0:1790964080.617885:0:31815:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 2, keep current deadline 4295608843 00000100:00000001:0.0:1790964080.617886:0:31815:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295608843 00000100:00000001:0.0:1790964080.617888:0:31815:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 3, keep current deadline 4295608843 00000100:00000001:0.0:1790964080.617889:0:31815:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964080.617891:0:31815:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617893:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617895:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964080.617899:0:31815:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964080.617900:0:31815:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:0.0:1790964080.617902:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964080.617903:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964080.617904:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964080.617906:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964080.618079:0:32670:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 0000000018ae7f56. 00000100:00000001:3.0:1790964080.618086:0:32670:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964080.618087:0:32670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961922842880 02000000:00000001:3.0:1790964080.618089:0:32670:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964080.618090:0:32670:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964080.618091:0:32670:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964080.618094:0:32670:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964080.618097:0:32670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961922842880 00000020:00000001:3.0:1790964080.618098:0:32670:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964080.618099:0:32670:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:3.0:1790964080.618101:0:32670:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:3.0:1790964080.618103:0:32670:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964080.618105:0:32670:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964080.618108:0:32670:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c4965ab2. 00000020:00000010:3.0:1790964080.618111:0:32670:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000d749233d. 00000020:00000010:3.0:1790964080.618115:0:32670:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000b929c40a. 00000100:00000001:3.0:1790964080.618117:0:32670:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964080.618119:0:32670:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1790964080.618120:0:32670:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.618124:0:32670:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.618136:0:32670:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964080.618142:0:32670:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964080.618143:0:32670:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964080.618147:0:32670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:3.0:1790964080.618149:0:32670:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446639021884274688 : -105051825276928 : ffffa074b7457800) 00000100:00000040:3.0:1790964080.618152:0:32670:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000face1570 x1877961922842880/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964100 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964080.618161:0:32670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000face1570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:31815:x1877961922842880:12345-0@lo:38: 00000100:00000200:3.0:1790964080.618164:0:32670:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961922842880 00000020:00000001:3.0:1790964080.618166:0:32670:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:3.0:1790964080.618173:0:32670:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000001:3.0:1790964080.618184:0:32670:0:(genops.c:655:class_str2obd()) Process leaving (rc=0 : 0 : 0) 00010000:00020000:3.0:1790964080.618187:0:32670:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00000001:1.0:1790964080.618298:0:32657:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964080.618304:0:32657:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000002661de00 x1877961922842624/t0(0) o400->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:656/0 lens 224/224 e 0 to 0 dl 1790964091 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964080.618312:0:32657:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964080.618314:0:32657:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964080.618316:0:32657:0:(import.c:2195:obd_at_measure()) add 1 to 00000000f7baa2ca time=11 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964080.618326:0:32657:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964080.618676:0:32657:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 17 to 0@lo 00000100:00000001:1.0:1790964080.618679:0:32657:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 02000000:00000001:1.0:1790964080.618682:0:32657:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964080.618683:0:32657:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.618686:0:32657:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964080.618688:0:32657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1790964080.623999:0:54:0:(connection.c:75:cpu_latency_work()) work item of 000000000c5ba90e (cpu 2) has reached its deadline 4295608843, at 4295608844 00000100:00000010:2.0:1790964080.624027:0:54:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000c16feb8b. 00000400:00000010:2.0:1790964080.624049:0:32657:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000003ededbfd. 00000100:00000200:2.0:1790964080.624059:0:32657:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877961922842624, offset 224 00000400:00000200:2.0:1790964080.624070:0:32657:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964080.624084:0:32657:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964080.624096:0:32657:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff15501000 00000400:00000200:2.0:1790964080.624104:0:32657:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xaed [1] + 224 00000400:00000200:2.0:1790964080.624112:0:32657:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964080.624130:0:32657:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964080.624137:0:32657:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964080.624143:0:32657:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1790964080.624152:0:32657:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.624175:0:32657:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1790964080.624183:0:32657:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000003ededbfd 00000400:00000010:2.0:1790964080.624185:0:32657:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000003ededbfd. 00000100:00000001:2.0:1790964080.624188:0:32657:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1790964080.624190:0:32657:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1790964080.624195:0:32657:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.624198:0:32657:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 16 to 0@lo 00010000:00000001:2.0:1790964080.624201:0:32657:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:2.0:1790964080.624214:0:32657:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964080.624217:0:32657:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1790964080.624223:0:32657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000002661de00 x1877961922842624/t0(0) o400->85a36975-6290-450b-9820-3830c7db4a1f@0@lo:656/0 lens 224/224 e 0 to 0 dl 1790964091 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964080.624232:0:32657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002661de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85a36975-6290-450b-9820-3830c7db4a1f+12:31819:x1877961922842624:12345-0@lo:400: Request processed in 8096us (9238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964080.624242:0:32657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00000040:2.0:1790964080.624245:0:32657:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a02e7c3f : new rpc_count 0 00000100:00000001:2.0:1790964080.624247:0:32657:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1790964080.624250:0:32657:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1790964080.624257:0:32657:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000003077a484. 00000020:00000010:2.0:1790964080.624261:0:32657:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000046d37ea9. 00000020:00000010:2.0:1790964080.624280:0:32657:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006640ae91. 00000020:00000040:2.0:1790964080.624287:0:32657:0:(genops.c:879:class_export_put()) PUTting export 00000000a02e7c3f : new refcount 11 02000000:00000001:2.0:1790964080.624292:0:32657:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:2.0:1790964080.624295:0:32657:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 0000000050148870. 02000000:00000001:2.0:1790964080.624298:0:32657:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:2.0:1790964080.624300:0:32657:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:2.0:1790964080.624307:0:32657:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:2.0:1790964080.624318:0:32657:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000008f6e1f6e. 00000400:00000010:2.0:1790964080.624324:0:32657:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000720e6fea. 00000100:00000001:2.0:1790964080.624367:0:31819:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964080.624371:0:31819:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1790964080.624377:0:31819:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964080.624379:0:31819:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964080.624380:0:31819:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000862a5b10. 00000400:00000200:2.0:1790964080.624383:0:31819:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000038ed8b00 00000400:00000010:2.0:1790964080.624385:0:31819:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000038ed8b00. 00000100:00000001:2.0:1790964080.624388:0:31819:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964080.624392:0:31819:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964080.624399:0:31819:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.624404:0:31819:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964080.624405:0:31819:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.624408:0:31819:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964080.624411:0:31819:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964080.624413:0:31819:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964080.624415:0:31819:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964080.624418:0:31819:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964080.624424:0:31819:0:(import.c:2195:obd_at_measure()) add 5 to 00000000b7619987 time=11 v=5 (5 0 0 0) 00000100:00001000:2.0:1790964080.624428:0:31819:0:(import.c:2195:obd_at_measure()) add 1 to 0000000059b2f512 time=11 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964080.624431:0:31819:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964080.624432:0:31819:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.624435:0:31819:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1790964080.624437:0:31819:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.624440:0:31819:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964080.624443:0:31819:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.624450:0:31819:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964080.624453:0:31819:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964080.624455:0:31819:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1790964080.624457:0:31819:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964080.624476:0:31819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004728da70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85a36975-6290-450b-9820-3830c7db4a1f:31819:1877961922842624:0@lo:400: 00000100:00000001:2.0:1790964080.624481:0:31819:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.624484:0:31819:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964080.624486:0:31819:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000004728da70 x1877961922842624/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964096 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964080.624493:0:31819:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964080.624495:0:31819:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964080.624497:0:31819:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 000000004d6c573f. 02000000:00000001:2.0:1790964080.624500:0:31819:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964080.624503:0:31819:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964080.624504:0:31819:0:(genops.c:1223:class_import_put()) import 00000000dba633d2 refcount=3 obd=MGC192.168.201.155@tcp 00000020:00000001:2.0:1790964080.624507:0:31819:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964080.624509:0:31819:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000c2e2b57d. 02000000:00000001:2.0:1790964080.624515:0:31819:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964080.624517:0:31819:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964080.624519:0:31819:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000004728da70. 00000100:00000001:2.0:1790964080.624522:0:31819:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964080.624524:0:31819:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.624526:0:31819:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.624532:0:31819:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964080.624534:0:31819:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.624537:0:31819:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964080.624539:0:31819:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964080.624764:0:11726:0:(connection.c:75:cpu_latency_work()) work item of 0000000036c02849 (cpu 0) has reached its deadline 4295608843, at 4295608844 00000100:00000010:0.0:1790964080.624771:0:11726:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000b9b2a36a. 00000100:00000040:1.0:1790964080.626443:0:418:0:(connection.c:75:cpu_latency_work()) work item of 00000000af6df018 (cpu 1) has reached its deadline 4295608843, at 4295608846 00000100:00000010:1.0:1790964080.626457:0:418:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000002888562. 00010000:00000001:3.0:1790964080.674494:0:32670:0:(ldlm_lib.c:1191:target_handle_connect()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00010000:00000001:3.0:1790964080.674510:0:32670:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:3.0:1790964080.674513:0:32670:0:(niobuf.c:816:ptlrpc_send_error()) Process entered 00000100:00000001:3.0:1790964080.674527:0:32670:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964080.674532:0:32670:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000040:3.0:1790964080.674551:0:24449:0:(connection.c:75:cpu_latency_work()) work item of 00000000be9ddb98 (cpu 3) has reached its deadline 4295608843, at 4295608894 00000100:00000010:3.0:1790964080.674565:0:24449:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000007dc37bf9. 02000000:00000010:3.0:1790964080.674583:0:32670:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 0000000037694522. 02000000:00000001:3.0:1790964080.674586:0:32670:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.674590:0:32670:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964080.674594:0:32670:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964080.674596:0:32670:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964080.674600:0:32670:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x0 req_flags=0x200 magic=bd00bd3/bd00bd3 len=224 00000100:00000001:3.0:1790964080.674614:0:32670:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:3.0:1790964080.674617:0:32670:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964080.674622:0:32670:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000005ccfb8c3 refcount 17 to 0@lo 00000100:00000001:3.0:1790964080.674624:0:32670:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446639016759113472 : -105056950438144 : ffffa07385c9b700) 00000100:00000001:3.0:1790964080.674627:0:32670:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446639016759113472 : -105056950438144 : 0xffffa07385c9b700) 00000100:00000040:3.0:1790964080.674630:0:32670:0:(connection.c:150:ptlrpc_connection_get()) conn=000000005ccfb8c3 refcount 17 to 0@lo 02000000:00000001:3.0:1790964080.674632:0:32670:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964080.674634:0:32670:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.674638:0:32670:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964080.674641:0:32670:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964080.674648:0:32670:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000034b29436. 00000100:00000200:3.0:1790964080.674657:0:32670:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1877961922842880, offset 0 00000400:00000200:3.0:1790964080.674663:0:32670:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964080.674678:0:32670:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964080.674688:0:32670:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6abff15501100 00000400:00000200:3.0:1790964080.674695:0:32670:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0xb09 [1] + 0 00000400:00000200:3.0:1790964080.674704:0:32670:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964080.674726:0:32670:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964080.674734:0:32670:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964080.674741:0:32670:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964095 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964080.674751:0:32670:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964080.674767:0:32670:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964080.674775:0:32670:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000034b29436 00000400:00000010:3.0:1790964080.674778:0:32670:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000034b29436. 00000100:00000001:3.0:1790964080.674781:0:32670:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964080.674782:0:32670:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1790964080.674787:0:32670:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964080.674789:0:32670:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000005ccfb8c3 refcount 16 to 0@lo 00000100:00000001:3.0:1790964080.674792:0:32670:0:(niobuf.c:837:ptlrpc_send_error()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964080.674794:0:32670:0:(tgt_handler.c:789:tgt_request_handle()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000040:3.0:1790964080.674800:0:32670:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000face1570 x1877961922842880/t0(0) o38->@:0/0 lens 520/224 e 0 to 0 dl 1790964100 ref 1 fl Interpret:/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964080.674809:0:32670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000face1570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:31815:x1877961922842880:12345-0@lo:38: Request processed in 56647us (57020us total) trans 0 rc -19/-19 00000100:00000001:1.0:1790964080.674882:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964080.674887:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964080.674894:0:31815:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964080.674896:0:31815:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964080.674898:0:31815:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000052b4625c. 00000400:00000200:1.0:1790964080.674902:0:31815:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000bfa20a8 00000400:00000010:1.0:1790964080.674904:0:31815:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000000bfa20a8. 00000100:00000001:1.0:1790964080.674907:0:31815:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964080.674922:0:31815:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964080.674930:0:31815:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964080.674935:0:31815:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964080.674937:0:31815:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964080.674940:0:31815:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964080.674943:0:31815:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964080.674945:0:31815:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964080.674947:0:31815:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964080.674949:0:31815:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:1.0:1790964080.674968:0:31815:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000006e6a3dbe. 00000100:00001000:1.0:1790964080.674976:0:31815:0:(import.c:2195:obd_at_measure()) add 0 to 00000000d9bb168e time=1790964080 v=5 (0 0 0 0) 00000100:00001000:1.0:1790964080.674980:0:31815:0:(import.c:2195:obd_at_measure()) add 1 to 00000000712c2b4e time=10 v=10 (10 0 0 0) 00000100:00000001:1.0:1790964080.674983:0:31815:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964080.674985:0:31815:0:(client.c:1506:ptlrpc_check_status()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:1.0:1790964080.674987:0:31815:0:(client.c:1712:after_reply()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:1.0:1790964080.674991:0:31815:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964080.675012:0:31815:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00000001:1.0:1790964080.675016:0:31815:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964080.675018:0:31815:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964080.675020:0:31815:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:1.0:1790964080.675022:0:31815:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00080000:1.0:1790964080.675026:0:31815:0:(import.c:65:import_set_state_nolock()) 00000000c787eafa lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790964080.675030:0:31815:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00000001:1.0:1790964080.675032:0:31815:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:1.0:1790964080.675035:0:31815:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964095 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964080.675041:0:31815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008351da65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31815:1877961922842880:0@lo:38: 00000100:00000001:1.0:1790964080.675045:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.675047:0:31815:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964080.675050:0:31815:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000008351da65 x1877961922842880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964095 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964080.675056:0:31815:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964080.675058:0:31815:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964080.675060:0:31815:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b7257324. 02000000:00000001:1.0:1790964080.675065:0:31815:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964080.675067:0:31815:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964080.675068:0:31815:0:(genops.c:1223:class_import_put()) import 00000000c787eafa refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000020:00000001:1.0:1790964080.675070:0:31815:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964080.675072:0:31815:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 0000000083488634. 02000000:00000001:1.0:1790964080.675075:0:31815:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964080.675077:0:31815:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964080.675078:0:31815:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000008351da65. 00000100:00000001:1.0:1790964080.675082:0:31815:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964080.675083:0:31815:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964080.675085:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.675087:0:31815:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964080.675088:0:31815:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964080.675095:0:31815:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964080.675096:0:31815:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964080.679689:0:32670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000001:3.0:1790964080.679700:0:32670:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964080.679703:0:32670:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1790964080.679710:0:32670:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000d749233d. 00000020:00000010:3.0:1790964080.679718:0:32670:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000b929c40a. 00000020:00000010:3.0:1790964080.679723:0:32670:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c4965ab2. 00000100:00000001:3.0:1790964080.679727:0:32670:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.803935:0:32702:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964080.804121:0:32702:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964080.804124:0:32702:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964080.804128:0:32702:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb70d782 going to sleep for 0 seconds 00000100:00000001:2.0:1790964080.804134:0:32702:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964080.804138:0:32702:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.804140:0:32702:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964080.804142:0:32702:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964080.804145:0:32702:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964081.123956:0:54:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964081.123965:0:54:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964081.123972:0:54:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964081.123991:0:54:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964081.127450:0:32653:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964081.127458:0:32653:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964081.127462:0:32653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:0.0:1790964081.472687:0:33108:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:0.0:1790964081.472708:0:33108:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964081.472713:0:33108:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) Debug log: 2677 lines, 2677 kept, 0 dropped, 0 bad.