00000020:01000004:2.0F:1790964084.529111:0:32632:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790964084.529125:0:32632:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790964084.529244:0:32632:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005f5bdeb5 00000080:02000400:2.0:1790964084.529255:0:32632:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1790964084.538338:0:32632:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790964084.538351:0:32632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790964084.538391:0:32632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000623c1251) 00000020:00000080:2.0:1790964084.538409:0:32632:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0F:1790964084.636728:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790964084.645956:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1790964084.650587:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 193: rc = 0 00100000:10000000:0.0:1790964084.650700:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 193: rc = 0 00100000:10000000:0.0:1790964084.652352:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790964084.652537:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 193: rc = 0 00100000:10000000:0.0:1790964084.652663:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 193: rc = 0 00100000:10000000:0.0:1790964084.652762:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 193: rc = 0 00100000:10000000:0.0:1790964084.652868:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 193: rc = 0 00100000:10000000:0.0:1790964084.657055:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 195: rc = 0 00100000:10000000:0.0:1790964084.669986:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 454: rc = 0 00100000:10000000:0.0:1790964084.670138:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 454: rc = 0 00100000:10000000:3.0F:1790964084.681679:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 459: rc = 0 00100000:10000000:3.0:1790964084.684991:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 459: rc = 0 00100000:10000000:3.0:1790964084.686362:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 459: rc = 0 00100000:10000000:3.0:1790964084.687663:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 459: rc = 0 00100000:10000000:3.0:1790964084.689069:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 459: rc = 0 00100000:10000000:3.0:1790964084.690456:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 459: rc = 0 00100000:10000000:3.0:1790964084.691744:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 459: rc = 0 00100000:10000000:3.0:1790964084.694513:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 459: rc = 0 00100000:10000000:3.0:1790964084.695820:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 459: rc = 0 00100000:10000000:2.0:1790964084.701088:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 459: rc = 0 00100000:10000000:2.0:1790964084.706984:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1790964084.713034:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 459: rc = 0 00100000:10000000:2.0:1790964084.717470:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 779: rc = 0 00100000:10000000:2.0:1790964084.718914:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 779: rc = 0 00100000:10000000:2.0:1790964084.723645:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 779: rc = 0 00100000:10000000:2.0:1790964084.725868:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 779: rc = 0 00100000:10000000:2.0:1790964084.728753:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 779: rc = 0 00100000:10000000:2.0:1790964084.730051:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 779: rc = 0 00100000:10000000:3.0:1790964084.746643:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 779: rc = 0 00100000:10000000:3.0:1790964084.752827:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 779: rc = 0 00100000:10000000:2.0:1790964084.755794:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 779: rc = 0 00100000:10000000:2.0:1790964084.759193:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 779: rc = 0 00100000:10000000:2.0:1790964084.761538:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 779: rc = 0 00100000:10000000:2.0:1790964084.762966:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 779: rc = 0 00100000:10000000:2.0:1790964084.765653:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 779: rc = 0 00100000:10000000:2.0:1790964084.768661:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 779: rc = 0 00100000:10000000:2.0:1790964084.772442:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 779: rc = 0 00100000:10000000:3.0:1790964084.786523:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 779: rc = 0 00100000:10000000:3.0:1790964084.788602:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 779: rc = 0 00100000:10000000:3.0:1790964084.794218:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 779: rc = 0 00100000:10000000:3.0:1790964084.797668:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 779: rc = 0 00100000:10000000:3.0:1790964084.803385:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 779: rc = 0 00100000:10000000:3.0:1790964084.804607:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 779: rc = 0 00100000:10000000:3.0:1790964084.806639:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 779: rc = 0 00100000:10000000:2.0:1790964084.811870:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 779: rc = 0 00100000:10000000:2.0:1790964084.813820:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 779: rc = 0 00100000:10000000:2.0:1790964084.815895:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 779: rc = 0 00100000:10000000:2.0:1790964084.817575:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 779: rc = 0 00100000:10000000:2.0:1790964084.818732:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 779: rc = 0 00100000:10000000:2.0:1790964084.820761:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 779: rc = 0 00100000:10000000:2.0:1790964084.824796:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 779: rc = 0 00100000:10000000:2.0:1790964084.828768:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 779: rc = 0 00100000:10000000:2.0:1790964084.831660:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 779: rc = 0 00100000:10000000:3.0:1790964084.837198:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 779: rc = 0 00100000:10000000:3.0:1790964084.840403:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 648: rc = 0 00100000:10000000:3.0:1790964084.841620:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 648: rc = 0 00100000:10000000:3.0:1790964084.861680:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790964084.863775:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 455: rc = 0 00100000:10000000:3.0:1790964084.865030:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790964084.865165:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 455: rc = 0 00100000:10000000:3.0:1790964084.868384:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790964084.868568:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 455: rc = 0 00100000:10000000:2.0:1790964084.874885:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790964084.875017:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:2.0:1790964084.876695:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790964084.876799:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:2.0:1790964084.878722:0:32632:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790964084.878948:0:32632:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00000020:00000080:2.0:1790964084.879381:0:32632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790964084.879390:0:32632:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790964084.879399:0:32632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd2056616bb766895 00000020:01000004:2.0:1790964084.879407:0:32632:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790964084.879412:0:32632:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790964084.879416:0:32632:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005f5bdeb5 from MGS 00000020:01000004:2.0:1790964084.879420:0:32632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790964084.879429:0:32632:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004e29aeae) 00000020:00000080:2.0:1790964084.879439:0:32632:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790964084.879583:0:32632:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f5bdeb5 from MGS, refs=2 00080000:01000000:2.0:1790964084.879589:0:32632:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790964084.879595:0:32632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd2056616bb7668a3 00000100:00100000:2.0:1790964084.879695:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790964084.879826:0:32632:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790964084.879833:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790964084.883726:0:32632:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790964084.883739:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790964084.884858:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964084.885061:0:32632:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790964084.885067:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790964084.886017:0:32632:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790964084.886027:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790964084.886672:0:32632:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790964084.886680:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1790964084.887812:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964084.887823:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964084.887826:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964084.888090:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964084.888115:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964084.888117:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964084.888946:0:32632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790964084.897190:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790964085.138547:0:32632:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2559 MB/s 00000001:01000000:1.0:1790964085.388390:0:32632:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2931 MB/s 00000001:01000000:2.0:1790964085.638743:0:32632:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 579 MB/s 00000001:01000000:3.0:1790964085.890832:0:32632:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 686 MB/s 00010000:00010000:1.0:1790964085.897528:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790964085.939770:0:32632:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790964085.939809:0:32632:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790964085.939812:0:32632:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790964085.946422:0:32641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790964085.946605:0:32632:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790964085.946716:0:32632:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790964085.946961:0:32632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790964085.947046:0:32632:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790964085.947402:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964085.947566:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790964085.947572:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790964085.957662:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790964085.957679:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790964085.960720:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790964085.960734:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790964085.962816:0:32632:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790964085.962843:0:32632:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.118@tcp' 00000020:01000004:2.0:1790964085.962845:0:32632:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790964085.962896:0:32632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.118@tcp (typ=mgc) 00000020:00000080:2.0:1790964085.962908:0:32632:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.118@tcp (00000000c39ce9ae) 00000020:00000080:2.0:1790964085.962928:0:32632:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790964085.963013:0:32632:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000089249098@MGC192.168.202.118@tcp: add connection 192.168.202.118@tcp at head 00010000:00010000:2.0:1790964085.963250:0:32632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.118@tcp-0 is initialized 00000040:01000000:2.0:1790964085.963323:0:32632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790964085.963648:0:32646:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790964085.965471:0:32647:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790964085.965519:0:32632:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.118@tcp (uuid 74395bcb-647f-40d7-b64f-5c134e7cfca1) 00000020:00000080:0.0:1790964085.965540:0:32632:0:(genops.c:1385:class_connect()) connect: client 74395bcb-647f-40d7-b64f-5c134e7cfca1, cookie 0xd2056616bb7668b1 00000100:00080000:0.0:1790964085.965551:0:32632:0:(import.c:545:import_select_connection()) MGC192.168.202.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790964085.965556:0:32632:0:(import.c:665:import_select_connection()) MGC192.168.202.118@tcp: import 0000000089249098 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1790964085.965587:0:32632:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c25cf80e x1877961941713024/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790964085.965608:0:32632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 74395bcb-647f-40d7-b64f-5c134e7cfca1->MGS 00000020:01000004:0.0:1790964085.965627:0:32632:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790964085.965633:0:32632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790964085.965652:0:32632:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000084b53743) 00000020:00000080:0.0:1790964085.965664:0:32632:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790964085.970293:0:31804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c25cf80e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74395bcb-647f-40d7-b64f-5c134e7cfca1:31804:1877961941713024:0@lo:250: 00000100:00100000:2.0:1790964085.970387:0:31804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964085.981535:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713024 00000100:00100000:3.0:1790964085.981610:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713024 00000100:00100000:3.0:1790964085.981748:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964085.981756:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb9f4924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:31804:x1877961941713024:12345-0@lo:250: 00010000:00080000:3.0:1790964085.981784:0:32643:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo t0 exp 0000000000000000 cur 956 last 0 00000020:00000080:3.0:1790964085.981826:0:32643:0:(genops.c:1385:class_connect()) connect: client 74395bcb-647f-40d7-b64f-5c134e7cfca1, cookie 0xd2056616bb7668bf 00000100:00080000:3.0:1790964085.981950:0:32643:0:(import.c:65:import_set_state_nolock()) 00000000c861104d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790964085.982027:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb9f4924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+5:31804:x1877961941713024:12345-0@lo:250: Request processed in 270us (11641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964085.982034:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964085.984672:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964085.984907:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790964085.984915:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790964085.985429:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790964085.985435:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790964085.985616:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790964085.985627:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790964085.995210:0:31804:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790964085.995227:0:31804:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.118@tcp: connect to target with instance 0 00000100:00080000:2.0:1790964085.995235:0:31804:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790964085.995240:0:31804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790964085.995243:0:31804:0:(import.c:65:import_set_state_nolock()) 0000000089249098 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790964085.995259:0:31804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790964085.995269:0:31804:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790964085.995276:0:31804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c25cf80e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74395bcb-647f-40d7-b64f-5c134e7cfca1:31804:1877961941713024:0@lo:250: 00000100:00100000:0.0:1790964086.001814:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964086.002020:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790964086.002026:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790964086.005822:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790964086.005836:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790964086.092076:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964086.092990:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790964086.092998:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790964086.097119:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790964086.097135:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790964086.104220:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964086.104437:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790964086.104444:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790964086.105560:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790964086.105570:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790964086.109752:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964086.109962:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790964086.109969:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790964086.112597:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790964086.112610:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790964086.113320:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964086.113515:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790964086.113520:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790964086.115830:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790964086.115845:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790964086.140058:0:32632:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964086.141518:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790964086.141532:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790964086.144243:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790964086.144269:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790964086.152767:0:32632:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790964086.152785:0:32632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790964086.159433:0:32632:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790964086.159469:0:32632:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790964086.159476:0:32632:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790964086.159611:0:32632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790964086.159652:0:32632:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.118@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790964086.159657:0:32632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790964086.159659:0:32632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964086.159661:0:32632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964086.159662:0:32632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964086.159663:0:32632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964086.159664:0:32632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964086.159665:0:32632:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964086.159667:0:32632:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964086.159668:0:32632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964086.159669:0:32632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790964086.159671:0:32632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790964086.159674:0:32632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790964086.159675:0:32632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964086.159676:0:32632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964086.159678:0:32632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964086.159679:0:32632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964086.159679:0:32632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964086.159680:0:32632:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964086.159681:0:32632:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964086.159682:0:32632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964086.159683:0:32632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790964086.159710:0:32632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790964086.159730:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf9e7d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713152:0@lo:253: 00000100:00100000:3.0:1790964086.159813:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.159920:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 000000004677d143 going to sleep for 11 seconds 00000100:00100000:2.0:1790964086.161130:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713152 00000100:00100000:2.0:1790964086.161145:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713152 00000100:00100000:2.0:1790964086.161203:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790964086.161213:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e562835a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+5:32632:x1877961941713152:12345-0@lo:253: 20000000:01000000:2.0:1790964086.161778:0:32645:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790964086.161783:0:32645:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790964086.161786:0:32645:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1790964086.162132:0:32666:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790964086.162662:0:32645:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:2.0:1790964086.191688:0:32668:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1790964086.191698:0:32668:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1790964086.191700:0:32668:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 00000040:00080000:2.0:1790964086.191760:0:32668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 20000000:01000000:1.0:1790964086.193689:0:32645:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790964086.193703:0:32645:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790964086.269887:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e562835a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+5:32632:x1877961941713152:12345-0@lo:253: Request processed in 108668us (110067us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964086.269920:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790964086.270032:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf9e7d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713152:0@lo:253: 10000000:01000000:1.0:1790964086.270060:0:32632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790964086.270064:0:32632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790964086.270066:0:32632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964086.270067:0:32632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964086.270068:0:32632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964086.270070:0:32632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964086.270071:0:32632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964086.270072:0:32632:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964086.270074:0:32632:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964086.270075:0:32632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964086.270076:0:32632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790964086.270123:0:32632:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005f5bdeb5 from lustre-MDT0000 10000000:01000000:1.0:1790964086.270148:0:32632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790964086.270157:0:32632:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790964086.270162:0:32632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c3f67d50000 10000000:01000000:1.0:1790964086.270167:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790964086.270176:0:32632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c3f67d50000 from 1 10000000:01000000:1.0:1790964086.270178:0:32632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790964086.270214:0:32632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000001ff97019/0xd2056616bb7668c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.270225:0:32632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000001ff97019/0xd2056616bb7668c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.270234:0:32632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000001ff97019/0xd2056616bb7668c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964086.270264:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c295bd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713280:0@lo:101: 00000100:00100000:1.0:1790964086.270326:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964086.270382:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7910731 going to sleep for 11 seconds 00000100:00100000:3.0:1790964086.270560:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713280 00000100:00100000:3.0:1790964086.270567:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713280 00000100:00100000:3.0:1790964086.270605:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790964086.270613:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb06f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+5:32632:x1877961941713280:12345-0@lo:101: 00010000:00010000:3.0:1790964086.270627:0:32643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964086.270642:0:32643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083352c7c/0xd2056616bb7668cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2056616bb7668c6 expref: -99 pid: 32643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.270666:0:32643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083352c7c/0xd2056616bb7668cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd2056616bb7668c6 expref: 6 pid: 32643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.270676:0:32643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083352c7c/0xd2056616bb7668cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb7668c6 expref: 6 pid: 32643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.270685:0:32643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083352c7c, rc 0) 00000100:00100000:3.0:1790964086.270724:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb06f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+6:32632:x1877961941713280:12345-0@lo:101: Request processed in 111us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964086.270730:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790964086.270855:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c295bd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713280:0@lo:101: 00010000:00010000:1.0:1790964086.270868:0:32632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000001ff97019/0xd2056616bb7668c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668cd expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.270876:0:32632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000001ff97019/0xd2056616bb7668c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd2056616bb7668cd expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964086.270915:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c295bd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713408:0@lo:501: 00000100:00100000:1.0:1790964086.270939:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964086.270960:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7910731 going to sleep for 11 seconds 00000100:00100000:3.0:1790964086.271003:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713408 00000100:00100000:3.0:1790964086.271006:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713408 00000100:00100000:3.0:1790964086.271042:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790964086.271048:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d0f8306 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+6:32632:x1877961941713408:12345-0@lo:501: 00000100:00100000:3.0:1790964086.271570:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d0f8306 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+6:32632:x1877961941713408:12345-0@lo:501: Request processed in 521us (629us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790964086.271578:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790964086.271633:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c295bd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713408:0@lo:501: 10000000:01000000:2.0:1790964086.271658:0:32632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790964086.271712:0:32632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000001ff97019/0xd2056616bb7668c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668cd expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.271720:0:32632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000001ff97019/0xd2056616bb7668c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668cd expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964086.271729:0:32632:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3f467d8000 10000000:01000000:2.0:1790964086.271734:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790964086.271739:0:32632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c3f467d8000 10000000:01000000:2.0:1790964086.271741:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790964086.271744:0:32632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c3f467d8000 from 1 10000000:01000000:2.0:1790964086.271746:0:32632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790964086.271767:0:32632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000002d191f6e/0xd2056616bb7668d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.271787:0:32632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000002d191f6e/0xd2056616bb7668d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.271809:0:32632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000002d191f6e/0xd2056616bb7668d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964086.271822:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713536:0@lo:101: 00000100:00100000:2.0:1790964086.271852:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.271886:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078f75f29 going to sleep for 11 seconds 00000100:00100000:1.0:1790964086.272011:0:32644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713536 00000100:00100000:1.0:1790964086.272016:0:32644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713536 00000100:00100000:1.0:1790964086.272246:0:32644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790964086.272372:0:32644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000140c332d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+6:32632:x1877961941713536:12345-0@lo:101: 00010000:00010000:1.0:1790964086.272383:0:32644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964086.272396:0:32644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b18f12fb/0xd2056616bb7668db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2056616bb7668d4 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.272425:0:32644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b18f12fb/0xd2056616bb7668db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd2056616bb7668d4 expref: 7 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.272435:0:32644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b18f12fb/0xd2056616bb7668db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb7668d4 expref: 7 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.272442:0:32644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b18f12fb, rc 0) 00000100:00100000:1.0:1790964086.272484:0:32644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000140c332d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+7:32632:x1877961941713536:12345-0@lo:101: Request processed in 115us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964086.272719:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713536:0@lo:101: 00010000:00010000:2.0:1790964086.272732:0:32632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000002d191f6e/0xd2056616bb7668d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668db expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.272740:0:32632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000002d191f6e/0xd2056616bb7668d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd2056616bb7668db expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964086.272754:0:32632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790964086.272769:0:32632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000002d191f6e/0xd2056616bb7668d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668db expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.272776:0:32632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000002d191f6e/0xd2056616bb7668d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668db expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964086.272783:0:32632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790964086.272788:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790964086.272803:0:32632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c3f467d8000 10000000:01000000:2.0:1790964086.272806:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790964086.272809:0:32632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790964086.272817:0:32632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790964086.272835:0:32632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000edf5acec/0xd2056616bb7668e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.272842:0:32632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000edf5acec/0xd2056616bb7668e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.272849:0:32632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000edf5acec/0xd2056616bb7668e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964086.272862:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713664:0@lo:101: 00000100:00100000:2.0:1790964086.272891:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.272913:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078f75f29 going to sleep for 11 seconds 00000100:00100000:3.0:1790964086.272981:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713664 00000100:00100000:3.0:1790964086.272986:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713664 00000100:00100000:1.0:1790964086.273231:0:32644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790964086.273443:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790964086.273451:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c351cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+7:32632:x1877961941713664:12345-0@lo:101: 00010000:00010000:3.0:1790964086.273461:0:32645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964086.273471:0:32645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b286e8da/0xd2056616bb7668e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2056616bb7668e2 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.273487:0:32645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b286e8da/0xd2056616bb7668e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd2056616bb7668e2 expref: 8 pid: 32645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.273495:0:32645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b286e8da/0xd2056616bb7668e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb7668e2 expref: 8 pid: 32645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.273502:0:32645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b286e8da, rc 0) 00000100:00100000:3.0:1790964086.273658:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c351cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+8:32632:x1877961941713664:12345-0@lo:101: Request processed in 208us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964086.273665:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790964086.273715:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713664:0@lo:101: 00010000:00010000:2.0:1790964086.273726:0:32632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000edf5acec/0xd2056616bb7668e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668e9 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.273734:0:32632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000edf5acec/0xd2056616bb7668e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd2056616bb7668e9 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964086.273782:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713792:0@lo:501: 00000100:00100000:2.0:1790964086.273821:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.274032:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078f75f29 going to sleep for 11 seconds 00000100:00100000:0.0:1790964086.274270:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713792 00000100:00100000:0.0:1790964086.274276:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713792 00000100:00100000:0.0:1790964086.274302:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790964086.274309:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f9c5f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+8:32632:x1877961941713792:12345-0@lo:501: 00000100:00100000:0.0:1790964086.274696:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f9c5f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32632:x1877961941713792:12345-0@lo:501: Request processed in 387us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.274704:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790964086.274859:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713792:0@lo:501: 00000100:00100000:2.0:1790964086.274908:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713920:0@lo:503: 00000100:00100000:2.0:1790964086.274949:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.274977:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078f75f29 going to sleep for 11 seconds 00000100:00100000:0.0:1790964086.275158:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941713920 00000100:00100000:0.0:1790964086.275163:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941713920 00000100:00100000:0.0:1790964086.275182:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790964086.275187:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cae18fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32632:x1877961941713920:12345-0@lo:503: 00000100:00100000:3.0:1790964086.289574:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cae18fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32632:x1877961941713920:12345-0@lo:503: Request processed in 14378us (14617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964086.289591:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790964086.290171:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d775c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941713920:0@lo:503: 00000100:00100000:1.0:1790964086.298203:0:32671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003793d7f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32671:1877961941714048:0@lo:502: 00000100:00100000:1.0:1790964086.298377:0:32671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964086.298528:0:32671:0:(client.c:2716:ptlrpc_set_wait()) set 000000003553bdfe going to sleep for 11 seconds 00000100:00100000:2.0:1790964086.301747:0:32644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941714048 00000100:00100000:2.0:1790964086.301761:0:32644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941714048 00000100:00100000:3.0:1790964086.303443:0:32644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790964086.303456:0:32644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee5e2a84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32671:x1877961941714048:12345-0@lo:502: 00000100:00100000:1.0:1790964086.316369:0:32644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee5e2a84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32671:x1877961941714048:12345-0@lo:502: Request processed in 12909us (17986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964086.316385:0:32644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790964086.316506:0:32671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003793d7f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32671:1877961941714048:0@lo:502: 00000020:01000000:3.0:1790964086.316543:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964086.316555:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.316558:0:32671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790964086.316563:0:32671:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790964086.316566:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964086.316595:0:32671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e8e453c6) 00000020:00000080:3.0:1790964086.316620:0:32671:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790964086.316627:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790964086.316760:0:32671:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790964086.316768:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd2056616bb7668f7 00000020:00000080:3.0:1790964086.317006:0:32671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790964086.317011:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964086.317015:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.317016:0:32671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790964086.317018:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964086.317022:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.317024:0:32671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790964086.317027:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964086.317033:0:32671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000077f99e63) 00000020:00000080:3.0:1790964086.317043:0:32671:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790964086.317047:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790964086.317049:0:32671:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790964086.317051:0:32671:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790964086.317058:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790964086.317194:0:32671:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f5bdeb5 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790964086.317207:0:32671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ac6bf686) 00000020:00000080:3.0:1790964086.317222:0:32671:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790964086.317283:0:32671:0:(lod_dev.c:2309:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790964086.317290:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd2056616bb76690c 00000020:00000080:3.0:1790964086.317398:0:32671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790964086.317405:0:32671:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790964086.317410:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd2056616bb766913 00080000:01000000:3.0:1790964086.317415:0:32671:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790964086.317418:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd2056616bb76691a 00010000:00010000:3.0:1790964086.426328:0:32671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790964086.433025:0:32671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934593 00000001:00080000:1.0:1790964086.433441:0:32671:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790964086.434134:0:32671:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002b956d72) 00000020:00000080:1.0:1790964086.434155:0:32671:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790964086.434258:0:32671:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790964086.434265:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd2056616bb766928 00000020:00000080:3.0:1790964086.437395:0:32671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790964086.451379:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd2056616bb76692f 00000020:00000080:0.0:1790964086.452049:0:32671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790964086.452062:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790964086.452068:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964086.452071:0:32671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790964086.452074:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790964086.452077:0:32671:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1790964086.452079:0:32671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790964086.452081:0:32671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790964086.452082:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790964086.452084:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964086.452086:0:32671:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790964086.452089:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790964086.452121:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964086.452123:0:32671:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790964086.452135:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790964086.452180:0:32671:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790964086.452194:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790964086.452198:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964086.452199:0:32671:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790964086.452201:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790964086.452204:0:32671:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790964086.452208:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964086.452209:0:32671:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790964086.452211:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790964086.452216:0:32671:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:0.0:1790964086.452243:0:32671:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790964086.452246:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790964086.452259:0:32671:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (00000000bfab059b) 00000020:00000080:0.0:1790964086.452275:0:32671:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790964086.452281:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790964086.452340:0:32671:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790964086.452347:0:32671:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790964086.452354:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd2056616bb76693d 00010000:00080000:0.0:1790964086.452388:0:32671:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae8ed40a@lustre-OST0000-osc-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1790964086.452620:0:32671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1790964086.453030:0:32671:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1790964086.453075:0:32671:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790964086.457754:0:32671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790964086.458496:0:32671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790964086.458598:0:32671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790964086.467481:0:32675:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790964086.467494:0:32675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790964086.468343:0:32671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790964086.468358:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790964086.468398:0:32671:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790964086.468429:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd2056616bb766944 00000100:00080000:3.0:1790964086.468440:0:32671:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964086.468446:0:32671:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000ae8ed40a using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1790964086.468481:0:32671:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000931640fa x1877961941714176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790964086.468509:0:32671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790964086.468565:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964086.468569:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.468571:0:32671:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790964086.468574:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790964086.468576:0:32671:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1790964086.468578:0:32671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964086.468579:0:32671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964086.468581:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790964086.468583:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.468584:0:32671:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790964086.468587:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964086.468591:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.468592:0:32671:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790964086.468595:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790964086.468599:0:32671:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:00000080:3.0:1790964086.468622:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964086.468632:0:32671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000007cd940d3) 00000020:00000080:3.0:1790964086.468642:0:32671:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790964086.468646:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790964086.468694:0:32671:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790964086.468698:0:32671:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790964086.468702:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd2056616bb766952 00010000:00080000:3.0:1790964086.468727:0:32671:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000808acfe1@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:3.0:1790964086.470397:0:32671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000100:00100000:2.0:1790964086.470695:0:31804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000931640fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31804:1877961941714176:0@lo:8: 00000400:00000100:2.0:1790964086.470756:0:31804:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877961941714176 offset 0 length 520: 4 00000020:00000080:3.0:1790964086.476614:0:32671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790964086.476636:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790964086.476674:0:32671:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790964086.476695:0:32671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd2056616bb766959 00000100:00080000:3.0:1790964086.476706:0:32671:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964086.476711:0:32671:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000808acfe1 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1790964086.476747:0:32671:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a33ce80c x1877961941714304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790964086.476829:0:31804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a33ce80c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31804:1877961941714304:0@lo:38: 00000100:00100000:2.0:1790964086.476901:0:31804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790964086.476973:0:32671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1790964086.477046:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964086.477050:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.477052:0:32671:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1790964086.477055:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964086.477059:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.477061:0:32671:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790964086.477063:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790964086.477065:0:32671:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 00000100:00100000:3.0:1790964086.477089:0:32671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32671:1877961941714432:0@lo:502: 00000100:00100000:3.0:1790964086.477163:0:32671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.477193:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941714432 00000100:00100000:3.0:1790964086.477201:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941714432 00000100:00100000:3.0:1790964086.477235:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790964086.477243:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a39e5858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32671:x1877961941714432:12345-0@lo:502: 00000100:00100000:1.0:1790964086.477522:0:32655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941714304 00000100:00100000:1.0:1790964086.477528:0:32655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941714304 00000100:00100000:1.0:1790964086.477551:0:32655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964086.477557:0:32655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d775c42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31804:x1877961941714304:12345-0@lo:38: 00010000:00020000:1.0:1790964086.477571:0:32655:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790964086.477689:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a39e5858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32671:x1877961941714432:12345-0@lo:502: Request processed in 447us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964086.477698:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790964086.477740:0:32671:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034e74328 going to sleep for 11 seconds 00000100:00100000:3.0:1790964086.477760:0:32671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32671:1877961941714432:0@lo:502: 00000020:01000000:3.0:1790964086.477786:0:32671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964086.477808:0:32671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964086.477810:0:32671:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790964086.477814:0:32671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1790964086.481480:0:32632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:2.0:1790964086.481516:0:32632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790964086.481537:0:32632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000edf5acec/0xd2056616bb7668e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668e9 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.481549:0:32632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000edf5acec/0xd2056616bb7668e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7668e9 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964086.481556:0:32632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3f467d8000 from 1 10000000:01000000:2.0:1790964086.481559:0:32632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790964086.481602:0:32632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.481610:0:32632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.481620:0:32632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964086.481641:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d74799e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714560:0@lo:101: 00000100:00100000:2.0:1790964086.481704:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.481805:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 00000000021b5f8b going to sleep for 11 seconds 00000100:00100000:0.0:1790964086.484198:0:32644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941714560 00000100:00100000:0.0:1790964086.484212:0:32644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941714560 00000100:00100000:0.0:1790964086.484274:0:32644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790964086.484284:0:32644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000149db654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+9:32632:x1877961941714560:12345-0@lo:101: 00010000:00010000:0.0:1790964086.484300:0:32644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964086.484335:0:32644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2056616bb766960 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964086.484378:0:32644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd2056616bb766960 expref: 10 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964086.484390:0:32644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb766960 expref: 10 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964086.484399:0:32644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065273703, rc 0) 00000100:00100000:0.0:1790964086.484578:0:32644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000149db654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+10:32632:x1877961941714560:12345-0@lo:101: Request processed in 296us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.484586:0:32644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790964086.484675:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d74799e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714560:0@lo:101: 00010000:00010000:3.0:1790964086.484692:0:32632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.484701:0:32632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964086.485285:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714688:0@lo:256: 00000100:00100000:3.0:1790964086.485327:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.485360:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034e74328 going to sleep for 11 seconds 00000100:00100000:0.0:1790964086.485504:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941714688 00000100:00100000:0.0:1790964086.485510:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941714688 00000100:00100000:0.0:1790964086.485544:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790964086.485552:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da64d3bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+10:32632:x1877961941714688:12345-0@lo:256: 20000000:01000000:0.0:1790964086.485568:0:32645:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790964086.485574:0:32645:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790964086.485641:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da64d3bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+10:32632:x1877961941714688:12345-0@lo:256: Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.485648:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790964086.485738:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714688:0@lo:256: 10000000:01000000:3.0:1790964086.486348:0:32632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790964086.486363:0:32632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.486372:0:32632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964086.486380:0:32632:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3f467d8000 from 1 10000000:01000000:3.0:1790964086.486383:0:32632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790964086.486410:0:32632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000d4cdc7f8/0xd2056616bb76696e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964086.486546:0:32655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d775c42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31804:x1877961941714304:12345-0@lo:38: Request processed in 8987us (9644us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790964086.486556:0:32655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790964086.486694:0:32632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000d4cdc7f8/0xd2056616bb76696e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.486718:0:32632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000d4cdc7f8/0xd2056616bb76696e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964086.486735:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714816:0@lo:101: 00000100:00100000:3.0:1790964086.486775:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.486826:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034e74328 going to sleep for 11 seconds 00000100:00100000:1.0:1790964086.487570:0:32644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941714816 00000100:00100000:1.0:1790964086.487579:0:32644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941714816 00000100:00100000:1.0:1790964086.487618:0:32644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790964086.487626:0:32644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005652cd66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+10:32632:x1877961941714816:12345-0@lo:101: 00010000:00010000:1.0:1790964086.487641:0:32644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964086.487660:0:32644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000349eb40b/0xd2056616bb766975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2056616bb76696e expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.487684:0:32644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000349eb40b/0xd2056616bb766975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd2056616bb76696e expref: 11 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.487693:0:32644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000349eb40b/0xd2056616bb766975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb76696e expref: 11 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964086.487700:0:32644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000349eb40b, rc 0) 00000100:00100000:1.0:1790964086.487754:0:32644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005652cd66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32632:x1877961941714816:12345-0@lo:101: Request processed in 129us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964086.487761:0:32644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790964086.487893:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714816:0@lo:101: 00010000:00010000:3.0:1790964086.487906:0:32632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000d4cdc7f8/0xd2056616bb76696e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766975 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.487915:0:32632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000d4cdc7f8/0xd2056616bb76696e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd2056616bb766975 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964086.487971:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714944:0@lo:501: 00000100:00100000:3.0:1790964086.488002:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.488077:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034e74328 going to sleep for 11 seconds 00000100:00080000:2.0:1790964086.488634:0:31804:0:(import.c:65:import_set_state_nolock()) 00000000808acfe1 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964086.488656:0:31804:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790964086.488660:0:31804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a33ce80c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31804:1877961941714304:0@lo:38: 00000100:00100000:0.0:1790964086.492323:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941714944 00000100:00100000:0.0:1790964086.492341:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941714944 00000100:00100000:0.0:1790964086.492485:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790964086.492496:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b943b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32632:x1877961941714944:12345-0@lo:501: 00000100:00100000:0.0:1790964086.492948:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b943b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32632:x1877961941714944:12345-0@lo:501: Request processed in 454us (4945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.492957:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790964086.493048:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941714944:0@lo:501: 00000100:00100000:3.0:1790964086.493124:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715072:0@lo:503: 00000100:00100000:3.0:1790964086.493172:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.496982:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034e74328 going to sleep for 11 seconds 00000100:00100000:1.0:1790964086.498249:0:32644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715072 00000100:00100000:1.0:1790964086.498266:0:32644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715072 00000100:00100000:0.0:1790964086.505518:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790964086.505544:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2030464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32632:x1877961941715072:12345-0@lo:503: 00000040:00080000:0.0:1790964086.505632:0:32643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790964086.507637:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2030464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32632:x1877961941715072:12345-0@lo:503: Request processed in 2100us (14459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.507653:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790964086.508914:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715072:0@lo:503: 00000040:00080000:0.0:1790964086.521398:0:32679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790964086.523800:0:32632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790964086.523834:0:32632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790964086.523857:0:32632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000d4cdc7f8/0xd2056616bb76696e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766975 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.523892:0:32632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000d4cdc7f8/0xd2056616bb76696e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766975 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964086.523938:0:32632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790964086.523940:0:32632:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3f467d8000 10000000:01000000:3.0:1790964086.523943:0:32632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3f467d8000 10000000:01000000:3.0:1790964086.523947:0:32632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790964086.523953:0:32632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3f467d8000 from 1 10000000:01000000:3.0:1790964086.523955:0:32632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790964086.523994:0:32632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000beccef21/0xd2056616bb76697c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.524001:0:32632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000beccef21/0xd2056616bb76697c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.524011:0:32632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000beccef21/0xd2056616bb76697c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964086.524032:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715200:0@lo:101: 00000100:00100000:3.0:1790964086.524381:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.524448:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067a22593 going to sleep for 11 seconds 00000100:00100000:2.0:1790964086.524502:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715200 00000100:00100000:2.0:1790964086.524510:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715200 00000100:00100000:2.0:1790964086.524561:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790964086.524570:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ef6cbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32632:x1877961941715200:12345-0@lo:101: 00010000:00010000:2.0:1790964086.524585:0:32645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790964086.524598:0:32645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff657305/0xd2056616bb766983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2056616bb76697c expref: -99 pid: 32645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.524620:0:32645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff657305/0xd2056616bb766983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd2056616bb76697c expref: 12 pid: 32645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.524630:0:32645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff657305/0xd2056616bb766983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb76697c expref: 12 pid: 32645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.524639:0:32645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff657305, rc 0) 00000100:00100000:2.0:1790964086.524691:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ef6cbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32632:x1877961941715200:12345-0@lo:101: Request processed in 121us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964086.524698:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790964086.524841:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715200:0@lo:101: 00010000:00010000:3.0:1790964086.524855:0:32632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000beccef21/0xd2056616bb76697c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766983 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.524863:0:32632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000beccef21/0xd2056616bb76697c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd2056616bb766983 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964086.524927:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715328:0@lo:501: 00000100:00100000:3.0:1790964086.524954:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.525018:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067a22593 going to sleep for 11 seconds 00000100:00100000:0.0:1790964086.527674:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715328 00000100:00100000:0.0:1790964086.527691:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715328 00000100:00100000:0.0:1790964086.527759:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790964086.527768:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006ebf940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32632:x1877961941715328:12345-0@lo:501: 00000100:00100000:0.0:1790964086.529909:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006ebf940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32632:x1877961941715328:12345-0@lo:501: Request processed in 2132us (4945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.529927:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790964086.534997:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715328:0@lo:501: 00000100:00100000:3.0:1790964086.535068:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715456:0@lo:503: 00000100:00100000:3.0:1790964086.535188:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.535342:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067a22593 going to sleep for 11 seconds 00000100:00100000:1.0:1790964086.535465:0:32644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715456 00000100:00100000:1.0:1790964086.535480:0:32644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715456 00000100:00100000:1.0:1790964086.535534:0:32644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790964086.535543:0:32644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d99ed8ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32632:x1877961941715456:12345-0@lo:503: 00000100:00100000:1.0:1790964086.535743:0:32644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d99ed8ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32632:x1877961941715456:12345-0@lo:503: Request processed in 201us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964086.535751:0:32644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790964086.535780:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715456:0@lo:503: 00000100:00100000:2.0:1790964086.536899:0:32680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d74799e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32680:1877961941715584:0@lo:502: 00000100:00100000:2.0:1790964086.536955:0:32680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.536993:0:32680:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7c7a53c going to sleep for 11 seconds 00000100:00100000:0.0:1790964086.537486:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715584 00000100:00100000:0.0:1790964086.537494:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715584 00000100:00100000:0.0:1790964086.537531:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790964086.537539:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093a52053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32680:x1877961941715584:12345-0@lo:502: 00000100:00100000:0.0:1790964086.537767:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093a52053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32680:x1877961941715584:12345-0@lo:502: Request processed in 228us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.537776:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790964086.537846:0:32680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d74799e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32680:1877961941715584:0@lo:502: 00000020:01000004:2.0:1790964086.537904:0:32680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790964086.537919:0:32680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005ca8c8e4) 00000020:00000080:2.0:1790964086.537939:0:32680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790964086.538015:0:32680:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f5bdeb5 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790964086.538019:0:32680:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005f5bdeb5 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790964086.538021:0:32680:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005f5bdeb5 4 00010000:00080000:2.0:1790964086.538056:0:32680:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000304291c9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:2.0:1790964086.539716:0:32680:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790964086.539924:0:32680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790964086.539956:0:32680:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790964086.539968:0:32680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd2056616bb766991 00000100:00080000:2.0:1790964086.539977:0:32680:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790964086.539983:0:32680:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000304291c9 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1790964086.540027:0:32680:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d74799e0 x1877961941715712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790964086.540057:0:32680:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790964086.543807:0:31804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d74799e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31804:1877961941715712:0@lo:38: 00000100:00100000:0.0:1790964086.543899:0:31804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964086.544191:0:32680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f551738 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32680:1877961941715840:0@lo:502: 00000100:00100000:0.0:1790964086.544372:0:32680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964086.544407:0:32644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715840 00000100:00100000:0.0:1790964086.544415:0:32644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715840 00000100:00100000:0.0:1790964086.544464:0:32644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790964086.544473:0:32644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee3ec321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32680:x1877961941715840:12345-0@lo:502: 00000100:00100000:0.0:1790964086.544717:0:32644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee3ec321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32680:x1877961941715840:12345-0@lo:502: Request processed in 245us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964086.544725:0:32644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790964086.544772:0:32680:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051e06373 going to sleep for 11 seconds 00000100:00100000:0.0:1790964086.544805:0:32680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f551738 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74395bcb-647f-40d7-b64f-5c134e7cfca1:32680:1877961941715840:0@lo:502: 00000040:00080000:0.0:1790964086.544832:0:32680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:1.0:1790964086.544860:0:32650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715712 00000100:00100000:1.0:1790964086.544865:0:32650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715712 00000100:00100000:1.0:1790964086.544892:0:32650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964086.544897:0:32650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea73f517 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31804:x1877961941715712:12345-0@lo:38: 00000100:00100000:1.0:1790964086.544949:0:32650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea73f517 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31804:x1877961941715712:12345-0@lo:38: Request processed in 51us (1050us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790964086.544955:0:32650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964086.544995:0:31804:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790964086.545002:0:31804:0:(import.c:65:import_set_state_nolock()) 00000000304291c9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790964086.545006:0:31804:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790964086.545009:0:31804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d74799e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31804:1877961941715712:0@lo:38: 00000020:01000000:3.0:1790964086.545362:0:32632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790964086.545382:0:32632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790964086.545407:0:32632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000beccef21/0xd2056616bb76697c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766983 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964086.545418:0:32632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000beccef21/0xd2056616bb76697c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb766983 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790964086.545464:0:32632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790964086.545467:0:32632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964086.545468:0:32632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964086.545470:0:32632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964086.545471:0:32632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964086.545472:0:32632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964086.545473:0:32632:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964086.545474:0:32632:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964086.545476:0:32632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964086.545477:0:32632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790964086.545481:0:32632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790964086.545483:0:32632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790964086.545485:0:32632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964086.545489:0:32632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964086.545490:0:32632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964086.545491:0:32632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964086.545492:0:32632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964086.545493:0:32632:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964086.545494:0:32632:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964086.545495:0:32632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964086.545495:0:32632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790964086.545512:0:32632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790964086.545524:0:32632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715968:0@lo:253: 00000100:00100000:3.0:1790964086.545559:0:32632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964086.545574:0:32632:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034e74328 going to sleep for 11 seconds 00000100:00100000:1.0:1790964086.545844:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941715968 00000100:00100000:1.0:1790964086.545850:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941715968 00000100:00100000:1.0:1790964086.545885:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790964086.545892:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9363274 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32632:x1877961941715968:12345-0@lo:253: 20000000:01000000:1.0:1790964086.545913:0:32643:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790964086.545927:0:32643:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790964086.652894:0:32643:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790964086.652915:0:32643:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790964086.653452:0:32666:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790964086.653457:0:32666:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790964086.653475:0:32666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653494:0:32666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb766960 expref: 12 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653501:0:32666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653543:0:32666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd2056616bb766960 expref: 12 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653557:0:32666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd2056616bb766960 expref: 12 pid: 32644 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964086.653569:0:32666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c289e1b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32666:1877961941716096:0@lo:104: 00000100:00100000:2.0:1790964086.653643:0:32666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.653700:0:32666:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf64fd31 going to sleep for 11 seconds 00000100:00100000:2.0:1790964086.653726:0:32633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941716096 00000100:00100000:2.0:1790964086.653733:0:32633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941716096 00000100:00100000:2.0:1790964086.653775:0:32633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790964086.653783:0:32633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000590c171 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74395bcb-647f-40d7-b64f-5c134e7cfca1+3:32666:x1877961941716096:12345-0@lo:104: 00010000:00010000:2.0:1790964086.653806:0:32633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653855:0:32633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790964086.653860:0:32633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000590c171 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74395bcb-647f-40d7-b64f-5c134e7cfca1+3:32666:x1877961941716096:12345-0@lo:104: Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964086.653866:0:32633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790964086.653889:0:32638:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790964086.653894:0:32638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653901:0:32638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d08e0756 already unused, calling callback (000000009d2a8492) 10000000:00010000:2.0:1790964086.653904:0:32638:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653911:0:32638:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790964086.653917:0:32638:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964086.653923:0:32638:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790964086.653951:0:32638:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653968:0:32638:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790964086.653985:0:32638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.653992:0:32638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 00000000d08e0756/0xd2056616bb766960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd2056616bb766967 expref: -99 pid: 32632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654008:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964086.654009:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964086.654011:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790964086.654068:0:31806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa2f289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74395bcb-647f-40d7-b64f-5c134e7cfca1:31806:1877961941716224:0@lo:103: 00000100:00100000:2.0:1790964086.654133:0:31806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964086.654227:0:32635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941716224 00000100:00100000:2.0:1790964086.654232:0:32635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941716224 00010000:00010000:2.0:1790964086.654249:0:32635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd2056616bb766960 expref: 13 pid: 32644 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964086.654272:0:32635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790964086.654278:0:32635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000138fa5b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74395bcb-647f-40d7-b64f-5c134e7cfca1+13:31806:x1877961941716224:12345-0@lo:103: 00010000:00010000:2.0:1790964086.654289:0:32635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790964086.654293:0:32635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd2056616bb766960 expref: 13 pid: 32644 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654302:0:32635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd2056616bb766960 expref: 13 pid: 32644 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654316:0:32635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654333:0:32635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790964086.654346:0:32635:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000889961s 00010000:00010000:2.0:1790964086.654350:0:32635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654355:0:32635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654361:0:32635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654367:0:32635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654372:0:32635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068026d76 already unused, calling callback (00000000fdd7c0c0) 00010000:00010000:2.0:1790964086.654376:0:32635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654383:0:32635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654390:0:32635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654399:0:32635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790964086.654427:0:32635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000138fa5b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74395bcb-647f-40d7-b64f-5c134e7cfca1+13:31806:x1877961941716224:12345-0@lo:103: Request processed in 149us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964086.654433:0:32635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790964086.654474:0:31806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa2f289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74395bcb-647f-40d7-b64f-5c134e7cfca1:31806:1877961941716224:0@lo:103: 00010000:00010000:2.0:1790964086.654503:0:32666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065273703/0xd2056616bb766967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd2056616bb766960 expref: 12 pid: 32644 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964086.654511:0:32666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c289e1b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32666:1877961941716096:0@lo:104: 00010000:00010000:2.0:1790964086.654521:0:32666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654529:0:32666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654534:0:32666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964086.654539:0:32666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068026d76/0xd2056616bb766998 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964086.663690:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9363274 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32632:x1877961941715968:12345-0@lo:253: Request processed in 117790us (118122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964086.663707:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790964086.663851:0:32632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6c7f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74395bcb-647f-40d7-b64f-5c134e7cfca1:32632:1877961941715968:0@lo:253: 10000000:01000000:0.0:1790964086.663865:0:32632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790964086.663868:0:32632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790964086.663870:0:32632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790964086.663872:0:32632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790964086.663873:0:32632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790964086.663874:0:32632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790964086.663875:0:32632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790964086.663876:0:32632:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790964086.663878:0:32632:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790964086.663879:0:32632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790964086.663881:0:32632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790964086.663898:0:32632:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790964086.673723:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790964086.673907:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790964086.674640:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790964086.674809:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790964086.675089:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790964086.675872:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790964086.680990:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790964086.681492:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790964086.681800:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790964086.681986:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790964086.682925:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790964086.683084:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:1.0:1790964086.751022:0:32632:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000004:02000000:1.0:1790964086.751030:0:32632:0:(lod_dev.c:733:lod_sub_init_llog()) *** cfs_fail_loc=2405, val=0*** 00000020:00080000:3.0:1790964086.752940:0:32686:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790964086.752950:0:32686:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790964086.754928:0:32687:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790964086.755274:0:32632:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1790964086.755645:0:32688:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@000000009a1c73f6 x1877961941716352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964086.755660:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00000040:01000000:2.0:1790964086.757861:0:32632:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790964086.757978:0:32632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790964086.762220:0:32632:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790964086.762244:0:32632:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790964086.762537:0:32632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790964086.763572:0:32632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790964086.764505:0:32687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790964086.765568:0:32632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790964086.765630:0:32632:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790964086.765908:0:32632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790964086.769141:0:32687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790964086.769225:0:32687:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:2.0:1790964086.775386:0:32632:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1790964086.784402:0:32632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1790964086.817369:0:32632:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790964086.817409:0:32632:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e2643c1b988 00100000:10000000:1.0:1790964086.817417:0:32632:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790964086.819046:0:32632:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790964086.819064:0:32632:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790964086.819078:0:32632:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790964086.819149:0:32632:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790964086.920371:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964087.821970:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00010000:00010000:2.0:1790964087.944261:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964088.842910:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00010000:00010000:1.0:1790964088.968597:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964089.864293:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00010000:00010000:3.0:1790964089.992599:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790964090.589491:0:32930:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all 00000400:00000001:1.0:1790964090.620450:0:32932:0:(debug.c:305:cfs_str2mask()) Process entered 00000100:00000001:2.0:1790964090.896484:0:32688:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964090.896491:0:32688:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964090.896493:0:32688:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964090.896498:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00000100:00000001:2.0:1790964090.896502:0:32688:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964090.896505:0:32688:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964090.896508:0:32688:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964090.896510:0:32688:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964090.896512:0:32688:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964091.016969:0:23299:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964091.016978:0:23299:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964091.016984:0:23299:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964091.016985:0:23299:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964091.017077:0:32639:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964091.017081:0:32639:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964091.017084:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:2.0:1790964091.162684:0:32941:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:2.0:1790964091.162700:0:32941:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964091.162706:0:32941:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.656229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 74395bcb-647f-40d7-b64f-5c134e7cfca1->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1790964091.656240:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1790964091.656251:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000a33ce80c. 00000020:00000040:3.0:1790964091.656258:0:8:0:(genops.c:1210:class_import_get()) import 0000000089249098 refcount=4 obd=MGC192.168.202.118@tcp 00000100:00000001:3.0:1790964091.656262:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964091.656265:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964091.656282:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964091.656289:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000088da9aa4. 00000100:00000001:3.0:1790964091.656295:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.656303:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 74395bcb-647f-40d7-b64f-5c134e7cfca1->MGS req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1790964091.656314:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964091.656316:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.656320:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a33ce80c] to pc [ptlrpcd_00_02+2] req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964091.656354:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:3.0:1790964091.656358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790964091.656361:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00000001:3.0:1790964091.656363:0:8:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:3.0:1790964091.656365:0:8:0:(import.c:65:import_set_state_nolock()) 00000000304291c9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:3.0:1790964091.656377:0:8:0:(import.c:520:import_select_connection()) Process entered 00000100:00000040:3.0:1790964091.656380:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000002ce3fa74 refcount 13 to 0@lo 00000100:00000001:3.0:1790964091.656383:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964091.656385:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 14 to 0@lo 00000100:00000001:3.0:1790964091.656387:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 00000020:00000001:3.0:1790964091.656390:0:8:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964091.656392:0:8:0:(genops.c:804:class_conn2export()) looking for export cookie 0xd2056616bb766991 00000020:00000001:3.0:1790964091.656395:0:8:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964091.656397:0:8:0:(lustre_handles.c:148:class_handle2object()) GET export 000000005d2fc5f8 refcount=7 00000020:00000001:3.0:1790964091.656399:0:8:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802092773376 : -127271616778240 : ffff8c3f447df000) 00000020:00000001:3.0:1790964091.656401:0:8:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446616802092773376 : -127271616778240 : ffff8c3f447df000) 00000100:00000040:3.0:1790964091.656403:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000002ce3fa74 refcount 13 to 0@lo 00000100:00000001:3.0:1790964091.656405:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964091.656407:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 14 to 0@lo 00000100:00000001:3.0:1790964091.656408:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 00000020:00000040:3.0:1790964091.656411:0:8:0:(genops.c:879:class_export_put()) PUTting export 000000005d2fc5f8 : new refcount 6 00000100:00080000:3.0:1790964091.656413:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000304291c9 using connection 192.168.202.118@tcp/0@lo 00000100:00000001:3.0:1790964091.656421:0:8:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964091.656424:0:8:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:3.0:1790964091.656430:0:8:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964091.656432:0:8:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.656434:0:8:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:3.0:1790964091.656437:0:8:0:(obd_class.h:895:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964091.656440:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000ea881b47. 00000020:00000040:3.0:1790964091.656442:0:8:0:(genops.c:1210:class_import_get()) import 00000000304291c9 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 02000000:00000001:3.0:1790964091.656445:0:8:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:3.0:1790964091.656446:0:8:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.656448:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964091.656450:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964091.656452:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964091.656455:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 0000000023bba707. 00000100:00000001:3.0:1790964091.656458:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964091.656463:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1790964091.656470:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964091.656471:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.656473:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea881b47] to pc [ptlrpcd_rcv+-1] req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964091.656488:0:8:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.656493:0:8:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (967) 00000100:00000001:2.0:1790964091.656546:0:31807:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:2.0:1790964091.656555:0:31807:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 0000000037160310. 00000020:00000010:2.0:1790964091.656560:0:31807:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 000000000c25d04c. 80000000:00000010:2.0:1790964091.656565:0:31807:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 00000000495dd651. 40000000:00000010:2.0:1790964091.656569:0:31807:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 000000008152dd9a. 00000008:00000010:2.0:1790964091.656574:0:31807:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 00000000498a5a86. 00020000:00000010:2.0:1790964091.656579:0:31807:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 00000000eb668212. 00008000:00000010:2.0:1790964091.656584:0:31807:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 00000000978d5c74. 00100000:00000010:2.0:1790964091.656589:0:31807:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 000000002a374565. 00040000:00000010:2.0:1790964091.656593:0:31807:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 00000000b47cbe2b. 00040000:00000010:2.0:1790964091.656596:0:31807:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 00000000e1112183. 00040000:00000010:2.0:1790964091.656599:0:31807:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 00000000717ae821. 00080000:00000010:2.0:1790964091.656603:0:31807:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 0000000034926f80. 00000004:00000010:2.0:1790964091.656606:0:31807:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 0000000028d59724. 00000004:00000010:2.0:1790964091.656611:0:31807:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 00000000a40722a2. 00000004:00000010:2.0:1790964091.656615:0:31807:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 000000009f5fb1a4. 00002000:00000010:2.0:1790964091.656619:0:31807:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 00000000159af5bc. 00000004:00000010:2.0:1790964091.656635:0:31807:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 00000000ca9dfa64. 00000080:00000010:2.0:1790964091.656641:0:31807:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 00000000405e778a. 00000080:00000010:2.0:1790964091.656651:0:31807:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 00000000b97815a1. 00000008:00000010:2.0:1790964091.656657:0:31807:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 000000006759f9e0. 00020000:00000010:2.0:1790964091.656660:0:31807:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 000000004eedeb25. 00008000:00000010:2.0:1790964091.656664:0:31807:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 000000000da538ef. 00000080:00000010:2.0:1790964091.656667:0:31807:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 00000000cda12c79. 00000100:00000001:2.0:1790964091.656670:0:31807:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964091.656672:0:31807:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964091.656676:0:31807:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.656683:0:31807:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964091.656685:0:31807:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964091.656688:0:31807:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1790964091.656691:0:31807:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964091.656693:0:31807:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964091.656695:0:31807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a33ce80c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74395bcb-647f-40d7-b64f-5c134e7cfca1:31807:1877961941716480:0@lo:400: 00000100:00000001:2.0:1790964091.656699:0:31807:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964091.656705:0:31807:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964091.656715:0:31807:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964091.656718:0:31807:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1790964091.656722:0:31807:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000595e9942. 02000000:00000001:2.0:1790964091.656724:0:31807:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1790964091.656729:0:31807:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000001d4ac652. 00000400:00000010:2.0:1790964091.656736:0:31807:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000009342fa80. 00000100:00000200:2.0:1790964091.656754:0:31807:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961941716480, portal 25 00000100:00000001:2.0:1790964091.656757:0:31807:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964091.656758:0:31807:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446616802037886336 : -127271671665280 : ffff8c3f41386d80) 00000100:00000040:2.0:1790964091.656763:0:31807:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.656770:0:31807:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964091.656772:0:31807:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964091.656775:0:31807:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000009541b9c2. 00000100:00000200:2.0:1790964091.656777:0:31807:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877961941716480, offset 0 00000400:00000200:2.0:1790964091.656782:0:31807:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964091.656800:0:31807:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964091.656810:0:31807:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff16700e00 00000400:00000200:2.0:1790964091.656815:0:31807:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x161 [2] + 0 00000400:00000010:2.0:1790964091.656819:0:31807:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000cb797aac. 00000400:00000200:2.0:1790964091.656825:0:31807:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000c05fb57e 00000400:00000200:2.0:1790964091.656833:0:31807:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964091.656837:0:31807:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:2.0:1790964091.656841:0:31807:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c05fb57e 00000400:00000010:2.0:1790964091.656843:0:31807:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000c05fb57e. 00000100:00000001:2.0:1790964091.656849:0:31807:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1790964091.656850:0:31807:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:2.0:1790964091.656853:0:31807:0:(events.c:341:request_in_callback()) incoming req@00000000e5d2d5b6 x1877961941716480 msgsize 224 00000100:00100000:2.0:1790964091.656857:0:31807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1790964091.656859:0:31807:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:2.0:1790964091.656876:0:31807:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:2.0:1790964091.656882:0:31807:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009541b9c2 00000400:00000010:2.0:1790964091.656883:0:31807:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000009541b9c2. 00000100:00000001:2.0:1790964091.656887:0:31807:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964091.656890:0:31807:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.656899:0:31807:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964091.656902:0:31807:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.656908:0:31807:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964091.656910:0:31807:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964091.656915:0:31807:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964091.656920:0:31807:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 0 is 4295629827 00000100:00000010:2.0:1790964091.656923:0:31807:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000d9d043d7. 00000100:00000001:2.0:1790964091.656930:0:31807:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 0 00000100:00000001:2.0:1790964091.656942:0:31807:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 1 is 4295629827 00000100:00000010:2.0:1790964091.656944:0:31807:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000b5c797c0. 00000100:00000001:2.0:1790964091.656948:0:31807:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 1 00000100:00000001:2.0:1790964091.656950:0:31807:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 2 is 4295629827 00000100:00000010:2.0:1790964091.656958:0:31807:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000e759e8b8. 00000100:00000001:2.0:1790964091.656960:0:31807:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 2 00000100:00000001:2.0:1790964091.656963:0:31807:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 3 is 4295629827 00000100:00000010:2.0:1790964091.656965:0:31807:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000008f173ee5. 00000100:00000001:2.0:1790964091.656967:0:31807:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 3 00000100:00000001:2.0:1790964091.656973:0:31807:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964091.656976:0:31807:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964091.656979:0:31807:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964091.656981:0:31807:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964091.656987:0:31807:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964091.656989:0:31807:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1790964091.656991:0:31807:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964091.656992:0:31807:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964091.656993:0:31807:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964091.656995:0:31807:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.657059:0:32645:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964091.657062:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941716480 02000000:00000001:3.0:1790964091.657064:0:32645:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964091.657066:0:32645:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964091.657067:0:31808:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964091.657068:0:32645:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964091.657072:0:32645:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964091.657073:0:31808:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 00000000c7798781. 00000100:00100000:3.0:1790964091.657077:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941716480 00000020:00000010:0.0:1790964091.657077:0:31808:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 000000001d16e9fd. 00000020:00000001:3.0:1790964091.657079:0:32645:0:(genops.c:792:class_conn2export()) Process entered 80000000:00000010:0.0:1790964091.657079:0:31808:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 0000000019d0ce17. 00000020:00000040:3.0:1790964091.657080:0:32645:0:(genops.c:804:class_conn2export()) looking for export cookie 0xd2056616bb7668bf 00000020:00000001:3.0:1790964091.657082:0:32645:0:(lustre_handles.c:130:class_handle2object()) Process entered 40000000:00000010:0.0:1790964091.657082:0:31808:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 00000000d44f7533. 00000020:00000040:3.0:1790964091.657084:0:32645:0:(lustre_handles.c:148:class_handle2object()) GET export 0000000028ed3367 refcount=11 00000020:00000001:3.0:1790964091.657110:0:32645:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802309058560 : -127271400493056 : ffff8c3f51623000) 00000020:00000001:3.0:1790964091.657112:0:32645:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446616802309058560 : -127271400493056 : ffff8c3f51623000) 00000100:00000001:3.0:1790964091.657116:0:32645:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964091.657121:0:32645:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000005b188efe. 00000100:00000001:3.0:1790964091.657124:0:32645:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964091.657126:0:32645:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000005b188efe. 00000008:00000010:0.0:1790964091.657128:0:31808:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 00000000bf9868c0. 00000020:00000010:3.0:1790964091.657132:0:32645:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f0c56ac. 00020000:00000010:0.0:1790964091.657132:0:31808:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 000000005484d1a0. 00000020:00000010:3.0:1790964091.657136:0:32645:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000002adc9d70. 00000020:00000010:3.0:1790964091.657140:0:32645:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000002007ff88. 00008000:00000010:0.0:1790964091.657143:0:31808:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 00000000fb1e1249. 00100000:00000010:0.0:1790964091.657146:0:31808:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 000000004c5e8933. 00000100:00000040:3.0:1790964091.657148:0:32645:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:3.0:1790964091.657151:0:32645:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964091.657152:0:32645:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00040000:00000010:0.0:1790964091.657153:0:31808:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 00000000e0db3fc4. 00000100:00000001:3.0:1790964091.657154:0:32645:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00040000:00000010:0.0:1790964091.657155:0:31808:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 000000003f5b076e. 00040000:00000010:0.0:1790964091.657157:0:31808:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 00000000e11b0ebc. 00080000:00000010:0.0:1790964091.657159:0:31808:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 000000000a87698f. 00000100:00000001:3.0:1790964091.657161:0:32645:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000004:00000010:0.0:1790964091.657162:0:31808:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 00000000b8750472. 00000004:00000010:0.0:1790964091.657165:0:31808:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 00000000b5b05b17. 00000004:00000010:0.0:1790964091.657167:0:31808:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 00000000102c26d5. 00000100:00000001:3.0:1790964091.657168:0:32645:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00002000:00000010:0.0:1790964091.657170:0:31808:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 00000000aece6f65. 00000004:00000010:0.0:1790964091.657172:0:31808:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 0000000076592956. 00000100:00000001:3.0:1790964091.657176:0:32645:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964091.657178:0:32645:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964091.657182:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000080:00000010:0.0:1790964091.657182:0:31808:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 00000000de3f3394. 00000100:00000040:3.0:1790964091.657185:0:32645:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 0000000028ed3367 : new rpc_count 1 00000080:00000010:0.0:1790964091.657186:0:31808:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 00000000077b6d8a. 00000100:00000001:3.0:1790964091.657187:0:32645:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446616802088971344 : -127271620580272 : ffff8c3f4443ec50) 00000100:00000040:3.0:1790964091.657190:0:32645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000e5d2d5b6 x1877961941716480/t0(0) o400->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:667/0 lens 224/0 e 0 to 0 dl 1790964102 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000008:00000010:0.0:1790964091.657190:0:31808:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 00000000137e15dc. 00020000:00000010:0.0:1790964091.657192:0:31808:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 000000001384cbb2. 00008000:00000010:0.0:1790964091.657195:0:31808:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 000000006c8d3389. 00000080:00000010:0.0:1790964091.657198:0:31808:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 00000000474ba541. 00000100:00000001:3.0:1790964091.657199:0:32645:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:0.0:1790964091.657200:0:31808:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964091.657201:0:32645:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000005b188efe. 00000100:00000001:3.0:1790964091.657202:0:32645:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964091.657204:0:32645:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000005b188efe. 00000100:00100000:3.0:1790964091.657207:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d2d5b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:31807:x1877961941716480:12345-0@lo:400: 00000100:00000200:3.0:1790964091.657210:0:32645:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961941716480 00000020:00000001:3.0:1790964091.657212:0:32645:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1790964091.657215:0:32645:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1790964091.657218:0:32645:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964091.657220:0:32645:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1790964091.657226:0:32645:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669817024 : -1039734592 : ffffffffc206e8c0) 00000020:00000001:3.0:1790964091.657356:0:32645:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1790964091.657359:0:32645:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964091.657361:0:32645:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1790964091.657363:0:32645:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1790964091.657366:0:32645:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964091.657368:0:32645:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:3.0:1790964091.657370:0:32645:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964091.657372:0:32645:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1790964091.657375:0:32645:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 0000000072edc3e8. 02000000:00000001:3.0:1790964091.657378:0:32645:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.657380:0:32645:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964091.657382:0:32645:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1790964091.657384:0:32645:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961941716480 00010000:00000001:3.0:1790964091.657387:0:32645:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:3.0:1790964091.657391:0:32645:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000e5d2d5b6 x1877961941716480/t0(0) o400->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:667/0 lens 224/224 e 0 to 0 dl 1790964102 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964091.657399:0:32645:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964091.657401:0:32645:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964091.657404:0:32645:0:(import.c:2195:obd_at_measure()) add 1 to 000000000149aadd time=6 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964091.657408:0:32645:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964091.657409:0:32645:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 15 to 0@lo 00000100:00000001:3.0:1790964091.657411:0:32645:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 02000000:00000001:3.0:1790964091.657413:0:32645:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964091.657415:0:32645:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.657417:0:32645:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964091.657418:0:32645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964091.657421:0:32645:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000e80a28d1. 00000100:00000200:3.0:1790964091.657424:0:32645:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877961941716480, offset 224 00000400:00000200:3.0:1790964091.657428:0:32645:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964091.657434:0:32645:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964091.657440:0:32645:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff16700e00 00000400:00000200:3.0:1790964091.657444:0:32645:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xaa9 [1] + 224 00000400:00000200:3.0:1790964091.657448:0:32645:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964091.657451:0:32645:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964091.657460:0:32645:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964091.657464:0:32645:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964091.657472:0:32645:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.657512:0:31807:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964091.657515:0:31807:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964091.657583:0:31804:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964091.657589:0:31804:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964091.657591:0:31804:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964091.657593:0:31804:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964091.657594:0:31804:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964091.657596:0:31804:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964091.657600:0:31804:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964091.657608:0:31804:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964091.657616:0:31804:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964091.657619:0:31804:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964091.657620:0:31804:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964091.657622:0:31804:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964091.657625:0:31804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea881b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31804:1877961941716608:0@lo:38: 00000100:00000001:1.0:1790964091.657629:0:31804:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964091.657631:0:31804:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964091.657632:0:31804:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964091.657633:0:31804:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964091.657636:0:31804:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000847872e7. 02000000:00000001:1.0:1790964091.657638:0:31804:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964091.657642:0:31804:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000070007e3b. 00000400:00000010:1.0:1790964091.657646:0:31804:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000004adb2d20. 00000100:00000200:1.0:1790964091.657649:0:31804:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961941716608, portal 10 00000100:00000001:1.0:1790964091.657650:0:31804:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964091.657651:0:31804:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446616802037887232 : -127271671664384 : ffff8c3f41387100) 00000100:00000040:1.0:1790964091.657657:0:31804:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964101 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964091.657662:0:31804:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964091.657664:0:31804:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964091.657665:0:31804:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000e5629541. 00000100:00000200:1.0:1790964091.657667:0:31804:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1877961941716608, offset 0 00000400:00000200:1.0:1790964091.657672:0:31804:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964091.657677:0:31804:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964091.657682:0:31804:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 12 MB=0x6abff16700e80 00000400:00000200:1.0:1790964091.657686:0:31804:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 520/520 into md 0x229 [64] + 520 00000400:00000200:1.0:1790964091.657691:0:31804:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964091.657693:0:31804:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964091.657697:0:31804:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964091.657698:0:31804:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:1.0:1790964091.657701:0:31804:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000002c90de5b. 00000100:00000040:1.0:1790964091.657704:0:31804:0:(events.c:341:request_in_callback()) incoming req@000000002c90de5b x1877961941716608 msgsize 520 00000100:00100000:1.0:1790964091.657719:0:31804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1790964091.657726:0:31804:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964091.657737:0:31804:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000e5629541 00000400:00000010:1.0:1790964091.657750:0:31804:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000e5629541. 00000100:00000001:1.0:1790964091.657754:0:31804:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964091.657757:0:31804:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964101 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964091.657764:0:31804:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964091.657766:0:31804:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964101 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964091.657772:0:31804:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964091.657773:0:31804:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964091.657777:0:31804:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964091.657780:0:31804:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6168 usecs (7 jiffies) 00000100:00000001:1.0:1790964091.657782:0:31804:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295629832 00000100:00000001:1.0:1790964091.657787:0:31804:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295629827 00000100:00000001:0.0:1790964091.657789:0:32652:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000001:1.0:1790964091.657790:0:31804:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295629832 00000100:00100000:0.0:1790964091.657791:0:32652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941716608 00000100:00000001:1.0:1790964091.657792:0:31804:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295629827 02000000:00000001:0.0:1790964091.657792:0:32652:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964091.657794:0:31804:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295629832 00000100:00000001:0.0:1790964091.657794:0:32652:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964091.657795:0:32652:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964091.657797:0:31804:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295629827 02000000:00000001:0.0:1790964091.657797:0:32652:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964091.657799:0:31804:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295629832 00000100:00100000:0.0:1790964091.657800:0:32652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941716608 00000100:00000001:1.0:1790964091.657801:0:31804:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295629827 00000020:00000001:0.0:1790964091.657801:0:32652:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964091.657803:0:32652:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000100:00000001:1.0:1790964091.657804:0:31804:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964091.657805:0:31804:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.657805:0:32652:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:0.0:1790964091.657806:0:32652:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964091.657808:0:31804:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.657808:0:32652:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964091.657810:0:31804:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:0.0:1790964091.657811:0:32652:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e2ad725b. 00000100:00000001:1.0:1790964091.657813:0:31804:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964091.657814:0:31804:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:0.0:1790964091.657814:0:32652:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000bcd744cf. 00000100:00000001:1.0:1790964091.657816:0:31804:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964091.657816:0:31804:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000020:00000010:0.0:1790964091.657817:0:32652:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000b567ca68. 00000100:00000001:1.0:1790964091.657818:0:31804:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964091.657819:0:31804:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964091.657820:0:32652:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964091.657821:0:32652:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964091.657824:0:32652:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964091.657827:0:32652:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964091.657847:0:32652:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964091.657848:0:32645:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964091.657854:0:32645:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000e80a28d1 00000400:00000010:3.0:1790964091.657856:0:32645:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000e80a28d1. 00000100:00000001:0.0:1790964091.657856:0:32652:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964091.657857:0:32652:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000001:3.0:1790964091.657858:0:32645:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964091.657860:0:32645:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00100000:0.0:1790964091.657860:0:32652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964091.657862:0:32652:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446616803116541568 : -127270593010048 : ffff8c3f81836680) 00000100:00000001:3.0:1790964091.657863:0:32645:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.657865:0:32645:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000002ce3fa74 refcount 14 to 0@lo 00000100:00000040:0.0:1790964091.657865:0:32652:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000002c90de5b x1877961941716608/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964091.657868:0:32645:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:3.0:1790964091.657869:0:32645:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964091.657871:0:32645:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1790964091.657873:0:32645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000e5d2d5b6 x1877961941716480/t0(0) o400->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:667/0 lens 224/224 e 0 to 0 dl 1790964102 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964091.657873:0:32652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c90de5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:31804:x1877961941716608:12345-0@lo:38: 00000100:00000200:0.0:1790964091.657877:0:32652:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961941716608 00000020:00000001:0.0:1790964091.657879:0:32652:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000100:00100000:3.0:1790964091.657881:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d2d5b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:31807:x1877961941716480:12345-0@lo:400: Request processed in 681us (1027us total) trans 0 rc 0/0 00010000:00000001:0.0:1790964091.657881:0:32652:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000100:00100000:3.0:1790964091.657887:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00000040:3.0:1790964091.657889:0:32645:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028ed3367 : new rpc_count 0 00000020:00000040:0.0:1790964091.657890:0:32652:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (0000000077f99e63) now 4 - find 00000100:00000001:3.0:1790964091.657891:0:32645:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964091.657892:0:32645:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000001:0.0:1790964091.657893:0:32652:0:(genops.c:655:class_str2obd()) Process leaving (rc=18446616802071235904 : -127271638315712 : ffff8c3f43354d40) 00000020:00000010:3.0:1790964091.657896:0:32645:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000002adc9d70. 00000100:00000001:0.0:1790964091.657898:0:32652:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000020:00000010:3.0:1790964091.657899:0:32645:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000002007ff88. 02000000:00000001:0.0:1790964091.657899:0:32652:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 00000020:00000010:3.0:1790964091.657902:0:32645:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f0c56ac. 02000000:00000010:0.0:1790964091.657902:0:32652:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 712 at 0000000053cd4730. 02000000:00000001:0.0:1790964091.657903:0:32652:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964091.657905:0:32652:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:3.0:1790964091.657906:0:32645:0:(genops.c:879:class_export_put()) PUTting export 0000000028ed3367 : new refcount 10 00010000:00000040:0.0:1790964091.657907:0:32652:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401047000022 tmp_exp_old_falloc: 0 02000000:00000001:3.0:1790964091.657909:0:32645:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:3.0:1790964091.657911:0:32645:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 0000000072edc3e8. 00010000:00080000:0.0:1790964091.657912:0:32652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 962 last 0 02000000:00000001:3.0:1790964091.657913:0:32645:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:3.0:1790964091.657915:0:32645:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:0.0:1790964091.657916:0:32652:0:(obd_class.h:859:obd_connect()) Process entered 00000100:00000200:3.0:1790964091.657918:0:32645:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000004:00000001:0.0:1790964091.657918:0:32652:0:(mdt_handler.c:7495:mdt_obd_connect()) Process entered 00000020:00000001:0.0:1790964091.657920:0:32652:0:(genops.c:1375:class_connect()) Process entered 00000400:00000010:3.0:1790964091.657922:0:32645:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000029eca100. 00000020:00000001:0.0:1790964091.657922:0:32652:0:(genops.c:931:__class_new_export()) Process entered 00000020:00000010:0.0:1790964091.657924:0:32652:0:(genops.c:933:__class_new_export()) kmalloced '(export)': 1208 at 000000001274f3dc. 00000020:00000001:0.0:1790964091.657926:0:32652:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:0.0:1790964091.657928:0:32652:0:(lustre_handles.c:93:class_handle_hash()) added object 000000001274f3dc with handle 0xd2056616bb76699f to hash 00000020:00000001:0.0:1790964091.657930:0:32652:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00000400:00000010:3.0:1790964091.657931:0:32645:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 000000008f1ebbe7. 00000020:00000001:0.0:1790964091.657932:0:32652:0:(obd_class.h:1015:obd_init_export()) Process entered 00000004:00000001:0.0:1790964091.657934:0:32652:0:(mdt_handler.c:7614:mdt_init_export()) Process entered 00000004:00000010:0.0:1790964091.657936:0:32652:0:(mdt_handler.c:7623:mdt_init_export()) kmalloced '(exp->exp_used_slots)': 64 at 00000000ab08a3f9. 00000001:00000001:0.0:1790964091.657938:0:32652:0:(tgt_lastrcvd.c:423:tgt_client_alloc()) Process entered 00000001:00000010:0.0:1790964091.657941:0:32652:0:(tgt_lastrcvd.c:431:tgt_client_alloc()) kmalloced '(exp->u.eu_target_data.ted_lcd)': 128 at 00000000f229eebf. 00000001:00000001:0.0:1790964091.657947:0:32652:0:(tgt_lastrcvd.c:438:tgt_client_alloc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964091.657949:0:32652:0:(ldlm_lockd.c:3138:ldlm_init_export()) Process entered 00000001:00000001:0.0:1790964091.657952:0:32652:0:(hash.c:1038:cfs_hash_create()) Process entered 00000001:00000010:0.0:1790964091.657956:0:32652:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 000000004d939aba. 00000001:00000010:0.0:1790964091.657960:0:32652:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 000000003c59a8e8. 00000001:00000010:0.0:1790964091.657964:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000cbfde3a7. 00000001:00000010:0.0:1790964091.657966:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000c7a74c95. 00000001:00000010:0.0:1790964091.657968:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000ebad2a00. 00000001:00000010:0.0:1790964091.657970:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000007cd61024. 00000001:00000001:0.0:1790964091.657973:0:32652:0:(hash.c:1038:cfs_hash_create()) Process entered 00000001:00000010:0.0:1790964091.657975:0:32652:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 00000000e9affecc. 00000001:00000010:0.0:1790964091.657977:0:32652:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 00000000e77abe5c. 00000001:00000010:0.0:1790964091.657978:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000dcc187dd. 00000001:00000010:0.0:1790964091.657980:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000dcc439a6. 00000001:00000010:0.0:1790964091.657982:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000001f605b99. 00000001:00000010:0.0:1790964091.657984:0:32652:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 0000000092731020. 00010000:00000001:0.0:1790964091.657986:0:32652:0:(ldlm_flock.c:1138:ldlm_init_flock_export()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964091.657987:0:32652:0:(ldlm_lockd.c:3157:ldlm_init_export()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964091.657989:0:32652:0:(mdt_handler.c:7640:mdt_init_export()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.657991:0:32652:0:(obd_class.h:1019:obd_init_export()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1790964091.657993:0:32652:0:(genops.c:868:class_export_get()) GET export 000000001274f3dc refcount=3 00000020:00000040:0.0:1790964091.657997:0:32652:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (0000000077f99e63) now 5 - export 00000020:00000001:0.0:1790964091.657998:0:32652:0:(genops.c:1001:__class_new_export()) Process leaving (rc=18446616802682816512 : -127271026735104 : ffff8c3f67a94800) 00000020:00000040:0.0:1790964091.658000:0:32652:0:(genops.c:879:class_export_put()) PUTting export 000000001274f3dc : new refcount 2 00000020:00000080:0.0:1790964091.658002:0:32652:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd2056616bb76699f 00000020:00000001:0.0:1790964091.658003:0:32652:0:(genops.c:1386:class_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.658005:0:32652:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964091.658006:0:32652:0:(genops.c:804:class_conn2export()) looking for export cookie 0xd2056616bb76699f 00000020:00000001:0.0:1790964091.658008:0:32652:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964091.658009:0:32652:0:(lustre_handles.c:148:class_handle2object()) GET export 000000001274f3dc refcount=3 00000020:00000001:0.0:1790964091.658011:0:32652:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802682816512 : -127271026735104 : ffff8c3f67a94800) 00000020:00000001:0.0:1790964091.658012:0:32652:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446616802682816512 : -127271026735104 : ffff8c3f67a94800) 00000001:00000001:0.0:1790964091.658016:0:32652:0:(nodemap_handler.c:735:nodemap_add_member()) Process entered 00000001:00000001:0.0:1790964091.658023:0:32652:0:(nodemap_handler.c:520:nodemap_classify_nid()) Process entered 00000001:00000040:0.0:1790964091.658029:0:32652:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.118@tcp 00000001:00000040:0.0:1790964091.658033:0:32652:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=00000000253a1bf3) : new refcount 5 00000001:00000001:0.0:1790964091.658035:0:32652:0:(nodemap_handler.c:558:nodemap_classify_nid()) Process leaving (rc=18446616802587929600 : -127271121622016 : ffff8c3f62016c00) 00000001:00000001:0.0:1790964091.658038:0:32652:0:(nodemap_member.c:132:nm_member_add()) Process entered 00000020:00000040:0.0:1790964091.658040:0:32652:0:(genops.c:868:class_export_get()) GET export 000000001274f3dc refcount=4 00000001:00000040:0.0:1790964091.658042:0:32652:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=00000000253a1bf3) : new refcount 6 00000020:00000010:0.0:1790964091.658047:0:32652:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at 00000000b10bb98b. 00000020:00000010:0.0:1790964091.658051:0:32652:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 2752 at 00000000cff8c22c. 00000001:00000001:0.0:1790964091.658077:0:32652:0:(nodemap_member.c:170:nm_member_add()) Process leaving (rc=0 : 0 : 0) 00000001:08000000:0.0:1790964091.658080:0:32652:0:(nodemap_handler.c:809:nodemap_add_member()) lustre-MDT0000: adding NID 0@lo to nodemap default 00000001:00000040:0.0:1790964091.658083:0:32652:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=00000000253a1bf3) : new refcount 5 00000001:00000001:0.0:1790964091.658085:0:32652:0:(nodemap_handler.c:815:nodemap_add_member()) Process leaving (rc=0 : 0 : 0) 00000004:00100000:0.0:1790964091.658087:0:32652:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000001:0.0:1790964091.658090:0:32652:0:(tgt_lastrcvd.c:1061:tgt_client_new()) Process entered 00000001:00000001:0.0:1790964091.658112:0:32652:0:(tgt_lastrcvd.c:1068:tgt_client_new()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964091.658114:0:32652:0:(mdt_fs.c:50:mdt_export_stats_init()) Process entered 00000020:00000001:0.0:1790964091.658116:0:32652:0:(lprocfs_status_server.c:708:lprocfs_exp_setup()) Process entered 00000020:00000010:0.0:1790964091.658121:0:32652:0:(lprocfs_status_server.c:729:lprocfs_exp_setup()) kmalloced '(new_stat)': 96 at 000000006742d5eb. 00000020:00000040:0.0:1790964091.658125:0:32652:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats 000000006742d5eb for nid 0@lo - ref 2 00000020:00000001:0.0:1790964091.658174:0:32652:0:(lprocfs_status_server.c:781:lprocfs_exp_setup()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964091.658179:0:32652:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 0000000044bed749. 00000020:00000010:0.0:1790964091.658182:0:32652:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 1728 at 00000000ad37b6e9. 00000020:00000010:0.0:1790964091.658185:0:32652:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 1080 at 00000000ed2471ab. 00000020:00000010:0.0:1790964091.658203:0:32652:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 0000000012d06913. 00000020:00000010:0.0:1790964091.658206:0:32652:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 448 at 000000007ff6f23b. 00000020:00000010:0.0:1790964091.658208:0:32652:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 280 at 0000000019216c7d. 00000004:00000001:0.0:1790964091.658222:0:32652:0:(mdt_fs.c:75:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964091.658224:0:32652:0:(mdt_handler.c:7562:mdt_obd_connect()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964091.658226:0:32652:0:(obd_class.h:875:obd_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964091.658230:0:32652:0:(genops.c:1264:class_new_import()) kmalloced '(imp)': 1720 at 00000000ebeaa694. 00000020:00000040:0.0:1790964091.658232:0:32652:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (0000000077f99e63) now 6 - import 00000020:00000001:0.0:1790964091.658242:0:32652:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964091.658243:0:32652:0:(genops.c:1223:class_import_put()) import 00000000ebeaa694 refcount=1 obd=lustre-MDT0000 00000020:00000001:0.0:1790964091.658245:0:32652:0:(genops.c:1230:class_import_put()) Process leaving 00000020:00000040:0.0:1790964091.658248:0:32652:0:(genops.c:868:class_export_get()) GET export 000000001274f3dc refcount=5 00000100:00000040:0.0:1790964091.658250:0:32652:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export 000000001274f3dc : new rpc_count 1 00000100:00000001:0.0:1790964091.658252:0:32652:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:0.0:1790964091.658254:0:32652:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964091.658256:0:32652:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 15 to 0@lo 00000100:00000001:0.0:1790964091.658258:0:32652:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 00000100:00000001:0.0:1790964091.658260:0:32652:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446616802168986752 : -127271540564864 : 0xffff8c3f4908dc80) 00000100:00000040:0.0:1790964091.658263:0:32652:0:(connection.c:150:ptlrpc_connection_get()) conn=000000002ce3fa74 refcount 15 to 0@lo 00000020:00000040:0.0:1790964091.658265:0:32652:0:(genops.c:868:class_export_get()) GET export 000000001274f3dc refcount=6 00000100:00000001:0.0:1790964091.658269:0:32652:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964091.658271:0:32652:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 16 to 0@lo 00000100:00000001:0.0:1790964091.658273:0:32652:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 02000000:00000001:0.0:1790964091.658275:0:32652:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:0.0:1790964091.658278:0:32652:0:(sec.c:1444:sptlrpc_sec_create()) Process entered 02000000:08000000:0.0:1790964091.658280:0:32652:0:(sec.c:1452:sptlrpc_sec_create()) mdt lustre-MDT0000: reverse sec using flavor null 02000000:00000001:0.0:1790964091.658283:0:32652:0:(sec.c:1483:sptlrpc_sec_create()) Process leaving (rc=18446744072662308256 : -1047243360 : ffffffffc19455a0) 02000000:00000001:0.0:1790964091.658285:0:32652:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964091.658287:0:32652:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000100:00000001:0.0:1790964091.658289:0:32652:0:(recover.c:149:ptlrpc_resend()) Process entered 00000100:00000001:0.0:1790964091.658291:0:32652:0:(recover.c:178:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:0.0:1790964091.658293:0:32652:0:(import.c:65:import_set_state_nolock()) 00000000ebeaa694 : changing import state from RECOVER to FULL 00000100:00000001:0.0:1790964091.658296:0:32652:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:0.0:1790964091.658297:0:32652:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:0.0:1790964091.658299:0:32652:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1790964091.658301:0:32652:0:(genops.c:879:class_export_put()) PUTting export 000000001274f3dc : new refcount 5 00000020:00000040:0.0:1790964091.658303:0:32652:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (0000000077f99e63) now 6 - find 00010000:00000001:0.0:1790964091.658306:0:32652:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.658308:0:32652:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1790964091.658310:0:32652:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072671800272 : -1037751344 : ffffffffc2252bd0) 00000020:00000001:0.0:1790964091.658313:0:32652:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1790964091.658319:0:32652:0:(tgt_handler.c:559:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1790964091.658332:0:32652:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1790964091.658335:0:32652:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1790964091.658336:0:32652:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.658339:0:32652:0:(tgt_handler.c:1061:tgt_connect()) Process entered 00000001:00000001:0.0:1790964091.658344:0:32652:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:0.0:1790964091.658345:0:32652:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:0.0:1790964091.658347:0:32652:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:0.0:1790964091.658348:0:32652:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.658350:0:32652:0:(tgt_handler.c:1130:tgt_connect()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964091.658352:0:32652:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961941716608 00010000:00000001:0.0:1790964091.658354:0:32652:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:0.0:1790964091.658358:0:32652:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000002c90de5b x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964111 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964091.658365:0:32652:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964091.658375:0:32652:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964091.658378:0:32652:0:(import.c:2195:obd_at_measure()) add 1 to 00000000ec394f72 time=1790964091 v=10 (0 0 0 0) 00000100:00001000:0.0:1790964091.658381:0:32652:0:(import.c:2261:obd_at_measure()) AT 00000000ec394f72 change: old=10 new=5 delta=-5 (val=1) hist 1 0 0 0 00000100:00001000:0.0:1790964091.658385:0:32652:0:(niobuf.c:566:ptlrpc_at_set_reply()) @@@ svc mdt changed estimate from 10 to 5 req@000000002c90de5b x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964111 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00001000:0.0:1790964091.658392:0:32652:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x200 magic=bd00bd3/bd00bd3 len=416 00000100:00000001:0.0:1790964091.658395:0:32652:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964091.658396:0:32652:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 17 to 0@lo 00000100:00000001:0.0:1790964091.658398:0:32652:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 02000000:00000001:0.0:1790964091.658399:0:32652:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964091.658401:0:32652:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964091.658403:0:32652:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964091.658404:0:32652:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964091.658407:0:32652:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000526c68b8. 00000100:00000200:0.0:1790964091.658411:0:32652:0:(niobuf.c:94:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1877961941716608, offset 0 00000400:00000200:0.0:1790964091.658415:0:32652:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964091.658421:0:32652:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964091.658426:0:32652:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 416 into portal 10 MB=0x6abff16700e80 00000400:00000200:0.0:1790964091.658430:0:32652:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 416/416 into md 0xab5 [1] + 0 00000400:00000200:0.0:1790964091.658442:0:32652:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964091.658445:0:32652:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964091.658448:0:32652:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964091.658451:0:32652:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964101 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964091.658460:0:32652:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964101 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964091.658480:0:32652:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964091.658485:0:32652:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000526c68b8 00000400:00000010:0.0:1790964091.658487:0:32652:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000526c68b8. 00000100:00000001:0.0:1790964091.658489:0:32652:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964091.658490:0:32652:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964091.658493:0:32652:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964091.658495:0:32652:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000002ce3fa74 refcount 16 to 0@lo 00010000:00000001:0.0:1790964091.658496:0:32652:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:0.0:1790964091.658498:0:32652:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964091.658499:0:32652:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1790964091.658502:0:32652:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000002c90de5b x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964111 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964091.658509:0:32652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c90de5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:31804:x1877961941716608:12345-0@lo:38: Request processed in 637us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964091.658516:0:32652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000040:0.0:1790964091.658517:0:32652:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001274f3dc : new rpc_count 0 00000100:00000001:0.0:1790964091.658519:0:32652:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964091.658520:0:32652:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964091.658523:0:32652:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000bcd744cf. 00000020:00000010:0.0:1790964091.658525:0:32652:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000b567ca68. 00000020:00000010:0.0:1790964091.658528:0:32652:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e2ad725b. 00000020:00000040:0.0:1790964091.658530:0:32652:0:(genops.c:879:class_export_put()) PUTting export 000000001274f3dc : new refcount 4 00000100:00000001:0.0:1790964091.658532:0:32652:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964091.659308:0:31804:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964091.659313:0:31804:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964091.659318:0:31804:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964091.659321:0:31804:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964091.659323:0:31804:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000070007e3b. 00000400:00000200:3.0:1790964091.659328:0:31804:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000004adb2d20 00000400:00000010:3.0:1790964091.659329:0:31804:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000004adb2d20. 00000100:00000001:3.0:1790964091.659332:0:31804:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964091.659336:0:31804:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964101 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964091.659344:0:31804:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964101 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964091.659349:0:31804:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964091.659351:0:31804:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964091.659353:0:31804:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964091.659356:0:31804:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964091.659357:0:31804:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964091.659359:0:31804:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964091.659361:0:31804:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964091.659370:0:31804:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000df54095c. 00000100:00001000:3.0:1790964091.659375:0:31804:0:(import.c:2195:obd_at_measure()) add 5 to 0000000076d078b6 time=1790964091 v=5 (0 0 0 0) 00000100:00001000:3.0:1790964091.659378:0:31804:0:(import.c:2195:obd_at_measure()) add 1 to 00000000bfbf84c8 time=5 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964091.659381:0:31804:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964091.659382:0:31804:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964091.659384:0:31804:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1790964091.659388:0:31804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964091.659394:0:31804:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.659397:0:31804:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1790964091.659399:0:31804:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:3.0:1790964091.659400:0:31804:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1790964091.659401:0:31804:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.659404:0:31804:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964091.659424:0:31804:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964091.659427:0:31804:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964091.659428:0:31804:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964091.659430:0:31804:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00080000:3.0:1790964091.659435:0:31804:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000020:00000001:3.0:1790964091.659437:0:31804:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964091.659438:0:31804:0:(genops.c:804:class_conn2export()) looking for export cookie 0xd2056616bb766991 00000020:00000001:3.0:1790964091.659440:0:31804:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964091.659442:0:31804:0:(lustre_handles.c:148:class_handle2object()) GET export 000000005d2fc5f8 refcount=7 00000020:00000001:3.0:1790964091.659444:0:31804:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802092773376 : -127271616778240 : ffff8c3f447df000) 00000020:00000001:3.0:1790964091.659447:0:31804:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446616802092773376 : -127271616778240 : ffff8c3f447df000) 00000100:00001000:3.0:1790964091.659449:0:31804:0:(import.c:2195:obd_at_measure()) add 1 to 00000000bfbf84c8 time=1790964091 v=0 (0 0 0 0) 00000100:00001000:3.0:1790964091.659452:0:31804:0:(import.c:2261:obd_at_measure()) AT 00000000bfbf84c8 change: old=0 new=5 delta=5 (val=1) hist 1 0 0 0 00000100:00080000:3.0:1790964091.659456:0:31804:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000020:00000040:3.0:1790964091.659459:0:31804:0:(genops.c:879:class_export_put()) PUTting export 000000005d2fc5f8 : new refcount 6 00000100:00000001:3.0:1790964091.659461:0:31804:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:3.0:1790964091.659464:0:31804:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00080000:3.0:1790964091.659465:0:31804:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790964091.659468:0:31804:0:(import.c:65:import_set_state_nolock()) 00000000304291c9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000001:3.0:1790964091.659470:0:31804:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:3.0:1790964091.659471:0:31804:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:3.0:1790964091.659472:0:31804:0:(import.c:1285:ptlrpc_connect_interpret()) Process leaving via finish (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964091.659475:0:31804:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000100:00000001:3.0:1790964091.659477:0:31804:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.659480:0:31804:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.659483:0:31804:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964101 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964091.659490:0:31804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea881b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31804:1877961941716608:0@lo:38: 00000100:00000001:3.0:1790964091.659494:0:31804:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.659497:0:31804:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964091.659505:0:31804:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000ea881b47 x1877961941716608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964101 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964091.659511:0:31804:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964091.659513:0:31804:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964091.659515:0:31804:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000847872e7. 02000000:00000001:3.0:1790964091.659518:0:31804:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964091.659520:0:31804:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964091.659521:0:31804:0:(genops.c:1223:class_import_put()) import 00000000304291c9 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:3.0:1790964091.659523:0:31804:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964091.659525:0:31804:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 0000000023bba707. 02000000:00000001:3.0:1790964091.659528:0:31804:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964091.659530:0:31804:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964091.659532:0:31804:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000ea881b47. 00000100:00000001:3.0:1790964091.659535:0:31804:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964091.659536:0:31804:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964091.659538:0:31804:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.659539:0:31804:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964091.659541:0:31804:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964091.659542:0:31804:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964091.659543:0:31804:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:2.0:1790964091.659603:0:31807:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964091.659606:0:31807:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964091.659607:0:31807:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000001d4ac652. 00000400:00000200:2.0:1790964091.659610:0:31807:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009342fa80 00000400:00000010:2.0:1790964091.659612:0:31807:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000009342fa80. 00000100:00000001:2.0:1790964091.659615:0:31807:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964091.659619:0:31807:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964091.659626:0:31807:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.659632:0:31807:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964091.659634:0:31807:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964091.659635:0:31807:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964091.659637:0:31807:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964091.659638:0:31807:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964091.659639:0:31807:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964091.659641:0:31807:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964091.659643:0:31807:0:(import.c:2195:obd_at_measure()) add 5 to 0000000042d42df6 time=6 v=5 (5 0 0 0) 00000100:00001000:2.0:1790964091.659652:0:31807:0:(import.c:2195:obd_at_measure()) add 1 to 00000000445bc341 time=6 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964091.659654:0:31807:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964091.659656:0:31807:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964091.659657:0:31807:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1790964091.659658:0:31807:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964091.659660:0:31807:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964091.659663:0:31807:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.659668:0:31807:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964091.659670:0:31807:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964091.659671:0:31807:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1790964091.659673:0:31807:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964091.659679:0:31807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a33ce80c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74395bcb-647f-40d7-b64f-5c134e7cfca1:31807:1877961941716480:0@lo:400: 00000100:00000001:2.0:1790964091.659683:0:31807:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964091.659685:0:31807:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964091.659687:0:31807:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000a33ce80c x1877961941716480/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964107 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964091.659692:0:31807:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964091.659694:0:31807:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964091.659695:0:31807:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000595e9942. 02000000:00000001:2.0:1790964091.659698:0:31807:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964091.659699:0:31807:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964091.659700:0:31807:0:(genops.c:1223:class_import_put()) import 0000000089249098 refcount=3 obd=MGC192.168.202.118@tcp 00000020:00000001:2.0:1790964091.659702:0:31807:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964091.659703:0:31807:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 0000000088da9aa4. 02000000:00000001:2.0:1790964091.659719:0:31807:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964091.659720:0:31807:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964091.659721:0:31807:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000a33ce80c. 00000100:00000001:2.0:1790964091.659725:0:31807:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964091.659726:0:31807:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964091.659727:0:31807:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964091.659734:0:31807:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964091.659736:0:31807:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964091.659752:0:31807:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964091.659754:0:31807:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964091.665243:0:32548:0:(connection.c:75:cpu_latency_work()) work item of 000000001b84c312 (cpu 3) has reached its deadline 4295629832, at 4295629833 00000100:00000010:3.0:1790964091.665262:0:32548:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000008f173ee5. 00000100:00000040:2.0:1790964091.665413:0:23299:0:(connection.c:75:cpu_latency_work()) work item of 00000000984ab863 (cpu 2) has reached its deadline 4295629832, at 4295629833 00000100:00000010:2.0:1790964091.665419:0:23299:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000e759e8b8. 00000100:00000040:0.0:1790964091.665497:0:10793:0:(connection.c:75:cpu_latency_work()) work item of 000000005aae0ac0 (cpu 0) has reached its deadline 4295629832, at 4295629833 00000100:00000010:0.0:1790964091.665503:0:10793:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000d9d043d7. 00000100:00000040:1.0:1790964091.665595:0:10687:0:(connection.c:75:cpu_latency_work()) work item of 00000000d96f467e (cpu 1) has reached its deadline 4295629832, at 4295629833 00000100:00000010:1.0:1790964091.665601:0:10687:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000b5c797c0. 00000100:00000001:3.0:1790964091.912394:0:32688:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964091.912401:0:32688:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964091.912403:0:32688:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964091.912407:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00000100:00000001:3.0:1790964091.912412:0:32688:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964091.912415:0:32688:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964091.912417:0:32688:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964091.912420:0:32688:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964091.912422:0:32688:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964092.045665:0:23299:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964092.045673:0:23299:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964092.045680:0:23299:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964092.045681:0:23299:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964092.047120:0:32638:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964092.047126:0:32638:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964092.047129:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:2.0:1790964092.049364:0:32996:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:2.0:1790964092.049389:0:32996:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964092.049393:0:32996:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964092.680225:0:31804:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964092.680242:0:31804:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964092.680245:0:31804:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964092.680267:0:31804:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964092.680270:0:31804:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964092.680274:0:31804:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964092.680277:0:31804:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964092.681230:0:32633:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:2.0:1790964092.681235:0:32633:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:1.0:1790964092.681500:0:32637:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 0000000075202496. 00000100:00000001:1.0:1790964092.681510:0:32637:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:1.0:1790964092.681512:0:32637:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964092.941153:0:32688:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964092.941161:0:32688:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964092.941164:0:32688:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964092.941168:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00000100:00000001:3.0:1790964092.941172:0:32688:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964092.941176:0:32688:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964092.941179:0:32688:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964092.941182:0:32688:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964092.941184:0:32688:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964093.064626:0:23299:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964093.064634:0:23299:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964093.064640:0:23299:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964093.064641:0:23299:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964093.070704:0:32639:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964093.070712:0:32639:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964093.070716:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:3.0:1790964093.564540:0:33045:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964093.564558:0:33045:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964093.564563:0:33045:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964093.704145:0:31804:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964093.704158:0:31804:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964093.704160:0:31804:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964093.704164:0:31804:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964093.704167:0:31804:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964093.704170:0:31804:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964093.704172:0:31804:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964093.961170:0:32688:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964093.961180:0:32688:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964093.961182:0:32688:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964093.961186:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00000100:00000001:3.0:1790964093.961191:0:32688:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964093.961193:0:32688:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964093.961196:0:32688:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964093.961199:0:32688:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964093.961201:0:32688:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:0.0:1790964094.053949:0:33081:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:0.0:1790964094.053957:0:33081:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: conf-sanity test_167: @@@@@@ FAIL: mds1 mounted without a remote update llog 00000001:00000001:0.0:1790964094.062033:0:33081:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00010000:00000001:2.0:1790964094.089539:0:23299:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964094.089548:0:23299:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964094.089554:0:23299:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964094.089556:0:23299:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964094.089641:0:32638:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964094.089645:0:32638:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964094.089647:0:32638:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00000001:2.0:1790964094.216221:0:32647:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:2.0:1790964094.216228:0:32647:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000a1511862) refs 2 10000000:00000001:2.0:1790964094.216233:0:32647:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:2.0:1790964094.216236:0:32647:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000001:2.0:1790964094.216238:0:32647:0:(mgc_request.c:120:config_log_put()) Process leaving 10000000:00000001:2.0:1790964094.216239:0:32647:0:(mgc_request.c:601:do_requeue()) Process entered 10000000:01000000:2.0:1790964094.216241:0:32647:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:00000001:2.0:1790964094.216243:0:32647:0:(mgc_request.c:1783:mgc_process_log()) Process entered 10000000:01000000:2.0:1790964094.216245:0:32647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3f467d8000 from 9 10000000:00000001:2.0:1790964094.216247:0:32647:0:(mgc_request.c:990:mgc_enqueue()) Process entered 10000000:01000000:2.0:1790964094.216249:0:32647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00000010:2.0:1790964094.216256:0:32647:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000009c289e1b. 00000020:00000040:2.0:1790964094.216261:0:32647:0:(genops.c:1210:class_import_get()) import 0000000089249098 refcount=4 obd=MGC192.168.202.118@tcp 00000100:00000001:2.0:1790964094.216266:0:32647:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964094.216269:0:32647:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964094.216273:0:32647:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964094.216284:0:32647:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000b0dc5147. 00000100:00000001:2.0:1790964094.216291:0:32647:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964094.216295:0:32647:0:(ldlm_request.c:1064:ldlm_cli_enqueue()) Process entered 00010000:00000001:2.0:1790964094.216298:0:32647:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:2.0:1790964094.216305:0:32647:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000c4607499. 00010000:00000001:2.0:1790964094.216309:0:32647:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:2.0:1790964094.216311:0:32647:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 000000006914b261. 00000020:00000001:2.0:1790964094.216316:0:32647:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:2.0:1790964094.216319:0:32647:0:(lustre_handles.c:93:class_handle_hash()) added object 000000006914b261 with handle 0xd2056616bb7669a6 to hash 00000020:00000001:2.0:1790964094.216321:0:32647:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:2.0:1790964094.216322:0:32647:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000001:2.0:1790964094.216326:0:32647:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000001:2.0:1790964094.216329:0:32647:0:(ldlm_lock.c:261:ldlm_lock_remove_from_lru_check()) Process entered 00010000:00000001:2.0:1790964094.216332:0:32647:0:(ldlm_lock.c:280:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1790964094.216335:0:32647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000006914b261/0xd2056616bb7669a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964094.216343:0:32647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000006914b261/0xd2056616bb7669a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964094.216353:0:32647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000006914b261/0xd2056616bb7669a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000001:2.0:1790964094.216359:0:32647:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:2.0:1790964094.216361:0:32647:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:2.0:1790964094.216380:0:32647:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 000000003baeeb3d. 00000100:00000001:2.0:1790964094.216383:0:32647:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446616797829334912 : -127275880216704 : ffff8c3e465f0780) 00000100:00000001:2.0:1790964094.216385:0:32647:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964094.216386:0:32647:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446616797939705472 : -127275769846144 : ffff8c3e4cf32680) 00000100:00000001:2.0:1790964094.216391:0:32647:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964094.216393:0:32647:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964094.216395:0:32647:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:2.0:1790964094.216397:0:32647:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964094.216404:0:32647:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964094.216419:0:32647:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964094.216421:0:32647:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964094.216425:0:32647:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1790964094.216427:0:32647:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964094.216429:0:32647:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964094.216431:0:32647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c289e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74395bcb-647f-40d7-b64f-5c134e7cfca1:32647:1877961941716736:0@lo:101: 00000100:00000001:2.0:1790964094.216435:0:32647:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964094.216440:0:32647:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964094.216442:0:32647:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964094.216444:0:32647:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1790964094.216449:0:32647:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e8c2dfee. 02000000:00000001:2.0:1790964094.216451:0:32647:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1790964094.216456:0:32647:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000001d4ac652. 00000400:00000010:2.0:1790964094.216463:0:32647:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000009342fa80. 00000100:00000200:2.0:1790964094.216470:0:32647:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961941716736, portal 25 00000100:00000001:2.0:1790964094.216472:0:32647:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964094.216473:0:32647:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446616797939705472 : -127275769846144 : ffff8c3e4cf32680) 00000100:00000040:2.0:1790964094.216477:0:32647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964094.216484:0:32647:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964094.216486:0:32647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964094.216489:0:32647:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000009541b9c2. 00000100:00000200:2.0:1790964094.216491:0:32647:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1877961941716736, offset 0 00000400:00000200:2.0:1790964094.216498:0:32647:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964094.216511:0:32647:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964094.216521:0:32647:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 328 into portal 26 MB=0x6abff16700f00 00000400:00000200:2.0:1790964094.216526:0:32647:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 328/328 into md 0x165 [2] + 0 00000400:00000010:2.0:1790964094.216530:0:32647:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000462158a4. 00000400:00000200:2.0:1790964094.216533:0:32647:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 0000000073a4f07c 00000400:00000200:2.0:1790964094.216541:0:32647:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964094.216544:0:32647:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:2.0:1790964094.216549:0:32647:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000073a4f07c 00000400:00000010:2.0:1790964094.216557:0:32647:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 0000000073a4f07c. 00000100:00000001:2.0:1790964094.216562:0:32647:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1790964094.216563:0:32647:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:2.0:1790964094.216566:0:32647:0:(events.c:341:request_in_callback()) incoming req@00000000bf248bcf x1877961941716736 msgsize 328 00000100:00100000:2.0:1790964094.216570:0:32647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1790964094.216571:0:32647:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:2.0:1790964094.216590:0:32647:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:2.0:1790964094.216597:0:32647:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009541b9c2 00000400:00000010:2.0:1790964094.216599:0:32647:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000009541b9c2. 00000100:00000001:2.0:1790964094.216603:0:32647:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964094.216606:0:32647:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964094.216615:0:32647:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964094.216616:0:32647:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964094.216623:0:32647:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964094.216624:0:32647:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964094.216629:0:32647:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964094.216632:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 0 is 4295632391 00000100:00000010:2.0:1790964094.216636:0:32647:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000000e801fa6. 00000100:00000001:2.0:1790964094.216643:0:32647:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 0 00000100:00000001:2.0:1790964094.216651:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 1 is 4295632391 00000100:00000010:2.0:1790964094.216653:0:32647:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000006208fdff. 00000100:00000001:2.0:1790964094.216656:0:32647:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 1 00000100:00000001:2.0:1790964094.216659:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 2 is 4295632391 00000100:00000010:2.0:1790964094.216661:0:32647:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000e759e8b8. 00000100:00000001:2.0:1790964094.216664:0:32647:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 2 00000100:00000001:2.0:1790964094.216666:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 3 is 4295632391 00000100:00000010:2.0:1790964094.216668:0:32647:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000004217160. 00000100:00000001:2.0:1790964094.216670:0:32647:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request now active for cpu 3 00000100:00000001:2.0:1790964094.216673:0:32647:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964094.216675:0:32647:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964094.216683:0:32647:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964094.216685:0:32647:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:2.0:1790964094.216687:0:32647:0:(client.c:2716:ptlrpc_set_wait()) set 000000003baeeb3d going to sleep for 11 seconds 00000100:00000001:2.0:1790964094.216690:0:32647:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964094.216692:0:32647:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964094.216802:0:32643:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964094.216806:0:32643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941716736 02000000:00000001:1.0:1790964094.216808:0:32643:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964094.216810:0:32643:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964094.216812:0:32643:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964094.216816:0:32643:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964094.216819:0:32643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941716736 00000020:00000001:1.0:1790964094.216822:0:32643:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964094.216823:0:32643:0:(genops.c:804:class_conn2export()) looking for export cookie 0xd2056616bb7668bf 00000020:00000001:1.0:1790964094.216825:0:32643:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964094.216828:0:32643:0:(lustre_handles.c:148:class_handle2object()) GET export 0000000028ed3367 refcount=11 00000020:00000001:1.0:1790964094.216830:0:32643:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802309058560 : -127271400493056 : ffff8c3f51623000) 00000020:00000001:1.0:1790964094.216832:0:32643:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446616802309058560 : -127271400493056 : ffff8c3f51623000) 00000100:00000001:1.0:1790964094.216837:0:32643:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964094.216841:0:32643:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000007135b7e2. 00000100:00000001:1.0:1790964094.216844:0:32643:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964094.216846:0:32643:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000007135b7e2. 00000020:00000010:1.0:1790964094.216852:0:32643:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a1ae76f9. 00000020:00000010:1.0:1790964094.216856:0:32643:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 0000000023482606. 00000020:00000010:1.0:1790964094.216860:0:32643:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000c8135af8. 00000100:00000040:1.0:1790964094.216869:0:32643:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964094.216872:0:32643:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964094.216873:0:32643:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964094.216875:0:32643:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964094.216882:0:32643:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964094.216898:0:32643:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964094.216908:0:32643:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964094.216910:0:32643:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964094.216914:0:32643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964094.216924:0:32643:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 0000000028ed3367 : new rpc_count 1 00000100:00000001:1.0:1790964094.216926:0:32643:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446616802088973392 : -127271620578224 : ffff8c3f4443f450) 00000100:00000040:1.0:1790964094.216931:0:32643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000bf248bcf x1877961941716736/t0(0) o101->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:670/0 lens 328/0 e 0 to 0 dl 1790964105 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964094.216939:0:32643:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964094.216942:0:32643:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000007135b7e2. 00000100:00000001:1.0:1790964094.216943:0:32643:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964094.216945:0:32643:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000007135b7e2. 00000100:00100000:1.0:1790964094.216948:0:32643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf248bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+11:32647:x1877961941716736:12345-0@lo:101: 00000100:00000200:1.0:1790964094.216952:0:32643:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961941716736 00000020:00000001:1.0:1790964094.216955:0:32643:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964094.216958:0:32643:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964094.216960:0:32643:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964094.216962:0:32643:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964094.216964:0:32643:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669816960 : -1039734656 : ffffffffc206e880) 00000020:00000001:1.0:1790964094.216967:0:32643:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964094.216969:0:32643:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964094.216971:0:32643:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964094.216973:0:32643:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964094.216976:0:32643:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964094.216978:0:32643:0:(tgt_handler.c:1471:tgt_enqueue()) Process entered 00010000:00000001:1.0:1790964094.216980:0:32643:0:(ldlm_lockd.c:1263:ldlm_handle_enqueue()) Process entered 00010000:00010000:1.0:1790964094.216981:0:32643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000001:1.0:1790964094.216983:0:32643:0:(ldlm_lockd.c:1725:ldlm_request_cancel()) Process entered 00010000:00000001:1.0:1790964094.216985:0:32643:0:(ldlm_lockd.c:1734:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964094.216990:0:32643:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:1.0:1790964094.216995:0:32643:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000102824a3. 00010000:00000001:1.0:1790964094.216998:0:32643:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:1.0:1790964094.217000:0:32643:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 000000004296e9e5. 00000020:00000001:1.0:1790964094.217003:0:32643:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:1.0:1790964094.217005:0:32643:0:(lustre_handles.c:93:class_handle_hash()) added object 000000004296e9e5 with handle 0xd2056616bb7669ad to hash 00000020:00000001:1.0:1790964094.217007:0:32643:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:1.0:1790964094.217008:0:32643:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446616803093032448 : -127270616519168 : ffff8c3f801cae00) 00010000:00000001:1.0:1790964094.217017:0:32643:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446616803093032448 : -127270616519168 : ffff8c3f801cae00) 00010000:00010000:1.0:1790964094.217020:0:32643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004296e9e5/0xd2056616bb7669ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2056616bb7669a6 expref: -99 pid: 32643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1790964094.217026:0:32643:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export 0000000028ed3367 : new locks_count 6 00000020:00000040:1.0:1790964094.217028:0:32643:0:(genops.c:868:class_export_get()) GET export 0000000028ed3367 refcount=12 00000100:00000001:1.0:1790964094.217036:0:32643:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964094.217038:0:32643:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964094.217041:0:32643:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 640 at 00000000847872e7. 02000000:00000001:1.0:1790964094.217043:0:32643:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964094.217045:0:32643:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964094.217047:0:32643:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:1.0:1790964094.217051:0:32643:0:(ldlm_lock.c:1758:ldlm_lock_enqueue_helper()) Process entered 00010000:00000001:1.0:1790964094.217053:0:32643:0:(ldlm_plain.c:119:ldlm_process_plain_lock()) Process entered 00010000:00000001:1.0:1790964094.217055:0:32643:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964094.217056:0:32643:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964094.217058:0:32643:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964094.217059:0:32643:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964094.217061:0:32643:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:1.0:1790964094.217063:0:32643:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:1.0:1790964094.217065:0:32643:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:1.0:1790964094.217066:0:32643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:1.0:1790964094.217068:0:32643:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000102824a3) refcount = 1 00010000:00010000:1.0:1790964094.217072:0:32643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004296e9e5/0xd2056616bb7669ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd2056616bb7669a6 expref: 12 pid: 32643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964094.217078:0:32643:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:1.0:1790964094.217079:0:32643:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:1.0:1790964094.217081:0:32643:0:(ldlm_plain.c:146:ldlm_process_plain_lock()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964094.217083:0:32643:0:(ldlm_lock.c:1769:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964094.217085:0:32643:0:(ldlm_lock.c:1928:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:1.0:1790964094.217089:0:32643:0:(ldlm_lockd.c:1494:ldlm_handle_enqueue()) Process leaving 00010000:00010000:1.0:1790964094.217121:0:32643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004296e9e5/0xd2056616bb7669ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd2056616bb7669a6 expref: 12 pid: 32643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964094.217139:0:32643:0:(ldlm_lock.c:2393:__ldlm_reprocess_all()) Process entered 00010000:00000001:1.0:1790964094.217141:0:32643:0:(ldlm_lock.c:1970:ldlm_reprocess_queue()) Process entered 00010000:00000001:1.0:1790964094.217143:0:32643:0:(ldlm_lock.c:2019:ldlm_reprocess_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964094.217145:0:32643:0:(ldlm_lock.c:2323:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964094.217146:0:32643:0:(ldlm_lock.c:2427:__ldlm_reprocess_all()) Process leaving 00010000:00000001:1.0:1790964094.217148:0:32643:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964094.217149:0:32643:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:1.0:1790964094.217150:0:32643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004296e9e5, rc 0) 00000020:00000001:1.0:1790964094.217153:0:32643:0:(tgt_handler.c:1496:tgt_enqueue()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964094.217155:0:32643:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961941716736 00010000:00000001:1.0:1790964094.217158:0:32643:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964094.217162:0:32643:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000bf248bcf x1877961941716736/t0(0) o101->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:670/0 lens 328/344 e 0 to 0 dl 1790964105 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964094.217170:0:32643:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964094.217172:0:32643:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964094.217176:0:32643:0:(import.c:2195:obd_at_measure()) add 1 to 000000000149aadd time=9 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964094.217180:0:32643:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964094.217182:0:32643:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 17 to 0@lo 00000100:00000001:1.0:1790964094.217184:0:32643:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 02000000:00000001:1.0:1790964094.217186:0:32643:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964094.217187:0:32643:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964094.217190:0:32643:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964094.217191:0:32643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964094.217194:0:32643:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000e5629541. 00000100:00000200:1.0:1790964094.217197:0:32643:0:(niobuf.c:94:ptl_send_buf()) Sending 344 bytes to portal 25, xid 1877961941716736, offset 224 00000400:00000200:1.0:1790964094.217202:0:32643:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964094.217208:0:32643:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964094.217214:0:32643:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 344 into portal 25 MB=0x6abff16700f00 00000400:00000200:1.0:1790964094.217218:0:32643:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 344/344 into md 0xac5 [1] + 224 00000400:00000200:1.0:1790964094.217223:0:32643:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964094.217225:0:32643:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964094.217228:0:32643:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964094.217236:0:32643:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964094.217243:0:32643:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964094.217258:0:32643:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964094.217264:0:32643:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000e5629541 00000400:00000010:1.0:1790964094.217265:0:32643:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000e5629541. 00000100:00000001:1.0:1790964094.217268:0:32643:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964094.217269:0:32643:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964094.217272:0:32643:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964094.217274:0:32643:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000002ce3fa74 refcount 16 to 0@lo 00010000:00000001:1.0:1790964094.217276:0:32643:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964094.217278:0:32643:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964094.217280:0:32643:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964094.217282:0:32643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000bf248bcf x1877961941716736/t0(0) o101->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:670/0 lens 328/344 e 0 to 0 dl 1790964105 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964094.217290:0:32643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf248bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32647:x1877961941716736:12345-0@lo:101: Request processed in 350us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964094.217296:0:32643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964094.217299:0:32643:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028ed3367 : new rpc_count 0 00000100:00000001:1.0:1790964094.217300:0:32643:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964094.217302:0:32643:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964094.217305:0:32643:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 0000000023482606. 00000020:00000010:1.0:1790964094.217309:0:32643:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000c8135af8. 00000020:00000010:1.0:1790964094.217312:0:32643:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a1ae76f9. 00000020:00000040:1.0:1790964094.217316:0:32643:0:(genops.c:879:class_export_put()) PUTting export 0000000028ed3367 : new refcount 11 02000000:00000001:1.0:1790964094.217319:0:32643:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964094.217321:0:32643:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 640 at 00000000847872e7. 02000000:00000001:1.0:1790964094.217323:0:32643:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964094.217325:0:32643:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964094.217328:0:32643:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964094.217333:0:32643:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000a4682ecc. 00000400:00000010:1.0:1790964094.217337:0:32643:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 0000000034b4628d. 00000100:00000001:3.0:1790964094.217413:0:32647:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964094.217420:0:32647:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964094.217422:0:32647:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964094.217424:0:32647:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000001d4ac652. 00000400:00000200:3.0:1790964094.217432:0:32647:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009342fa80 00000400:00000010:3.0:1790964094.217434:0:32647:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000009342fa80. 00000100:00000001:3.0:1790964094.217437:0:32647:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964094.217440:0:32647:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964094.217448:0:32647:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217453:0:32647:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964094.217455:0:32647:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.217458:0:32647:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964094.217460:0:32647:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964094.217461:0:32647:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964094.217462:0:32647:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964094.217465:0:32647:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964094.217469:0:32647:0:(import.c:2195:obd_at_measure()) add 5 to 0000000042d42df6 time=9 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964094.217472:0:32647:0:(import.c:2195:obd_at_measure()) add 1 to 00000000445bc341 time=9 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964094.217474:0:32647:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964094.217476:0:32647:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964094.217478:0:32647:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1790964094.217480:0:32647:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217482:0:32647:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964094.217486:0:32647:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217493:0:32647:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964094.217495:0:32647:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964094.217496:0:32647:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964094.217499:0:32647:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964094.217506:0:32647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c289e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74395bcb-647f-40d7-b64f-5c134e7cfca1:32647:1877961941716736:0@lo:101: 00000100:00000001:3.0:1790964094.217510:0:32647:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.217512:0:32647:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217514:0:32647:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:3.0:1790964094.217515:0:32647:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964094.217524:0:32647:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217530:0:32647:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964094.217533:0:32647:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 000000003baeeb3d. 00000100:00000001:3.0:1790964094.217535:0:32647:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:3.0:1790964094.217537:0:32647:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964094.217539:0:32647:0:(ldlm_request.c:661:ldlm_cli_enqueue_fini()) Process entered 00010000:00000001:3.0:1790964094.217542:0:32647:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964094.217544:0:32647:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964094.217545:0:32647:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 000000006914b261 refcount=4 00000020:00000001:3.0:1790964094.217547:0:32647:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000001:3.0:1790964094.217550:0:32647:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000040:3.0:1790964094.217553:0:32647:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: 000000006914b261, remote cookie: 0xd2056616bb7669ad, flags: 0x0 00010000:00000001:3.0:1790964094.217556:0:32647:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:3.0:1790964094.217558:0:32647:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:3.0:1790964094.217560:0:32647:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:3.0:1790964094.217561:0:32647:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:3.0:1790964094.217562:0:32647:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:3.0:1790964094.217563:0:32647:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000c4607499) refcount = 1 00010000:00010000:3.0:1790964094.217566:0:32647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000006914b261/0xd2056616bb7669a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7669ad expref: -99 pid: 32647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964094.217572:0:32647:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:3.0:1790964094.217573:0:32647:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:3.0:1790964094.217575:0:32647:0:(ldlm_lock.c:1914:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:3.0:1790964094.217578:0:32647:0:(ldlm_request.c:286:ldlm_completion_ast()) Process entered 00010000:00000001:3.0:1790964094.217580:0:32647:0:(ldlm_request.c:295:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964094.217582:0:32647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000006914b261/0xd2056616bb7669a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd2056616bb7669ad expref: -99 pid: 32647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964094.217587:0:32647:0:(ldlm_request.c:842:ldlm_cli_enqueue_fini()) Process leaving 00010000:00000001:3.0:1790964094.217589:0:32647:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964094.217590:0:32647:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964094.217591:0:32647:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964094.217591:0:32647:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964094.217598:0:32647:0:(ldlm_request.c:1218:ldlm_cli_enqueue()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217601:0:32647:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964094.217604:0:32647:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000009c289e1b x1877961941716736/t0(0) o101->MGC192.168.202.118@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964110 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217610:0:32647:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964094.217612:0:32647:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964094.217614:0:32647:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e8c2dfee. 02000000:00000001:3.0:1790964094.217618:0:32647:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964094.217620:0:32647:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964094.217621:0:32647:0:(genops.c:1223:class_import_put()) import 0000000089249098 refcount=3 obd=MGC192.168.202.118@tcp 00000020:00000001:3.0:1790964094.217623:0:32647:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964094.217625:0:32647:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000b0dc5147. 02000000:00000001:3.0:1790964094.217628:0:32647:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964094.217630:0:32647:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964094.217631:0:32647:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000009c289e1b. 00000100:00000001:3.0:1790964094.217635:0:32647:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964094.217636:0:32647:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000001:3.0:1790964094.217637:0:32647:0:(mgc_request.c:1023:mgc_enqueue()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964094.217640:0:32647:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:3.0:1790964094.217641:0:32647:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000a1511862) refs 3 10000000:00000001:3.0:1790964094.217643:0:32647:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964094.217645:0:32647:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964094.217647:0:32647:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964094.217648:0:32647:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 000000006914b261 refcount=3 00000020:00000001:3.0:1790964094.217650:0:32647:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000001:3.0:1790964094.217652:0:32647:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000001:3.0:1790964094.217655:0:32647:0:(ldlm_lock.c:2547:ldlm_lock_set_data()) Process entered 00010000:00000001:3.0:1790964094.217656:0:32647:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964094.217657:0:32647:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964094.217658:0:32647:0:(ldlm_lock.c:2556:ldlm_lock_set_data()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964094.217660:0:32647:0:(mgc_request.c:1520:mgc_process_recover_log()) Process entered 10000000:00000010:3.0:1790964094.217663:0:32647:0:(mgc_request.c:1532:mgc_process_recover_log()) kmalloced '(folios)': 32 at 000000001d3625ed. 00000100:00000010:3.0:1790964094.217678:0:32647:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000ea881b47. 00000020:00000040:3.0:1790964094.217681:0:32647:0:(genops.c:1210:class_import_get()) import 0000000089249098 refcount=4 obd=MGC192.168.202.118@tcp 00000100:00000001:3.0:1790964094.217684:0:32647:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964094.217686:0:32647:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964094.217693:0:32647:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964094.217699:0:32647:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 0000000079af9065. 00000100:00000001:3.0:1790964094.217703:0:32647:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217707:0:32647:0:(client.c:227:ptlrpc_prep_bulk_imp()) Process entered 00000100:00000010:3.0:1790964094.217710:0:32647:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 00000000fa39cc18. 00000100:00000010:3.0:1790964094.217713:0:32647:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 64 at 00000000cb92abec. 00000020:00000040:3.0:1790964094.217727:0:32647:0:(genops.c:1210:class_import_get()) import 0000000089249098 refcount=5 obd=MGC192.168.202.118@tcp 00000100:00000001:3.0:1790964094.217730:0:32647:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:3.0:1790964094.217732:0:32647:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:3.0:1790964094.217736:0:32647:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 0000000055320e45. 00000100:00000001:3.0:1790964094.217738:0:32647:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446616802105427072 : -127271604124544 : ffff8c3f453f0480) 00000100:00000001:3.0:1790964094.217740:0:32647:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964094.217741:0:32647:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446616802037887232 : -127271671664384 : ffff8c3f41387100) 00000100:00000001:3.0:1790964094.217744:0:32647:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964094.217746:0:32647:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217748:0:32647:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:3.0:1790964094.217749:0:32647:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964094.217751:0:32647:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217757:0:32647:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964094.217759:0:32647:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964094.217762:0:32647:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964094.217764:0:32647:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964094.217766:0:32647:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964094.217768:0:32647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea881b47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74395bcb-647f-40d7-b64f-5c134e7cfca1:32647:1877961941716864:0@lo:256: 00000100:00000001:3.0:1790964094.217770:0:32647:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964094.217773:0:32647:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964094.217775:0:32647:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217777:0:32647:0:(niobuf.c:346:ptlrpc_register_bulk()) Process entered 00000400:00000010:3.0:1790964094.217782:0:32647:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000b97a017e. 00000400:00000010:3.0:1790964094.217785:0:32647:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at 000000001725a543. 00000100:00000200:3.0:1790964094.217789:0:32647:0:(niobuf.c:453:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 4 pages 16384 bytes, mbits x0x6abff16700f80-0x6abff16700f80, portal 33 00000100:00000001:3.0:1790964094.217791:0:32647:0:(niobuf.c:455:ptlrpc_register_bulk()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964094.217793:0:32647:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964094.217800:0:32647:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000e592f4bf. 02000000:00000001:3.0:1790964094.217802:0:32647:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964094.217805:0:32647:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000cc0fd854. 00000400:00000010:3.0:1790964094.217809:0:32647:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000e80a28d1. 00000100:00000200:3.0:1790964094.217811:0:32647:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961941716864, portal 25 00000100:00000001:3.0:1790964094.217813:0:32647:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964094.217814:0:32647:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446616802037887232 : -127271671664384 : ffff8c3f41387100) 00000100:00000040:3.0:1790964094.217818:0:32647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217823:0:32647:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964094.217825:0:32647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964094.217827:0:32647:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000c3669931. 00000100:00000200:3.0:1790964094.217829:0:32647:0:(niobuf.c:94:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1877961941716864, offset 0 00000400:00000200:3.0:1790964094.217833:0:32647:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964094.217839:0:32647:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964094.217845:0:32647:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 304 into portal 26 MB=0x6abff16700f80 00000400:00000200:3.0:1790964094.217849:0:32647:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 304/304 into md 0x169 [2] + 0 00000400:00000010:3.0:1790964094.217852:0:32647:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000c1a81d10. 00000400:00000200:3.0:1790964094.217854:0:32647:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000fc6baad9 00000400:00000200:3.0:1790964094.217858:0:32647:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964094.217860:0:32647:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964094.217863:0:32647:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000fc6baad9 00000400:00000010:3.0:1790964094.217865:0:32647:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000fc6baad9. 00000100:00000001:3.0:1790964094.217868:0:32647:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964094.217869:0:32647:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:3.0:1790964094.217871:0:32647:0:(events.c:341:request_in_callback()) incoming req@000000004c60b3af x1877961941716864 msgsize 304 00000100:00100000:3.0:1790964094.217874:0:32647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1790964094.217875:0:32647:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:3.0:1790964094.217882:0:32647:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964094.217885:0:32647:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c3669931 00000400:00000010:3.0:1790964094.217887:0:32647:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000c3669931. 00000100:00000001:3.0:1790964094.217889:0:32647:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964094.217891:0:32647:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217908:0:32647:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964094.217910:0:32647:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.217915:0:32647:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217916:0:32647:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964094.217921:0:32647:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217923:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 0 is 4295632392 00000100:00000001:3.0:1790964094.217929:0:32647:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4295632391 00000100:00000001:3.0:1790964094.217933:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 1 is 4295632392 00000100:00000001:3.0:1790964094.217936:0:32647:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295632391 00000100:00000001:3.0:1790964094.217938:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 2 is 4295632392 00000100:00000001:3.0:1790964094.217940:0:32647:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4295632391 00000100:00000001:3.0:1790964094.217942:0:32647:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS new deadline estimation for cpu 3 is 4295632392 00000100:00000001:3.0:1790964094.217944:0:32647:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.202.118@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4295632391 00000100:00000001:3.0:1790964094.217947:0:32647:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964094.217949:0:32647:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217951:0:32647:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964094.217952:0:32647:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:3.0:1790964094.217954:0:32647:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055320e45 going to sleep for 11 seconds 00000100:00000001:3.0:1790964094.217956:0:32647:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964094.217957:0:32647:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.217970:0:32645:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964094.217972:0:32645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961941716864 02000000:00000001:3.0:1790964094.217974:0:32645:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964094.217975:0:32645:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964094.217977:0:32645:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964094.217979:0:32645:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964094.217982:0:32645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961941716864 00000020:00000001:3.0:1790964094.217983:0:32645:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964094.217985:0:32645:0:(genops.c:804:class_conn2export()) looking for export cookie 0xd2056616bb7668bf 00000020:00000001:3.0:1790964094.217986:0:32645:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964094.217992:0:32645:0:(lustre_handles.c:148:class_handle2object()) GET export 0000000028ed3367 refcount=12 00000020:00000001:3.0:1790964094.217994:0:32645:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802309058560 : -127271400493056 : ffff8c3f51623000) 00000020:00000001:3.0:1790964094.217996:0:32645:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446616802309058560 : -127271400493056 : ffff8c3f51623000) 00000100:00000001:3.0:1790964094.217999:0:32645:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964094.218001:0:32645:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000616f5ed2. 00000100:00000001:3.0:1790964094.218004:0:32645:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964094.218006:0:32645:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000616f5ed2. 00000020:00000010:3.0:1790964094.218010:0:32645:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033a202ce. 00000020:00000010:3.0:1790964094.218013:0:32645:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000002adc9d70. 00000020:00000010:3.0:1790964094.218017:0:32645:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000002007ff88. 00000100:00000040:3.0:1790964094.218023:0:32645:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:3.0:1790964094.218025:0:32645:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964094.218026:0:32645:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1790964094.218028:0:32645:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218031:0:32645:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218036:0:32645:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.218043:0:32645:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964094.218044:0:32645:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964094.218047:0:32645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00000040:3.0:1790964094.218050:0:32645:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 0000000028ed3367 : new rpc_count 1 00000100:00000001:3.0:1790964094.218051:0:32645:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446616802088970320 : -127271620581296 : ffff8c3f4443e850) 00000100:00000040:3.0:1790964094.218055:0:32645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000004c60b3af x1877961941716864/t0(0) o256->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:670/0 lens 304/0 e 0 to 0 dl 1790964105 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.218063:0:32645:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964094.218065:0:32645:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000616f5ed2. 00000100:00000001:3.0:1790964094.218068:0:32645:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964094.218069:0:32645:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000616f5ed2. 00000100:00100000:3.0:1790964094.218072:0:32645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c60b3af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32647:x1877961941716864:12345-0@lo:256: 00000100:00000200:3.0:1790964094.218076:0:32645:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961941716864 00000020:00000001:3.0:1790964094.218078:0:32645:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1790964094.218081:0:32645:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1790964094.218082:0:32645:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964094.218090:0:32645:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1790964094.218115:0:32645:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669817376 : -1039734240 : ffffffffc206ea20) 00000020:00000001:3.0:1790964094.218119:0:32645:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1790964094.218121:0:32645:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964094.218123:0:32645:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1790964094.218124:0:32645:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1790964094.218127:0:32645:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218129:0:32645:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964094.218131:0:32645:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1790964094.218135:0:32645:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 536 at 000000001bd1c9de. 02000000:00000001:3.0:1790964094.218137:0:32645:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218139:0:32645:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 20000000:00000001:3.0:1790964094.218141:0:32645:0:(mgs_handler.c:690:mgs_config_read()) Process entered 20000000:00000001:3.0:1790964094.218144:0:32645:0:(mgs_nids.c:889:mgs_get_ir_logs()) Process entered 20000000:01000000:3.0:1790964094.218148:0:32645:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000010:3.0:1790964094.218150:0:32645:0:(mgs_nids.c:917:mgs_get_ir_logs()) kmalloced '(folios)': 32 at 00000000a4ed7fff. 20000000:00000001:3.0:1790964094.218152:0:32645:0:(mgs_nids.c:188:mgs_nidtbl_read()) Process entered 20000000:00000040:3.0:1790964094.218162:0:32645:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1790964094.218167:0:32645:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790964094.218170:0:32645:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 20000000:00000001:3.0:1790964094.218172:0:32645:0:(mgs_nids.c:321:mgs_nidtbl_read()) Process leaving (rc=44 : 44 : 2c) 00000100:00000001:3.0:1790964094.218175:0:32645:0:(niobuf.c:145:ptlrpc_prep_bulk_exp()) Process entered 00000100:00000010:3.0:1790964094.218178:0:32645:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 0000000096bf76be. 00000100:00000010:3.0:1790964094.218180:0:32645:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 16 at 00000000f2aa6ff9. 00000020:00000040:3.0:1790964094.218182:0:32645:0:(genops.c:868:class_export_get()) GET export 0000000028ed3367 refcount=13 00010000:00000001:3.0:1790964094.218185:0:32645:0:(ldlm_lib.c:3582:target_bulk_io()) Process entered 00000100:00000001:3.0:1790964094.218188:0:32645:0:(niobuf.c:184:ptlrpc_start_bulk_transfer()) Process entered 00000400:00000010:3.0:1790964094.218190:0:32645:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000c3669931. 00000400:00000010:3.0:1790964094.218196:0:32645:0:(lib-lnet.h:449:lnet_rspt_alloc()) alloc 'rspt': 64 at 00000000b948b703. 00000400:00000200:3.0:1790964094.218199:0:32645:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964094.218206:0:32645:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964094.218211:0:32645:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 44 into portal 33 MB=0x6abff16700f80 00000400:00000200:3.0:1790964094.218215:0:32645:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 21 from 12345-0@lo of length 44/44 into md 0xad5 [4] + 0 00000400:00000010:3.0:1790964094.218218:0:32645:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000b97a017e. 00000400:00000200:3.0:1790964094.218221:0:32645:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000001725a543 00000400:00000200:3.0:1790964094.218224:0:32645:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964094.218232:0:32645:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964094.218235:0:32645:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000001725a543 00000400:00000010:3.0:1790964094.218237:0:32645:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 184 at 000000001725a543. 00000100:00000001:3.0:1790964094.218239:0:32645:0:(events.c:177:client_bulk_callback()) Process entered 00000100:00000200:3.0:1790964094.218241:0:32645:0:(events.c:195:client_bulk_callback()) event type 2, status 0, req 00000000ea881b47 desc 00000000fa39cc18 mbits 1877961941716864 00000100:00000001:3.0:1790964094.218249:0:32645:0:(events.c:220:client_bulk_callback()) Process leaving 00000400:00000200:3.0:1790964094.218252:0:32645:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md 0000000000000000 with offset 0 00000400:00000200:3.0:1790964094.218256:0:32645:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : ACK - for me 00000400:00000200:3.0:1790964094.218263:0:32645:0:(lib-move.c:4532:lnet_parse_ack()) 0@lo: ACK from 12345-0@lo into md 0xae1 00000400:00000200:3.0:1790964094.218265:0:32645:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964094.218268:0:32645:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: ACK: OK 00000100:00000001:3.0:1790964094.218271:0:32645:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:3.0:1790964094.218272:0:32645:0:(events.c:464:server_bulk_callback()) event type 4, status 0, desc 0000000096bf76be 00000100:00000001:3.0:1790964094.218274:0:32645:0:(events.c:491:server_bulk_callback()) Process leaving 00000400:00000200:3.0:1790964094.218278:0:32645:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c3669931 00000400:00000010:3.0:1790964094.218280:0:32645:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000c3669931. 00000100:00000001:3.0:1790964094.218282:0:32645:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:3.0:1790964094.218283:0:32645:0:(events.c:464:server_bulk_callback()) event type 5, status 0, desc 0000000096bf76be 00000100:00000001:3.0:1790964094.218284:0:32645:0:(events.c:491:server_bulk_callback()) Process leaving 00000100:00000200:3.0:1790964094.218288:0:32645:0:(niobuf.c:279:ptlrpc_start_bulk_transfer()) Transferring 1 pages 44 bytes via portal 33 id 12345-0@lo mbits 0x6abff16700f80-0x6abff16700f80 00000100:00000001:3.0:1790964094.218291:0:32645:0:(niobuf.c:281:ptlrpc_start_bulk_transfer()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964094.218294:0:32645:0:(ldlm_lib.c:3674:target_bulk_io()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218296:0:32645:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000040:3.0:1790964094.218298:0:32645:0:(genops.c:879:class_export_put()) PUTting export 0000000028ed3367 : new refcount 12 00000100:00000010:3.0:1790964094.218301:0:32645:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 16 at 00000000f2aa6ff9. 00000100:00000010:3.0:1790964094.218303:0:32645:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 0000000096bf76be. 00000100:00000001:3.0:1790964094.218306:0:32645:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 20000000:00000001:3.0:1790964094.218307:0:32645:0:(mgs_nids.c:953:mgs_get_ir_logs()) Process leaving via out (rc=0 : 0 : 0x0) 20000000:00000010:3.0:1790964094.218315:0:32645:0:(mgs_nids.c:964:mgs_get_ir_logs()) kvfree 'folios': 32 at 00000000a4ed7fff. 20000000:00000001:3.0:1790964094.218320:0:32645:0:(mgs_handler.c:713:mgs_config_read()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1790964094.218322:0:32645:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961941716864 00010000:00000001:3.0:1790964094.218324:0:32645:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:3.0:1790964094.218328:0:32645:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000004c60b3af x1877961941716864/t0(0) o256->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:670/0 lens 304/240 e 0 to 0 dl 1790964105 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964094.218335:0:32645:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964094.218340:0:32645:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964094.218343:0:32645:0:(import.c:2195:obd_at_measure()) add 1 to 000000000149aadd time=9 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964094.218346:0:32645:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964094.218348:0:32645:0:(connection.c:162:ptlrpc_connection_addref()) conn=000000002ce3fa74 refcount 17 to 0@lo 00000100:00000001:3.0:1790964094.218350:0:32645:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446616802168986752 : -127271540564864 : ffff8c3f4908dc80) 02000000:00000001:3.0:1790964094.218353:0:32645:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964094.218354:0:32645:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218357:0:32645:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964094.218358:0:32645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964094.218360:0:32645:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000c3669931. 00000100:00000200:3.0:1790964094.218363:0:32645:0:(niobuf.c:94:ptl_send_buf()) Sending 240 bytes to portal 25, xid 1877961941716864, offset 224 00000400:00000200:3.0:1790964094.218367:0:32645:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964094.218372:0:32645:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964094.218377:0:32645:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 240 into portal 25 MB=0x6abff16700f80 00000400:00000200:3.0:1790964094.218380:0:32645:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 240/240 into md 0xad9 [1] + 224 00000400:00000200:3.0:1790964094.218384:0:32645:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964094.218387:0:32645:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964094.218390:0:32645:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964094.218392:0:32645:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964094.218399:0:32645:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.218406:0:32645:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964094.218409:0:32645:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c3669931 00000400:00000010:3.0:1790964094.218411:0:32645:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000c3669931. 00000100:00000001:3.0:1790964094.218413:0:32645:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964094.218414:0:32645:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1790964094.218416:0:32645:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964094.218418:0:32645:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=000000002ce3fa74 refcount 16 to 0@lo 00010000:00000001:3.0:1790964094.218420:0:32645:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:3.0:1790964094.218422:0:32645:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964094.218424:0:32645:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1790964094.218426:0:32645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000004c60b3af x1877961941716864/t0(0) o256->74395bcb-647f-40d7-b64f-5c134e7cfca1@0@lo:670/0 lens 304/240 e 0 to 0 dl 1790964105 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964094.218445:0:32645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c60b3af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74395bcb-647f-40d7-b64f-5c134e7cfca1+12:32647:x1877961941716864:12345-0@lo:256: Request processed in 380us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964094.218452:0:32645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00000040:3.0:1790964094.218454:0:32645:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028ed3367 : new rpc_count 0 00000100:00000001:3.0:1790964094.218456:0:32645:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964094.218457:0:32645:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1790964094.218460:0:32645:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000002adc9d70. 00000020:00000010:3.0:1790964094.218465:0:32645:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000002007ff88. 00000020:00000010:3.0:1790964094.218468:0:32645:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033a202ce. 00000020:00000040:3.0:1790964094.218475:0:32645:0:(genops.c:879:class_export_put()) PUTting export 0000000028ed3367 : new refcount 11 02000000:00000001:3.0:1790964094.218478:0:32645:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:3.0:1790964094.218480:0:32645:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 536 at 000000001bd1c9de. 02000000:00000001:3.0:1790964094.218482:0:32645:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:3.0:1790964094.218483:0:32645:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:3.0:1790964094.218487:0:32645:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:3.0:1790964094.218490:0:32645:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000b97a017e. 00000400:00000010:3.0:1790964094.218494:0:32645:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 000000001725a543. 00000100:00000001:3.0:1790964094.218508:0:32647:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964094.218511:0:32647:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964094.218512:0:32647:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964094.218514:0:32647:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000cc0fd854. 00000400:00000200:3.0:1790964094.218516:0:32647:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000e80a28d1 00000400:00000010:3.0:1790964094.218517:0:32647:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000e80a28d1. 00000100:00000001:3.0:1790964094.218519:0:32647:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964094.218522:0:32647:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964094.218529:0:32647:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.218535:0:32647:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964094.218536:0:32647:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.218538:0:32647:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964094.218539:0:32647:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964094.218541:0:32647:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964094.218547:0:32647:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964094.218549:0:32647:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964094.218551:0:32647:0:(import.c:2195:obd_at_measure()) add 5 to 0000000042d42df6 time=9 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964094.218554:0:32647:0:(import.c:2195:obd_at_measure()) add 1 to 00000000445bc341 time=9 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964094.218556:0:32647:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964094.218558:0:32647:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964094.218560:0:32647:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1790964094.218561:0:32647:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218563:0:32647:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964094.218566:0:32647:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964094.218573:0:32647:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.218579:0:32647:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964094.218581:0:32647:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964094.218583:0:32647:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964094.218589:0:32647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea881b47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74395bcb-647f-40d7-b64f-5c134e7cfca1:32647:1877961941716864:0@lo:256: 00000100:00000001:3.0:1790964094.218593:0:32647:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.218595:0:32647:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218596:0:32647:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:3.0:1790964094.218597:0:32647:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964094.218599:0:32647:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.218605:0:32647:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964094.218607:0:32647:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 0000000055320e45. 00000100:00000001:3.0:1790964094.218609:0:32647:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:3.0:1790964094.218610:0:32647:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 10000000:00000040:3.0:1790964094.218613:0:32647:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 9, more 0. 10000000:00000001:3.0:1790964094.218615:0:32647:0:(mgc_request.c:1308:mgc_apply_recover_logs()) Process entered 10000000:00000010:3.0:1790964094.218619:0:32647:0:(mgc_request.c:1331:mgc_apply_recover_logs()) kmalloced '(nidlist)': 640 at 000000001bd1c9de. 10000000:00000010:3.0:1790964094.218622:0:32647:0:(mgc_request.c:1343:mgc_apply_recover_logs()) kmalloced '(obdname)': 128 at 000000002adc9d70. 10000000:00000200:3.0:1790964094.218626:0:32647:0:(mgc_request.c:1241:mgc_build_nidlist()) use 1 from 1 NIDs 10000000:00000040:3.0:1790964094.218633:0:32647:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-MDT0000-mdc-MDT0000 10000000:00000040:3.0:1790964094.218639:0:32647:0:(mgc_request.c:1445:mgc_apply_recover_logs()) MGC192.168.202.118@tcp: cannot find OBD lustre-MDT0000-mdc-MDT0000 10000000:00000010:3.0:1790964094.218641:0:32647:0:(mgc_request.c:1492:mgc_apply_recover_logs()) kfreed 'obdname': 128 at 000000002adc9d70. 10000000:00000010:3.0:1790964094.218643:0:32647:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'nidlist': 640 at 000000001bd1c9de. 10000000:00000001:3.0:1790964094.218645:0:32647:0:(mgc_request.c:1496:mgc_apply_recover_logs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.218647:0:32647:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964094.218650:0:32647:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000ea881b47 x1877961941716864/t0(0) o256->MGC192.168.202.118@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964110 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964094.218655:0:32647:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964094.218656:0:32647:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964094.218658:0:32647:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000e592f4bf. 02000000:00000001:3.0:1790964094.218660:0:32647:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964094.218661:0:32647:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964094.218662:0:32647:0:(genops.c:1223:class_import_put()) import 0000000089249098 refcount=4 obd=MGC192.168.202.118@tcp 00000020:00000001:3.0:1790964094.218664:0:32647:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000001:3.0:1790964094.218665:0:32647:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000001:3.0:1790964094.218666:0:32647:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964094.218667:0:32647:0:(genops.c:1223:class_import_put()) import 0000000089249098 refcount=3 obd=MGC192.168.202.118@tcp 00000020:00000001:3.0:1790964094.218668:0:32647:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000010:3.0:1790964094.218670:0:32647:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 64 at 00000000cb92abec. 00000100:00000010:3.0:1790964094.218671:0:32647:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 00000000fa39cc18. 00000100:00000001:3.0:1790964094.218673:0:32647:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 02000000:00000010:3.0:1790964094.218674:0:32647:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 0000000079af9065. 02000000:00000001:3.0:1790964094.218678:0:32647:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964094.218679:0:32647:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964094.218680:0:32647:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000ea881b47. 00000100:00000001:3.0:1790964094.218682:0:32647:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964094.218683:0:32647:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000010:3.0:1790964094.218695:0:32647:0:(mgc_request.c:1652:mgc_process_recover_log()) kvfree 'folios': 32 at 000000001d3625ed. 10000000:01000000:3.0:1790964094.218699:0:32647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 10000000:00000001:3.0:1790964094.218702:0:32647:0:(mgc_request.c:1029:mgc_cancel()) Process entered 00010000:00000001:3.0:1790964094.218704:0:32647:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964094.218705:0:32647:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964094.218707:0:32647:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 000000006914b261 refcount=3 00000020:00000001:3.0:1790964094.218709:0:32647:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000001:3.0:1790964094.218711:0:32647:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446616802862291456 : -127270847260160 : ffff8c3f725bda00) 00010000:00000001:3.0:1790964094.218732:0:32647:0:(ldlm_lock.c:854:ldlm_lock_decref_internal()) Process entered 00010000:00010000:3.0:1790964094.218735:0:32647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000006914b261/0xd2056616bb7669a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7669ad expref: -99 pid: 32647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964094.218742:0:32647:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964094.218743:0:32647:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:3.0:1790964094.218745:0:32647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000006914b261/0xd2056616bb7669a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd2056616bb7669ad expref: -99 pid: 32647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964094.218751:0:32647:0:(ldlm_lock.c:923:ldlm_lock_decref_internal()) Process leaving 00010000:00000001:3.0:1790964094.218752:0:32647:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964094.218754:0:32647:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 10000000:00000001:3.0:1790964094.218755:0:32647:0:(mgc_request.c:1033:mgc_cancel()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964094.218757:0:32647:0:(mgc_request.c:1907:mgc_process_log()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964094.218759:0:32647:0:(mgc_request.c:621:do_requeue()) Process leaving 10000000:00000001:3.0:1790964094.218762:0:32647:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000040:3.0:1790964094.218763:0:32647:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(00000000a1511862) refs 3 10000000:00000001:3.0:1790964094.218766:0:32647:0:(mgc_request.c:147:config_log_put()) Process leaving 00000100:00000040:1.0:1790964094.226120:0:10687:0:(connection.c:75:cpu_latency_work()) work item of 00000000d96f467e (cpu 1) has reached its deadline 4295632392, at 4295632394 00000100:00000010:1.0:1790964094.226136:0:10687:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000006208fdff. 00000100:00000040:3.0:1790964094.226475:0:32548:0:(connection.c:75:cpu_latency_work()) work item of 000000001b84c312 (cpu 3) has reached its deadline 4295632392, at 4295632394 00000100:00000010:3.0:1790964094.226481:0:32548:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000004217160. 00000100:00000040:0.0:1790964094.228494:0:10793:0:(connection.c:75:cpu_latency_work()) work item of 000000005aae0ac0 (cpu 0) has reached its deadline 4295632392, at 4295632396 00000100:00000010:0.0:1790964094.228508:0:10793:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000000e801fa6. 00000100:00000040:2.0:1790964094.231663:0:23299:0:(connection.c:75:cpu_latency_work()) work item of 00000000984ab863 (cpu 2) has reached its deadline 4295632392, at 4295632399 00000100:00000010:2.0:1790964094.231677:0:23299:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000e759e8b8. 00000100:00000001:3.0:1790964094.729957:0:31804:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964094.729969:0:31804:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964094.729971:0:31804:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.729975:0:31804:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964094.729978:0:31804:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964094.729981:0:31804:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.729982:0:31804:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964094.989343:0:32688:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964094.989351:0:32688:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964094.989353:0:32688:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964094.989357:0:32688:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034099c81 going to sleep for 0 seconds 00000100:00000001:3.0:1790964094.989362:0:32688:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964094.989365:0:32688:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.989377:0:32688:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964094.989380:0:32688:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964094.989383:0:32688:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964095.118456:0:23299:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964095.118464:0:23299:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964095.118471:0:23299:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964095.118472:0:23299:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964095.118654:0:32639:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1790964095.118657:0:32639:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1790964095.118660:0:32639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:2.0:1790964095.140996:0:33094:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:2.0:1790964095.141011:0:33094:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964095.141016:0:33094:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) Debug log: 2420 lines, 2420 kept, 0 dropped, 0 bad.