00000020:01000004:3.0F:1790964152.308765:0:32610:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790964152.308780:0:32610:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1790964152.308954:0:32610:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f5d5af73 00000080:02000400:3.0:1790964152.308966:0:32610:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1790964152.316368:0:32610:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790964152.316383:0:32610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0F:1790964152.316521:0:32610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004271ea85) 00000020:00000080:2.0:1790964152.316555:0:32610:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1790964152.396958:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0F:1790964152.438993:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1790964152.442438:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 173: rc = 0 00100000:10000000:0.0:1790964152.442537:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 173: rc = 0 00100000:10000000:0.0:1790964152.442973:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 173: rc = 0 00100000:10000000:0.0:1790964152.443074:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 173: rc = 0 00100000:10000000:0.0:1790964152.443173:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 173: rc = 0 00100000:10000000:0.0:1790964152.446409:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790964152.449024:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 173: rc = 0 00100000:10000000:2.0:1790964152.462283:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 175: rc = 0 00100000:10000000:0.0:1790964152.480441:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 677: rc = 0 00100000:10000000:0.0:1790964152.480726:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 677: rc = 0 00100000:10000000:0.0:1790964152.484107:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 216: rc = 0 00100000:10000000:0.0:1790964152.487055:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 216: rc = 0 00100000:10000000:1.0:1790964152.489882:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 216: rc = 0 00100000:10000000:1.0:1790964152.491144:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 216: rc = 0 00100000:10000000:1.0:1790964152.493227:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 216: rc = 0 00100000:10000000:1.0:1790964152.494730:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 216: rc = 0 00100000:10000000:1.0:1790964152.496201:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 216: rc = 0 00100000:10000000:1.0:1790964152.497410:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 216: rc = 0 00100000:10000000:1.0:1790964152.499282:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 216: rc = 0 00100000:10000000:1.0:1790964152.500875:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 216: rc = 0 00100000:10000000:1.0:1790964152.502298:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 216: rc = 0 00100000:10000000:1.0:1790964152.504591:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 216: rc = 0 00100000:10000000:1.0:1790964152.509494:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 597: rc = 0 00100000:10000000:1.0:1790964152.511151:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 597: rc = 0 00100000:10000000:1.0:1790964152.512469:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 597: rc = 0 00100000:10000000:2.0:1790964152.516449:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 597: rc = 0 00100000:10000000:2.0:1790964152.518376:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 597: rc = 0 00100000:10000000:2.0:1790964152.521274:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 597: rc = 0 00100000:10000000:2.0:1790964152.527051:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 597: rc = 0 00100000:10000000:2.0:1790964152.528429:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 597: rc = 0 00100000:10000000:2.0:1790964152.536381:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 597: rc = 0 00100000:10000000:2.0:1790964152.537480:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 597: rc = 0 00100000:10000000:2.0:1790964152.541793:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 597: rc = 0 00100000:10000000:2.0:1790964152.544408:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 597: rc = 0 00100000:10000000:2.0:1790964152.546224:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 597: rc = 0 00100000:10000000:2.0:1790964152.547883:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 597: rc = 0 00100000:10000000:2.0:1790964152.549806:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 597: rc = 0 00100000:10000000:2.0:1790964152.551863:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 597: rc = 0 00100000:10000000:2.0:1790964152.559931:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 597: rc = 0 00100000:10000000:2.0:1790964152.566226:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 597: rc = 0 00100000:10000000:2.0:1790964152.568362:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 597: rc = 0 00100000:10000000:2.0:1790964152.585113:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 597: rc = 0 00100000:10000000:3.0:1790964152.594402:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 597: rc = 0 00100000:10000000:3.0:1790964152.603433:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 597: rc = 0 00100000:10000000:3.0:1790964152.611861:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 597: rc = 0 00100000:10000000:0.0:1790964152.623259:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 597: rc = 0 00100000:10000000:0.0:1790964152.631559:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 597: rc = 0 00100000:10000000:0.0:1790964152.634410:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 597: rc = 0 00100000:10000000:0.0:1790964152.636503:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 597: rc = 0 00100000:10000000:0.0:1790964152.643592:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 597: rc = 0 00100000:10000000:0.0:1790964152.652399:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 597: rc = 0 00100000:10000000:0.0:1790964152.653501:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 597: rc = 0 00100000:10000000:0.0:1790964152.658831:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 597: rc = 0 00100000:10000000:0.0:1790964152.661078:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 597: rc = 0 00100000:10000000:0.0:1790964152.674830:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 219: rc = 0 00100000:10000000:0.0:1790964152.676118:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 219: rc = 0 00100000:10000000:3.0:1790964152.690562:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1790964152.691888:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 213: rc = 0 00100000:10000000:0.0:1790964152.693461:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1790964152.693564:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 213: rc = 0 00100000:10000000:0.0:1790964152.695810:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1790964152.695915:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 213: rc = 0 00100000:10000000:0.0:1790964152.708446:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1790964152.708601:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 678: rc = 0 00100000:10000000:0.0:1790964152.711676:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1790964152.711789:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 678: rc = 0 00100000:10000000:0.0:1790964152.718856:0:32610:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1790964152.719084:0:32610:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 678: rc = 0 00000020:00000080:0.0:1790964152.720902:0:32610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790964152.720913:0:32610:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790964152.720926:0:32610:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7851639485e2d7c4 00000020:01000004:0.0:1790964152.720935:0:32610:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1790964152.720940:0:32610:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790964152.720945:0:32610:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5d5af73 from MGS 00000020:01000004:0.0:1790964152.720950:0:32610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790964152.722419:0:32610:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f2086d70) 00000020:00000080:0.0:1790964152.722451:0:32610:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790964152.722569:0:32610:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5d5af73 from MGS, refs=2 00080000:01000000:0.0:1790964152.722577:0:32610:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790964152.722584:0:32610:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7851639485e2d7d2 00000100:00100000:0.0:1790964152.722738:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790964152.722890:0:32610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790964152.722897:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790964152.723413:0:32610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790964152.723420:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790964152.724942:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964152.725170:0:32610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790964152.725176:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790964152.726150:0:32610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790964152.726159:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790964152.726411:0:32610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790964152.726416:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790964152.730280:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964152.730285:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964152.730288:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964152.732415:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964152.732421:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964152.732423:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964152.733148:0:32610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790964152.736020:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790964152.983194:0:32610:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2687 MB/s 00000001:01000000:0.0:1790964153.235136:0:32610:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3297 MB/s 00000001:01000000:3.0:1790964153.484801:0:32610:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 431 MB/s 00000001:01000000:3.0:1790964153.737238:0:32610:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 615 MB/s 00000040:01000000:1.0:1790964153.765828:0:32610:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790964153.765860:0:32610:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790964153.765863:0:32610:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790964153.767324:0:32619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790964153.767466:0:32610:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790964153.767802:0:32610:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790964153.767949:0:32610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790964153.768013:0:32610:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790964153.768312:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964153.768480:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790964153.768486:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790964153.773039:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790964153.773055:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790964153.773494:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790964153.773501:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790964153.778534:0:32610:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790964153.778557:0:32610:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.135@tcp' 00000020:01000004:3.0:1790964153.778559:0:32610:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790964153.778638:0:32610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.135@tcp (typ=mgc) 00000020:00000080:3.0:1790964153.778659:0:32610:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.135@tcp (0000000090e4f977) 00000020:00000080:3.0:1790964153.778675:0:32610:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790964153.778792:0:32610:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003559c588@MGC192.168.204.135@tcp: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1790964153.778926:0:32610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.135@tcp-0 is initialized 00000040:01000000:3.0:1790964153.778937:0:32610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 1 is initialized 00000100:00080000:2.0:1790964153.779867:0:32624:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790964153.781364:0:32625:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790964153.781777:0:32610:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.135@tcp (uuid b465b99b-a0b4-4368-8d34-49a45cd42e5a) 00000020:00000080:3.0:1790964153.781800:0:32610:0:(genops.c:1385:class_connect()) connect: client b465b99b-a0b4-4368-8d34-49a45cd42e5a, cookie 0x7851639485e2d7e0 00000100:00080000:3.0:1790964153.781813:0:32610:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964153.781818:0:32610:0:(import.c:665:import_select_connection()) MGC192.168.204.135@tcp: import 000000003559c588 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1790964153.781850:0:32610:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ab50d27 x1877962009870464/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790964153.781871:0:32610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b465b99b-a0b4-4368-8d34-49a45cd42e5a->MGS 00000020:01000004:3.0:1790964153.781891:0:32610:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790964153.781896:0:32610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790964153.781909:0:32610:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e9c1ee15) 00000020:00000080:3.0:1790964153.781919:0:32610:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790964153.786758:0:31780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ab50d27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31780:1877962009870464:0@lo:250: 00000100:00100000:2.0:1790964153.786859:0:31780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964153.787389:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009870464 00000100:00100000:1.0:1790964153.787399:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009870464 00000100:00100000:1.0:1790964153.787446:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964153.787452:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040354fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:31780:x1877962009870464:12345-0@lo:250: 00010000:00080000:1.0:1790964153.787478:0:32620:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo t0 exp 0000000000000000 cur 1016 last 0 00000020:00000080:1.0:1790964153.787511:0:32620:0:(genops.c:1385:class_connect()) connect: client b465b99b-a0b4-4368-8d34-49a45cd42e5a, cookie 0x7851639485e2d7ee 00000100:00080000:1.0:1790964153.787668:0:32620:0:(import.c:65:import_set_state_nolock()) 000000009218be5f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790964153.787750:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040354fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+5:31780:x1877962009870464:12345-0@lo:250: Request processed in 295us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964153.787766:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964153.787807:0:31780:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790964153.787818:0:31780:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:1.0:1790964153.787828:0:31780:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790964153.787832:0:31780:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790964153.787836:0:31780:0:(import.c:65:import_set_state_nolock()) 000000003559c588 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790964153.787838:0:31780:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790964153.787849:0:31780:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790964153.787853:0:31780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ab50d27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31780:1877962009870464:0@lo:250: 00000100:00100000:3.0:1790964153.791245:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964153.791410:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790964153.791415:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:0.0:1790964153.792027:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964153.793650:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790964153.793661:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790964153.794601:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790964153.794646:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790964153.796348:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964153.796527:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790964153.796533:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790964153.797270:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790964153.797279:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790964153.824486:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964153.824940:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790964153.824948:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790964153.826084:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790964153.826094:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790964153.826904:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964153.827089:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790964153.827095:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790964153.827852:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790964153.827860:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790964153.828799:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964153.828975:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790964153.828980:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790964153.829451:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790964153.829457:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790964153.830260:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964153.830421:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790964153.830426:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790964153.830983:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790964153.830990:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790964153.847792:0:32610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964153.848038:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790964153.848045:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790964153.849388:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790964153.849398:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790964153.850317:0:32610:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790964153.850325:0:32610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790964153.851592:0:32610:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790964153.851648:0:32610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790964153.851654:0:32610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790964153.851989:0:32610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790964153.852025:0:32610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790964153.852029:0:32610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790964153.852030:0:32610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790964153.852032:0:32610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790964153.852032:0:32610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790964153.852034:0:32610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790964153.852035:0:32610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790964153.852036:0:32610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790964153.852037:0:32610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790964153.852038:0:32610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790964153.852040:0:32610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790964153.852042:0:32610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790964153.852045:0:32610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790964153.852046:0:32610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790964153.852047:0:32610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790964153.852048:0:32610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790964153.852049:0:32610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790964153.852050:0:32610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790964153.852051:0:32610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790964153.852052:0:32610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790964153.852057:0:32610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790964153.852058:0:32610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790964153.852090:0:32610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790964153.852107:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870592:0@lo:253: 00000100:00100000:2.0:1790964153.852176:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964153.855389:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7bde2a3 going to sleep for 11 seconds 00000100:00100000:0.0:1790964153.855559:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009870592 00000100:00100000:0.0:1790964153.855815:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009870592 00000100:00100000:0.0:1790964153.855906:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790964153.855915:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000532f98ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+5:32610:x1877962009870592:12345-0@lo:253: 20000000:01000000:0.0:1790964153.855972:0:32623:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790964153.855975:0:32623:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790964153.855977:0:32623:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1790964153.856248:0:32644:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790964153.856839:0:32623:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1790964153.864335:0:32645:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790964153.864342:0:32645:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790964153.864345:0:32645:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 00000040:00080000:1.0:1790964153.864394:0:32645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 20000000:01000000:1.0:1790964153.864686:0:32623:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790964153.864786:0:32623:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790964153.918561:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000532f98ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+5:32610:x1877962009870592:12345-0@lo:253: Request processed in 62637us (66376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964153.918589:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790964153.918870:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870592:0@lo:253: 10000000:01000000:2.0:1790964153.918886:0:32610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790964153.918889:0:32610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790964153.918890:0:32610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790964153.918892:0:32610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790964153.918892:0:32610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790964153.918894:0:32610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790964153.918895:0:32610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790964153.918896:0:32610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790964153.918897:0:32610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790964153.918899:0:32610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790964153.918900:0:32610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790964153.918918:0:32610:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5d5af73 from lustre-MDT0000 10000000:01000000:2.0:1790964153.918943:0:32610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790964153.918946:0:32610:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790964153.918951:0:32610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93d20ade19c0 10000000:01000000:2.0:1790964153.918955:0:32610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790964153.918963:0:32610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d20ade19c0 from 1 10000000:01000000:2.0:1790964153.918965:0:32610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790964153.919006:0:32610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000065687a45/0x7851639485e2d7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.919016:0:32610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000065687a45/0x7851639485e2d7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.919025:0:32610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000065687a45/0x7851639485e2d7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964153.919061:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870720:0@lo:101: 00000100:00100000:2.0:1790964153.919095:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964153.919219:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009870720 00000100:00100000:1.0:1790964153.919231:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009870720 00000100:00100000:1.0:1790964153.919280:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790964153.919297:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e6882e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+5:32610:x1877962009870720:12345-0@lo:101: 00010000:00010000:1.0:1790964153.919311:0:32620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964153.919326:0:32620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000333059e9/0x7851639485e2d7fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7851639485e2d7f5 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.919348:0:32620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000333059e9/0x7851639485e2d7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7851639485e2d7f5 expref: 6 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.919358:0:32620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000333059e9/0x7851639485e2d7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d7f5 expref: 6 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.919366:0:32620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000333059e9, rc 0) 00000100:00100000:1.0:1790964153.919395:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e6882e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+6:32610:x1877962009870720:12345-0@lo:101: Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964153.919400:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790964153.919536:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f2d8db6 going to sleep for 11 seconds 00000100:00100000:2.0:1790964153.919550:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870720:0@lo:101: 00010000:00010000:2.0:1790964153.919561:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000065687a45/0x7851639485e2d7f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d7fc expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.919581:0:32610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000065687a45/0x7851639485e2d7f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7851639485e2d7fc expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964153.919668:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870848:0@lo:501: 00000100:00100000:2.0:1790964153.919708:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964153.919726:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f2d8db6 going to sleep for 11 seconds 00000100:00100000:3.0:1790964153.920544:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009870848 00000100:00100000:3.0:1790964153.920551:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009870848 00000100:00100000:3.0:1790964153.920838:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790964153.920847:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000282fd334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+6:32610:x1877962009870848:12345-0@lo:501: 00000100:00100000:3.0:1790964153.921116:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000282fd334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+6:32610:x1877962009870848:12345-0@lo:501: Request processed in 270us (1420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790964153.921140:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790964153.921225:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870848:0@lo:501: 10000000:01000000:2.0:1790964153.921260:0:32610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790964153.921281:0:32610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000065687a45/0x7851639485e2d7f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d7fc expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.921299:0:32610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000065687a45/0x7851639485e2d7f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d7fc expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964153.921308:0:32610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d2393ae800 10000000:01000000:2.0:1790964153.921313:0:32610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790964153.921317:0:32610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d2393ae800 10000000:01000000:2.0:1790964153.921320:0:32610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790964153.921322:0:32610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d2393ae800 from 1 10000000:01000000:2.0:1790964153.921330:0:32610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790964153.921355:0:32610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000c049f8f1/0x7851639485e2d803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.921362:0:32610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000c049f8f1/0x7851639485e2d803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.921370:0:32610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000c049f8f1/0x7851639485e2d803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964153.921384:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870976:0@lo:101: 00000100:00100000:2.0:1790964153.921415:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964153.921907:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f2d8db6 going to sleep for 11 seconds 00000100:00100000:1.0:1790964153.921978:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009870976 00000100:00100000:1.0:1790964153.921984:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009870976 00000100:00100000:1.0:1790964153.922015:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790964153.922021:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b17aa7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+6:32610:x1877962009870976:12345-0@lo:101: 00010000:00010000:1.0:1790964153.922031:0:32620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964153.922046:0:32620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a580fcb/0x7851639485e2d80a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7851639485e2d803 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.922066:0:32620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a580fcb/0x7851639485e2d80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7851639485e2d803 expref: 7 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.922076:0:32620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a580fcb/0x7851639485e2d80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d803 expref: 7 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.922097:0:32620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a580fcb, rc 0) 00000100:00100000:1.0:1790964153.922204:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b17aa7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+7:32610:x1877962009870976:12345-0@lo:101: Request processed in 183us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964153.922211:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790964153.922298:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009870976:0@lo:101: 00010000:00010000:2.0:1790964153.922311:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000c049f8f1/0x7851639485e2d803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d80a expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.922319:0:32610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000c049f8f1/0x7851639485e2d803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7851639485e2d80a expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964153.922331:0:32610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790964153.922345:0:32610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000c049f8f1/0x7851639485e2d803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d80a expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.922351:0:32610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000c049f8f1/0x7851639485e2d803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d80a expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964153.922357:0:32610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790964153.922361:0:32610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790964153.922365:0:32610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d2393ae800 10000000:01000000:2.0:1790964153.922373:0:32610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790964153.922377:0:32610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790964153.922378:0:32610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790964153.922393:0:32610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000009097524c/0x7851639485e2d811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.922399:0:32610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000009097524c/0x7851639485e2d811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.922405:0:32610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000009097524c/0x7851639485e2d811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964153.922417:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009871104:0@lo:101: 00000100:00100000:2.0:1790964153.922443:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964153.922454:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f2d8db6 going to sleep for 11 seconds 00000100:00100000:1.0:1790964153.922512:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009871104 00000100:00100000:1.0:1790964153.922516:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009871104 00000100:00100000:1.0:1790964153.922534:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790964153.922539:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d38ac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+7:32610:x1877962009871104:12345-0@lo:101: 00010000:00010000:1.0:1790964153.922545:0:32620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964153.922552:0:32620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008bfa34fa/0x7851639485e2d818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7851639485e2d811 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.922564:0:32620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008bfa34fa/0x7851639485e2d818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7851639485e2d811 expref: 8 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.922658:0:32620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008bfa34fa/0x7851639485e2d818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d811 expref: 8 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964153.922665:0:32620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008bfa34fa, rc 0) 00000100:00100000:2.0:1790964153.922778:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009871104:0@lo:101: 00010000:00010000:2.0:1790964153.922788:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000009097524c/0x7851639485e2d811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d818 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964153.922795:0:32610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000009097524c/0x7851639485e2d811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7851639485e2d818 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964153.922839:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009871232:0@lo:501: 00000100:00100000:2.0:1790964153.922969:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964153.923020:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f2d8db6 going to sleep for 11 seconds 00000100:00100000:1.0:1790964153.923060:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d38ac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+8:32610:x1877962009871104:12345-0@lo:101: Request processed in 521us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964153.923066:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790964153.923084:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009871232 00000100:00100000:1.0:1790964153.923086:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009871232 00000100:00100000:3.0:1790964153.923121:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790964153.923206:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037077de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+8:32610:x1877962009871232:12345-0@lo:501: 00000100:00100000:3.0:1790964153.923558:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037077de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32610:x1877962009871232:12345-0@lo:501: Request processed in 353us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964153.923680:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009871232:0@lo:501: 00000100:00100000:2.0:1790964153.923724:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009871360:0@lo:503: 00000100:00100000:2.0:1790964153.923761:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964153.923783:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f2d8db6 going to sleep for 11 seconds 00000100:00100000:1.0:1790964153.923885:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009871360 00000100:00100000:1.0:1790964153.923890:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009871360 00000100:00100000:3.0:1790964153.924213:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790964153.924279:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790964153.924298:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebcef04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32610:x1877962009871360:12345-0@lo:503: 00000100:00100000:1.0:1790964153.930022:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebcef04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32610:x1877962009871360:12345-0@lo:503: Request processed in 5719us (6253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964153.930037:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790964153.930171:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009871360:0@lo:503: 00000100:00100000:3.0:1790964153.932850:0:32648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32648:1877962009871488:0@lo:502: 00000100:00100000:3.0:1790964153.932988:0:32648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964153.933068:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009871488 00000100:00100000:1.0:1790964153.933077:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009871488 00000100:00100000:3.0:1790964153.933105:0:32648:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb75f5fd going to sleep for 11 seconds 00000100:00100000:1.0:1790964153.939711:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790964153.939736:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a61889a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32648:x1877962009871488:12345-0@lo:502: 00000100:00100000:3.0:1790964153.949057:0:32648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32648:1877962009871488:0@lo:502: 00000020:01000000:3.0:1790964153.949096:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964153.949107:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964153.949109:0:32648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790964153.949113:0:32648:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790964153.949116:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964153.949129:0:32648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000eb6443d7) 00000020:00000080:3.0:1790964153.949147:0:32648:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790964153.949151:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790964153.949230:0:32648:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790964153.949237:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7851639485e2d826 00000020:00000080:3.0:1790964153.949477:0:32648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790964153.949482:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964153.949485:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964153.949486:0:32648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790964153.949488:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964153.949492:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964153.949493:0:32648:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790964153.949496:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964153.949507:0:32648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005e9df553) 00000020:00000080:3.0:1790964153.949516:0:32648:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790964153.949533:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790964153.949534:0:32648:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790964153.949537:0:32648:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790964153.949542:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790964153.949590:0:32648:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5d5af73 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790964153.949610:0:32648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009cafbec9) 00000020:00000080:3.0:1790964153.949647:0:32648:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790964153.949706:0:32648:0:(lod_dev.c:2309:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790964153.949711:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7851639485e2d83b 00000020:00000080:3.0:1790964153.949805:0:32648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790964153.949812:0:32648:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790964153.949816:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7851639485e2d842 00080000:01000000:3.0:1790964153.949821:0:32648:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790964153.949824:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7851639485e2d849 00000100:00100000:1.0:1790964153.950045:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a61889a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32648:x1877962009871488:12345-0@lo:502: Request processed in 9203us (15940us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964153.950058:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1790964154.079320:0:32648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790964154.082382:0:32648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934593 00000001:00080000:2.0:1790964154.082716:0:32648:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790964154.083766:0:32648:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009f24ea3e) 00000020:00000080:2.0:1790964154.083787:0:32648:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790964154.083862:0:32648:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790964154.086024:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7851639485e2d857 00000020:00000080:2.0:1790964154.086310:0:32648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790964154.098374:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7851639485e2d85e 00000020:00000080:3.0:1790964154.102603:0:32648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790964154.102799:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964154.102807:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964154.102810:0:32648:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790964154.102813:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790964154.102815:0:32648:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1790964154.102817:0:32648:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964154.102818:0:32648:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964154.102820:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790964154.102822:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964154.102823:0:32648:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790964154.102826:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964154.102831:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964154.102832:0:32648:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790964154.102836:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790964154.103054:0:32648:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790964154.103076:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964154.103079:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964154.103093:0:32648:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790964154.103097:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790964154.103100:0:32648:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790964154.103103:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964154.103105:0:32648:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790964154.103107:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790964154.103112:0:32648:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:3.0:1790964154.103138:0:32648:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790964154.103142:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964154.103159:0:32648:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (000000006ddaf189) 00000020:00000080:3.0:1790964154.103178:0:32648:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790964154.103184:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790964154.103244:0:32648:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790964154.103250:0:32648:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790964154.103258:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7851639485e2d86c 00010000:00080000:3.0:1790964154.103305:0:32648:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000791c0c9@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1790964154.103560:0:32648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790964154.104437:0:32648:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790964154.104485:0:32648:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790964154.117317:0:32648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964154.120467:0:32648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1790964154.120641:0:32648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7:0x0].1, 64 off8256 00000020:00000080:1.0:1790964154.123920:0:32648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790964154.123937:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790964154.123970:0:32648:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790964154.123990:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7851639485e2d873 00000100:00080000:1.0:1790964154.124001:0:32648:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964154.124007:0:32648:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 000000000791c0c9 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1790964154.124044:0:32648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790964154.124067:0:32648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790964154.124118:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964154.124122:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964154.124124:0:32648:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790964154.124126:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790964154.124128:0:32648:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1790964154.124130:0:32648:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790964154.124131:0:32648:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790964154.124133:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790964154.124135:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964154.124136:0:32648:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790964154.124149:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790964154.124152:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964154.124154:0:32648:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790964154.124156:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790964154.124159:0:32648:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:1.0:1790964154.124184:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790964154.124204:0:32648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000002b6febe2) 00000020:00000080:1.0:1790964154.124216:0:32648:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790964154.124222:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790964154.124333:0:32648:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790964154.124340:0:32648:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790964154.124345:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7851639485e2d881 00010000:00080000:1.0:1790964154.124372:0:32648:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000064ad1a4a@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00000040:00080000:0.0:1790964154.124391:0:32652:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790964154.124396:0:32652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1790964154.125406:0:31780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073db718b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31780:1877962009871616:0@lo:8: 00000400:00000100:2.0:1790964154.125464:0:31780:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877962009871616 offset 0 length 520: 4 00010000:00010000:1.0:1790964154.133293:0:32648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:1.0:1790964154.137854:0:32648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790964154.137870:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790964154.137902:0:32648:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790964154.137922:0:32648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7851639485e2d888 00000100:00080000:1.0:1790964154.137933:0:32648:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964154.137939:0:32648:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000064ad1a4a using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1790964154.137977:0:32648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003c6622c x1877962009871744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790964154.138008:0:32648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1790964154.138059:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964154.138063:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964154.138064:0:32648:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790964154.138067:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790964154.138071:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964154.138072:0:32648:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790964154.138075:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790964154.138076:0:32648:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 00000100:00100000:1.0:1790964154.138111:0:32648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008649198d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32648:1877962009871872:0@lo:502: 00000100:00100000:1.0:1790964154.138188:0:32648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964154.138232:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009871872 00000100:00100000:1.0:1790964154.138239:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009871872 00000100:00100000:1.0:1790964154.138290:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790964154.138298:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054397a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32648:x1877962009871872:12345-0@lo:502: 00000100:00100000:1.0:1790964154.138548:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054397a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32648:x1877962009871872:12345-0@lo:502: Request processed in 249us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964154.138556:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790964154.138657:0:32648:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059bde8bc going to sleep for 11 seconds 00000100:00100000:1.0:1790964154.138680:0:32648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008649198d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32648:1877962009871872:0@lo:502: 00000020:01000000:1.0:1790964154.138704:0:32648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964154.138708:0:32648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964154.138710:0:32648:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790964154.138713:0:32648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1790964154.140302:0:32610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:2.0:1790964154.140335:0:32610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790964154.140358:0:32610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000009097524c/0x7851639485e2d811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d818 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.140371:0:32610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000009097524c/0x7851639485e2d811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d818 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964154.140382:0:32610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d2393ae800 from 1 10000000:01000000:2.0:1790964154.140384:0:32610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790964154.140422:0:32610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.140429:0:32610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.140457:0:32610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964154.140476:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872000:0@lo:101: 00000100:00100000:2.0:1790964154.140534:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964154.140587:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc0dd1a9 going to sleep for 11 seconds 00000100:00100000:3.0:1790964154.140762:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872000 00000100:00100000:3.0:1790964154.140770:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872000 00000100:00100000:3.0:1790964154.140809:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790964154.140816:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fcb6b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+9:32610:x1877962009872000:12345-0@lo:101: 00010000:00010000:3.0:1790964154.140829:0:32623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964154.140844:0:32623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7851639485e2d88f expref: -99 pid: 32623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.140865:0:32623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7851639485e2d88f expref: 10 pid: 32623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.140883:0:32623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d88f expref: 10 pid: 32623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.140892:0:32623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e053c633, rc 0) 00000100:00100000:3.0:1790964154.140932:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fcb6b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+10:32610:x1877962009872000:12345-0@lo:101: Request processed in 117us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964154.140938:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790964154.141272:0:31780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003c6622c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31780:1877962009871744:0@lo:38: 00000100:00100000:2.0:1790964154.141318:0:31780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964154.141385:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872000:0@lo:101: 00010000:00010000:2.0:1790964154.141399:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.141407:0:32610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964154.142069:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872128:0@lo:256: 00000100:00100000:2.0:1790964154.142115:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964154.142133:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc0dd1a9 going to sleep for 11 seconds 00000100:00100000:0.0:1790964154.142635:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872128 00000100:00100000:0.0:1790964154.142643:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872128 00000100:00100000:0.0:1790964154.142686:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790964154.142693:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f50ba5f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+10:32610:x1877962009872128:12345-0@lo:256: 20000000:01000000:0.0:1790964154.142710:0:32620:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790964154.142715:0:32620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790964154.142785:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f50ba5f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+10:32610:x1877962009872128:12345-0@lo:256: Request processed in 92us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964154.142792:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790964154.142887:0:32633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009871744 00000100:00100000:3.0:1790964154.142892:0:32633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009871744 00000100:00100000:3.0:1790964154.142923:0:32633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964154.142928:0:32633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdaaea95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31780:x1877962009871744:12345-0@lo:38: 00010000:00020000:3.0:1790964154.142943:0:32633:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790964154.142982:0:32633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdaaea95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31780:x1877962009871744:12345-0@lo:38: Request processed in 53us (1663us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790964154.142988:0:32633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790964154.144209:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872128:0@lo:256: 00000100:00080000:0.0:1790964154.144715:0:31780:0:(import.c:65:import_set_state_nolock()) 0000000064ad1a4a lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790964154.144736:0:31780:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790964154.144739:0:31780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003c6622c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31780:1877962009871744:0@lo:38: 10000000:01000000:2.0:1790964154.147140:0:32610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790964154.147214:0:32610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.147228:0:32610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964154.147255:0:32610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d2393ae800 from 1 10000000:01000000:2.0:1790964154.147258:0:32610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790964154.147309:0:32610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000002b1cb4b4/0x7851639485e2d89d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.147316:0:32610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000002b1cb4b4/0x7851639485e2d89d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.147327:0:32610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000002b1cb4b4/0x7851639485e2d89d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964154.147348:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872256:0@lo:101: 00000100:00100000:2.0:1790964154.147419:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964154.147475:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc0dd1a9 going to sleep for 11 seconds 00000100:00100000:0.0:1790964154.149127:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872256 00000100:00100000:0.0:1790964154.149143:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872256 00000100:00100000:0.0:1790964154.149208:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790964154.149229:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033dfc26d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+10:32610:x1877962009872256:12345-0@lo:101: 00010000:00010000:0.0:1790964154.149245:0:32620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964154.149266:0:32620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082f30fd1/0x7851639485e2d8a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7851639485e2d89d expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964154.149300:0:32620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082f30fd1/0x7851639485e2d8a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7851639485e2d89d expref: 11 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964154.149311:0:32620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082f30fd1/0x7851639485e2d8a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d89d expref: 11 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964154.149320:0:32620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082f30fd1, rc 0) 00000100:00100000:0.0:1790964154.149382:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033dfc26d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32610:x1877962009872256:12345-0@lo:101: Request processed in 155us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964154.149389:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790964154.149766:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872256:0@lo:101: 00010000:00010000:2.0:1790964154.149783:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000002b1cb4b4/0x7851639485e2d89d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8a4 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.149792:0:32610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000002b1cb4b4/0x7851639485e2d89d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7851639485e2d8a4 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964154.149854:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872384:0@lo:501: 00000100:00100000:2.0:1790964154.149900:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964154.149935:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc0dd1a9 going to sleep for 11 seconds 00000100:00100000:3.0:1790964154.149995:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872384 00000100:00100000:3.0:1790964154.150000:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872384 00000100:00100000:3.0:1790964154.150033:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790964154.150040:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f98f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32610:x1877962009872384:12345-0@lo:501: 00000100:00100000:3.0:1790964154.150406:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f98f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32610:x1877962009872384:12345-0@lo:501: Request processed in 367us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964154.150414:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790964154.150496:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872384:0@lo:501: 00000100:00100000:2.0:1790964154.150523:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872512:0@lo:503: 00000100:00100000:2.0:1790964154.150583:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964154.150604:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc0dd1a9 going to sleep for 11 seconds 00000100:00100000:3.0:1790964154.150750:0:32622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872512 00000100:00100000:3.0:1790964154.150754:0:32622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872512 00000100:00100000:3.0:1790964154.150781:0:32622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790964154.150786:0:32622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067cf57a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32610:x1877962009872512:12345-0@lo:503: 00000040:00080000:3.0:1790964154.150830:0:32622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790964154.150866:0:32622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067cf57a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32610:x1877962009872512:12345-0@lo:503: Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964154.150873:0:32622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790964154.150954:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fb5feb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872512:0@lo:503: 00000040:00080000:2.0:1790964154.151956:0:32656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790964154.152176:0:32610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790964154.152197:0:32610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790964154.152352:0:32610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000002b1cb4b4/0x7851639485e2d89d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8a4 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.152363:0:32610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000002b1cb4b4/0x7851639485e2d89d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8a4 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964154.152404:0:32610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790964154.152407:0:32610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d2393ae800 10000000:01000000:3.0:1790964154.152409:0:32610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d2393ae800 10000000:01000000:3.0:1790964154.152413:0:32610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790964154.152418:0:32610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d2393ae800 from 1 10000000:01000000:3.0:1790964154.152421:0:32610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790964154.152453:0:32610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000cf5062f9/0x7851639485e2d8ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.152461:0:32610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000cf5062f9/0x7851639485e2d8ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.152471:0:32610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000cf5062f9/0x7851639485e2d8ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964154.152489:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872640:0@lo:101: 00000100:00100000:3.0:1790964154.152544:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964154.152608:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f5fcd06 going to sleep for 11 seconds 00000100:00100000:0.0:1790964154.152768:0:32622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872640 00000100:00100000:0.0:1790964154.152775:0:32622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872640 00000100:00100000:0.0:1790964154.152813:0:32622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790964154.152821:0:32622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b77a5d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32610:x1877962009872640:12345-0@lo:101: 00010000:00010000:0.0:1790964154.152834:0:32622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964154.152845:0:32622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087872964/0x7851639485e2d8b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7851639485e2d8ab expref: -99 pid: 32622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964154.152864:0:32622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087872964/0x7851639485e2d8b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7851639485e2d8ab expref: 12 pid: 32622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964154.152882:0:32622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087872964/0x7851639485e2d8b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d8ab expref: 12 pid: 32622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964154.152890:0:32622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087872964, rc 0) 00000100:00100000:0.0:1790964154.152942:0:32622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b77a5d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32610:x1877962009872640:12345-0@lo:101: Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964154.152949:0:32622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790964154.153072:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872640:0@lo:101: 00010000:00010000:3.0:1790964154.153085:0:32610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000cf5062f9/0x7851639485e2d8ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8b2 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.153093:0:32610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000cf5062f9/0x7851639485e2d8ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7851639485e2d8b2 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964154.153139:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872768:0@lo:501: 00000100:00100000:3.0:1790964154.153164:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964154.153189:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f5fcd06 going to sleep for 11 seconds 00000100:00100000:2.0:1790964154.153266:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872768 00000100:00100000:2.0:1790964154.153271:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872768 00000100:00100000:2.0:1790964154.153307:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790964154.153313:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b7053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32610:x1877962009872768:12345-0@lo:501: 00000100:00100000:2.0:1790964154.153559:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b7053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32610:x1877962009872768:12345-0@lo:501: Request processed in 247us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964154.153582:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790964154.153813:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872768:0@lo:501: 00000100:00100000:3.0:1790964154.153843:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872896:0@lo:503: 00000100:00100000:3.0:1790964154.153892:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964154.153916:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f5fcd06 going to sleep for 11 seconds 00000100:00100000:0.0:1790964154.154031:0:32622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009872896 00000100:00100000:0.0:1790964154.154036:0:32622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009872896 00000100:00100000:0.0:1790964154.154056:0:32622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790964154.154062:0:32622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef497683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32610:x1877962009872896:12345-0@lo:503: 00000100:00100000:0.0:1790964154.154232:0:32622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef497683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32610:x1877962009872896:12345-0@lo:503: Request processed in 170us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964154.154239:0:32622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790964154.154366:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009872896:0@lo:503: 00000100:00100000:0.0:1790964154.154811:0:32657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000501f40c3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32657:1877962009873024:0@lo:502: 00000100:00100000:0.0:1790964154.154850:0:32657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964154.154942:0:32657:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099166b56 going to sleep for 11 seconds 00000100:00100000:2.0:1790964154.154989:0:32622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009873024 00000100:00100000:2.0:1790964154.154994:0:32622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009873024 00000100:00100000:2.0:1790964154.155026:0:32622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790964154.155033:0:32622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb3fc52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32657:x1877962009873024:12345-0@lo:502: 00000100:00100000:2.0:1790964154.155259:0:32622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb3fc52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32657:x1877962009873024:12345-0@lo:502: Request processed in 227us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964154.155266:0:32622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790964154.155464:0:32657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000501f40c3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32657:1877962009873024:0@lo:502: 00000020:01000004:3.0:1790964154.155520:0:32657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790964154.155535:0:32657:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000283bfe1d) 00000020:00000080:3.0:1790964154.155553:0:32657:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1790964154.155831:0:32657:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5d5af73 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790964154.155834:0:32657:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f5d5af73 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790964154.155837:0:32657:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f5d5af73 4 00010000:00080000:3.0:1790964154.155864:0:32657:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003caaf679@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1790964154.160934:0:32657:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1790964154.161195:0:32657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790964154.161231:0:32657:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790964154.161251:0:32657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7851639485e2d8c0 00000100:00080000:3.0:1790964154.161261:0:32657:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964154.161266:0:32657:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003caaf679 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1790964154.161312:0:32657:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc4852af x1877962009873152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790964154.161344:0:32657:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790964154.161470:0:31780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31780:1877962009873152:0@lo:38: 00000100:00100000:2.0:1790964154.161543:0:31780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964154.162197:0:32628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009873152 00000100:00100000:3.0:1790964154.162206:0:32628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009873152 00000100:00100000:3.0:1790964154.162238:0:32628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964154.162244:0:32628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fb5feb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31780:x1877962009873152:12345-0@lo:38: 00000100:00100000:3.0:1790964154.162319:0:32628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fb5feb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31780:x1877962009873152:12345-0@lo:38: Request processed in 73us (777us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790964154.162326:0:32628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790964154.162394:0:31780:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790964154.162401:0:31780:0:(import.c:65:import_set_state_nolock()) 000000003caaf679 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964154.162404:0:31780:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790964154.162407:0:31780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc4852af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31780:1877962009873152:0@lo:38: 00000100:00100000:1.0:1790964154.172326:0:32657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008649198d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32657:1877962009873280:0@lo:502: 00000100:00100000:1.0:1790964154.172416:0:32657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964154.172458:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009873280 00000100:00100000:1.0:1790964154.172465:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009873280 00000100:00100000:1.0:1790964154.172508:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790964154.172517:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021ba83cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32657:x1877962009873280:12345-0@lo:502: 00000100:00100000:1.0:1790964154.173274:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021ba83cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32657:x1877962009873280:12345-0@lo:502: Request processed in 756us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964154.173294:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790964154.173354:0:32657:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059bde8bc going to sleep for 11 seconds 00000100:00100000:1.0:1790964154.173374:0:32657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008649198d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32657:1877962009873280:0@lo:502: 00000040:00080000:1.0:1790964154.173402:0:32657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790964154.176004:0:32610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790964154.176040:0:32610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790964154.176063:0:32610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000cf5062f9/0x7851639485e2d8ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8b2 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.176076:0:32610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000cf5062f9/0x7851639485e2d8ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8b2 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790964154.176135:0:32610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790964154.176137:0:32610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964154.176139:0:32610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964154.176140:0:32610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964154.176141:0:32610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964154.176143:0:32610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964154.176144:0:32610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964154.176145:0:32610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964154.176147:0:32610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964154.176148:0:32610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790964154.176151:0:32610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790964154.176157:0:32610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790964154.176159:0:32610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964154.176160:0:32610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964154.176161:0:32610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964154.176161:0:32610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964154.176162:0:32610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964154.176163:0:32610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964154.176164:0:32610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964154.176165:0:32610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964154.176166:0:32610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790964154.176194:0:32610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790964154.176211:0:32610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ad76108 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009873408:0@lo:253: 00000100:00100000:3.0:1790964154.176301:0:32610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964154.176338:0:32610:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0c86746 going to sleep for 11 seconds 00000100:00100000:0.0:1790964154.176417:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009873408 00000100:00100000:0.0:1790964154.176425:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009873408 00000100:00100000:0.0:1790964154.176477:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790964154.176485:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000666128a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32610:x1877962009873408:12345-0@lo:253: 20000000:01000000:0.0:1790964154.176512:0:32620:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790964154.176525:0:32620:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790964154.211088:0:32620:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790964154.211108:0:32620:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790964154.211221:0:32644:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790964154.211227:0:32644:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790964154.211263:0:32644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.211296:0:32644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d88f expref: 12 pid: 32623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.211304:0:32644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.211341:0:32644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7851639485e2d88f expref: 12 pid: 32623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.211357:0:32644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7851639485e2d88f expref: 12 pid: 32623 timeout: 1166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964154.211373:0:32644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4339323 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32644:1877962009873536:0@lo:104: 00000100:00100000:2.0:1790964154.211439:0:32644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964154.211500:0:32644:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c97b6f73 going to sleep for 11 seconds 00000100:00100000:3.0:1790964154.211592:0:32611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009873536 00000100:00100000:3.0:1790964154.211600:0:32611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009873536 00000100:00100000:3.0:1790964154.211674:0:32611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964154.211683:0:32611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d35185c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+3:32644:x1877962009873536:12345-0@lo:104: 00010000:00010000:3.0:1790964154.211696:0:32611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.211747:0:32611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790964154.211752:0:32611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d35185c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+3:32644:x1877962009873536:12345-0@lo:104: Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964154.211759:0:32611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790964154.211779:0:32616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790964154.211784:0:32616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.211791:0:32616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdc79542 already unused, calling callback (000000002e7c7a28) 10000000:00010000:3.0:1790964154.211794:0:32616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.211814:0:32616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790964154.211820:0:32616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964154.211826:0:32616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790964154.211854:0:32616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.211860:0:32616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790964154.211876:0:32616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.211882:0:32616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 00000000bdc79542/0x7851639485e2d88f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7851639485e2d896 expref: -99 pid: 32610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.211899:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964154.211901:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964154.211902:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790964154.211951:0:31782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019d6995a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31782:1877962009873664:0@lo:103: 00000100:00100000:3.0:1790964154.211981:0:31782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964154.212046:0:32613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009873664 00000100:00100000:3.0:1790964154.212050:0:32613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009873664 00010000:00010000:3.0:1790964154.212065:0:32613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7851639485e2d88f expref: 13 pid: 32623 timeout: 1166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964154.212087:0:32613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964154.212093:0:32613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f996b7a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+13:31782:x1877962009873664:12345-0@lo:103: 00010000:00010000:3.0:1790964154.212111:0:32613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790964154.212115:0:32613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7851639485e2d88f expref: 13 pid: 32623 timeout: 1166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212125:0:32613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7851639485e2d88f expref: 13 pid: 32623 timeout: 1166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212139:0:32613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212146:0:32613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790964154.212159:0:32613:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000933318s 00010000:00010000:3.0:1790964154.212163:0:32613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212169:0:32613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212175:0:32613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212181:0:32613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212186:0:32613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9d25b34 already unused, calling callback (00000000f4a90e11) 00010000:00010000:3.0:1790964154.212189:0:32613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212195:0:32613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212210:0:32613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964154.212220:0:32613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790964154.212248:0:32613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f996b7a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+13:31782:x1877962009873664:12345-0@lo:103: Request processed in 156us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964154.212254:0:32613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964154.212301:0:31782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019d6995a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31782:1877962009873664:0@lo:103: 00010000:00010000:2.0:1790964154.212456:0:32644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e053c633/0x7851639485e2d896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7851639485e2d88f expref: 12 pid: 32623 timeout: 1166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964154.212467:0:32644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4339323 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32644:1877962009873536:0@lo:104: 00010000:00010000:2.0:1790964154.212479:0:32644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.212487:0:32644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.212492:0:32644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964154.212508:0:32644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d9d25b34/0x7851639485e2d8c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964154.221311:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000666128a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32610:x1877962009873408:12345-0@lo:253: Request processed in 44819us (45003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964154.221327:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790964154.221439:0:32610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ad76108 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32610:1877962009873408:0@lo:253: 10000000:01000000:3.0:1790964154.221455:0:32610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790964154.221458:0:32610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790964154.221460:0:32610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964154.221461:0:32610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964154.221462:0:32610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964154.221463:0:32610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964154.221464:0:32610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964154.221465:0:32610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964154.221467:0:32610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964154.221468:0:32610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964154.221470:0:32610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790964154.221485:0:32610:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790964154.226383:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964154.226531:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964154.226911:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964154.227043:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964154.227528:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964154.227863:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964154.228538:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964154.228848:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964154.229105:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964154.229257:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790964154.229529:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790964154.229858:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1790964154.256064:0:32610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000004:02000000:3.0:1790964154.256074:0:32610:0:(lod_dev.c:733:lod_sub_init_llog()) *** cfs_fail_loc=2405, val=0*** 00000020:00080000:1.0:1790964154.258712:0:32663:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790964154.258723:0:32663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790964154.260060:0:32664:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790964154.260317:0:32610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1790964154.260786:0:32664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964154.262874:0:32664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790964154.262954:0:32664:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1790964154.264185:0:32665:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@000000006ad76108 x1877962009873792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964154.264198:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00000040:01000000:3.0:1790964154.266113:0:32610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790964154.266242:0:32610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790964154.266894:0:32610:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790964154.266906:0:32610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790964154.267072:0:32610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964154.268384:0:32610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790964154.269069:0:32610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790964154.269114:0:32610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790964154.269398:0:32610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790964154.272222:0:32610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1790964154.279156:0:32610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1790964154.314115:0:32610:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790964154.314154:0:32610:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2ac0504f988 00100000:10000000:1.0:1790964154.314162:0:32610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790964154.315468:0:32610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790964154.315572:0:32610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790964154.315587:0:32610:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790964154.315669:0:32610:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790964154.815745:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790964155.329515:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00010000:00010000:3.0:1790964155.841977:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964156.354912:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00010000:00010000:0.0:1790964156.866141:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964157.375728:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00010000:00010000:2.0:1790964157.895025:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964158.399818:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00010000:00010000:1.0:1790964158.914635:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790964159.172307:0:26546:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790964159.172317:0:26546:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790964159.172320:0:26546:0:(import.c:65:import_set_state_nolock()) 000000003caaf679 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790964159.172333:0:26546:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003caaf679 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1790964159.172352:0:26546:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b1a0206c x1877962009874048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790964159.172401:0:31780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1a0206c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31780:1877962009874048:0@lo:38: 00000100:00100000:0.0:1790964159.172484:0:31780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964159.173839:0:31783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce85ef6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31783:1877962009873920:0@lo:400: 00000100:00100000:1.0:1790964159.173892:0:31783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964159.173980:0:32630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009874048 00000100:00100000:1.0:1790964159.173988:0:32630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009874048 00000100:00100000:1.0:1790964159.174017:0:32630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790964159.174022:0:32630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000870a7bdf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:31780:x1877962009874048:12345-0@lo:38: 00010000:00080000:1.0:1790964159.174048:0:32630:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 1021 last 0 00000020:00000080:1.0:1790964159.174081:0:32630:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7851639485e2d8ce 00000004:00100000:1.0:1790964159.174138:0:32630:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790964159.174275:0:32630:0:(import.c:65:import_set_state_nolock()) 00000000062ffe6f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790964159.174329:0:32630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000870a7bdf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:31780:x1877962009874048:12345-0@lo:38: Request processed in 305us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964159.174337:0:32630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790964159.175566:0:32622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009873920 00000100:00100000:0.0:1790964159.175579:0:32622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009873920 00000100:00100000:0.0:1790964159.175642:0:32622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790964159.175650:0:32622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000854351d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:31783:x1877962009873920:12345-0@lo:400: 00000100:00100000:0.0:1790964159.175723:0:32622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000854351d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:31783:x1877962009873920:12345-0@lo:400: Request processed in 74us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964159.175730:0:32622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790964159.175793:0:31783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce85ef6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31783:1877962009873920:0@lo:400: 00010000:00080000:0.0:1790964159.175829:0:31780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b1a0206c x1877962009874048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790964159.175843:0:31780:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790964159.175850:0:31780:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790964159.175854:0:31780:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790964159.175856:0:31780:0:(import.c:65:import_set_state_nolock()) 000000003caaf679 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790964159.175861:0:31780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1a0206c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31780:1877962009874048:0@lo:38: 00000100:00100000:1.0:1790964159.425211:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00000001:02000400:2.0:1790964159.437546:0:32908:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug -1 all 00000400:00000001:3.0:1790964159.477119:0:32910:0:(debug.c:305:cfs_str2mask()) Process entered 00010000:00000001:0.0:1790964159.935891:0:255:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964159.935900:0:255:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964159.935906:0:255:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964159.935907:0:255:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964159.936039:0:32616:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964159.936044:0:32616:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964159.936047:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:2.0:1790964160.061402:0:32923:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:2.0:1790964160.061418:0:32923:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964160.061423:0:32923:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964160.191675:0:31780:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964160.191689:0:31780:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964160.191691:0:31780:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964160.191695:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964160.191697:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964160.191700:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964160.191703:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964160.447868:0:32665:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964160.447875:0:32665:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964160.447877:0:32665:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964160.447896:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00000100:00000001:2.0:1790964160.447901:0:32665:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964160.447904:0:32665:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964160.447906:0:32665:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964160.447908:0:32665:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964160.447911:0:32665:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964160.707510:0:32615:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:3.0:1790964160.707517:0:32615:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964160.709350:0:32611:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000635bcbb8. 00000100:00000001:0.0:1790964160.709365:0:32611:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:0.0:1790964160.709367:0:32611:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964160.962047:0:255:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964160.962056:0:255:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964160.962082:0:255:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964160.962083:0:255:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964160.962549:0:32617:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964160.962554:0:32617:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964160.962558:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:1.0:1790964161.010357:0:32974:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964161.010373:0:32974:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964161.010379:0:32974:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.216258:0:31780:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964161.216274:0:31780:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964161.216276:0:31780:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964161.216281:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964161.216283:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964161.216285:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.216288:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.473851:0:32665:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964161.473859:0:32665:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964161.473860:0:32665:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964161.473864:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00000100:00000001:2.0:1790964161.473868:0:32665:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964161.473871:0:32665:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964161.473873:0:32665:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964161.473875:0:32665:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964161.473877:0:32665:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:0.0:1790964161.728247:0:32625:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:0.0:1790964161.728256:0:32625:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000f8c0a1c4) refs 2 10000000:00000001:0.0:1790964161.728261:0:32625:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:0.0:1790964161.728264:0:32625:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000001:0.0:1790964161.728265:0:32625:0:(mgc_request.c:120:config_log_put()) Process leaving 10000000:00000001:0.0:1790964161.728266:0:32625:0:(mgc_request.c:601:do_requeue()) Process entered 10000000:01000000:0.0:1790964161.728269:0:32625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:00000001:0.0:1790964161.728271:0:32625:0:(mgc_request.c:1783:mgc_process_log()) Process entered 10000000:01000000:0.0:1790964161.728273:0:32625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d2393ae800 from 9 10000000:00000001:0.0:1790964161.728275:0:32625:0:(mgc_request.c:990:mgc_enqueue()) Process entered 10000000:01000000:0.0:1790964161.728277:0:32625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00000010:0.0:1790964161.728289:0:32625:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000b1a0206c. 00000020:00000040:0.0:1790964161.728293:0:32625:0:(genops.c:1210:class_import_get()) import 000000003559c588 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000001:0.0:1790964161.728297:0:32625:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1790964161.728301:0:32625:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1790964161.728307:0:32625:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1790964161.728314:0:32625:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000b9a87b2f. 00000100:00000001:0.0:1790964161.728321:0:32625:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964161.728325:0:32625:0:(ldlm_request.c:1064:ldlm_cli_enqueue()) Process entered 00010000:00000001:0.0:1790964161.728327:0:32625:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:0.0:1790964161.728334:0:32625:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 000000006abfedf9. 00010000:00000001:0.0:1790964161.728339:0:32625:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:0.0:1790964161.728342:0:32625:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 00000000d4eaafbe. 00000020:00000010:0.0:1790964161.728348:0:32625:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 128 at 00000000b3fcae47. 00000020:00000001:0.0:1790964161.728351:0:32625:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:0.0:1790964161.728353:0:32625:0:(lustre_handles.c:93:class_handle_hash()) added object 00000000d4eaafbe with handle 0x7851639485e2d8d5 to hash 00000020:00000001:0.0:1790964161.728355:0:32625:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:0.0:1790964161.728356:0:32625:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000001:0.0:1790964161.728359:0:32625:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000001:0.0:1790964161.728362:0:32625:0:(ldlm_lock.c:261:ldlm_lock_remove_from_lru_check()) Process entered 00010000:00000001:0.0:1790964161.728365:0:32625:0:(ldlm_lock.c:280:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1790964161.728367:0:32625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000d4eaafbe/0x7851639485e2d8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964161.728392:0:32625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000d4eaafbe/0x7851639485e2d8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964161.728401:0:32625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000d4eaafbe/0x7851639485e2d8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000001:0.0:1790964161.728406:0:32625:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:0.0:1790964161.728408:0:32625:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:0.0:1790964161.728413:0:32625:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 00000000bafdb7f8. 00000100:00000001:0.0:1790964161.728415:0:32625:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446625128979200448 : -118944730351168 : ffff93d2059979c0) 00000100:00000001:0.0:1790964161.728417:0:32625:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964161.728419:0:32625:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625124733577728 : -118948975973888 : ffff93d1088a6a00) 00000100:00000001:0.0:1790964161.728422:0:32625:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1790964161.728424:0:32625:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964161.728426:0:32625:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:0.0:1790964161.728428:0:32625:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1790964161.728435:0:32625:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964161.728443:0:32625:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964161.728445:0:32625:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964161.728448:0:32625:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1790964161.728450:0:32625:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964161.728452:0:32625:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964161.728455:0:32625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1a0206c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32625:1877962009874176:0@lo:101: 00000100:00000001:0.0:1790964161.728459:0:32625:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1790964161.728464:0:32625:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1790964161.728466:0:32625:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964161.728468:0:32625:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1790964161.728471:0:32625:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000cca0985e. 02000000:00000001:0.0:1790964161.728473:0:32625:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1790964161.728479:0:32625:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000006eb3ee3d. 00000400:00000010:0.0:1790964161.728485:0:32625:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000004d099f33. 00000100:00000200:0.0:1790964161.728497:0:32625:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877962009874176, portal 25 00000100:00000001:0.0:1790964161.728499:0:32625:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964161.728501:0:32625:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625124733577728 : -118948975973888 : ffff93d1088a6a00) 00000100:00000040:0.0:1790964161.728505:0:32625:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964161.728512:0:32625:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964161.728514:0:32625:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964161.728516:0:32625:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000005c0bc177. 00000100:00000200:0.0:1790964161.728518:0:32625:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1877962009874176, offset 0 00000400:00000200:0.0:1790964161.728524:0:32625:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964161.728539:0:32625:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964161.728548:0:32625:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 328 into portal 26 MB=0x6abff1a800f00 00000400:00000200:0.0:1790964161.728554:0:32625:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 328/328 into md 0x165 [2] + 0 00000400:00000010:0.0:1790964161.728557:0:32625:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000039a8a980. 00000400:00000200:0.0:1790964161.728563:0:32625:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000008e3087ec 00000400:00000200:0.0:1790964161.728572:0:32625:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964161.728576:0:32625:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:0.0:1790964161.728581:0:32625:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008e3087ec 00000400:00000010:0.0:1790964161.728583:0:32625:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000008e3087ec. 00000100:00000001:0.0:1790964161.728591:0:32625:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:0.0:1790964161.728593:0:32625:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:0.0:1790964161.728596:0:32625:0:(events.c:341:request_in_callback()) incoming req@00000000876eecbb x1877962009874176 msgsize 328 00000100:00100000:0.0:1790964161.728599:0:32625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1790964161.728601:0:32625:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:0.0:1790964161.728647:0:32625:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1790964161.728654:0:32625:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000005c0bc177 00000400:00000010:0.0:1790964161.728655:0:32625:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000005c0bc177. 00000100:00000001:0.0:1790964161.728658:0:32625:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:0.0:1790964161.728661:0:32625:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964161.728670:0:32625:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964161.728672:0:32625:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964161.728678:0:32625:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964161.728685:0:32625:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1790964161.728691:0:32625:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964161.728695:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 0 is 4295691780 00000100:00000010:0.0:1790964161.728698:0:32625:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000004597eea4. 00000100:00000001:0.0:1790964161.728705:0:32625:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 0 00000100:00000001:0.0:1790964161.728711:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 1 is 4295691780 00000100:00000010:0.0:1790964161.728714:0:32625:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000094c9a085. 00000100:00000001:0.0:1790964161.728717:0:32625:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 1 00000100:00000001:0.0:1790964161.728724:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 2 is 4295691780 00000100:00000010:0.0:1790964161.728726:0:32625:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000f5167ce7. 00000100:00000001:0.0:1790964161.728729:0:32625:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1790964161.728733:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 3 is 4295691780 00000100:00000010:0.0:1790964161.728736:0:32625:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000496b08d3. 00000100:00000001:0.0:1790964161.728739:0:32625:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1790964161.728752:0:32625:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964161.728755:0:32625:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964161.728758:0:32625:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964161.728759:0:32625:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:0.0:1790964161.728762:0:32625:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bafdb7f8 going to sleep for 11 seconds 00000100:00000001:0.0:1790964161.728764:0:32625:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964161.728767:0:32625:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964161.728954:0:32620:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964161.728958:0:32620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009874176 02000000:00000001:1.0:1790964161.728961:0:32620:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964161.728963:0:32620:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964161.728965:0:32620:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964161.728969:0:32620:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964161.728972:0:32620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009874176 00000020:00000001:1.0:1790964161.728974:0:32620:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964161.728976:0:32620:0:(genops.c:804:class_conn2export()) looking for export cookie 0x7851639485e2d7ee 00000020:00000001:1.0:1790964161.728978:0:32620:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964161.728981:0:32620:0:(lustre_handles.c:148:class_handle2object()) GET export 000000006e0ef6a6 refcount=11 00000020:00000001:1.0:1790964161.728983:0:32620:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625128940896256 : -118944768655360 : ffff93d203510000) 00000020:00000001:1.0:1790964161.728985:0:32620:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446625128940896256 : -118944768655360 : ffff93d203510000) 00000100:00000001:1.0:1790964161.728989:0:32620:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964161.728993:0:32620:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000058a7d1a2. 00000100:00000001:1.0:1790964161.728996:0:32620:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964161.728999:0:32620:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000058a7d1a2. 00000020:00000010:1.0:1790964161.729004:0:32620:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c61e06e1. 00000020:00000010:1.0:1790964161.729009:0:32620:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000001c29524a. 00000020:00000010:1.0:1790964161.729014:0:32620:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000eaf5dd81. 00000100:00000040:1.0:1790964161.729024:0:32620:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964161.729027:0:32620:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964161.729034:0:32620:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964161.729036:0:32620:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964161.729045:0:32620:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964161.729062:0:32620:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964161.729073:0:32620:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964161.729075:0:32620:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964161.729079:0:32620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964161.729081:0:32620:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000006e0ef6a6 : new rpc_count 1 00000100:00000001:1.0:1790964161.729083:0:32620:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446625129920948304 : -118943788603312 : ffff93d23dbb6850) 00000100:00000040:1.0:1790964161.729088:0:32620:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000876eecbb x1877962009874176/t0(0) o101->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:737/0 lens 328/0 e 0 to 0 dl 1790964172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964161.729097:0:32620:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964161.729100:0:32620:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000058a7d1a2. 00000100:00000001:1.0:1790964161.729101:0:32620:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964161.729103:0:32620:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000058a7d1a2. 00000100:00100000:1.0:1790964161.729107:0:32620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000876eecbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+11:32625:x1877962009874176:12345-0@lo:101: 00000100:00000200:1.0:1790964161.729110:0:32620:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962009874176 00000020:00000001:1.0:1790964161.729113:0:32620:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964161.729117:0:32620:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964161.729119:0:32620:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964161.729121:0:32620:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964161.729123:0:32620:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072670541952 : -1039009664 : ffffffffc211f880) 00000020:00000001:1.0:1790964161.729126:0:32620:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964161.729127:0:32620:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964161.729142:0:32620:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964161.729145:0:32620:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964161.729148:0:32620:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964161.729150:0:32620:0:(tgt_handler.c:1471:tgt_enqueue()) Process entered 00010000:00000001:1.0:1790964161.729152:0:32620:0:(ldlm_lockd.c:1263:ldlm_handle_enqueue()) Process entered 00010000:00010000:1.0:1790964161.729154:0:32620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000001:1.0:1790964161.729156:0:32620:0:(ldlm_lockd.c:1725:ldlm_request_cancel()) Process entered 00010000:00000001:1.0:1790964161.729158:0:32620:0:(ldlm_lockd.c:1734:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964161.729163:0:32620:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:1.0:1790964161.729174:0:32620:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000d22dff85. 00010000:00000001:1.0:1790964161.729177:0:32620:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:1.0:1790964161.729179:0:32620:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 0000000037986407. 00000020:00000001:1.0:1790964161.729183:0:32620:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:1.0:1790964161.729184:0:32620:0:(lustre_handles.c:93:class_handle_hash()) added object 0000000037986407 with handle 0x7851639485e2d8dc to hash 00000020:00000001:1.0:1790964161.729186:0:32620:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:1.0:1790964161.729187:0:32620:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446625129944497152 : -118943765054464 : ffff93d23f22bc00) 00010000:00000001:1.0:1790964161.729190:0:32620:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446625129944497152 : -118943765054464 : ffff93d23f22bc00) 00010000:00010000:1.0:1790964161.729192:0:32620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037986407/0x7851639485e2d8dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7851639485e2d8d5 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1790964161.729199:0:32620:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export 000000006e0ef6a6 : new locks_count 6 00000020:00000040:1.0:1790964161.729201:0:32620:0:(genops.c:868:class_export_get()) GET export 000000006e0ef6a6 refcount=12 00000100:00000001:1.0:1790964161.729208:0:32620:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964161.729210:0:32620:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964161.729214:0:32620:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 640 at 000000005cff333a. 02000000:00000001:1.0:1790964161.729217:0:32620:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964161.729219:0:32620:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964161.729221:0:32620:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:1.0:1790964161.729224:0:32620:0:(ldlm_lock.c:1758:ldlm_lock_enqueue_helper()) Process entered 00010000:00000001:1.0:1790964161.729226:0:32620:0:(ldlm_plain.c:119:ldlm_process_plain_lock()) Process entered 00010000:00000001:1.0:1790964161.729228:0:32620:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964161.729230:0:32620:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964161.729232:0:32620:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:1.0:1790964161.729233:0:32620:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964161.729235:0:32620:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:1.0:1790964161.729237:0:32620:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:1.0:1790964161.729239:0:32620:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:1.0:1790964161.729240:0:32620:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:1.0:1790964161.729242:0:32620:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000d22dff85) refcount = 1 00010000:00010000:1.0:1790964161.729247:0:32620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037986407/0x7851639485e2d8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7851639485e2d8d5 expref: 12 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964161.729253:0:32620:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:1.0:1790964161.729255:0:32620:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:1.0:1790964161.729263:0:32620:0:(ldlm_plain.c:146:ldlm_process_plain_lock()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964161.729266:0:32620:0:(ldlm_lock.c:1769:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964161.729268:0:32620:0:(ldlm_lock.c:1928:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:1.0:1790964161.729273:0:32620:0:(ldlm_lockd.c:1494:ldlm_handle_enqueue()) Process leaving 00010000:00010000:1.0:1790964161.729276:0:32620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037986407/0x7851639485e2d8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7851639485e2d8d5 expref: 12 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964161.729283:0:32620:0:(ldlm_lock.c:2393:__ldlm_reprocess_all()) Process entered 00010000:00000001:1.0:1790964161.729285:0:32620:0:(ldlm_lock.c:1970:ldlm_reprocess_queue()) Process entered 00010000:00000001:1.0:1790964161.729287:0:32620:0:(ldlm_lock.c:2019:ldlm_reprocess_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1790964161.729289:0:32620:0:(ldlm_lock.c:2323:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964161.729292:0:32620:0:(ldlm_lock.c:2427:__ldlm_reprocess_all()) Process leaving 00010000:00000001:1.0:1790964161.729293:0:32620:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964161.729295:0:32620:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:1.0:1790964161.729296:0:32620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037986407, rc 0) 00000020:00000001:1.0:1790964161.729298:0:32620:0:(tgt_handler.c:1496:tgt_enqueue()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964161.729301:0:32620:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962009874176 00010000:00000001:1.0:1790964161.729304:0:32620:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964161.729308:0:32620:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000876eecbb x1877962009874176/t0(0) o101->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:737/0 lens 328/344 e 0 to 0 dl 1790964172 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964161.729315:0:32620:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964161.729317:0:32620:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964161.729321:0:32620:0:(import.c:2195:obd_at_measure()) add 1 to 000000006e7c27fb time=8 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964161.729325:0:32620:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964161.729327:0:32620:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 17 to 0@lo 00000100:00000001:1.0:1790964161.729329:0:32620:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 02000000:00000001:1.0:1790964161.729332:0:32620:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964161.729333:0:32620:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964161.729336:0:32620:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964161.729338:0:32620:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964161.729342:0:32620:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000c71038de. 00000100:00000200:1.0:1790964161.729345:0:32620:0:(niobuf.c:94:ptl_send_buf()) Sending 344 bytes to portal 25, xid 1877962009874176, offset 224 00000400:00000200:1.0:1790964161.729349:0:32620:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964161.729355:0:32620:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964161.729361:0:32620:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 344 into portal 25 MB=0x6abff1a800f00 00000400:00000200:1.0:1790964161.729371:0:32620:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 344/344 into md 0xac5 [1] + 224 00000400:00000200:1.0:1790964161.729377:0:32620:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964161.729380:0:32620:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964161.729384:0:32620:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964161.729388:0:32620:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964161.729396:0:32620:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964161.729410:0:32620:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964161.729416:0:32620:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c71038de 00000400:00000010:1.0:1790964161.729418:0:32620:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000c71038de. 00000100:00000001:1.0:1790964161.729420:0:32620:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964161.729421:0:32620:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964161.729426:0:32620:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964161.729428:0:32620:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 16 to 0@lo 00010000:00000001:1.0:1790964161.729430:0:32620:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964161.729432:0:32620:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964161.729434:0:32620:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964161.729437:0:32620:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000876eecbb x1877962009874176/t0(0) o101->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:737/0 lens 328/344 e 0 to 0 dl 1790964172 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964161.729445:0:32620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000876eecbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32625:x1877962009874176:12345-0@lo:101: Request processed in 347us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964161.729452:0:32620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00000040:1.0:1790964161.729454:0:32620:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006e0ef6a6 : new rpc_count 0 00000100:00000001:1.0:1790964161.729456:0:32620:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964161.729458:0:32620:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964161.729462:0:32620:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000001c29524a. 00000020:00000010:1.0:1790964161.729466:0:32620:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000eaf5dd81. 00000020:00000010:1.0:1790964161.729469:0:32620:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c61e06e1. 00000020:00000040:1.0:1790964161.729474:0:32620:0:(genops.c:879:class_export_put()) PUTting export 000000006e0ef6a6 : new refcount 11 02000000:00000001:1.0:1790964161.729477:0:32620:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964161.729480:0:32620:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 640 at 000000005cff333a. 02000000:00000001:1.0:1790964161.729489:0:32620:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964161.729491:0:32620:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964161.729495:0:32620:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964161.729499:0:32620:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000028a66f76. 00000400:00000010:1.0:1790964161.729503:0:32620:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 0000000016f6295d. 00000100:00000001:2.0:1790964161.729639:0:32625:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1790964161.729645:0:32625:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964161.729647:0:32625:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964161.729649:0:32625:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000006eb3ee3d. 00000400:00000200:2.0:1790964161.729653:0:32625:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000004d099f33 00000400:00000010:2.0:1790964161.729655:0:32625:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000004d099f33. 00000100:00000001:2.0:1790964161.729657:0:32625:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964161.729660:0:32625:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964161.729668:0:32625:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.729674:0:32625:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964161.729676:0:32625:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964161.729678:0:32625:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964161.729680:0:32625:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964161.729681:0:32625:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964161.729683:0:32625:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964161.729685:0:32625:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964161.729690:0:32625:0:(import.c:2195:obd_at_measure()) add 5 to 000000002a1ba3d6 time=8 v=5 (5 0 0 0) 00000100:00001000:2.0:1790964161.729693:0:32625:0:(import.c:2195:obd_at_measure()) add 1 to 00000000b4d2d0c9 time=8 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964161.729695:0:32625:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964161.729697:0:32625:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964161.729704:0:32625:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1790964161.729706:0:32625:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.729709:0:32625:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964161.729713:0:32625:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.729719:0:32625:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964161.729722:0:32625:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964161.729724:0:32625:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1790964161.729726:0:32625:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964161.729733:0:32625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1a0206c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32625:1877962009874176:0@lo:101: 00000100:00000001:2.0:1790964161.729737:0:32625:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964161.729739:0:32625:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.729741:0:32625:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:2.0:1790964161.729743:0:32625:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964161.729745:0:32625:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.729751:0:32625:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964161.729753:0:32625:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 00000000bafdb7f8. 00000100:00000001:2.0:1790964161.729756:0:32625:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:2.0:1790964161.729758:0:32625:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964161.729759:0:32625:0:(ldlm_request.c:661:ldlm_cli_enqueue_fini()) Process entered 00010000:00000001:2.0:1790964161.729762:0:32625:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:2.0:1790964161.729764:0:32625:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964161.729766:0:32625:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000d4eaafbe refcount=4 00000020:00000001:2.0:1790964161.729767:0:32625:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000001:2.0:1790964161.729771:0:32625:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000040:2.0:1790964161.729775:0:32625:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: 00000000d4eaafbe, remote cookie: 0x7851639485e2d8dc, flags: 0x0 00010000:00000001:2.0:1790964161.729778:0:32625:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:2.0:1790964161.729780:0:32625:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:2.0:1790964161.729781:0:32625:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:2.0:1790964161.729782:0:32625:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:2.0:1790964161.729784:0:32625:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:2.0:1790964161.729791:0:32625:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (000000006abfedf9) refcount = 1 00010000:00010000:2.0:1790964161.729794:0:32625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000d4eaafbe/0x7851639485e2d8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8dc expref: -99 pid: 32625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:2.0:1790964161.729799:0:32625:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:2.0:1790964161.729801:0:32625:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:2.0:1790964161.729802:0:32625:0:(ldlm_lock.c:1914:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:2.0:1790964161.729804:0:32625:0:(ldlm_request.c:286:ldlm_completion_ast()) Process entered 00010000:00000001:2.0:1790964161.729806:0:32625:0:(ldlm_request.c:295:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1790964161.729809:0:32625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000d4eaafbe/0x7851639485e2d8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7851639485e2d8dc expref: -99 pid: 32625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:2.0:1790964161.729814:0:32625:0:(ldlm_request.c:842:ldlm_cli_enqueue_fini()) Process leaving 00010000:00000001:2.0:1790964161.729815:0:32625:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:2.0:1790964161.729816:0:32625:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:2.0:1790964161.729817:0:32625:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:2.0:1790964161.729818:0:32625:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:2.0:1790964161.729819:0:32625:0:(ldlm_request.c:1218:ldlm_cli_enqueue()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.729821:0:32625:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964161.729823:0:32625:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000b1a0206c x1877962009874176/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964177 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.729829:0:32625:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964161.729831:0:32625:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964161.729834:0:32625:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000cca0985e. 02000000:00000001:2.0:1790964161.729837:0:32625:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964161.729838:0:32625:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964161.729839:0:32625:0:(genops.c:1223:class_import_put()) import 000000003559c588 refcount=3 obd=MGC192.168.204.135@tcp 00000020:00000001:2.0:1790964161.729841:0:32625:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964161.729843:0:32625:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000b9a87b2f. 02000000:00000001:2.0:1790964161.729846:0:32625:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964161.729848:0:32625:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964161.729849:0:32625:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000b1a0206c. 00000100:00000001:2.0:1790964161.729852:0:32625:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964161.729853:0:32625:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000001:2.0:1790964161.729855:0:32625:0:(mgc_request.c:1023:mgc_enqueue()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:2.0:1790964161.729857:0:32625:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:2.0:1790964161.729863:0:32625:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000f8c0a1c4) refs 3 10000000:00000001:2.0:1790964161.729865:0:32625:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964161.729867:0:32625:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:2.0:1790964161.729869:0:32625:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964161.729870:0:32625:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000d4eaafbe refcount=3 00000020:00000001:2.0:1790964161.729872:0:32625:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000001:2.0:1790964161.729874:0:32625:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000001:2.0:1790964161.729876:0:32625:0:(ldlm_lock.c:2547:ldlm_lock_set_data()) Process entered 00010000:00000001:2.0:1790964161.729878:0:32625:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:2.0:1790964161.729878:0:32625:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:2.0:1790964161.729880:0:32625:0:(ldlm_lock.c:2556:ldlm_lock_set_data()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:2.0:1790964161.729883:0:32625:0:(mgc_request.c:1520:mgc_process_recover_log()) Process entered 10000000:00000010:2.0:1790964161.729885:0:32625:0:(mgc_request.c:1532:mgc_process_recover_log()) kmalloced '(folios)': 32 at 00000000ddf743d4. 00000100:00000010:2.0:1790964161.729900:0:32625:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000b4339323. 00000020:00000040:2.0:1790964161.729903:0:32625:0:(genops.c:1210:class_import_get()) import 000000003559c588 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000001:2.0:1790964161.729906:0:32625:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964161.729908:0:32625:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964161.729910:0:32625:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964161.729914:0:32625:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000db02b419. 00000100:00000001:2.0:1790964161.729918:0:32625:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.729922:0:32625:0:(client.c:227:ptlrpc_prep_bulk_imp()) Process entered 00000100:00000010:2.0:1790964161.729925:0:32625:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 00000000fa38c6d7. 00000100:00000010:2.0:1790964161.729928:0:32625:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 64 at 00000000d56489b7. 00000020:00000040:2.0:1790964161.729930:0:32625:0:(genops.c:1210:class_import_get()) import 000000003559c588 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000001:2.0:1790964161.729934:0:32625:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:2.0:1790964161.729935:0:32625:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:2.0:1790964161.729938:0:32625:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 000000006e542257. 00000100:00000001:2.0:1790964161.729940:0:32625:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446625129025171840 : -118944684379776 : ffff93d20856f180) 00000100:00000001:2.0:1790964161.729942:0:32625:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964161.729943:0:32625:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625124732104064 : -118948977447552 : ffff93d10873ed80) 00000100:00000001:2.0:1790964161.729947:0:32625:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964161.729949:0:32625:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.729950:0:32625:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:2.0:1790964161.729951:0:32625:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964161.729954:0:32625:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.729966:0:32625:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964161.729967:0:32625:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964161.729970:0:32625:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1790964161.729972:0:32625:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964161.729974:0:32625:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964161.729976:0:32625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4339323 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32625:1877962009874304:0@lo:256: 00000100:00000001:2.0:1790964161.729979:0:32625:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964161.729982:0:32625:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964161.729984:0:32625:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.729987:0:32625:0:(niobuf.c:346:ptlrpc_register_bulk()) Process entered 00000400:00000010:2.0:1790964161.729992:0:32625:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000037f121c7. 00000400:00000010:2.0:1790964161.729996:0:32625:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at 000000000791d2f0. 00000100:00000200:2.0:1790964161.729999:0:32625:0:(niobuf.c:453:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 4 pages 16384 bytes, mbits x0x6abff1a800f80-0x6abff1a800f80, portal 33 00000100:00000001:2.0:1790964161.730002:0:32625:0:(niobuf.c:455:ptlrpc_register_bulk()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964161.730004:0:32625:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1790964161.730006:0:32625:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000f0f8ac2b. 02000000:00000001:2.0:1790964161.730008:0:32625:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1790964161.730010:0:32625:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000ee03f7c6. 00000400:00000010:2.0:1790964161.730013:0:32625:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002a30c83d. 00000100:00000200:2.0:1790964161.730014:0:32625:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877962009874304, portal 25 00000100:00000001:2.0:1790964161.730016:0:32625:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964161.730017:0:32625:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625124732104064 : -118948977447552 : ffff93d10873ed80) 00000100:00000040:2.0:1790964161.730020:0:32625:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.730026:0:32625:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964161.730028:0:32625:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964161.730030:0:32625:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000083b52280. 00000100:00000200:2.0:1790964161.730031:0:32625:0:(niobuf.c:94:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1877962009874304, offset 0 00000400:00000200:2.0:1790964161.730035:0:32625:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964161.730042:0:32625:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964161.730048:0:32625:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 304 into portal 26 MB=0x6abff1a800f80 00000400:00000200:2.0:1790964161.730051:0:32625:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 304/304 into md 0x169 [2] + 0 00000400:00000010:2.0:1790964161.730058:0:32625:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000b2f58b27. 00000400:00000200:2.0:1790964161.730061:0:32625:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000f7245953 00000400:00000200:2.0:1790964161.730066:0:32625:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964161.730069:0:32625:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:2.0:1790964161.730072:0:32625:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000f7245953 00000400:00000010:2.0:1790964161.730074:0:32625:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000f7245953. 00000100:00000001:2.0:1790964161.730077:0:32625:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1790964161.730078:0:32625:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:2.0:1790964161.730081:0:32625:0:(events.c:341:request_in_callback()) incoming req@00000000d001fc35 x1877962009874304 msgsize 304 00000100:00100000:2.0:1790964161.730084:0:32625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1790964161.730086:0:32625:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:2.0:1790964161.730169:0:32625:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:2.0:1790964161.730175:0:32625:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000083b52280 00000400:00000010:2.0:1790964161.730177:0:32625:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000083b52280. 00000100:00000001:2.0:1790964161.730180:0:32625:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964161.730183:0:32625:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.730191:0:32625:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964161.730193:0:32625:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.730199:0:32625:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.730200:0:32625:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964161.730204:0:32625:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.730207:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 0 is 4295691781 00000100:00000001:2.0:1790964161.730212:0:32625:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4295691780 00000100:00000001:2.0:1790964161.730216:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 1 is 4295691781 00000100:00000001:2.0:1790964161.730219:0:32625:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295691780 00000100:00000001:2.0:1790964161.730221:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 2 is 4295691781 00000100:00000001:2.0:1790964161.730224:0:32625:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4295691780 00000100:00000001:2.0:1790964161.730226:0:32625:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 3 is 4295691781 00000100:00000001:2.0:1790964161.730229:0:32625:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4295691780 00000100:00000001:2.0:1790964161.730231:0:32625:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964161.730240:0:32625:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.730242:0:32625:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964161.730243:0:32625:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:2.0:1790964161.730245:0:32625:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e542257 going to sleep for 11 seconds 00000100:00000001:2.0:1790964161.730248:0:32625:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964161.730250:0:32625:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.730336:0:32623:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964161.730340:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009874304 02000000:00000001:3.0:1790964161.730342:0:32623:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964161.730344:0:32623:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964161.730345:0:32623:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964161.730348:0:32623:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964161.730351:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009874304 00000020:00000001:3.0:1790964161.730353:0:32623:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964161.730354:0:32623:0:(genops.c:804:class_conn2export()) looking for export cookie 0x7851639485e2d7ee 00000020:00000001:3.0:1790964161.730356:0:32623:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964161.730358:0:32623:0:(lustre_handles.c:148:class_handle2object()) GET export 000000006e0ef6a6 refcount=12 00000020:00000001:3.0:1790964161.730367:0:32623:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625128940896256 : -118944768655360 : ffff93d203510000) 00000020:00000001:3.0:1790964161.730369:0:32623:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446625128940896256 : -118944768655360 : ffff93d203510000) 00000100:00000001:3.0:1790964161.730372:0:32623:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964161.730375:0:32623:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000003720c47b. 00000100:00000001:3.0:1790964161.730377:0:32623:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964161.730378:0:32623:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000003720c47b. 00000020:00000010:3.0:1790964161.730383:0:32623:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000038819c7b. 00000020:00000010:3.0:1790964161.730388:0:32623:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 0000000069e1a5df. 00000020:00000010:3.0:1790964161.730391:0:32623:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000dd13e27e. 00000100:00000040:3.0:1790964161.730397:0:32623:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:3.0:1790964161.730399:0:32623:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964161.730400:0:32623:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1790964161.730402:0:32623:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.730407:0:32623:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.730423:0:32623:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964161.730431:0:32623:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964161.730432:0:32623:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964161.730436:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00000040:3.0:1790964161.730438:0:32623:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000006e0ef6a6 : new rpc_count 1 00000100:00000001:3.0:1790964161.730440:0:32623:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446625129920946256 : -118943788605360 : ffff93d23dbb6050) 00000100:00000040:3.0:1790964161.730443:0:32623:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000d001fc35 x1877962009874304/t0(0) o256->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:737/0 lens 304/0 e 0 to 0 dl 1790964172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964161.730451:0:32623:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964161.730453:0:32623:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000003720c47b. 00000100:00000001:3.0:1790964161.730455:0:32623:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964161.730456:0:32623:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000003720c47b. 00000100:00100000:3.0:1790964161.730460:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d001fc35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32625:x1877962009874304:12345-0@lo:256: 00000100:00000200:3.0:1790964161.730463:0:32623:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962009874304 00000020:00000001:3.0:1790964161.730465:0:32623:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1790964161.730467:0:32623:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1790964161.730469:0:32623:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964161.730470:0:32623:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1790964161.730478:0:32623:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072670542368 : -1039009248 : ffffffffc211fa20) 00000020:00000001:3.0:1790964161.730481:0:32623:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1790964161.730482:0:32623:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964161.730484:0:32623:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1790964161.730485:0:32623:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1790964161.730487:0:32623:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.730490:0:32623:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964161.730492:0:32623:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1790964161.730495:0:32623:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 536 at 00000000104b1832. 02000000:00000001:3.0:1790964161.730497:0:32623:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.730498:0:32623:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 20000000:00000001:3.0:1790964161.730501:0:32623:0:(mgs_handler.c:690:mgs_config_read()) Process entered 20000000:00000001:3.0:1790964161.730504:0:32623:0:(mgs_nids.c:889:mgs_get_ir_logs()) Process entered 20000000:01000000:3.0:1790964161.730509:0:32623:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000010:3.0:1790964161.730511:0:32623:0:(mgs_nids.c:917:mgs_get_ir_logs()) kmalloced '(folios)': 32 at 000000004fad9095. 20000000:00000001:3.0:1790964161.730514:0:32623:0:(mgs_nids.c:188:mgs_nidtbl_read()) Process entered 20000000:00000040:3.0:1790964161.730522:0:32623:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1790964161.730529:0:32623:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790964161.732882:0:32623:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 20000000:00000001:3.0:1790964161.732895:0:32623:0:(mgs_nids.c:321:mgs_nidtbl_read()) Process leaving (rc=44 : 44 : 2c) 00000100:00000001:3.0:1790964161.732899:0:32623:0:(niobuf.c:145:ptlrpc_prep_bulk_exp()) Process entered 00000100:00000010:3.0:1790964161.732909:0:32623:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 00000000e3aeaa36. 00000100:00000010:3.0:1790964161.732915:0:32623:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 16 at 000000009f06495c. 00000020:00000040:3.0:1790964161.732919:0:32623:0:(genops.c:868:class_export_get()) GET export 000000006e0ef6a6 refcount=13 00010000:00000001:3.0:1790964161.732924:0:32623:0:(ldlm_lib.c:3582:target_bulk_io()) Process entered 00000100:00000001:3.0:1790964161.732929:0:32623:0:(niobuf.c:184:ptlrpc_start_bulk_transfer()) Process entered 00000400:00000010:3.0:1790964161.732934:0:32623:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000000ff09279. 00000400:00000010:3.0:1790964161.732945:0:32623:0:(lib-lnet.h:449:lnet_rspt_alloc()) alloc 'rspt': 64 at 00000000f03eff7b. 00000400:00000200:3.0:1790964161.732952:0:32623:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964161.732966:0:32623:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964161.732976:0:32623:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 44 into portal 33 MB=0x6abff1a800f80 00000400:00000200:3.0:1790964161.732983:0:32623:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 21 from 12345-0@lo of length 44/44 into md 0xad5 [4] + 0 00000400:00000010:3.0:1790964161.732987:0:32623:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000037f121c7. 00000400:00000200:3.0:1790964161.732994:0:32623:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000000791d2f0 00000400:00000200:3.0:1790964161.733001:0:32623:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964161.733005:0:32623:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964161.733027:0:32623:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000791d2f0 00000400:00000010:3.0:1790964161.733029:0:32623:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 184 at 000000000791d2f0. 00000100:00000001:3.0:1790964161.733034:0:32623:0:(events.c:177:client_bulk_callback()) Process entered 00000100:00000200:3.0:1790964161.733035:0:32623:0:(events.c:195:client_bulk_callback()) event type 2, status 0, req 00000000b4339323 desc 00000000fa38c6d7 mbits 1877962009874304 00000100:00000001:3.0:1790964161.733045:0:32623:0:(events.c:220:client_bulk_callback()) Process leaving 00000400:00000200:3.0:1790964161.733049:0:32623:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md 0000000000000000 with offset 0 00000400:00000200:3.0:1790964161.733053:0:32623:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : ACK - for me 00000400:00000200:3.0:1790964161.733059:0:32623:0:(lib-move.c:4532:lnet_parse_ack()) 0@lo: ACK from 12345-0@lo into md 0xae1 00000400:00000200:3.0:1790964161.733062:0:32623:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964161.733065:0:32623:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: ACK: OK 00000100:00000001:3.0:1790964161.733067:0:32623:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:3.0:1790964161.733069:0:32623:0:(events.c:464:server_bulk_callback()) event type 4, status 0, desc 00000000e3aeaa36 00000100:00000001:3.0:1790964161.733071:0:32623:0:(events.c:491:server_bulk_callback()) Process leaving 00000400:00000200:3.0:1790964161.733076:0:32623:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000ff09279 00000400:00000010:3.0:1790964161.733078:0:32623:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000000ff09279. 00000100:00000001:3.0:1790964161.733080:0:32623:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:3.0:1790964161.733081:0:32623:0:(events.c:464:server_bulk_callback()) event type 5, status 0, desc 00000000e3aeaa36 00000100:00000001:3.0:1790964161.733083:0:32623:0:(events.c:491:server_bulk_callback()) Process leaving 00000100:00000200:3.0:1790964161.733087:0:32623:0:(niobuf.c:279:ptlrpc_start_bulk_transfer()) Transferring 1 pages 44 bytes via portal 33 id 12345-0@lo mbits 0x6abff1a800f80-0x6abff1a800f80 00000100:00000001:3.0:1790964161.733090:0:32623:0:(niobuf.c:281:ptlrpc_start_bulk_transfer()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964161.733093:0:32623:0:(ldlm_lib.c:3674:target_bulk_io()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.733095:0:32623:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000040:3.0:1790964161.733098:0:32623:0:(genops.c:879:class_export_put()) PUTting export 000000006e0ef6a6 : new refcount 12 00000100:00000010:3.0:1790964161.733101:0:32623:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 16 at 000000009f06495c. 00000100:00000010:3.0:1790964161.733104:0:32623:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 00000000e3aeaa36. 00000100:00000001:3.0:1790964161.733107:0:32623:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 20000000:00000001:3.0:1790964161.733108:0:32623:0:(mgs_nids.c:953:mgs_get_ir_logs()) Process leaving via out (rc=0 : 0 : 0x0) 20000000:00000010:3.0:1790964161.733116:0:32623:0:(mgs_nids.c:964:mgs_get_ir_logs()) kvfree 'folios': 32 at 000000004fad9095. 20000000:00000001:3.0:1790964161.733119:0:32623:0:(mgs_handler.c:713:mgs_config_read()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1790964161.733123:0:32623:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962009874304 00010000:00000001:3.0:1790964161.733125:0:32623:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:3.0:1790964161.733145:0:32623:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000d001fc35 x1877962009874304/t0(0) o256->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:737/0 lens 304/240 e 0 to 0 dl 1790964172 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964161.733154:0:32623:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964161.733156:0:32623:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964161.733165:0:32623:0:(import.c:2195:obd_at_measure()) add 1 to 000000006e7c27fb time=8 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964161.733169:0:32623:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964161.733172:0:32623:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 17 to 0@lo 00000100:00000001:3.0:1790964161.733173:0:32623:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 02000000:00000001:3.0:1790964161.733176:0:32623:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964161.733179:0:32623:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964161.733183:0:32623:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964161.733185:0:32623:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964161.733187:0:32623:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000000ff09279. 00000100:00000200:3.0:1790964161.733190:0:32623:0:(niobuf.c:94:ptl_send_buf()) Sending 240 bytes to portal 25, xid 1877962009874304, offset 224 00000400:00000200:3.0:1790964161.733193:0:32623:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964161.733198:0:32623:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964161.733202:0:32623:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 240 into portal 25 MB=0x6abff1a800f80 00000400:00000200:3.0:1790964161.733208:0:32623:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 240/240 into md 0xad9 [1] + 224 00000400:00000200:3.0:1790964161.733213:0:32623:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964161.733215:0:32623:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964161.733219:0:32623:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964161.733222:0:32623:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964161.733230:0:32623:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964161.733236:0:32623:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964161.733240:0:32623:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000ff09279 00000400:00000010:3.0:1790964161.733242:0:32623:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000000ff09279. 00000100:00000001:3.0:1790964161.733244:0:32623:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964161.733245:0:32623:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1790964161.733248:0:32623:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964161.733250:0:32623:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 16 to 0@lo 00010000:00000001:3.0:1790964161.733252:0:32623:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:3.0:1790964161.733254:0:32623:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964161.733256:0:32623:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1790964161.733260:0:32623:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000d001fc35 x1877962009874304/t0(0) o256->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:737/0 lens 304/240 e 0 to 0 dl 1790964172 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964161.733268:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d001fc35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:32625:x1877962009874304:12345-0@lo:256: Request processed in 2816us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964161.733284:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00000040:3.0:1790964161.733287:0:32623:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006e0ef6a6 : new rpc_count 0 00000100:00000001:3.0:1790964161.733289:0:32623:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964161.733290:0:32623:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1790964161.733297:0:32623:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 0000000069e1a5df. 00000020:00000010:3.0:1790964161.733301:0:32623:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000dd13e27e. 00000020:00000010:3.0:1790964161.733304:0:32623:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000038819c7b. 00000020:00000040:3.0:1790964161.733309:0:32623:0:(genops.c:879:class_export_put()) PUTting export 000000006e0ef6a6 : new refcount 11 02000000:00000001:3.0:1790964161.733312:0:32623:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:3.0:1790964161.733314:0:32623:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 536 at 00000000104b1832. 02000000:00000001:3.0:1790964161.733317:0:32623:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:3.0:1790964161.733319:0:32623:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:3.0:1790964161.733324:0:32623:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:3.0:1790964161.733329:0:32623:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000001fd7aa24. 00000400:00000010:3.0:1790964161.733333:0:32623:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000c28ae345. 00000100:00000001:2.0:1790964161.733491:0:32625:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1790964161.733498:0:32625:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964161.733500:0:32625:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964161.733502:0:32625:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000ee03f7c6. 00000400:00000200:2.0:1790964161.733505:0:32625:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002a30c83d 00000400:00000010:2.0:1790964161.733507:0:32625:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002a30c83d. 00000100:00000001:2.0:1790964161.733509:0:32625:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964161.733513:0:32625:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964161.733520:0:32625:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.733526:0:32625:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964161.733528:0:32625:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964161.733543:0:32625:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964161.733546:0:32625:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964161.733547:0:32625:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964161.733549:0:32625:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964161.733552:0:32625:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964161.733556:0:32625:0:(import.c:2195:obd_at_measure()) add 5 to 000000002a1ba3d6 time=8 v=5 (5 0 0 0) 00000100:00001000:2.0:1790964161.733559:0:32625:0:(import.c:2195:obd_at_measure()) add 1 to 00000000b4d2d0c9 time=8 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964161.733562:0:32625:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964161.733563:0:32625:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964161.733565:0:32625:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1790964161.733568:0:32625:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.733570:0:32625:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964161.733573:0:32625:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1790964161.733580:0:32625:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.733598:0:32625:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964161.733600:0:32625:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1790964161.733603:0:32625:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964161.733609:0:32625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4339323 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b465b99b-a0b4-4368-8d34-49a45cd42e5a:32625:1877962009874304:0@lo:256: 00000100:00000001:2.0:1790964161.733650:0:32625:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964161.733653:0:32625:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.733655:0:32625:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:2.0:1790964161.733657:0:32625:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964161.733660:0:32625:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.733667:0:32625:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964161.733669:0:32625:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 000000006e542257. 00000100:00000001:2.0:1790964161.733672:0:32625:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:2.0:1790964161.733673:0:32625:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 10000000:00000040:2.0:1790964161.733678:0:32625:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 9, more 0. 10000000:00000001:2.0:1790964161.733682:0:32625:0:(mgc_request.c:1308:mgc_apply_recover_logs()) Process entered 10000000:00000010:2.0:1790964161.733688:0:32625:0:(mgc_request.c:1331:mgc_apply_recover_logs()) kmalloced '(nidlist)': 640 at 00000000de24ffeb. 10000000:00000010:2.0:1790964161.733691:0:32625:0:(mgc_request.c:1343:mgc_apply_recover_logs()) kmalloced '(obdname)': 128 at 00000000b9b5a829. 10000000:00000200:2.0:1790964161.733695:0:32625:0:(mgc_request.c:1241:mgc_build_nidlist()) use 1 from 1 NIDs 10000000:00000040:2.0:1790964161.733698:0:32625:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-MDT0000-mdc-MDT0000 10000000:00000040:2.0:1790964161.733705:0:32625:0:(mgc_request.c:1445:mgc_apply_recover_logs()) MGC192.168.204.135@tcp: cannot find OBD lustre-MDT0000-mdc-MDT0000 10000000:00000010:2.0:1790964161.733707:0:32625:0:(mgc_request.c:1492:mgc_apply_recover_logs()) kfreed 'obdname': 128 at 00000000b9b5a829. 10000000:00000010:2.0:1790964161.733709:0:32625:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'nidlist': 640 at 00000000de24ffeb. 10000000:00000001:2.0:1790964161.733712:0:32625:0:(mgc_request.c:1496:mgc_apply_recover_logs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964161.733714:0:32625:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964161.733716:0:32625:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000b4339323 x1877962009874304/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964177 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964161.733722:0:32625:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964161.733724:0:32625:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964161.733726:0:32625:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000f0f8ac2b. 02000000:00000001:2.0:1790964161.733734:0:32625:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964161.733736:0:32625:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964161.733738:0:32625:0:(genops.c:1223:class_import_put()) import 000000003559c588 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000001:2.0:1790964161.733740:0:32625:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000001:2.0:1790964161.733741:0:32625:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000001:2.0:1790964161.733743:0:32625:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964161.733744:0:32625:0:(genops.c:1223:class_import_put()) import 000000003559c588 refcount=3 obd=MGC192.168.204.135@tcp 00000020:00000001:2.0:1790964161.733745:0:32625:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000010:2.0:1790964161.733747:0:32625:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 64 at 00000000d56489b7. 00000100:00000010:2.0:1790964161.733750:0:32625:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 00000000fa38c6d7. 00000100:00000001:2.0:1790964161.733752:0:32625:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 02000000:00000010:2.0:1790964161.733754:0:32625:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000db02b419. 02000000:00000001:2.0:1790964161.733756:0:32625:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964161.733758:0:32625:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964161.733759:0:32625:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000b4339323. 00000100:00000001:2.0:1790964161.733763:0:32625:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964161.733764:0:32625:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000010:2.0:1790964161.733777:0:32625:0:(mgc_request.c:1652:mgc_process_recover_log()) kvfree 'folios': 32 at 00000000ddf743d4. 10000000:01000000:2.0:1790964161.733781:0:32625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 10000000:00000001:2.0:1790964161.733784:0:32625:0:(mgc_request.c:1029:mgc_cancel()) Process entered 00010000:00000001:2.0:1790964161.733786:0:32625:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:2.0:1790964161.733788:0:32625:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964161.733791:0:32625:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000d4eaafbe refcount=3 00000020:00000001:2.0:1790964161.733794:0:32625:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000001:2.0:1790964161.733796:0:32625:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446625129285316608 : -118944424235008 : ffff93d217d87000) 00010000:00000001:2.0:1790964161.733799:0:32625:0:(ldlm_lock.c:854:ldlm_lock_decref_internal()) Process entered 00010000:00010000:2.0:1790964161.733803:0:32625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000d4eaafbe/0x7851639485e2d8d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8dc expref: -99 pid: 32625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:2.0:1790964161.733810:0:32625:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:2.0:1790964161.733812:0:32625:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:2.0:1790964161.733813:0:32625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000d4eaafbe/0x7851639485e2d8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7851639485e2d8dc expref: -99 pid: 32625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:2.0:1790964161.733819:0:32625:0:(ldlm_lock.c:923:ldlm_lock_decref_internal()) Process leaving 00010000:00000001:2.0:1790964161.733825:0:32625:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:2.0:1790964161.733826:0:32625:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 10000000:00000001:2.0:1790964161.733827:0:32625:0:(mgc_request.c:1033:mgc_cancel()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:2.0:1790964161.733829:0:32625:0:(mgc_request.c:1907:mgc_process_log()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:2.0:1790964161.733832:0:32625:0:(mgc_request.c:621:do_requeue()) Process leaving 10000000:00000001:2.0:1790964161.733834:0:32625:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000040:2.0:1790964161.733836:0:32625:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(00000000f8c0a1c4) refs 3 10000000:00000001:2.0:1790964161.733838:0:32625:0:(mgc_request.c:147:config_log_put()) Process leaving 00000100:00000040:3.0:1790964161.733996:0:32160:0:(connection.c:75:cpu_latency_work()) work item of 00000000e0ae9ff4 (cpu 3) has reached its deadline 4295691781, at 4295691782 00000100:00000010:3.0:1790964161.734005:0:32160:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000496b08d3. 00000100:00000040:0.0:1790964161.734114:0:255:0:(connection.c:75:cpu_latency_work()) work item of 0000000030864b4e (cpu 0) has reached its deadline 4295691781, at 4295691782 00000100:00000010:0.0:1790964161.734120:0:255:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000004597eea4. 00000100:00000040:1.0:1790964161.735457:0:24214:0:(connection.c:75:cpu_latency_work()) work item of 00000000b46f7bb8 (cpu 1) has reached its deadline 4295691781, at 4295691783 00000100:00000010:1.0:1790964161.735467:0:24214:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000094c9a085. 00000100:00000040:2.0:1790964161.735826:0:31459:0:(connection.c:75:cpu_latency_work()) work item of 00000000b00bc849 (cpu 2) has reached its deadline 4295691781, at 4295691784 00000100:00000010:2.0:1790964161.735833:0:31459:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000f5167ce7. 00010000:00000001:0.0:1790964161.984652:0:255:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964161.984661:0:255:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964161.984667:0:255:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964161.984669:0:255:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964161.984839:0:32616:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964161.984844:0:32616:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964161.984847:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:2.0:1790964162.241052:0:31780:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964162.241066:0:31780:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964162.241068:0:31780:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964162.241071:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964162.241074:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964162.241076:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964162.241078:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964162.495712:0:32665:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964162.495719:0:32665:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964162.495721:0:32665:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964162.495725:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00000100:00000001:2.0:1790964162.495729:0:32665:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964162.495732:0:32665:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964162.495734:0:32665:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964162.495737:0:32665:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964162.495739:0:32665:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:3.0:1790964162.648534:0:33024:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964162.648550:0:33024:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964162.648555:0:33024:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964163.013358:0:255:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964163.013366:0:255:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964163.013373:0:255:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964163.013374:0:255:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964163.013461:0:32617:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964163.013465:0:32617:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964163.013468:0:32617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000001:1.0:1790964163.045276:0:33060:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:1.0:1790964163.045285:0:33060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: conf-sanity test_167: @@@@@@ FAIL: mds1 mounted without a remote update llog 00000001:00000001:1.0:1790964163.052234:0:33060:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00000100:00000001:2.0:1790964163.263710:0:31780:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964163.263728:0:31780:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964163.263730:0:31780:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964163.263734:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964163.263736:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964163.263740:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964163.263742:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964163.519750:0:32665:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964163.519758:0:32665:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964163.519760:0:32665:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964163.519764:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00000100:00000001:2.0:1790964163.519768:0:32665:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964163.519772:0:32665:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964163.519792:0:32665:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964163.519795:0:32665:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964163.519797:0:32665:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964164.034384:0:255:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964164.034395:0:255:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964164.034415:0:255:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964164.034418:0:255:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1790964164.034421:0:255:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1790964164.034424:0:255:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964164.034428:0:255:0:(ldlm_lockd.c:2241:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1790964164.034430:0:255:0:(ldlm_lockd.c:2244:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964164.034432:0:255:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964164.034434:0:255:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964164.034523:0:32616:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964164.034538:0:32616:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964164.034541:0:32616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1790964164.288978:0:13014:0:(pinger.c:229:ptlrpc_pinger_process_import()) b465b99b-a0b4-4368-8d34-49a45cd42e5a->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1790964164.288991:0:13014:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1790964164.289000:0:13014:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000008649198d. 00000020:00000040:1.0:1790964164.289008:0:13014:0:(genops.c:1210:class_import_get()) import 000000003559c588 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000001:1.0:1790964164.289012:0:13014:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964164.289015:0:13014:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964164.289019:0:13014:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964164.289027:0:13014:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000067f211a. 00000100:00000001:1.0:1790964164.289033:0:13014:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.289041:0:13014:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging b465b99b-a0b4-4368-8d34-49a45cd42e5a->MGS req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1790964164.289052:0:13014:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964164.289054:0:13014:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.289059:0:13014:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008649198d] to pc [ptlrpcd_00_03+3] req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.289094:0:13014:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:1.0:1790964164.289098:0:13014:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790964164.289101:0:13014:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00000001:1.0:1790964164.289103:0:13014:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:1.0:1790964164.289105:0:13014:0:(import.c:65:import_set_state_nolock()) 0000000064ad1a4a lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:1.0:1790964164.289109:0:13014:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:1.0:1790964164.289122:0:13014:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 1016 00000100:00001000:1.0:1790964164.289126:0:13014:0:(import.c:2195:obd_at_measure()) add 10 to 000000007d090ef0 time=10 v=5 (1 0 0 0) 00000100:00001000:1.0:1790964164.289130:0:13014:0:(import.c:2261:obd_at_measure()) AT 000000007d090ef0 change: old=5 new=10 delta=5 (val=10) hist 10 0 0 0 00000100:00080000:1.0:1790964164.289132:0:13014:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:1.0:1790964164.289134:0:13014:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 15 to 0@lo 00000100:00000001:1.0:1790964164.289137:0:13014:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964164.289139:0:13014:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 16 to 0@lo 00000100:00000001:1.0:1790964164.289140:0:13014:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 00000020:00000001:1.0:1790964164.289143:0:13014:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964164.289145:0:13014:0:(genops.c:804:class_conn2export()) looking for export cookie 0x7851639485e2d888 00000020:00000001:1.0:1790964164.289147:0:13014:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964164.289151:0:13014:0:(lustre_handles.c:148:class_handle2object()) GET export 000000005acc499a refcount=4 00000020:00000001:1.0:1790964164.289153:0:13014:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625124736704512 : -118948972847104 : ffff93d108ba2000) 00000020:00000001:1.0:1790964164.289155:0:13014:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446625124736704512 : -118948972847104 : ffff93d108ba2000) 00000100:00000040:1.0:1790964164.289157:0:13014:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 15 to 0@lo 00000100:00000001:1.0:1790964164.289159:0:13014:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964164.289160:0:13014:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 16 to 0@lo 00000100:00000001:1.0:1790964164.289161:0:13014:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 00000020:00000040:1.0:1790964164.289163:0:13014:0:(genops.c:879:class_export_put()) PUTting export 000000005acc499a : new refcount 3 00000100:00080000:1.0:1790964164.289166:0:13014:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000064ad1a4a using connection 192.168.204.135@tcp/0@lo 00000100:00000001:1.0:1790964164.289168:0:13014:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.289170:0:13014:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:1.0:1790964164.289175:0:13014:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964164.289177:0:13014:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289179:0:13014:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:1.0:1790964164.289182:0:13014:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:1.0:1790964164.289185:0:13014:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000d101bb28. 00000020:00000040:1.0:1790964164.289187:0:13014:0:(genops.c:1210:class_import_get()) import 0000000064ad1a4a refcount=4 obd=lustre-MDT0001-osp-MDT0000 02000000:00000001:1.0:1790964164.289190:0:13014:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:1.0:1790964164.289192:0:13014:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289194:0:13014:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964164.289195:0:13014:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964164.289202:0:13014:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964164.289206:0:13014:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 0000000082153837. 00000100:00000001:1.0:1790964164.289210:0:13014:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964164.289216:0:13014:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1790964164.289223:0:13014:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964164.289224:0:13014:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.289226:0:13014:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d101bb28] to pc [ptlrpcd_rcv+-1] req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.289240:0:13014:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.289242:0:13014:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1790964164.289246:0:13014:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1790964164.289249:0:13014:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000c1cf10d3. 00000020:00000040:1.0:1790964164.289251:0:13014:0:(genops.c:1210:class_import_get()) import 000000003caaf679 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000001:1.0:1790964164.289253:0:13014:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964164.289254:0:13014:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964164.289256:0:13014:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964164.289258:0:13014:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000049461875. 00000100:00000001:1.0:1790964164.289261:0:13014:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.289264:0:13014:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1790964164.289269:0:13014:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964164.289270:0:13014:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.289273:0:13014:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c1cf10d3] to pc [ptlrpcd_00_00+0] req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.289294:0:13014:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.289298:0:13014:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (1032) 00000100:00000001:1.0:1790964164.289312:0:31784:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.289315:0:31784:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964164.289318:0:31784:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964164.289321:0:31784:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.289338:0:31784:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964164.289340:0:31784:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.289343:0:31784:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964164.289345:0:31784:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964164.289347:0:31784:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964164.289349:0:31784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008649198d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31784:1877962009874432:0@lo:400: 00000100:00000001:1.0:1790964164.289353:0:31784:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964164.289358:0:31784:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964164.289360:0:31784:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.289362:0:31784:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964164.289365:0:31784:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000081158c30. 02000000:00000001:1.0:1790964164.289367:0:31784:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964164.289374:0:31784:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000664210d7. 00000400:00000010:1.0:1790964164.289381:0:31784:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000c71038de. 00000100:00000200:1.0:1790964164.289387:0:31784:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877962009874432, portal 25 00000100:00000001:1.0:1790964164.289390:0:31784:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964164.289391:0:31784:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625129980445568 : -118943729106048 : ffff93d241474380) 00000100:00000040:1.0:1790964164.289396:0:31784:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.289402:0:31784:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964164.289404:0:31784:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964164.289406:0:31784:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000036da9d25. 00000100:00000200:1.0:1790964164.289409:0:31784:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877962009874432, offset 0 00000400:00000200:1.0:1790964164.289414:0:31784:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964164.289426:0:31784:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964164.289435:0:31784:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff1a801000 00000400:00000200:1.0:1790964164.289440:0:31784:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x16d [2] + 0 00000400:00000010:1.0:1790964164.289444:0:31784:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000c20d3d8a. 00000400:00000200:1.0:1790964164.289449:0:31784:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000f862d8c5 00000400:00000200:1.0:1790964164.289456:0:31784:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964164.289460:0:31784:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964164.289466:0:31784:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000f862d8c5 00000400:00000010:1.0:1790964164.289473:0:31784:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000f862d8c5. 00000100:00000001:1.0:1790964164.289479:0:31784:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964164.289481:0:31784:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964164.289484:0:31784:0:(events.c:341:request_in_callback()) incoming req@00000000c10f53ad x1877962009874432 msgsize 224 00000100:00100000:1.0:1790964164.289487:0:31784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964164.289489:0:31784:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964164.289498:0:31784:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964164.289814:0:31784:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000036da9d25 00000400:00000010:1.0:1790964164.289818:0:31784:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000036da9d25. 00000100:00000001:1.0:1790964164.289823:0:31784:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964164.289827:0:31784:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.289837:0:31784:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964164.289839:0:31784:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.289845:0:31784:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289847:0:31784:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964164.289855:0:31784:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289859:0:31784:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 0 is 4295694340 00000100:00000010:1.0:1790964164.289865:0:31784:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000f7ae5088. 00000100:00000001:1.0:1790964164.289871:0:31784:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1790964164.289876:0:31784:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 1 is 4295694340 00000100:00000010:1.0:1790964164.289879:0:31784:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000025a58c03. 00000100:00000001:1.0:1790964164.289882:0:31784:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 1 00000100:00000001:1.0:1790964164.289885:0:31784:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 2 is 4295694340 00000100:00000010:1.0:1790964164.289887:0:31784:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000d3ff13bc. 00000100:00000001:1.0:1790964164.289890:0:31784:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1790964164.289892:0:31784:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS new deadline estimation for cpu 3 is 4295694340 00000100:00000010:1.0:1790964164.289895:0:31784:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000022e33ead. 00000100:00000001:1.0:1790964164.289898:0:31784:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.135@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1790964164.289901:0:31784:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964164.289904:0:31784:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289913:0:31784:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289916:0:31784:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.289925:0:31784:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964164.289927:0:31784:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1790964164.289929:0:31784:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.289930:0:31784:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964164.289932:0:31784:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289934:0:31784:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289947:0:31783:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.289949:0:31783:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.289956:0:31780:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964164.289958:0:31780:0:(client.c:2486:ptlrpc_expire_one_request()) Process entered 00000100:00100000:1.0:1790964164.289964:0:31780:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790964154/real 1790964154] req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000400:00000001:1.0:1790964164.289975:0:31780:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964164.289977:0:31780:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964164.289980:0:31780:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000002a772189. 00000400:00000200:1.0:1790964164.289992:0:31780:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000001165bdd5 00000400:00000010:1.0:1790964164.289995:0:31780:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000001165bdd5. 00000100:00000001:1.0:1790964164.289999:0:31780:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964164.290002:0:31780:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964164.290009:0:31780:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290015:0:31780:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964164.290016:0:31780:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290018:0:31780:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964164.290020:0:31780:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:1.0:1790964164.290022:0:31780:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290027:0:31780:0:(client.c:2540:ptlrpc_expire_one_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290031:0:31780:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964164.290032:0:31780:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290034:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.290035:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964164.290042:0:31780:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964164.290045:0:31780:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290052:0:31780:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964164.290053:0:31780:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.290056:0:31780:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964164.290057:0:31780:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964164.290059:0:31780:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964164.290061:0:31780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d101bb28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31780:1877962009874560:0@lo:38: 00000100:00000001:1.0:1790964164.290064:0:31780:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964164.290066:0:31780:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964164.290068:0:31780:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.290069:0:31780:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964164.290072:0:31780:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003a74c544. 02000000:00000001:1.0:1790964164.290074:0:31780:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964164.290077:0:31780:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000003167431. 00000400:00000010:1.0:1790964164.290093:0:31780:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000036da9d25. 00000100:00000200:1.0:1790964164.290096:0:31780:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877962009874560, portal 4 00000100:00000001:1.0:1790964164.290098:0:31780:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964164.290099:0:31780:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625129980455424 : -118943729096192 : ffff93d241476a00) 00000020:00000010:1.0:1790964164.290106:0:31780:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000003ad67c6b. 00000100:00000040:1.0:1790964164.290111:0:31780:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964179 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290117:0:31780:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964164.290119:0:31780:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964164.290120:0:31780:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007da4e241. 00000100:00000200:1.0:1790964164.290122:0:31780:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 24, xid 1877962009874560, offset 0 00000400:00000200:1.0:1790964164.290126:0:31780:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964164.290132:0:31780:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964164.290136:0:31780:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 24 MB=0x6abff1a801080 00000400:00000200:1.0:1790964164.290141:0:31780:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 520/520 into md 0x429 [256] + 520 00000400:00000200:1.0:1790964164.290146:0:31780:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964164.290149:0:31780:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964164.290158:0:31780:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964164.290159:0:31780:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 00000100:00000010:1.0:1790964164.290163:0:31780:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000003c6622c. 00000100:00000040:1.0:1790964164.290166:0:31780:0:(events.c:341:request_in_callback()) incoming req@0000000003c6622c x1877962009874560 msgsize 520 00000100:00100000:1.0:1790964164.290170:0:31780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1790964164.290179:0:31780:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964164.290185:0:31780:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007da4e241 00000400:00000010:1.0:1790964164.290187:0:31780:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007da4e241. 00000100:00000001:1.0:1790964164.290189:0:31780:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964164.290192:0:31780:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964179 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290199:0:31780:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964164.290201:0:31780:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964179 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290206:0:31780:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290207:0:31780:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964164.290211:0:31780:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.290214:0:31780:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 8385 usecs (9 jiffies) 00000100:00000001:1.0:1790964164.290216:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295694346 00000100:00000001:1.0:1790964164.290220:0:31780:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295694340 00000100:00000001:1.0:1790964164.290223:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295694346 00000100:00000001:1.0:1790964164.290225:0:31780:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295694340 00000100:00000001:1.0:1790964164.290227:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295694346 00000100:00000001:1.0:1790964164.290229:0:31780:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295694340 00000100:00000001:1.0:1790964164.290231:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295694346 00000100:00000001:1.0:1790964164.290233:0:31780:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295694340 00000100:00000001:1.0:1790964164.290236:0:31780:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964164.290238:0:31780:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290241:0:31780:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964164.290243:0:31780:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964164 ref 1 fl Rpc:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290261:0:31780:0:(client.c:2143:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00000001:1.0:1790964164.290264:0:31780:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290265:0:31780:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964164.290266:0:31780:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290269:0:31780:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:1.0:1790964164.290270:0:31780:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00080000:1.0:1790964164.290273:0:31780:0:(import.c:65:import_set_state_nolock()) 000000000791c0c9 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790964164.290285:0:31780:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00000001:1.0:1790964164.290288:0:31780:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551506 : -110 : ffffffffffffff92) 00000100:00000040:1.0:1790964164.290291:0:31780:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964164 ref 1 fl Interpret:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964164.290297:0:31780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073db718b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31780:1877962009871616:0@lo:8: 00000100:00000001:1.0:1790964164.290301:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290303:0:31780:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964164.290305:0:31780:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000073db718b x1877962009871616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964164 ref 1 fl Complete:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290311:0:31780:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964164.290313:0:31780:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964164.290315:0:31780:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bb4e257f. 02000000:00000001:1.0:1790964164.290319:0:31780:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964164.290321:0:31780:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964164.290322:0:31780:0:(genops.c:1223:class_import_put()) import 000000000791c0c9 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000001:1.0:1790964164.290325:0:31780:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964164.290327:0:31780:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 000000006f110af1. 02000000:00000001:1.0:1790964164.290336:0:31780:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964164.290337:0:31780:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964164.290339:0:31780:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000073db718b. 00000100:00000001:1.0:1790964164.290342:0:31780:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964164.290343:0:31780:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290344:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290347:0:31780:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964164.290353:0:31780:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:1.0:1790964164.290356:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.290357:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964164.290358:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290360:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290369:0:31782:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:1.0:1790964164.290371:0:31782:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000001:1.0:1790964164.290373:0:31782:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290377:0:31782:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964164.290379:0:31782:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290380:0:31782:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.290381:0:31782:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964164.290383:0:31782:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964164.290387:0:31782:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290393:0:31782:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964164.290395:0:31782:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.290397:0:31782:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964164.290398:0:31782:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964164.290400:0:31782:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964164.290402:0:31782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1cf10d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:31782:1877962009874688:0@lo:400: 00000100:00000001:1.0:1790964164.290405:0:31782:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964164.290407:0:31782:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964164.290408:0:31782:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.290410:0:31782:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964164.290413:0:31782:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000822716d9. 02000000:00000001:1.0:1790964164.290415:0:31782:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964164.290418:0:31782:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000009e611efc. 00000400:00000010:1.0:1790964164.290421:0:31782:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000007da4e241. 00000100:00000200:1.0:1790964164.290423:0:31782:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877962009874688, portal 10 00000100:00000001:1.0:1790964164.290425:0:31782:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964164.290426:0:31782:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625129980453632 : -118943729097984 : ffff93d241476300) 00000020:00000010:1.0:1790964164.290433:0:31782:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000004a4bc3d4. 00000100:00000040:1.0:1790964164.290437:0:31782:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290452:0:31782:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964164.290454:0:31782:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964164.290456:0:31782:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002b67d4c9. 00000100:00000200:1.0:1790964164.290458:0:31782:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1877962009874688, offset 0 00000400:00000200:1.0:1790964164.290461:0:31782:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964164.290467:0:31782:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964164.290471:0:31782:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6abff1a801100 00000400:00000200:1.0:1790964164.290477:0:31782:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x229 [64] + 1040 00000400:00000200:1.0:1790964164.290481:0:31782:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964164.290484:0:31782:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964164.290487:0:31782:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964164.290489:0:31782:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:1.0:1790964164.290491:0:31782:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000073db718b. 00000100:00000040:1.0:1790964164.290493:0:31782:0:(events.c:341:request_in_callback()) incoming req@0000000073db718b x1877962009874688 msgsize 224 00000100:00100000:1.0:1790964164.290497:0:31782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1790964164.290505:0:31782:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964164.290509:0:31782:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002b67d4c9 00000400:00000010:1.0:1790964164.290510:0:31782:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002b67d4c9. 00000100:00000001:1.0:1790964164.290513:0:31782:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964164.290515:0:31782:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290522:0:31782:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964164.290524:0:31782:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290529:0:31782:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290531:0:31782:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964164.290534:0:31782:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.290537:0:31782:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 2816 usecs (3 jiffies) 00000100:00000001:1.0:1790964164.290539:0:31782:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295694340 00000100:00000001:1.0:1790964164.290541:0:31782:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, keep current deadline 4295694346 00000100:00000001:1.0:1790964164.290543:0:31782:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295694340 00000100:00000001:1.0:1790964164.290544:0:31782:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, keep current deadline 4295694346 00000100:00000001:1.0:1790964164.290552:0:31782:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295694340 00000100:00000001:1.0:1790964164.290554:0:31782:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, keep current deadline 4295694346 00000100:00000001:1.0:1790964164.290556:0:31782:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295694340 00000100:00000001:1.0:1790964164.290558:0:31782:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, keep current deadline 4295694346 00000100:00000001:1.0:1790964164.290560:0:31782:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964164.290562:0:31782:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290564:0:31782:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290566:0:31782:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290585:0:32623:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964164.290588:0:32623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009874432 02000000:00000001:1.0:1790964164.290590:0:32623:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964164.290593:0:32623:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964164.290595:0:32623:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.290600:0:32623:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964164.290603:0:32623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009874432 00000020:00000001:1.0:1790964164.290606:0:32623:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964164.290607:0:32623:0:(genops.c:804:class_conn2export()) looking for export cookie 0x7851639485e2d7ee 00000020:00000001:1.0:1790964164.290609:0:32623:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964164.290611:0:32623:0:(lustre_handles.c:148:class_handle2object()) GET export 000000006e0ef6a6 refcount=12 00000020:00000001:1.0:1790964164.290638:0:32623:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625128940896256 : -118944768655360 : ffff93d203510000) 00000020:00000001:1.0:1790964164.290640:0:32623:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446625128940896256 : -118944768655360 : ffff93d203510000) 00000100:00000001:1.0:1790964164.290644:0:32623:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964164.290648:0:32623:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000008c785c72. 00000100:00000001:1.0:1790964164.290651:0:32623:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964164.290653:0:32623:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000008c785c72. 00000020:00000010:1.0:1790964164.290658:0:32623:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c61e06e1. 00000020:00000010:1.0:1790964164.290663:0:32623:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000b3b459ac. 00000020:00000010:1.0:1790964164.290668:0:32623:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000eaf5dd81. 00000100:00000040:1.0:1790964164.290676:0:32623:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964164.290680:0:32623:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964164.290681:0:32623:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964164.290683:0:32623:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290692:0:32623:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.290705:0:32623:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.290715:0:32623:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964164.290717:0:32623:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964164.290721:0:32623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00000040:1.0:1790964164.290724:0:32623:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000006e0ef6a6 : new rpc_count 1 00000100:00000001:1.0:1790964164.290726:0:32623:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446625129920940112 : -118943788611504 : ffff93d23dbb4850) 00000100:00000040:1.0:1790964164.290730:0:32623:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000c10f53ad x1877962009874432/t0(0) o400->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:740/0 lens 224/0 e 0 to 0 dl 1790964175 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.290739:0:32623:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:2.0:1790964164.291994:0:31781:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964164.292001:0:31781:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1790964164.292038:0:32629:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000d5387fe4. 00000100:00000001:2.0:1790964164.292047:0:32629:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:2.0:1790964164.292049:0:32629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009874688 02000000:00000001:2.0:1790964164.292051:0:32629:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1790964164.292053:0:32629:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964164.292055:0:32629:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964164.292059:0:32629:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964164.292062:0:32629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009874688 00000020:00000001:2.0:1790964164.292065:0:32629:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964164.292066:0:32629:0:(genops.c:804:class_conn2export()) looking for export cookie 0x7851639485e2d8ce 00000020:00000001:2.0:1790964164.292068:0:32629:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964164.292071:0:32629:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000c464f866 refcount=5 00000020:00000001:2.0:1790964164.292073:0:32629:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625124736712704 : -118948972838912 : ffff93d108ba4000) 00000020:00000001:2.0:1790964164.292076:0:32629:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446625124736712704 : -118948972838912 : ffff93d108ba4000) 00000100:00000001:2.0:1790964164.292091:0:32629:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964164.292096:0:32629:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000d30670b0. 00000100:00000001:2.0:1790964164.292099:0:32629:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964164.292101:0:32629:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000d30670b0. 00000020:00000010:2.0:1790964164.292108:0:32629:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a077ee2d. 00000020:00000010:2.0:1790964164.292111:0:32629:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000003abbecd5. 00000020:00000010:2.0:1790964164.292115:0:32629:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000036bd8196. 00000100:00000040:2.0:1790964164.292122:0:32629:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000001:2.0:1790964164.292125:0:32629:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1790964164.292126:0:32629:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1790964164.292129:0:32629:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.292134:0:32629:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:2.0:1790964164.292137:0:32629:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:2.0:1790964164.292138:0:32629:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.292147:0:32629:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.292157:0:32629:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1790964164.292172:0:32629:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1790964164.292178:0:32629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00000040:2.0:1790964164.292181:0:32629:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000c464f866 : new rpc_count 1 00000100:00000001:2.0:1790964164.292183:0:32629:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446625129980454528 : -118943729097088 : ffff93d241476680) 00000100:00000040:2.0:1790964164.292188:0:32629:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@0000000073db718b x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:740/0 lens 224/0 e 0 to 0 dl 1790964175 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964164.292198:0:32629:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964164.292200:0:32629:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000d30670b0. 00000100:00000001:2.0:1790964164.292202:0:32629:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964164.292204:0:32629:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000d30670b0. 00000100:00100000:2.0:1790964164.292207:0:32629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073db718b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31782:x1877962009874688:12345-0@lo:400: 00000100:00000200:2.0:1790964164.292211:0:32629:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962009874688 00000020:00000001:2.0:1790964164.292214:0:32629:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1790964164.292218:0:32629:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:2.0:1790964164.292220:0:32629:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964164.292223:0:32629:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1790964164.292225:0:32629:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072662654656 : -1046896960 : ffffffffc1999ec0) 00000020:00000001:2.0:1790964164.292228:0:32629:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:2.0:1790964164.292231:0:32629:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1790964164.292233:0:32629:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1790964164.292235:0:32629:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:2.0:1790964164.292238:0:32629:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964164.292240:0:32629:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:2.0:1790964164.292244:0:32629:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1790964164.292246:0:32629:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:2.0:1790964164.292250:0:32629:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 000000003674509f. 02000000:00000001:2.0:1790964164.292253:0:32629:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.292255:0:32629:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964164.292257:0:32629:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:2.0:1790964164.292261:0:32629:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962009874688 00010000:00000001:2.0:1790964164.292263:0:32629:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:2.0:1790964164.292267:0:32629:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@0000000073db718b x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:740/0 lens 224/224 e 0 to 0 dl 1790964175 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1790964164.292286:0:32629:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:2.0:1790964164.292289:0:32629:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964164.292292:0:32629:0:(import.c:2195:obd_at_measure()) add 1 to 00000000ec6fe973 time=5 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964164.292297:0:32629:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964164.292299:0:32629:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 17 to 0@lo 00000100:00000001:2.0:1790964164.292301:0:32629:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 02000000:00000001:2.0:1790964164.292304:0:32629:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:2.0:1790964164.292306:0:32629:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.292309:0:32629:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964164.292311:0:32629:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964164.292315:0:32629:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002a30c83d. 00000100:00000200:2.0:1790964164.292320:0:32629:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1877962009874688, offset 224 00000400:00000200:2.0:1790964164.292326:0:32629:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964164.292337:0:32629:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964164.292345:0:32629:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6abff1a801100 00000400:00000200:2.0:1790964164.292351:0:32629:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0xafd [1] + 224 00000400:00000200:2.0:1790964164.292358:0:32629:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964164.292361:0:32629:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964164.292367:0:32629:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964164.292370:0:32629:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1790964164.292379:0:32629:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964164.292391:0:32629:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1790964164.292397:0:32629:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002a30c83d 00000400:00000010:2.0:1790964164.292399:0:32629:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002a30c83d. 00000100:00000001:2.0:1790964164.292402:0:32629:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1790964164.292404:0:32629:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1790964164.292408:0:32629:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964164.292410:0:32629:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 16 to 0@lo 00010000:00000001:2.0:1790964164.292413:0:32629:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:2.0:1790964164.292415:0:32629:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964164.292417:0:32629:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1790964164.292425:0:32629:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000073db718b x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:740/0 lens 224/224 e 0 to 0 dl 1790964175 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964164.292433:0:32629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073db718b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31782:x1877962009874688:12345-0@lo:400: Request processed in 234us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964164.292439:0:32629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00000040:2.0:1790964164.292442:0:32629:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c464f866 : new rpc_count 0 00000100:00000001:2.0:1790964164.292444:0:32629:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1790964164.292445:0:32629:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1790964164.292449:0:32629:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000003abbecd5. 00000020:00000010:2.0:1790964164.292453:0:32629:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000036bd8196. 00000020:00000010:2.0:1790964164.292456:0:32629:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a077ee2d. 00000020:00000040:2.0:1790964164.292460:0:32629:0:(genops.c:879:class_export_put()) PUTting export 00000000c464f866 : new refcount 4 00000100:00000001:2.0:1790964164.292463:0:32629:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:2.0:1790964164.292497:0:32633:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000f9641181. 00000100:00000001:2.0:1790964164.292501:0:32633:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:2.0:1790964164.292503:0:32633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962009874560 02000000:00000001:2.0:1790964164.292504:0:32633:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1790964164.292507:0:32633:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964164.292508:0:32633:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964164.292510:0:32633:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964164.292512:0:32633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962009874560 00000020:00000001:2.0:1790964164.292513:0:32633:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964164.292515:0:32633:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:2.0:1790964164.292516:0:32633:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:2.0:1790964164.292518:0:32633:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964164.292520:0:32633:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1790964164.292523:0:32633:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a077ee2d. 00000020:00000010:2.0:1790964164.292526:0:32633:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000003abbecd5. 00000020:00000010:2.0:1790964164.292528:0:32633:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000036bd8196. 00000100:00000001:2.0:1790964164.292532:0:32633:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1790964164.292533:0:32633:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1790964164.292534:0:32633:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.292538:0:32633:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.292555:0:32633:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.292569:0:32633:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1790964164.292571:0:32633:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1790964164.292573:0:32633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:2.0:1790964164.292575:0:32633:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446625129980450944 : -118943729100672 : ffff93d241475880) 00000100:00000040:2.0:1790964164.292579:0:32633:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@0000000003c6622c x1877962009874560/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964164.292586:0:32633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003c6622c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31780:x1877962009874560:12345-0@lo:38: 00000100:00000200:2.0:1790964164.292589:0:32633:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962009874560 00000020:00000001:2.0:1790964164.292591:0:32633:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:2.0:1790964164.292593:0:32633:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000001:2.0:1790964164.292607:0:32633:0:(genops.c:655:class_str2obd()) Process leaving (rc=0 : 0 : 0) 00010000:00020000:2.0:1790964164.292611:0:32633:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000010:1.0:1790964164.293851:0:32623:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000008c785c72. 00000100:00000001:1.0:1790964164.294961:0:32623:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964164.294970:0:32623:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000008c785c72. 00000100:00100000:1.0:1790964164.294982:0:32623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c10f53ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:31784:x1877962009874432:12345-0@lo:400: 00000100:00000200:1.0:1790964164.294987:0:32623:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962009874432 00000020:00000001:1.0:1790964164.294992:0:32623:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964164.294997:0:32623:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964164.294999:0:32623:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964164.295001:0:32623:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964164.295003:0:32623:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072670542016 : -1039009600 : ffffffffc211f8c0) 00000020:00000001:1.0:1790964164.295007:0:32623:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964164.295008:0:32623:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964164.295010:0:32623:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964164.295012:0:32623:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964164.295015:0:32623:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964164.295017:0:32623:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:1.0:1790964164.295019:0:32623:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964164.295022:0:32623:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964164.295030:0:32623:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000e942e98e. 02000000:00000001:1.0:1790964164.295032:0:32623:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.295034:0:32623:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964164.295037:0:32623:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964164.295040:0:32623:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962009874432 00010000:00000001:1.0:1790964164.295043:0:32623:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964164.295062:0:32623:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000c10f53ad x1877962009874432/t0(0) o400->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:740/0 lens 224/224 e 0 to 0 dl 1790964175 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964164.295072:0:32623:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964164.295074:0:32623:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964164.295077:0:32623:0:(import.c:2195:obd_at_measure()) add 1 to 000000006e7c27fb time=11 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964164.295373:0:32623:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964164.295376:0:32623:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 17 to 0@lo 00000100:00000001:1.0:1790964164.295379:0:32623:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 02000000:00000001:1.0:1790964164.295382:0:32623:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964164.295384:0:32623:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.295388:0:32623:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964164.295391:0:32623:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964164.295398:0:32623:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002b67d4c9. 00000100:00000200:1.0:1790964164.295405:0:32623:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877962009874432, offset 224 00000400:00000200:1.0:1790964164.295411:0:32623:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964164.295425:0:32623:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964164.295436:0:32623:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff1a801000 00000400:00000200:1.0:1790964164.295443:0:32623:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xaed [1] + 224 00000400:00000200:1.0:1790964164.295451:0:32623:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964164.295455:0:32623:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964164.295462:0:32623:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964164.295467:0:32623:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964164.295475:0:32623:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.295510:0:32623:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964164.295520:0:32623:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000002b67d4c9 00000400:00000010:1.0:1790964164.295522:0:32623:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000002b67d4c9. 00000100:00000001:1.0:1790964164.295525:0:32623:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964164.295527:0:32623:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964164.295532:0:32623:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.295535:0:32623:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 16 to 0@lo 00010000:00000001:1.0:1790964164.295537:0:32623:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964164.295538:0:32623:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964164.295548:0:32623:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964164.295552:0:32623:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000c10f53ad x1877962009874432/t0(0) o400->b465b99b-a0b4-4368-8d34-49a45cd42e5a@0@lo:740/0 lens 224/224 e 0 to 0 dl 1790964175 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964164.295560:0:32623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c10f53ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b465b99b-a0b4-4368-8d34-49a45cd42e5a+12:31784:x1877962009874432:12345-0@lo:400: Request processed in 4819us (6074us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964164.295568:0:32623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00000040:1.0:1790964164.295571:0:32623:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006e0ef6a6 : new rpc_count 0 00000100:00000001:1.0:1790964164.295573:0:32623:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964164.295574:0:32623:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964164.295579:0:32623:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000b3b459ac. 00000020:00000010:1.0:1790964164.295582:0:32623:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000eaf5dd81. 00000020:00000010:1.0:1790964164.295586:0:32623:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c61e06e1. 00000020:00000040:1.0:1790964164.295591:0:32623:0:(genops.c:879:class_export_put()) PUTting export 000000006e0ef6a6 : new refcount 11 02000000:00000001:1.0:1790964164.295594:0:32623:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964164.295596:0:32623:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 00000000e942e98e. 02000000:00000001:1.0:1790964164.295599:0:32623:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964164.295602:0:32623:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964164.295607:0:32623:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000100:00000001:0.0:1790964164.296602:0:31782:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964164.296608:0:31782:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1790964164.296643:0:31782:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964164.296646:0:31782:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964164.296648:0:31782:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000009e611efc. 00000400:00000200:0.0:1790964164.296654:0:31782:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007da4e241 00000400:00000010:0.0:1790964164.296656:0:31782:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000007da4e241. 00000100:00000001:0.0:1790964164.296660:0:31782:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964164.296665:0:31782:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964164.296675:0:31782:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964164.296682:0:31782:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964164.296683:0:31782:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964164.296685:0:31782:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1790964164.296688:0:31782:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1790964164.296690:0:31782:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964164.296692:0:31782:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964164.296695:0:31782:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964164.296702:0:31782:0:(import.c:2195:obd_at_measure()) add 5 to 0000000055883682 time=5 v=5 (5 0 0 0) 00000100:00001000:0.0:1790964164.296706:0:31782:0:(import.c:2195:obd_at_measure()) add 1 to 00000000bb59bd10 time=5 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964164.296708:0:31782:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1790964164.296710:0:31782:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964164.296712:0:31782:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1790964164.296715:0:31782:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964164.296722:0:31782:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964164.296725:0:31782:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1790964164.296735:0:31782:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:0.0:1790964164.296738:0:31782:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1790964164.296740:0:31782:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964164.297492:0:32623:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000089e29f1e. 00000400:00000010:1.0:1790964164.297509:0:32623:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 0000000006b4eda0. 00000100:00000001:3.0:1790964164.298034:0:31784:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964164.298039:0:31784:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964164.298045:0:31784:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964164.298047:0:31784:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964164.298051:0:31784:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000664210d7. 00000400:00000200:3.0:1790964164.298065:0:31784:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c71038de 00000400:00000010:3.0:1790964164.298067:0:31784:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000c71038de. 00000100:00000001:3.0:1790964164.298070:0:31784:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964164.298076:0:31784:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964164.298097:0:31784:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964164.298104:0:31784:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964164.298106:0:31784:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964164.298108:0:31784:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964164.298110:0:31784:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964164.298112:0:31784:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964164.298114:0:31784:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964164.298116:0:31784:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964164.298120:0:31784:0:(import.c:2195:obd_at_measure()) add 5 to 000000002a1ba3d6 time=11 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964164.298123:0:31784:0:(import.c:2195:obd_at_measure()) add 1 to 00000000b4d2d0c9 time=11 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964164.298125:0:31784:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964164.298127:0:31784:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964164.298129:0:31784:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1790964164.298130:0:31784:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964164.298133:0:31784:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964164.298136:0:31784:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964164.298142:0:31784:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964164.298145:0:31784:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964164.298147:0:31784:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964164.298149:0:31784:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964164.298156:0:31784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008649198d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b465b99b-a0b4-4368-8d34-49a45cd42e5a:31784:1877962009874432:0@lo:400: 00000100:00000001:3.0:1790964164.298161:0:31784:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964164.298163:0:31784:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964164.298165:0:31784:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000008649198d x1877962009874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964164.298181:0:31784:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964164.298184:0:31784:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964164.298186:0:31784:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000081158c30. 02000000:00000001:3.0:1790964164.298190:0:31784:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964164.298192:0:31784:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964164.298193:0:31784:0:(genops.c:1223:class_import_put()) import 000000003559c588 refcount=3 obd=MGC192.168.204.135@tcp 00000020:00000001:3.0:1790964164.298196:0:31784:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964164.298198:0:31784:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000067f211a. 02000000:00000001:3.0:1790964164.298202:0:31784:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964164.298203:0:31784:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964164.298205:0:31784:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000008649198d. 00000100:00000001:3.0:1790964164.298208:0:31784:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964164.298209:0:31784:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964164.298211:0:31784:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964164.298219:0:31784:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964164.298221:0:31784:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964164.298223:0:31784:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964164.298225:0:31784:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964164.302393:0:31782:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964164.302408:0:31782:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964164.302412:0:31782:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964164.302414:0:31782:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1790964164.302416:0:31782:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964164.302423:0:31782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1cf10d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:31782:1877962009874688:0@lo:400: 00000100:00000001:0.0:1790964164.302429:0:31782:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964164.302433:0:31782:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964164.302435:0:31782:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000c1cf10d3 x1877962009874688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964180 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964164.302441:0:31782:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964164.302444:0:31782:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964164.302448:0:31782:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000822716d9. 02000000:00000001:0.0:1790964164.302456:0:31782:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964164.302458:0:31782:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964164.302460:0:31782:0:(genops.c:1223:class_import_put()) import 000000003caaf679 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:0.0:1790964164.302462:0:31782:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964164.302465:0:31782:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 0000000049461875. 02000000:00000001:0.0:1790964164.302468:0:31782:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964164.302470:0:31782:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964164.302471:0:31782:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000c1cf10d3. 00000100:00000001:0.0:1790964164.302475:0:31782:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964164.302476:0:31782:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964164.302479:0:31782:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964164.302488:0:31782:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964164.302490:0:31782:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964164.302492:0:31782:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964164.302494:0:31782:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964164.302524:0:255:0:(connection.c:75:cpu_latency_work()) work item of 0000000030864b4e (cpu 0) has reached its deadline 4295694346, at 4295694350 00000100:00000010:0.0:1790964164.302550:0:255:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000f7ae5088. 00000100:00000040:1.0:1790964164.303210:0:24214:0:(connection.c:75:cpu_latency_work()) work item of 00000000b46f7bb8 (cpu 1) has reached its deadline 4295694346, at 4295694350 00000100:00000010:1.0:1790964164.303217:0:24214:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000025a58c03. 00000100:00000040:3.0:1790964164.303386:0:32160:0:(connection.c:75:cpu_latency_work()) work item of 00000000e0ae9ff4 (cpu 3) has reached its deadline 4295694346, at 4295694350 00000100:00000010:3.0:1790964164.303393:0:32160:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000022e33ead. 00000100:00080000:1.0:1790964164.303829:0:13014:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790964164.303835:0:13014:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00000001:1.0:1790964164.303838:0:13014:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:1.0:1790964164.303840:0:13014:0:(import.c:65:import_set_state_nolock()) 000000000791c0c9 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:1.0:1790964164.303844:0:13014:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:1.0:1790964164.303848:0:13014:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 1016 00000100:00001000:1.0:1790964164.303852:0:13014:0:(import.c:2195:obd_at_measure()) add 10 to 000000005bf947e9 time=1790964164 v=0 (0 0 0 0) 00000100:00001000:1.0:1790964164.303856:0:13014:0:(import.c:2261:obd_at_measure()) AT 000000005bf947e9 change: old=0 new=10 delta=10 (val=10) hist 10 0 0 0 00000100:00080000:1.0:1790964164.303859:0:13014:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:1.0:1790964164.303883:0:13014:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 15 to 0@lo 00000100:00000001:1.0:1790964164.303886:0:13014:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964164.303888:0:13014:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 16 to 0@lo 00000100:00000001:1.0:1790964164.303889:0:13014:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 00000020:00000001:1.0:1790964164.303893:0:13014:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964164.303895:0:13014:0:(genops.c:804:class_conn2export()) looking for export cookie 0x7851639485e2d873 00000020:00000001:1.0:1790964164.303898:0:13014:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964164.303902:0:13014:0:(lustre_handles.c:148:class_handle2object()) GET export 000000000412baec refcount=4 00000020:00000001:1.0:1790964164.303904:0:13014:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446625124740823040 : -118948968728576 : ffff93d108f8f800) 00000020:00000001:1.0:1790964164.303906:0:13014:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446625124740823040 : -118948968728576 : ffff93d108f8f800) 00000100:00000040:1.0:1790964164.303908:0:13014:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 15 to 0@lo 00000100:00000001:1.0:1790964164.303910:0:13014:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964164.303911:0:13014:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 16 to 0@lo 00000100:00000001:1.0:1790964164.303913:0:13014:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 00000020:00000040:1.0:1790964164.303915:0:13014:0:(genops.c:879:class_export_put()) PUTting export 000000000412baec : new refcount 3 00000100:00080000:1.0:1790964164.303918:0:13014:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 000000000791c0c9 using connection 192.168.204.135@tcp/0@lo 00000100:00000001:1.0:1790964164.303920:0:13014:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.303924:0:13014:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:1.0:1790964164.303932:0:13014:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964164.303934:0:13014:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.303936:0:13014:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:1.0:1790964164.303939:0:13014:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:1.0:1790964164.303943:0:13014:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000010deb2aa. 00000020:00000040:1.0:1790964164.303947:0:13014:0:(genops.c:1210:class_import_get()) import 000000000791c0c9 refcount=3 obd=lustre-OST0000-osc-MDT0000 02000000:00000001:1.0:1790964164.303950:0:13014:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:1.0:1790964164.303951:0:13014:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.303955:0:13014:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964164.303957:0:13014:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964164.303962:0:13014:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964164.303969:0:13014:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 00000000e942e98e. 00000100:00000001:1.0:1790964164.303976:0:13014:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964164.303982:0:13014:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000010deb2aa x1877962009874816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1790964164.304002:0:13014:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964164.304005:0:13014:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.304009:0:13014:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000010deb2aa] to pc [ptlrpcd_rcv+-1] req@0000000010deb2aa x1877962009874816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.304024:0:13014:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.304029:0:13014:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (1032) 00000100:00000001:1.0:1790964164.304041:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.304044:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964164.304047:0:31780:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964164.304050:0:31780:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000010deb2aa x1877962009874816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.304057:0:31780:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964164.304059:0:31780:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.304062:0:31780:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964164.304065:0:31780:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964164.304067:0:31780:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964164.304069:0:31780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010deb2aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31780:1877962009874816:0@lo:8: 00000100:00000001:1.0:1790964164.304073:0:31780:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964164.304077:0:31780:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964164.304091:0:31780:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964164.304093:0:31780:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964164.304097:0:31780:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d7adfaa7. 02000000:00000001:1.0:1790964164.304100:0:31780:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964164.304107:0:31780:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000c89bbab1. 00000400:00000010:1.0:1790964164.304113:0:31780:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000002b67d4c9. 00000100:00000200:1.0:1790964164.304119:0:31780:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877962009874816, portal 4 00000100:00000001:1.0:1790964164.304121:0:31780:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964164.304123:0:31780:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446625129980458112 : -118943729093504 : ffff93d241477480) 00000020:00000010:1.0:1790964164.304144:0:31780:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 0000000006ade1ba. 00000100:00000040:1.0:1790964164.304152:0:31780:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000010deb2aa x1877962009874816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964179 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.304158:0:31780:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964164.304166:0:31780:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964164.304168:0:31780:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000046fb1a72. 00000100:00000200:1.0:1790964164.304171:0:31780:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 28, xid 1877962009874816, offset 0 00000400:00000200:1.0:1790964164.304178:0:31780:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964164.304191:0:31780:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964164.304200:0:31780:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 28 MB=0x6abff1a801180 00000400:00000100:1.0:1790964164.304205:0:31780:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877962009874816 offset 0 length 520: 4 00000400:00000200:1.0:1790964164.304209:0:31780:0:(lib-msg.c:1116:lnet_is_health_check()) Msg 00000000f13fefc5 is in inconsistent state, don't perform health checking (-2, 0) 00000400:00000200:1.0:1790964164.304212:0:31780:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 0, status = -2, hstatus = 0 00000400:00000200:1.0:1790964164.304222:0:31780:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000046fb1a72 00000400:00000010:1.0:1790964164.304224:0:31780:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000046fb1a72. 00000100:00000001:1.0:1790964164.304228:0:31780:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964164.304231:0:31780:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000010deb2aa x1877962009874816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964179 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.304239:0:31780:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964164.304241:0:31780:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000010deb2aa x1877962009874816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964179 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964164.304247:0:31780:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.304249:0:31780:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964164.304254:0:31780:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964164.304258:0:31780:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000001:1.0:1790964164.304262:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295694360 00000100:00000010:1.0:1790964164.304265:0:31780:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000025a58c03. 00000100:00000001:1.0:1790964164.304270:0:31780:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 0 00000100:00000001:1.0:1790964164.304274:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295694360 00000100:00000010:1.0:1790964164.304276:0:31780:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000983ea563. 00000100:00000001:1.0:1790964164.304279:0:31780:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 1 00000100:00000001:1.0:1790964164.304281:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295694360 00000100:00000001:1.0:1790964164.304285:0:31780:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295694346 00000100:00000001:1.0:1790964164.304288:0:31780:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295694360 00000100:00000010:1.0:1790964164.304290:0:31780:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000c877f42b. 00000100:00000001:1.0:1790964164.304297:0:31780:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 3 00000100:00000001:1.0:1790964164.304305:0:31780:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964164.304308:0:31780:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.304312:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.304314:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964164.304320:0:31780:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964164.304322:0:31780:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:1.0:1790964164.304324:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964164.304326:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964164.304327:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964164.304329:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964164.317786:0:255:0:(connection.c:75:cpu_latency_work()) work item of 0000000030864b4e (cpu 0) has reached its deadline 4295694360, at 4295694366 00000100:00000010:0.0:1790964164.317803:0:255:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000025a58c03. 00000100:00000040:3.0:1790964164.319507:0:32160:0:(connection.c:75:cpu_latency_work()) work item of 00000000e0ae9ff4 (cpu 3) has reached its deadline 4295694360, at 4295694367 00000100:00000010:3.0:1790964164.319521:0:32160:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000c877f42b. 00000100:00000040:1.0:1790964164.323030:0:24214:0:(connection.c:75:cpu_latency_work()) work item of 00000000b46f7bb8 (cpu 1) has reached its deadline 4295694360, at 4295694370 00000100:00000010:1.0:1790964164.323047:0:24214:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000983ea563. 00010000:00000001:2.0:1790964164.348799:0:32633:0:(ldlm_lib.c:1191:target_handle_connect()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00010000:00000001:2.0:1790964164.348811:0:32633:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:2.0:1790964164.348815:0:32633:0:(niobuf.c:816:ptlrpc_send_error()) Process entered 00000100:00000001:2.0:1790964164.348819:0:32633:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1790964164.348822:0:32633:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000040:2.0:1790964164.348870:0:31459:0:(connection.c:75:cpu_latency_work()) work item of 00000000b00bc849 (cpu 2) has reached its deadline 4295694360, at 4295694397 00000100:00000010:2.0:1790964164.348882:0:31459:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000d3ff13bc. 02000000:00000010:0.0:1790964164.349212:0:32633:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000cd200eee. 02000000:00000001:0.0:1790964164.349217:0:32633:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964164.349221:0:32633:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964164.349226:0:32633:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964164.349228:0:32633:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964164.349231:0:32633:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x0 req_flags=0x200 magic=bd00bd3/bd00bd3 len=224 00000100:00000001:0.0:1790964164.349234:0:32633:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:0.0:1790964164.349237:0:32633:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964164.349241:0:32633:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000646c7348 refcount 17 to 0@lo 00000100:00000001:0.0:1790964164.349243:0:32633:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446625129771962688 : -118943937588928 : ffff93d234da1140) 00000100:00000001:0.0:1790964164.349245:0:32633:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446625129771962688 : -118943937588928 : 0xffff93d234da1140) 00000100:00000040:0.0:1790964164.349248:0:32633:0:(connection.c:150:ptlrpc_connection_get()) conn=00000000646c7348 refcount 17 to 0@lo 02000000:00000001:0.0:1790964164.349250:0:32633:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964164.349251:0:32633:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964164.349254:0:32633:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964164.349256:0:32633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964164.349261:0:32633:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000005c0bc177. 00000100:00000200:0.0:1790964164.349267:0:32633:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1877962009874560, offset 0 00000400:00000200:0.0:1790964164.349273:0:32633:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964164.349286:0:32633:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964164.349295:0:32633:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6abff1a801080 00000400:00000200:0.0:1790964164.349302:0:32633:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0xaf5 [1] + 0 00000400:00000200:0.0:1790964164.349310:0:32633:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964164.349313:0:32633:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964164.349319:0:32633:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964164.349325:0:32633:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964179 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964164.349334:0:32633:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964179 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964164.349392:0:32633:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964164.349402:0:32633:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000005c0bc177 00000400:00000010:0.0:1790964164.349404:0:32633:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000005c0bc177. 00000100:00000001:0.0:1790964164.349408:0:32633:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964164.349410:0:32633:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964164.349416:0:32633:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964164.349419:0:32633:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000646c7348 refcount 16 to 0@lo 00000100:00000001:0.0:1790964164.349420:0:32633:0:(niobuf.c:837:ptlrpc_send_error()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964164.349422:0:32633:0:(tgt_handler.c:789:tgt_request_handle()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000040:0.0:1790964164.349428:0:32633:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000003c6622c x1877962009874560/t0(0) o38->@:0/0 lens 520/224 e 0 to 0 dl 1790964184 ref 1 fl Interpret:/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964164.349436:0:32633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003c6622c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31780:x1877962009874560:12345-0@lo:38: Request processed in 56849us (59268us total) trans 0 rc -19/-19 00000020:00000010:0.0:1790964164.349447:0:32633:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000adc5b232. 00000100:00100000:0.0:1790964164.349454:0:32633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964164.349458:0:32633:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964164.349459:0:32633:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964164.349465:0:32633:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000003abbecd5. 00000020:00000010:0.0:1790964164.349469:0:32633:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000036bd8196. 00000020:00000010:0.0:1790964164.349472:0:32633:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a077ee2d. 00000100:00000001:0.0:1790964164.349475:0:32633:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.351245:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964164.351253:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1790964164.351261:0:31780:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964164.351263:0:31780:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964164.351266:0:31780:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000003167431. 00000400:00000200:2.0:1790964164.351272:0:31780:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000036da9d25 00000400:00000010:2.0:1790964164.351274:0:31780:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000036da9d25. 00000100:00000001:2.0:1790964164.351278:0:31780:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964164.351286:0:31780:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964179 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964164.351295:0:31780:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964179 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964164.351302:0:31780:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964164.351318:0:31780:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.351321:0:31780:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964164.351324:0:31780:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964164.351326:0:31780:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964164.351328:0:31780:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964164.351331:0:31780:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964164.351340:0:31780:0:(import.c:2195:obd_at_measure()) add 0 to 00000000a92a210c time=1790964164 v=5 (0 0 0 0) 00000100:00001000:2.0:1790964164.351343:0:31780:0:(import.c:2195:obd_at_measure()) add 1 to 000000007d090ef0 time=10 v=10 (10 0 0 0) 00000100:00000001:2.0:1790964164.351346:0:31780:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964164.351348:0:31780:0:(client.c:1506:ptlrpc_check_status()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:2.0:1790964164.351350:0:31780:0:(client.c:1712:after_reply()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:2.0:1790964164.351354:0:31780:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964179 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964164.351373:0:31780:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00000001:2.0:1790964164.351377:0:31780:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964164.351379:0:31780:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.351381:0:31780:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:2.0:1790964164.351383:0:31780:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00080000:2.0:1790964164.351387:0:31780:0:(import.c:65:import_set_state_nolock()) 0000000064ad1a4a lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964164.351391:0:31780:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00000001:2.0:1790964164.351394:0:31780:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:2.0:1790964164.351397:0:31780:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964179 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964164.351403:0:31780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d101bb28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31780:1877962009874560:0@lo:38: 00000100:00000001:2.0:1790964164.351407:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.351409:0:31780:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964164.351412:0:31780:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000d101bb28 x1877962009874560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964179 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964164.351418:0:31780:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964164.351420:0:31780:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964164.351422:0:31780:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003a74c544. 02000000:00000001:2.0:1790964164.351426:0:31780:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964164.351434:0:31780:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964164.351436:0:31780:0:(genops.c:1223:class_import_put()) import 0000000064ad1a4a refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000020:00000001:2.0:1790964164.351439:0:31780:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964164.351441:0:31780:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 0000000082153837. 02000000:00000001:2.0:1790964164.351444:0:31780:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964164.351446:0:31780:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964164.351447:0:31780:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000d101bb28. 00000100:00000001:2.0:1790964164.351451:0:31780:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964164.351452:0:31780:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.351454:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.351456:0:31780:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964164.351457:0:31780:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964164.351459:0:31780:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.351460:0:31780:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:3.0:1790964164.459032:0:33072:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964164.459049:0:33072:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964164.459054:0:33072:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964164.546508:0:32665:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964164.546516:0:32665:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964164.546517:0:32665:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964164.546522:0:32665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44e1d23 going to sleep for 0 seconds 00000100:00000001:2.0:1790964164.546527:0:32665:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964164.546530:0:32665:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.546533:0:32665:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964164.546535:0:32665:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964164.546538:0:32665:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) Debug log: 2680 lines, 2680 kept, 0 dropped, 0 bad.