00000020:01000004:2.0F:1790964472.724823:0:32586:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790964472.724836:0:32586:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790964472.726109:0:32586:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009b65eef9 00000080:02000400:2.0:1790964472.726123:0:32586:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1790964472.736322:0:32586:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790964472.736338:0:32586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0F:1790964472.736484:0:32586:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e39cd1be) 00000020:00000080:3.0:1790964472.736512:0:32586:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790964472.806430:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790964472.820109:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1790964472.821884:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1790964472.822213:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1790964472.822400:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 579: rc = 0 00100000:10000000:3.0:1790964472.823123:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1790964472.824464:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790964472.824568:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:3.0:1790964472.824683:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:3.0:1790964472.831200:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:3.0:1790964472.852450:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 770: rc = 0 00100000:10000000:3.0:1790964472.852565:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 770: rc = 0 00100000:10000000:2.0:1790964472.855927:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 396: rc = 0 00100000:10000000:2.0:1790964472.857934:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 396: rc = 0 00100000:10000000:2.0:1790964472.859185:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 396: rc = 0 00100000:10000000:2.0:1790964472.861101:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 396: rc = 0 00100000:10000000:2.0:1790964472.862969:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 396: rc = 0 00100000:10000000:2.0:1790964472.864462:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 396: rc = 0 00100000:10000000:2.0:1790964472.867047:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 396: rc = 0 00100000:10000000:2.0:1790964472.869360:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 396: rc = 0 00100000:10000000:2.0:1790964472.871085:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 396: rc = 0 00100000:10000000:2.0:1790964472.872476:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 396: rc = 0 00100000:10000000:2.0:1790964472.874102:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 396: rc = 0 00100000:10000000:2.0:1790964472.877263:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 396: rc = 0 00100000:10000000:2.0:1790964472.880530:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 789: rc = 0 00100000:10000000:2.0:1790964472.882101:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 789: rc = 0 00100000:10000000:3.0:1790964472.885785:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 789: rc = 0 00100000:10000000:3.0:1790964472.897974:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 789: rc = 0 00100000:10000000:3.0:1790964472.900096:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 789: rc = 0 00100000:10000000:3.0:1790964472.902968:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 789: rc = 0 00100000:10000000:3.0:1790964472.904476:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 789: rc = 0 00100000:10000000:2.0:1790964472.908290:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 789: rc = 0 00100000:10000000:2.0:1790964472.910106:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 789: rc = 0 00100000:10000000:2.0:1790964472.911931:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 789: rc = 0 00100000:10000000:2.0:1790964472.914183:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 789: rc = 0 00100000:10000000:2.0:1790964472.920446:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 789: rc = 0 00100000:10000000:1.0F:1790964472.928883:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 789: rc = 0 00100000:10000000:1.0:1790964472.931225:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 789: rc = 0 00100000:10000000:1.0:1790964472.934105:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 789: rc = 0 00100000:10000000:1.0:1790964472.935914:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 789: rc = 0 00100000:10000000:1.0:1790964472.937565:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 789: rc = 0 00100000:10000000:1.0:1790964472.939260:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 789: rc = 0 00100000:10000000:1.0:1790964472.941093:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 789: rc = 0 00100000:10000000:1.0:1790964472.946940:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 789: rc = 0 00100000:10000000:0.0F:1790964472.958574:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 789: rc = 0 00100000:10000000:0.0:1790964472.960928:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 789: rc = 0 00100000:10000000:0.0:1790964472.967850:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 789: rc = 0 00100000:10000000:0.0:1790964472.973837:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 789: rc = 0 00100000:10000000:0.0:1790964472.977803:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 789: rc = 0 00100000:10000000:0.0:1790964472.979252:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 789: rc = 0 00100000:10000000:1.0:1790964472.983872:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 789: rc = 0 00100000:10000000:2.0:1790964472.988619:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 789: rc = 0 00100000:10000000:2.0:1790964472.990596:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 789: rc = 0 00100000:10000000:2.0:1790964472.993760:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 789: rc = 0 00100000:10000000:2.0:1790964472.995819:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 789: rc = 0 00100000:10000000:2.0:1790964472.997510:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 789: rc = 0 00100000:10000000:2.0:1790964473.006230:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 404: rc = 0 00100000:10000000:2.0:1790964473.007905:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 404: rc = 0 00100000:10000000:1.0:1790964473.021022:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1790964473.023090:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:1.0:1790964473.026207:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1790964473.026376:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:1.0:1790964473.032127:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1790964473.032355:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:1.0:1790964473.040428:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1790964473.040613:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:1.0:1790964473.041850:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1790964473.041939:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:0.0:1790964473.044041:0:32586:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1790964473.044219:0:32586:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 775: rc = 0 00000020:00000080:0.0:1790964473.044504:0:32586:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790964473.044513:0:32586:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790964473.044523:0:32586:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x461a674dcbd7c56d 00000020:01000004:0.0:1790964473.044530:0:32586:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1790964473.044535:0:32586:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790964473.044539:0:32586:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b65eef9 from MGS 00000020:01000004:0.0:1790964473.044543:0:32586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790964473.044579:0:32586:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000be55669d) 00000020:00000080:0.0:1790964473.044592:0:32586:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790964473.044654:0:32586:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b65eef9 from MGS, refs=2 00080000:01000000:0.0:1790964473.044660:0:32586:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790964473.044665:0:32586:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x461a674dcbd7c57b 00000100:00100000:0.0:1790964473.044754:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790964473.044894:0:32586:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790964473.044900:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790964473.045466:0:32586:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790964473.045474:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790964473.046304:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964473.046456:0:32586:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790964473.046462:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790964473.047030:0:32586:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790964473.047037:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790964473.047351:0:32586:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790964473.047357:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790964473.050706:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964473.050712:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964473.050715:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964473.051107:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964473.051110:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790964473.051111:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964473.051629:0:32586:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790964473.063916:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1790964473.301413:0:32586:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2711 MB/s 00000001:01000000:1.0:1790964473.551059:0:32586:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2835 MB/s 00000001:01000000:0.0:1790964473.801511:0:32586:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 535 MB/s 00000001:01000000:0.0:1790964474.052518:0:32586:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 617 MB/s 00010000:00010000:3.0:1790964474.110643:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790964474.141814:0:32586:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1790964474.141838:0:32586:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790964474.141840:0:32586:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790964474.148249:0:32596:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790964474.148494:0:32586:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790964474.148642:0:32586:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790964474.149979:0:32586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790964474.151100:0:32586:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790964474.151584:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964474.153313:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790964474.153324:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790964474.158945:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790964474.158985:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790964474.160569:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790964474.160579:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790964474.161464:0:32586:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790964474.161485:0:32586:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.132@tcp' 00000020:01000004:1.0:1790964474.161487:0:32586:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790964474.161545:0:32586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.132@tcp (typ=mgc) 00000020:00000080:1.0:1790964474.161566:0:32586:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.132@tcp (00000000d09ecd37) 00000020:00000080:1.0:1790964474.161582:0:32586:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790964474.161699:0:32586:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e79a1a7f@MGC192.168.204.132@tcp: add connection 192.168.204.132@tcp at head 00000100:00080000:3.0:1790964474.161833:0:32601:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1790964474.162023:0:32586:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.132@tcp-0 is initialized 00000040:01000000:1.0:1790964474.162029:0:32586:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 1 is initialized 10000000:01000000:1.0:1790964474.169514:0:32602:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790964474.169613:0:32586:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.132@tcp (uuid f924b2d8-958e-436c-995a-bd5c559444c6) 00000020:00000080:0.0:1790964474.169639:0:32586:0:(genops.c:1385:class_connect()) connect: client f924b2d8-958e-436c-995a-bd5c559444c6, cookie 0x461a674dcbd7c589 00000100:00080000:0.0:1790964474.169651:0:32586:0:(import.c:545:import_select_connection()) MGC192.168.204.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790964474.169657:0:32586:0:(import.c:665:import_select_connection()) MGC192.168.204.132@tcp: import 00000000e79a1a7f using connection 192.168.204.132@tcp/0@lo 00000100:00100000:0.0:1790964474.169692:0:32586:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003e52c4a2 x1877962346463360/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790964474.169730:0:32586:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f924b2d8-958e-436c-995a-bd5c559444c6->MGS 00000020:01000004:0.0:1790964474.169756:0:32586:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790964474.169761:0:32586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790964474.169774:0:32586:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fb61733b) 00000020:00000080:0.0:1790964474.169786:0:32586:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790964474.171101:0:31768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e52c4a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f924b2d8-958e-436c-995a-bd5c559444c6:31768:1877962346463360:0@lo:250: 00000100:00100000:1.0:1790964474.171215:0:31768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964474.171379:0:32598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346463360 00000100:00100000:1.0:1790964474.171388:0:32598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346463360 00000100:00100000:1.0:1790964474.171419:0:32598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964474.171426:0:32598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c05fd8ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:31768:x1877962346463360:12345-0@lo:250: 00010000:00080000:1.0:1790964474.171454:0:32598:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f924b2d8-958e-436c-995a-bd5c559444c6@0@lo t0 exp 0000000000000000 cur 936 last 0 00000020:00000080:1.0:1790964474.171483:0:32598:0:(genops.c:1385:class_connect()) connect: client f924b2d8-958e-436c-995a-bd5c559444c6, cookie 0x461a674dcbd7c597 00000100:00080000:1.0:1790964474.171651:0:32598:0:(import.c:65:import_set_state_nolock()) 000000009bbb5e68 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790964474.171711:0:32598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c05fd8ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+5:31768:x1877962346463360:12345-0@lo:250: Request processed in 284us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.171718:0:32598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964474.171778:0:31768:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790964474.171787:0:31768:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.132@tcp: connect to target with instance 0 00000100:00080000:1.0:1790964474.171795:0:31768:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790964474.171799:0:31768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790964474.171802:0:31768:0:(import.c:65:import_set_state_nolock()) 00000000e79a1a7f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790964474.171805:0:31768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790964474.171813:0:31768:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790964474.171818:0:31768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e52c4a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f924b2d8-958e-436c-995a-bd5c559444c6:31768:1877962346463360:0@lo:250: 00000100:00100000:0.0:1790964474.192561:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964474.193880:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790964474.193889:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790964474.225517:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790964474.225549:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790964474.225942:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790964474.225977:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790964474.226844:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964474.227087:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790964474.227093:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790964474.232020:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790964474.232034:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790964474.290085:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964474.290315:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790964474.290323:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790964474.302351:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790964474.303352:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790964474.304839:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964474.309271:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790964474.309283:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790964474.312816:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790964474.312837:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790964474.318706:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790964474.318915:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790964474.318922:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790964474.324838:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790964474.324862:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790964474.325585:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964474.325783:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790964474.325789:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790964474.326505:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790964474.326513:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790964474.361497:0:32586:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964474.361791:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790964474.361798:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790964474.365850:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790964474.365865:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790964474.368448:0:32586:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790964474.368471:0:32586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790964474.369889:0:32586:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790964474.369915:0:32586:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1790964474.369922:0:32586:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790964474.370085:0:32586:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790964474.370119:0:32586:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.132@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790964474.370123:0:32586:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790964474.370125:0:32586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964474.370126:0:32586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964474.370127:0:32586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964474.370129:0:32586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964474.370130:0:32586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964474.370131:0:32586:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964474.370132:0:32586:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964474.370133:0:32586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964474.370134:0:32586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790964474.370136:0:32586:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790964474.370138:0:32586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790964474.370138:0:32586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964474.370139:0:32586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964474.370140:0:32586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964474.370141:0:32586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964474.370142:0:32586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964474.370143:0:32586:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964474.370144:0:32586:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964474.370148:0:32586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964474.370149:0:32586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790964474.370177:0:32586:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790964474.370195:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026a22c40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463488:0@lo:253: 00000100:00100000:1.0:1790964474.370284:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964474.370348:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd406557 going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.370853:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346463488 00000100:00100000:3.0:1790964474.370864:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346463488 00000100:00100000:3.0:1790964474.370917:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790964474.370925:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff1357e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+5:32586:x1877962346463488:12345-0@lo:253: 20000000:01000000:3.0:1790964474.370996:0:32600:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790964474.370999:0:32600:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790964474.371002:0:32600:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790964474.373877:0:32620:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790964474.375896:0:32600:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1790964474.390102:0:32622:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790964474.390112:0:32622:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790964474.390115:0:32622:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 00000040:00080000:1.0:1790964474.390182:0:32622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 20000000:01000000:3.0:1790964474.390918:0:32600:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790964474.390929:0:32600:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790964474.478902:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff1357e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+5:32586:x1877962346463488:12345-0@lo:253: Request processed in 107968us (108610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964474.478941:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790964474.479175:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026a22c40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463488:0@lo:253: 10000000:01000000:1.0:1790964474.479192:0:32586:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790964474.479195:0:32586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790964474.479197:0:32586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964474.479198:0:32586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964474.479199:0:32586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964474.479200:0:32586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964474.479201:0:32586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964474.479203:0:32586:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964474.479204:0:32586:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964474.479206:0:32586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964474.479207:0:32586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790964474.479233:0:32586:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b65eef9 from lustre-MDT0000 10000000:01000000:1.0:1790964474.479260:0:32586:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790964474.479263:0:32586:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790964474.479268:0:32586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff957e76c54d40 10000000:01000000:1.0:1790964474.479274:0:32586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790964474.479283:0:32586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff957e76c54d40 from 1 10000000:01000000:1.0:1790964474.479286:0:32586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790964474.479320:0:32586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 000000007eca952f/0x461a674dcbd7c59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.479330:0:32586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 000000007eca952f/0x461a674dcbd7c59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.479345:0:32586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 000000007eca952f/0x461a674dcbd7c59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964474.479363:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026a22c40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463616:0@lo:101: 00000100:00100000:1.0:1790964474.479400:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964474.479468:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd98bfaf going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.482131:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346463616 00000100:00100000:3.0:1790964474.482146:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346463616 00000100:00100000:3.0:1790964474.482220:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790964474.482229:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0afadd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+5:32586:x1877962346463616:12345-0@lo:101: 00010000:00010000:3.0:1790964474.482247:0:32599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964474.482270:0:32599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d981cd16/0x461a674dcbd7c5a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x461a674dcbd7c59e expref: -99 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.482296:0:32599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d981cd16/0x461a674dcbd7c5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x461a674dcbd7c59e expref: 6 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.482307:0:32599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d981cd16/0x461a674dcbd7c5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c59e expref: 6 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.482334:0:32599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d981cd16, rc 0) 00000100:00100000:3.0:1790964474.482405:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0afadd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+6:32586:x1877962346463616:12345-0@lo:101: Request processed in 177us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964474.482411:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790964474.484038:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026a22c40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463616:0@lo:101: 00010000:00010000:2.0:1790964474.484063:0:32586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 000000007eca952f/0x461a674dcbd7c59e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5a5 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964474.484074:0:32586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 000000007eca952f/0x461a674dcbd7c59e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x461a674dcbd7c5a5 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964474.484225:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce7e11fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463744:0@lo:501: 00000100:00100000:2.0:1790964474.484278:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964474.484327:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ff9a426 going to sleep for 11 seconds 00000100:00100000:0.0:1790964474.484432:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346463744 00000100:00100000:0.0:1790964474.484438:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346463744 00000100:00100000:0.0:1790964474.484483:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790964474.484493:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005645f831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+6:32586:x1877962346463744:12345-0@lo:501: 00000100:00100000:0.0:1790964474.485665:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005645f831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+6:32586:x1877962346463744:12345-0@lo:501: Request processed in 1168us (1382us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790964474.485678:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790964474.487666:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce7e11fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463744:0@lo:501: 10000000:01000000:1.0:1790964474.487717:0:32586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790964474.487742:0:32586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 000000007eca952f/0x461a674dcbd7c59e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5a5 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.487753:0:32586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 000000007eca952f/0x461a674dcbd7c59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5a5 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964474.487764:0:32586:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff957e7ce43000 10000000:01000000:1.0:1790964474.487771:0:32586:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790964474.487775:0:32586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff957e7ce43000 10000000:01000000:1.0:1790964474.487778:0:32586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790964474.487781:0:32586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff957e7ce43000 from 1 10000000:01000000:1.0:1790964474.487784:0:32586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790964474.487817:0:32586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 0000000055674a0b/0x461a674dcbd7c5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.487825:0:32586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 0000000055674a0b/0x461a674dcbd7c5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.487835:0:32586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 0000000055674a0b/0x461a674dcbd7c5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.488323:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e2767a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463872:0@lo:101: 00000100:00100000:0.0:1790964474.488387:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.488495:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000822b6cde going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.488681:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346463872 00000100:00100000:3.0:1790964474.488689:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346463872 00000100:00100000:3.0:1790964474.488735:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790964474.488742:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000980c5b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+6:32586:x1877962346463872:12345-0@lo:101: 00010000:00010000:3.0:1790964474.488755:0:32599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964474.488769:0:32599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040c46148/0x461a674dcbd7c5b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x461a674dcbd7c5ac expref: -99 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.488790:0:32599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040c46148/0x461a674dcbd7c5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x461a674dcbd7c5ac expref: 7 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.488798:0:32599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040c46148/0x461a674dcbd7c5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c5ac expref: 7 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.488807:0:32599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040c46148, rc 0) 00000100:00100000:3.0:1790964474.489169:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000980c5b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+7:32586:x1877962346463872:12345-0@lo:101: Request processed in 426us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964474.489177:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790964474.489351:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e2767a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346463872:0@lo:101: 00010000:00010000:0.0:1790964474.489368:0:32586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 0000000055674a0b/0x461a674dcbd7c5ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5b3 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.489377:0:32586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 0000000055674a0b/0x461a674dcbd7c5ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x461a674dcbd7c5b3 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790964474.489392:0:32586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790964474.489410:0:32586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 0000000055674a0b/0x461a674dcbd7c5ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5b3 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.489417:0:32586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 0000000055674a0b/0x461a674dcbd7c5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5b3 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790964474.489424:0:32586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790964474.489429:0:32586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790964474.489447:0:32586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff957e7ce43000 10000000:01000000:0.0:1790964474.489450:0:32586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790964474.489453:0:32586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790964474.489455:0:32586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790964474.489559:0:32586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 000000000196d954/0x461a674dcbd7c5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.489567:0:32586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 000000000196d954/0x461a674dcbd7c5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.489575:0:32586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 000000000196d954/0x461a674dcbd7c5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.489657:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464000:0@lo:101: 00000100:00100000:0.0:1790964474.493808:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.493985:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000822b6cde going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.494221:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346464000 00000100:00100000:1.0:1790964474.494230:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346464000 00000100:00100000:1.0:1790964474.494319:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790964474.494328:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a21b9ccd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+7:32586:x1877962346464000:12345-0@lo:101: 00010000:00010000:1.0:1790964474.494344:0:32600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964474.494375:0:32600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca77b27e/0x461a674dcbd7c5c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x461a674dcbd7c5ba expref: -99 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.494406:0:32600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca77b27e/0x461a674dcbd7c5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x461a674dcbd7c5ba expref: 8 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.494416:0:32600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca77b27e/0x461a674dcbd7c5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c5ba expref: 8 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.494426:0:32600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca77b27e, rc 0) 00000100:00100000:1.0:1790964474.494496:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a21b9ccd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+8:32586:x1877962346464000:12345-0@lo:101: Request processed in 169us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.494503:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790964474.494735:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464000:0@lo:101: 00010000:00010000:0.0:1790964474.494755:0:32586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 000000000196d954/0x461a674dcbd7c5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5c1 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.494765:0:32586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 000000000196d954/0x461a674dcbd7c5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x461a674dcbd7c5c1 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.494835:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464128:0@lo:501: 00000100:00100000:0.0:1790964474.494869:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.496265:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000822b6cde going to sleep for 11 seconds 00000100:00100000:2.0:1790964474.496422:0:32598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346464128 00000100:00100000:2.0:1790964474.496431:0:32598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346464128 00000100:00100000:2.0:1790964474.496495:0:32598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790964474.496503:0:32598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b91bab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+8:32586:x1877962346464128:12345-0@lo:501: 00000100:00100000:2.0:1790964474.496990:0:32598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b91bab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+9:32586:x1877962346464128:12345-0@lo:501: Request processed in 488us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964474.497000:0:32598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790964474.497223:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464128:0@lo:501: 00000100:00100000:0.0:1790964474.497272:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464256:0@lo:503: 00000100:00100000:0.0:1790964474.497324:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964474.497525:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000822b6cde going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.497568:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346464256 00000100:00100000:3.0:1790964474.497574:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346464256 00000100:00100000:3.0:1790964474.497646:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790964474.497653:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f47a4c85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+9:32586:x1877962346464256:12345-0@lo:503: 00000100:00100000:3.0:1790964474.501259:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f47a4c85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+9:32586:x1877962346464256:12345-0@lo:503: Request processed in 3598us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964474.501285:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790964474.501413:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464256:0@lo:503: 00000100:00100000:0.0:1790964474.501897:0:32625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32625:1877962346464384:0@lo:502: 00000100:00100000:0.0:1790964474.502091:0:32625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.502283:0:32625:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9986190 going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.502325:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346464384 00000100:00100000:1.0:1790964474.502332:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346464384 00000100:00100000:1.0:1790964474.502369:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790964474.502377:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000884b25d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+9:32625:x1877962346464384:12345-0@lo:502: 00000100:00100000:0.0:1790964474.506885:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000884b25d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+9:32625:x1877962346464384:12345-0@lo:502: Request processed in 4501us (4786us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964474.506902:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790964474.507192:0:32625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f382e21 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32625:1877962346464384:0@lo:502: 00000020:01000000:3.0:1790964474.507232:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964474.507243:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.507245:0:32625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790964474.507252:0:32625:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790964474.507255:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964474.507266:0:32625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ec34f351) 00000020:00000080:3.0:1790964474.507284:0:32625:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790964474.507289:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790964474.507363:0:32625:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790964474.507371:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x461a674dcbd7c5cf 00000020:00000080:3.0:1790964474.507628:0:32625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790964474.507633:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964474.507637:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.507638:0:32625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790964474.507641:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964474.507645:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.507646:0:32625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790964474.507649:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964474.507656:0:32625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006894f514) 00000020:00000080:3.0:1790964474.507665:0:32625:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790964474.507669:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790964474.507671:0:32625:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790964474.507673:0:32625:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790964474.507679:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790964474.507717:0:32625:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b65eef9 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790964474.507728:0:32625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000011ee7788) 00000020:00000080:3.0:1790964474.507735:0:32625:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790964474.507791:0:32625:0:(lod_dev.c:2309:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790964474.507797:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x461a674dcbd7c5e4 00000020:00000080:3.0:1790964474.507893:0:32625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790964474.507899:0:32625:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790964474.507903:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x461a674dcbd7c5eb 00080000:01000000:3.0:1790964474.507908:0:32625:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790964474.507911:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x461a674dcbd7c5f2 00010000:00010000:2.0:1790964474.607729:0:32625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790964474.609809:0:32625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934593 00000001:00080000:2.0:1790964474.610617:0:32625:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790964474.611572:0:32625:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000098d08fbf) 00000020:00000080:2.0:1790964474.611594:0:32625:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790964474.611699:0:32625:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790964474.611708:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x461a674dcbd7c600 00000020:00000080:2.0:1790964474.613361:0:32625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790964474.626222:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x461a674dcbd7c607 00000020:00000080:3.0:1790964474.627267:0:32625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790964474.627280:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964474.627287:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.627290:0:32625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790964474.627293:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964474.627300:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.627301:0:32625:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790964474.627305:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790964474.627342:0:32625:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790964474.628052:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964474.628060:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.628061:0:32625:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790964474.628065:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790964474.628067:0:32625:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1790964474.628069:0:32625:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964474.628070:0:32625:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964474.628072:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790964474.628074:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.628075:0:32625:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790964474.628077:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790964474.628080:0:32625:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790964474.628084:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964474.628085:0:32625:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790964474.628088:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790964474.628093:0:32625:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.132@tcp to nid 0x20000c0a8cc84 (192.168.204.132@tcp) 00000020:01000000:3.0:1790964474.628118:0:32625:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790964474.628121:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964474.628158:0:32625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (000000004e499a29) 00000020:00000080:3.0:1790964474.628176:0:32625:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790964474.628182:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790964474.628240:0:32625:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790964474.628246:0:32625:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790964474.628251:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x461a674dcbd7c615 00010000:00080000:3.0:1790964474.628282:0:32625:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cceab2ac@lustre-OST0000-osc-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:3.0:1790964474.628808:0:32625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790964474.630234:0:32625:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790964474.630285:0:32625:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790964474.635473:0:32625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790964474.636753:0:32625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790964474.636843:0:32625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790964474.638089:0:32629:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790964474.638095:0:32629:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790964474.640266:0:32625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790964474.640280:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790964474.640317:0:32625:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790964474.640333:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x461a674dcbd7c61c 00000100:00080000:0.0:1790964474.640344:0:32625:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790964474.640349:0:32625:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000cceab2ac using connection 192.168.204.132@tcp/0@lo 00000100:00100000:0.0:1790964474.640385:0:32625:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790964474.640412:0:32625:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1790964474.640683:0:31768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001db2de9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31768:1877962346464512:0@lo:8: 00000400:00000100:1.0:1790964474.640745:0:31768:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877962346464512 offset 0 length 520: 4 00000020:01000000:0.0:1790964474.640860:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790964474.640864:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964474.640866:0:32625:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790964474.640869:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790964474.640871:0:32625:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790964474.640873:0:32625:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790964474.640874:0:32625:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790964474.640875:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790964474.640877:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964474.640886:0:32625:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790964474.640889:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790964474.640893:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790964474.640894:0:32625:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1790964474.640897:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790964474.640901:0:32625:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.132@tcp to nid 0x20000c0a8cc84 (192.168.204.132@tcp) 00000020:00000080:0.0:1790964474.640923:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790964474.640933:0:32625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001887c345) 00000020:00000080:0.0:1790964474.640966:0:32625:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1790964474.640973:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790964474.641059:0:32625:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1790964474.641065:0:32625:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790964474.641071:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x461a674dcbd7c62a 00010000:00080000:0.0:1790964474.641125:0:32625:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000efe04c75@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:0.0:1790964474.642806:0:32625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:1.0:1790964474.646016:0:32625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790964474.646032:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790964474.646064:0:32625:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790964474.646091:0:32625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x461a674dcbd7c631 00000100:00080000:1.0:1790964474.646101:0:32625:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964474.646238:0:32625:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000efe04c75 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1790964474.646274:0:32625:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000c39d035 x1877962346464640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790964474.646297:0:32625:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1790964474.646355:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964474.646375:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964474.646377:0:32625:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790964474.646381:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790964474.646558:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964474.646561:0:32625:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790964474.646566:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790964474.646568:0:32625:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 00000100:00100000:1.0:1790964474.646597:0:32625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32625:1877962346464768:0@lo:502: 00000100:00100000:1.0:1790964474.646677:0:32625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964474.646723:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346464768 00000100:00100000:1.0:1790964474.646730:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346464768 00000100:00100000:1.0:1790964474.646771:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790964474.646779:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d1ab1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+9:32625:x1877962346464768:12345-0@lo:502: 00000100:00100000:3.0:1790964474.647259:0:31768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c39d035 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31768:1877962346464640:0@lo:38: 00000100:00100000:3.0:1790964474.647303:0:31768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964474.647374:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346464640 00000100:00100000:3.0:1790964474.647379:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346464640 00000100:00100000:3.0:1790964474.647403:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964474.647408:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c6e497b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31768:x1877962346464640:12345-0@lo:38: 00010000:00020000:3.0:1790964474.647422:0:32609:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790964474.647463:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c6e497b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31768:x1877962346464640:12345-0@lo:38: Request processed in 55us (160us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790964474.647484:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790964474.647528:0:31768:0:(import.c:65:import_set_state_nolock()) 00000000efe04c75 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790964474.647539:0:31768:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790964474.647542:0:31768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c39d035 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31768:1877962346464640:0@lo:38: 00000100:00100000:1.0:1790964474.647883:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d1ab1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+9:32625:x1877962346464768:12345-0@lo:502: Request processed in 1104us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.647892:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790964474.647970:0:32625:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eabe833b going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.647984:0:32625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32625:1877962346464768:0@lo:502: 00000020:01000000:1.0:1790964474.648296:0:32625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964474.648303:0:32625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964474.648305:0:32625:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790964474.648309:0:32625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1790964474.648635:0:32586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:0.0:1790964474.648654:0:32586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790964474.648671:0:32586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 000000000196d954/0x461a674dcbd7c5ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5c1 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.648682:0:32586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 000000000196d954/0x461a674dcbd7c5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c5c1 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790964474.648691:0:32586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff957e7ce43000 from 1 10000000:01000000:0.0:1790964474.648693:0:32586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790964474.648724:0:32586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.648731:0:32586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.648740:0:32586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.648765:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464896:0@lo:101: 00000100:00100000:0.0:1790964474.648807:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.648837:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed48bd4d going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.648977:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346464896 00000100:00100000:3.0:1790964474.648983:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346464896 00000100:00100000:3.0:1790964474.649312:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790964474.649320:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d0568e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+9:32586:x1877962346464896:12345-0@lo:101: 00010000:00010000:3.0:1790964474.649333:0:32600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964474.649354:0:32600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x461a674dcbd7c638 expref: -99 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.649377:0:32600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 10 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.649387:0:32600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 10 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.649396:0:32600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042ef35b7, rc 0) 00000100:00100000:3.0:1790964474.649441:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d0568e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+10:32586:x1877962346464896:12345-0@lo:101: Request processed in 122us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964474.649447:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790964474.649606:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346464896:0@lo:101: 00010000:00010000:0.0:1790964474.649620:0:32586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.649629:0:32586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.650710:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465024:0@lo:256: 00000100:00100000:0.0:1790964474.650781:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.650863:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed48bd4d going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.651375:0:32598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465024 00000100:00100000:1.0:1790964474.651383:0:32598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465024 00000100:00100000:1.0:1790964474.651457:0:32598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790964474.651466:0:32598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095979e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+10:32586:x1877962346465024:12345-0@lo:256: 20000000:01000000:1.0:1790964474.651495:0:32598:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790964474.651501:0:32598:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790964474.651599:0:32598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095979e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+10:32586:x1877962346465024:12345-0@lo:256: Request processed in 135us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.651606:0:32598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790964474.651679:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465024:0@lo:256: 10000000:01000000:0.0:1790964474.652491:0:32586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790964474.652522:0:32586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.652532:0:32586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790964474.652540:0:32586:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff957e7ce43000 from 1 10000000:01000000:0.0:1790964474.652543:0:32586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790964474.652573:0:32586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000da78dc27/0x461a674dcbd7c646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.652579:0:32586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000da78dc27/0x461a674dcbd7c646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.652601:0:32586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000da78dc27/0x461a674dcbd7c646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.652617:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465152:0@lo:101: 00000100:00100000:0.0:1790964474.652659:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.653409:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed48bd4d going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.653559:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465152 00000100:00100000:3.0:1790964474.653567:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465152 00000100:00100000:2.0:1790964474.653727:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790964474.653736:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc52881a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+10:32586:x1877962346465152:12345-0@lo:101: 00010000:00010000:2.0:1790964474.653751:0:32600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790964474.653768:0:32600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eafde62e/0x461a674dcbd7c64d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x461a674dcbd7c646 expref: -99 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964474.653791:0:32600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eafde62e/0x461a674dcbd7c64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x461a674dcbd7c646 expref: 11 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964474.653801:0:32600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eafde62e/0x461a674dcbd7c64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c646 expref: 11 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964474.653810:0:32600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eafde62e, rc 0) 00000100:00100000:2.0:1790964474.653862:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc52881a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+11:32586:x1877962346465152:12345-0@lo:101: Request processed in 126us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964474.653868:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790964474.653972:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465152:0@lo:101: 00010000:00010000:0.0:1790964474.653987:0:32586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000da78dc27/0x461a674dcbd7c646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c64d expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.654006:0:32586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000da78dc27/0x461a674dcbd7c646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x461a674dcbd7c64d expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.654066:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465280:0@lo:501: 00000100:00100000:0.0:1790964474.654094:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.654623:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed48bd4d going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.654672:0:32598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465280 00000100:00100000:1.0:1790964474.654678:0:32598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465280 00000100:00100000:3.0:1790964474.654722:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790964474.654732:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006c884f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+11:32586:x1877962346465280:12345-0@lo:501: 00000100:00100000:3.0:1790964474.655221:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006c884f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+11:32586:x1877962346465280:12345-0@lo:501: Request processed in 491us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964474.655229:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790964474.655661:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465280:0@lo:501: 00000100:00100000:0.0:1790964474.655709:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465408:0@lo:503: 00000100:00100000:0.0:1790964474.655760:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.655792:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed48bd4d going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.655855:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465408 00000100:00100000:3.0:1790964474.655860:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465408 00000100:00100000:3.0:1790964474.655885:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790964474.655891:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d180774a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+11:32586:x1877962346465408:12345-0@lo:503: 00000040:00080000:0.0:1790964474.656297:0:32599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790964474.656343:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d180774a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+11:32586:x1877962346465408:12345-0@lo:503: Request processed in 452us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964474.656350:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790964474.656393:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465408:0@lo:503: 00000040:00080000:3.0:1790964474.657866:0:32633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790964474.658662:0:32586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790964474.658687:0:32586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790964474.658708:0:32586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 00000000da78dc27/0x461a674dcbd7c646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c64d expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.658721:0:32586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 00000000da78dc27/0x461a674dcbd7c646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c64d expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790964474.658773:0:32586:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790964474.658776:0:32586:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff957e7ce43000 10000000:01000000:0.0:1790964474.658780:0:32586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff957e7ce43000 10000000:01000000:0.0:1790964474.658784:0:32586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790964474.658790:0:32586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff957e7ce43000 from 1 10000000:01000000:0.0:1790964474.658794:0:32586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790964474.658832:0:32586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000becce32d/0x461a674dcbd7c654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.658840:0:32586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000becce32d/0x461a674dcbd7c654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.658849:0:32586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000becce32d/0x461a674dcbd7c654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.658872:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465536:0@lo:101: 00000100:00100000:0.0:1790964474.659259:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964474.659367:0:32598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465536 00000100:00100000:1.0:1790964474.659375:0:32598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465536 00000100:00100000:0.0:1790964474.659452:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef8a16a6 going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.659602:0:32598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790964474.659611:0:32598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3cd1e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+11:32586:x1877962346465536:12345-0@lo:101: 00010000:00010000:1.0:1790964474.659625:0:32598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964474.659639:0:32598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b729b7a8/0x461a674dcbd7c65b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x461a674dcbd7c654 expref: -99 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.659663:0:32598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b729b7a8/0x461a674dcbd7c65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x461a674dcbd7c654 expref: 12 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.659673:0:32598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b729b7a8/0x461a674dcbd7c65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c654 expref: 12 pid: 32598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.659681:0:32598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b729b7a8, rc 0) 00000100:00100000:1.0:1790964474.659773:0:32598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3cd1e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+12:32586:x1877962346465536:12345-0@lo:101: Request processed in 163us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.659780:0:32598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790964474.659788:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3cb9111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465536:0@lo:101: 00010000:00010000:2.0:1790964474.659801:0:32586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000becce32d/0x461a674dcbd7c654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c65b expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964474.659819:0:32586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000becce32d/0x461a674dcbd7c654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x461a674dcbd7c65b expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964474.659875:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465664:0@lo:501: 00000100:00100000:2.0:1790964474.659996:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964474.660300:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465664 00000100:00100000:3.0:1790964474.660306:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465664 00000100:00100000:2.0:1790964474.660312:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb028f74 going to sleep for 11 seconds 00000100:00100000:3.0:1790964474.660342:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790964474.660348:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc6919e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+12:32586:x1877962346465664:12345-0@lo:501: 00000100:00100000:3.0:1790964474.660784:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc6919e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+12:32586:x1877962346465664:12345-0@lo:501: Request processed in 435us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964474.660792:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790964474.660869:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465664:0@lo:501: 00000100:00100000:2.0:1790964474.661734:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465792:0@lo:503: 00000100:00100000:0.0:1790964474.661876:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964474.662193:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb028f74 going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.662403:0:32598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465792 00000100:00100000:1.0:1790964474.662410:0:32598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465792 00000100:00100000:1.0:1790964474.662566:0:32598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790964474.662576:0:32598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f3790f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+12:32586:x1877962346465792:12345-0@lo:503: 00000100:00100000:1.0:1790964474.662801:0:32598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f3790f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+12:32586:x1877962346465792:12345-0@lo:503: Request processed in 226us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.662809:0:32598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790964474.662883:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346465792:0@lo:503: 00000100:00100000:2.0:1790964474.663552:0:32634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32634:1877962346465920:0@lo:502: 00000100:00100000:2.0:1790964474.663601:0:32634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964474.663817:0:32634:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0f29132 going to sleep for 11 seconds 00000100:00100000:0.0:1790964474.663886:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346465920 00000100:00100000:0.0:1790964474.663893:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346465920 00000100:00100000:0.0:1790964474.663939:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790964474.663968:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097607ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+12:32634:x1877962346465920:12345-0@lo:502: 00000100:00100000:0.0:1790964474.664414:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097607ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+12:32634:x1877962346465920:12345-0@lo:502: Request processed in 467us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964474.664423:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790964474.664577:0:32634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32634:1877962346465920:0@lo:502: 00000020:01000004:2.0:1790964474.664638:0:32634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790964474.664652:0:32634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f4181af4) 00000020:00000080:2.0:1790964474.664672:0:32634:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790964474.664767:0:32634:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b65eef9 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790964474.664772:0:32634:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009b65eef9 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790964474.664774:0:32634:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009b65eef9 4 00010000:00080000:2.0:1790964474.664801:0:32634:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000d56375e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:2.0:1790964474.666807:0:32634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790964474.669678:0:32634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790964474.669717:0:32634:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790964474.669731:0:32634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x461a674dcbd7c669 00000100:00080000:2.0:1790964474.669742:0:32634:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790964474.669754:0:32634:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000d56375e using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1790964474.669787:0:32634:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000062c030b9 x1877962346466048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790964474.669822:0:31768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31768:1877962346466048:0@lo:38: 00000100:00100000:2.0:1790964474.669885:0:31768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790964474.669941:0:32634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790964474.670290:0:32604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346466048 00000100:00100000:1.0:1790964474.670299:0:32604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346466048 00000100:00100000:1.0:1790964474.670337:0:32604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964474.670344:0:32604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054a9039a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31768:x1877962346466048:12345-0@lo:38: 00000100:00100000:1.0:1790964474.670404:0:32604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054a9039a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31768:x1877962346466048:12345-0@lo:38: Request processed in 59us (519us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790964474.670411:0:32604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790964474.670568:0:31768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790964474.670575:0:31768:0:(import.c:65:import_set_state_nolock()) 000000000d56375e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964474.670578:0:31768:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790964474.670581:0:31768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31768:1877962346466048:0@lo:38: 00000100:00100000:2.0:1790964474.670675:0:32634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32634:1877962346466176:0@lo:502: 00000100:00100000:2.0:1790964474.670719:0:32634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964474.670744:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346466176 00000100:00100000:2.0:1790964474.670747:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346466176 00000100:00100000:2.0:1790964474.670773:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790964474.670779:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008be7577c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+12:32634:x1877962346466176:12345-0@lo:502: 00000100:00100000:2.0:1790964474.671255:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008be7577c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+12:32634:x1877962346466176:12345-0@lo:502: Request processed in 475us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964474.671263:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790964474.671308:0:32634:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ff9a426 going to sleep for 11 seconds 00000100:00100000:2.0:1790964474.671321:0:32634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f924b2d8-958e-436c-995a-bd5c559444c6:32634:1877962346466176:0@lo:502: 00000040:00080000:2.0:1790964474.671340:0:32634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790964474.674282:0:32586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1790964474.674323:0:32586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790964474.674340:0:32586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 00000000becce32d/0x461a674dcbd7c654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c65b expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.674353:0:32586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 00000000becce32d/0x461a674dcbd7c654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c65b expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790964474.674411:0:32586:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790964474.674414:0:32586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964474.674415:0:32586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964474.674416:0:32586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964474.674417:0:32586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964474.674419:0:32586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964474.674420:0:32586:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964474.674421:0:32586:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964474.674423:0:32586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964474.674424:0:32586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790964474.674433:0:32586:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790964474.674435:0:32586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790964474.674436:0:32586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964474.674437:0:32586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964474.674438:0:32586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964474.674439:0:32586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964474.674440:0:32586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964474.674440:0:32586:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964474.674441:0:32586:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964474.674442:0:32586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964474.674443:0:32586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790964474.674608:0:32586:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790964474.674627:0:32586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346466304:0@lo:253: 00000100:00100000:1.0:1790964474.674694:0:32586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964474.674739:0:32586:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed3c26a3 going to sleep for 11 seconds 00000100:00100000:0.0:1790964474.674788:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346466304 00000100:00100000:0.0:1790964474.674795:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346466304 00000100:00100000:0.0:1790964474.674842:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790964474.674849:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b614610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+12:32586:x1877962346466304:12345-0@lo:253: 20000000:01000000:0.0:1790964474.674872:0:32599:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790964474.674884:0:32599:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790964474.740536:0:32599:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790964474.740552:0:32599:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790964474.740702:0:32620:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790964474.740707:0:32620:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790964474.740728:0:32620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.740746:0:32620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 12 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.740754:0:32620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.740796:0:32620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 12 pid: 32600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964474.740811:0:32620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 12 pid: 32600 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964474.740823:0:32620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000243892b5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32620:1877962346466432:0@lo:104: 00000100:00100000:3.0:1790964474.740998:0:32620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964474.741056:0:32620:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5aa91bd going to sleep for 11 seconds 00000100:00100000:1.0:1790964474.741140:0:32587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346466432 00000100:00100000:1.0:1790964474.741149:0:32587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346466432 00000100:00100000:1.0:1790964474.741203:0:32587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964474.741212:0:32587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb0aa66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f924b2d8-958e-436c-995a-bd5c559444c6+3:32620:x1877962346466432:12345-0@lo:104: 00010000:00010000:1.0:1790964474.741226:0:32587:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741282:0:32587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790964474.741288:0:32587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb0aa66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f924b2d8-958e-436c-995a-bd5c559444c6+3:32620:x1877962346466432:12345-0@lo:104: Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.741295:0:32587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790964474.741314:0:32592:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790964474.741319:0:32592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741325:0:32592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f3bdee1e already unused, calling callback (00000000ceca24a0) 10000000:00010000:1.0:1790964474.741328:0:32592:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741361:0:32592:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790964474.741369:0:32592:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964474.741375:0:32592:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790964474.741412:0:32592:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741419:0:32592:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790964474.741435:0:32592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741441:0:32592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: 00000000f3bdee1e/0x461a674dcbd7c638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x461a674dcbd7c63f expref: -99 pid: 32586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741456:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964474.741458:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790964474.741459:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964474.741523:0:31770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000942a0342 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f924b2d8-958e-436c-995a-bd5c559444c6:31770:1877962346466560:0@lo:103: 00000100:00100000:1.0:1790964474.741557:0:31770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964474.741632:0:32589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346466560 00000100:00100000:1.0:1790964474.741636:0:32589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346466560 00010000:00010000:1.0:1790964474.741651:0:32589:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 13 pid: 32600 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964474.741673:0:32589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964474.741679:0:32589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090351e06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f924b2d8-958e-436c-995a-bd5c559444c6+13:31770:x1877962346466560:12345-0@lo:103: 00010000:00010000:1.0:1790964474.741695:0:32589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790964474.741700:0:32589:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 13 pid: 32600 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741709:0:32589:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 13 pid: 32600 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741724:0:32589:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741731:0:32589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790964474.741743:0:32589:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001036682s 00010000:00010000:1.0:1790964474.741747:0:32589:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741753:0:32589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741758:0:32589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741764:0:32589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741769:0:32589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad9dc837 already unused, calling callback (00000000d0af94b4) 00010000:00010000:1.0:1790964474.741772:0:32589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741778:0:32589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741793:0:32589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964474.741802:0:32589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790964474.741829:0:32589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090351e06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f924b2d8-958e-436c-995a-bd5c559444c6+13:31770:x1877962346466560:12345-0@lo:103: Request processed in 151us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964474.741835:0:32589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964474.741870:0:31770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000942a0342 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f924b2d8-958e-436c-995a-bd5c559444c6:31770:1877962346466560:0@lo:103: 00010000:00010000:0.0:1790964474.742758:0:32620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000042ef35b7/0x461a674dcbd7c63f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x461a674dcbd7c638 expref: 12 pid: 32600 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790964474.742776:0:32620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000243892b5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32620:1877962346466432:0@lo:104: 00010000:00010000:0.0:1790964474.742792:0:32620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.742802:0:32620:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.742809:0:32620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964474.742814:0:32620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad9dc837/0x461a674dcbd7c670 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964474.753198:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b614610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+11:32586:x1877962346466304:12345-0@lo:253: Request processed in 78339us (78494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964474.753214:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790964474.753326:0:32586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f924b2d8-958e-436c-995a-bd5c559444c6:32586:1877962346466304:0@lo:253: 10000000:01000000:1.0:1790964474.753342:0:32586:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790964474.753346:0:32586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790964474.753348:0:32586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790964474.753349:0:32586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790964474.753350:0:32586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790964474.753352:0:32586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790964474.753353:0:32586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790964474.753354:0:32586:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790964474.753356:0:32586:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790964474.753358:0:32586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790964474.753359:0:32586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790964474.753374:0:32586:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790964474.760340:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964474.760671:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964474.761092:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964474.761316:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964474.761737:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964474.762051:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964474.763361:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964474.763683:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964474.764061:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964474.764301:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964474.765086:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964474.765343:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1790964474.798426:0:32586:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000004:02000000:3.0:1790964474.798434:0:32586:0:(lod_dev.c:733:lod_sub_init_llog()) *** cfs_fail_loc=2405, val=0*** 00000020:00080000:1.0:1790964474.798712:0:32640:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790964474.798716:0:32640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790964474.803817:0:32641:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790964474.804336:0:32586:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1790964474.804743:0:32641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1790964474.807165:0:32642:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@000000006895932e x1877962346466688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964474.807181:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00000040:00080000:3.0:1790964474.811249:0:32641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790964474.811317:0:32641:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1790964474.811814:0:32586:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790964474.812094:0:32586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790964474.812733:0:32586:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790964474.812743:0:32586:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790964474.813008:0:32586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790964474.814730:0:32586:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790964474.816027:0:32586:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790964474.816076:0:32586:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790964474.816503:0:32586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790964474.817763:0:32586:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:3.0:1790964474.825522:0:32586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1790964474.864809:0:32586:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790964474.864850:0:32586:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb8d241977988 00100000:10000000:3.0:1790964474.864858:0:32586:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790964474.867662:0:32586:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790964474.867683:0:32586:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790964474.867699:0:32586:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790964474.867727:0:32586:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1790964475.137126:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964475.838227:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00010000:00010000:3.0:1790964476.162050:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964476.862246:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00010000:00010000:3.0:1790964477.182572:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790964477.886120:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00010000:00010000:3.0:1790964478.206610:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964478.911305:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00000001:02000400:1.0:1790964479.119850:0:32884:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug -1 all 00000400:00000001:2.0:1790964479.154715:0:32886:0:(debug.c:305:cfs_str2mask()) Process entered 00010000:00000001:0.0:1790964479.230261:0:415:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964479.230271:0:415:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964479.230279:0:415:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964479.230280:0:415:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964479.232853:0:32593:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964479.232860:0:32593:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964479.232864:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:2.0:1790964479.605609:0:32899:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:2.0:1790964479.605627:0:32899:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964479.605633:0:32899:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964479.937025:0:31768:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964479.937039:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964479.937041:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964479.937045:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964479.937047:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964479.937050:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964479.937052:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964479.937209:0:32642:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964479.937212:0:32642:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964479.937214:0:32642:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964479.937216:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00000100:00000001:2.0:1790964479.937219:0:32642:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964479.937222:0:32642:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964479.937224:0:32642:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964479.937226:0:32642:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964479.937228:0:32642:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.937447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f924b2d8-958e-436c-995a-bd5c559444c6->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1790964479.937454:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1790964479.937461:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000007574d221. 00000020:00000040:0.0:1790964479.937468:0:8:0:(genops.c:1210:class_import_get()) import 00000000e79a1a7f refcount=4 obd=MGC192.168.204.132@tcp 00000100:00000001:0.0:1790964479.937472:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1790964479.937476:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1790964479.937484:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1790964479.937491:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000edcdc347. 00000100:00000001:0.0:1790964479.937499:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.937518:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f924b2d8-958e-436c-995a-bd5c559444c6->MGS req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1790964479.937529:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1790964479.937531:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.937536:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007574d221] to pc [ptlrpcd_00_02+2] req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.937577:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:0.0:1790964479.937581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790964479.937584:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00000001:0.0:1790964479.937587:0:8:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:0.0:1790964479.937589:0:8:0:(import.c:65:import_set_state_nolock()) 000000000d56375e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:0.0:1790964479.937592:0:8:0:(import.c:520:import_select_connection()) Process entered 00000100:00000040:0.0:1790964479.937595:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 13 to 0@lo 00000100:00000001:0.0:1790964479.937598:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964479.937600:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 14 to 0@lo 00000100:00000001:0.0:1790964479.937601:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000020:00000001:0.0:1790964479.937604:0:8:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964479.937606:0:8:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c669 00000020:00000001:0.0:1790964479.937608:0:8:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964479.937611:0:8:0:(lustre_handles.c:148:class_handle2object()) GET export 000000007ed70d12 refcount=7 00000020:00000001:0.0:1790964479.937613:0:8:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964101132288 : -117109608419328 : ffff957d4b63f000) 00000020:00000001:0.0:1790964479.937615:0:8:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626964101132288 : -117109608419328 : ffff957d4b63f000) 00000100:00000040:0.0:1790964479.937618:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 13 to 0@lo 00000100:00000001:0.0:1790964479.937619:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964479.937620:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 14 to 0@lo 00000100:00000001:0.0:1790964479.937622:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000020:00000040:0.0:1790964479.937624:0:8:0:(genops.c:879:class_export_put()) PUTting export 000000007ed70d12 : new refcount 6 00000100:00080000:0.0:1790964479.937626:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000d56375e using connection 192.168.204.132@tcp/0@lo 00000100:00000001:0.0:1790964479.937628:0:8:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964479.937630:0:8:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:0.0:1790964479.937643:0:8:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964479.937646:0:8:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.937648:0:8:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:0.0:1790964479.937651:0:8:0:(obd_class.h:895:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:0.0:1790964479.937654:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000f4ade8bf. 00000020:00000040:0.0:1790964479.937657:0:8:0:(genops.c:1210:class_import_get()) import 000000000d56375e refcount=3 obd=lustre-MDT0000-lwp-MDT0000 02000000:00000001:0.0:1790964479.937660:0:8:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:0.0:1790964479.937662:0:8:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.937664:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1790964479.937666:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1790964479.937668:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1790964479.937671:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 00000000b6368214. 00000100:00000001:0.0:1790964479.937674:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964479.937679:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1790964479.937686:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1790964479.937688:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.937690:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f4ade8bf] to pc [ptlrpcd_rcv+-1] req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.937704:0:8:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.937709:0:8:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (947) 00000100:00000001:0.0:1790964479.938018:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964479.938022:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964479.938024:0:31768:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1790964479.938029:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.938035:0:31768:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964479.938036:0:31768:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964479.938040:0:31768:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1790964479.938042:0:31768:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1790964479.938044:0:31768:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964479.938047:0:31768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4ade8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31768:1877962346466944:0@lo:38: 00000100:00000001:0.0:1790964479.938051:0:31768:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1790964479.938055:0:31768:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1790964479.938064:0:31768:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964479.938066:0:31768:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1790964479.938070:0:31768:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000049372cfb. 02000000:00000001:0.0:1790964479.938071:0:31768:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1790964479.938078:0:31768:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000cc3997be. 00000400:00000010:0.0:1790964479.938086:0:31768:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000df649902. 00000100:00000200:0.0:1790964479.938092:0:31768:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877962346466944, portal 10 00000100:00000001:0.0:1790964479.938095:0:31768:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1790964479.938096:0:31768:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626969272733184 : -117104436818432 : ffff957e7fa44e00) 00000020:00000010:0.0:1790964479.938105:0:31768:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000005bd126bf. 00000100:00000040:0.0:1790964479.938110:0:31768:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964489 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.938117:0:31768:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964479.938119:0:31768:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964479.938121:0:31768:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000cfecf3a7. 00000100:00000200:0.0:1790964479.938123:0:31768:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1877962346466944, offset 0 00000400:00000200:0.0:1790964479.938129:0:31768:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964479.938143:0:31768:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964479.938154:0:31768:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 12 MB=0x6abff2e900e80 00000400:00000200:0.0:1790964479.938160:0:31768:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 520/520 into md 0x229 [64] + 520 00000400:00000200:0.0:1790964479.938169:0:31768:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964479.938173:0:31768:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964479.938179:0:31768:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:0.0:1790964479.938181:0:31768:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:0.0:1790964479.938185:0:31768:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000a9716208. 00000100:00000040:0.0:1790964479.938188:0:31768:0:(events.c:341:request_in_callback()) incoming req@00000000a9716208 x1877962346466944 msgsize 520 00000100:00100000:0.0:1790964479.938192:0:31768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:0.0:1790964479.938200:0:31768:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1790964479.938207:0:31768:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000cfecf3a7 00000400:00000010:0.0:1790964479.938209:0:31768:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000cfecf3a7. 00000100:00000001:0.0:1790964479.938212:0:31768:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:0.0:1790964479.938215:0:31768:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964489 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.938223:0:31768:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964479.938232:0:31768:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964489 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.938238:0:31768:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938240:0:31768:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1790964479.938246:0:31768:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.938250:0:31768:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 947 usecs (1 jiffies) 00000100:00000001:0.0:1790964479.938253:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295609349 00000100:00000010:0.0:1790964479.938256:0:31768:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000009a20ba67. 00000100:00000001:0.0:1790964479.938263:0:31768:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 0 00000100:00000001:0.0:1790964479.938268:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295609349 00000100:00000010:0.0:1790964479.938270:0:31768:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000009ae4acc6. 00000100:00000001:0.0:1790964479.938273:0:31768:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 1 00000100:00000001:0.0:1790964479.938275:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295609349 00000100:00000010:0.0:1790964479.938279:0:31768:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000a20294c7. 00000100:00000001:0.0:1790964479.938283:0:31768:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 2 00000100:00000001:0.0:1790964479.938285:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295609349 00000100:00000010:0.0:1790964479.938287:0:31768:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000f1a18421. 00000100:00000001:0.0:1790964479.938290:0:31768:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request now active for cpu 3 00000100:00000001:0.0:1790964479.938293:0:31768:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964479.938296:0:31768:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938299:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938300:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.938307:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964479.938308:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.938310:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964479.938311:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964479.938312:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938314:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964479.938332:0:32606:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000000573e73e. 00000100:00000001:0.0:1790964479.938338:0:32606:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964479.938340:0:32606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346466944 02000000:00000001:0.0:1790964479.938341:0:32606:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964479.938348:0:32606:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964479.938351:0:32606:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964479.938355:0:32606:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964479.938359:0:32606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346466944 00000020:00000001:0.0:1790964479.938361:0:32606:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964479.938363:0:32606:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:0.0:1790964479.938364:0:32606:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:0.0:1790964479.938365:0:32606:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.938367:0:32606:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964479.938371:0:32606:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000082adadc8. 00000020:00000010:0.0:1790964479.938375:0:32606:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000ce45edb7. 00000020:00000010:0.0:1790964479.938379:0:32606:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000032d9e1b1. 00000100:00000001:0.0:1790964479.938384:0:32606:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964479.938385:0:32606:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964479.938388:0:32606:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938395:0:32606:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938400:0:32606:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.938421:0:32606:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964479.938423:0:32606:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964479.938427:0:32606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964479.938430:0:32606:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446626969272743936 : -117104436807680 : ffff957e7fa47800) 00000100:00000040:0.0:1790964479.938434:0:32606:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000a9716208 x1877962346466944/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964499 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964479.938443:0:32606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9716208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:31768:x1877962346466944:12345-0@lo:38: 00000100:00000200:0.0:1790964479.938446:0:32606:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962346466944 00000020:00000001:0.0:1790964479.938449:0:32606:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:0.0:1790964479.938453:0:32606:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000040:0.0:1790964479.938464:0:32606:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000006894f514) now 4 - find 00000020:00000001:0.0:1790964479.938467:0:32606:0:(genops.c:655:class_str2obd()) Process leaving (rc=18446626969222846912 : -117104486704704 : ffff957e7cab19c0) 00000100:00000001:0.0:1790964479.938472:0:32606:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964479.938474:0:32606:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1790964479.938478:0:32606:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 712 at 00000000a1302521. 02000000:00000001:0.0:1790964479.938480:0:32606:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938482:0:32606:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964479.938490:0:32606:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401047000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1790964479.938495:0:32606:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 942 last 0 00010000:00000001:0.0:1790964479.938499:0:32606:0:(obd_class.h:859:obd_connect()) Process entered 00000004:00000001:0.0:1790964479.938502:0:32606:0:(mdt_handler.c:7495:mdt_obd_connect()) Process entered 00000020:00000001:0.0:1790964479.938506:0:32606:0:(genops.c:1375:class_connect()) Process entered 00000020:00000001:0.0:1790964479.938508:0:32606:0:(genops.c:931:__class_new_export()) Process entered 00000020:00000010:0.0:1790964479.938511:0:32606:0:(genops.c:933:__class_new_export()) kmalloced '(export)': 1208 at 0000000045b721ce. 00000020:00000001:0.0:1790964479.938513:0:32606:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:0.0:1790964479.938515:0:32606:0:(lustre_handles.c:93:class_handle_hash()) added object 0000000045b721ce with handle 0x461a674dcbd7c677 to hash 00000020:00000001:0.0:1790964479.938517:0:32606:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00000020:00000001:0.0:1790964479.938519:0:32606:0:(obd_class.h:1015:obd_init_export()) Process entered 00000004:00000001:0.0:1790964479.938521:0:32606:0:(mdt_handler.c:7614:mdt_init_export()) Process entered 00000004:00000010:0.0:1790964479.938523:0:32606:0:(mdt_handler.c:7623:mdt_init_export()) kmalloced '(exp->exp_used_slots)': 64 at 0000000061d055a5. 00000001:00000001:0.0:1790964479.938526:0:32606:0:(tgt_lastrcvd.c:423:tgt_client_alloc()) Process entered 00000001:00000010:0.0:1790964479.938528:0:32606:0:(tgt_lastrcvd.c:431:tgt_client_alloc()) kmalloced '(exp->u.eu_target_data.ted_lcd)': 128 at 00000000ebfc7cc1. 00000001:00000001:0.0:1790964479.938530:0:32606:0:(tgt_lastrcvd.c:438:tgt_client_alloc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964479.938532:0:32606:0:(ldlm_lockd.c:3138:ldlm_init_export()) Process entered 00000001:00000001:0.0:1790964479.938535:0:32606:0:(hash.c:1038:cfs_hash_create()) Process entered 00000001:00000010:0.0:1790964479.938539:0:32606:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 00000000315f6071. 00000001:00000010:0.0:1790964479.938543:0:32606:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 00000000733fbd63. 00000001:00000010:0.0:1790964479.938547:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 0000000003bbfce2. 00000001:00000010:0.0:1790964479.938550:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000004de3e349. 00000001:00000010:0.0:1790964479.938552:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000f890d31d. 00000001:00000010:0.0:1790964479.938554:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000003f549758. 00000001:00000001:0.0:1790964479.938557:0:32606:0:(hash.c:1038:cfs_hash_create()) Process entered 00000001:00000010:0.0:1790964479.938558:0:32606:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 000000007ec7f55d. 00000001:00000010:0.0:1790964479.938561:0:32606:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 0000000032c66aab. 00000001:00000010:0.0:1790964479.938563:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000d9f2792f. 00000001:00000010:0.0:1790964479.938565:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000ff15612e. 00000001:00000010:0.0:1790964479.938567:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000e0a57c21. 00000001:00000010:0.0:1790964479.938569:0:32606:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 0000000064b86a49. 00010000:00000001:0.0:1790964479.938571:0:32606:0:(ldlm_flock.c:1138:ldlm_init_flock_export()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964479.938573:0:32606:0:(ldlm_lockd.c:3157:ldlm_init_export()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964479.938575:0:32606:0:(mdt_handler.c:7640:mdt_init_export()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.938581:0:32606:0:(obd_class.h:1019:obd_init_export()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1790964479.938584:0:32606:0:(genops.c:868:class_export_get()) GET export 0000000045b721ce refcount=3 00000020:00000040:0.0:1790964479.938587:0:32606:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000006894f514) now 5 - export 00000020:00000001:0.0:1790964479.938589:0:32606:0:(genops.c:1001:__class_new_export()) Process leaving (rc=18446626964098510848 : -117109611040768 : ffff957d4b3bf000) 00000020:00000040:0.0:1790964479.938591:0:32606:0:(genops.c:879:class_export_put()) PUTting export 0000000045b721ce : new refcount 2 00000020:00000080:0.0:1790964479.938593:0:32606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x461a674dcbd7c677 00000020:00000001:0.0:1790964479.938595:0:32606:0:(genops.c:1386:class_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.938596:0:32606:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964479.938597:0:32606:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c677 00000020:00000001:0.0:1790964479.938598:0:32606:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964479.938600:0:32606:0:(lustre_handles.c:148:class_handle2object()) GET export 0000000045b721ce refcount=3 00000020:00000001:0.0:1790964479.938602:0:32606:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964098510848 : -117109611040768 : ffff957d4b3bf000) 00000020:00000001:0.0:1790964479.938603:0:32606:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626964098510848 : -117109611040768 : ffff957d4b3bf000) 00000001:00000001:0.0:1790964479.938606:0:32606:0:(nodemap_handler.c:735:nodemap_add_member()) Process entered 00000001:00000001:0.0:1790964479.938609:0:32606:0:(nodemap_handler.c:520:nodemap_classify_nid()) Process entered 00000001:00000040:0.0:1790964479.938616:0:32606:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.132@tcp 00000001:00000040:0.0:1790964479.938621:0:32606:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=000000003b0a4a05) : new refcount 5 00000001:00000001:0.0:1790964479.938623:0:32606:0:(nodemap_handler.c:558:nodemap_classify_nid()) Process leaving (rc=18446626969231542272 : -117104478009344 : ffff957e7d2fc800) 00000001:00000001:0.0:1790964479.938626:0:32606:0:(nodemap_member.c:132:nm_member_add()) Process entered 00000020:00000040:0.0:1790964479.938628:0:32606:0:(genops.c:868:class_export_get()) GET export 0000000045b721ce refcount=4 00000001:00000040:0.0:1790964479.938629:0:32606:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=000000003b0a4a05) : new refcount 6 00000020:00000010:0.0:1790964479.938636:0:32606:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at 000000002b82a52f. 00000020:00000010:0.0:1790964479.938640:0:32606:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 2752 at 000000009deeeb8b. 00000001:00000001:0.0:1790964479.938667:0:32606:0:(nodemap_member.c:170:nm_member_add()) Process leaving (rc=0 : 0 : 0) 00000001:08000000:0.0:1790964479.938671:0:32606:0:(nodemap_handler.c:809:nodemap_add_member()) lustre-MDT0000: adding NID 0@lo to nodemap default 00000001:00000040:0.0:1790964479.938673:0:32606:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=000000003b0a4a05) : new refcount 5 00000001:00000001:0.0:1790964479.938674:0:32606:0:(nodemap_handler.c:815:nodemap_add_member()) Process leaving (rc=0 : 0 : 0) 00000004:00100000:0.0:1790964479.938678:0:32606:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000001:0.0:1790964479.938681:0:32606:0:(tgt_lastrcvd.c:1061:tgt_client_new()) Process entered 00000001:00000001:0.0:1790964479.938682:0:32606:0:(tgt_lastrcvd.c:1068:tgt_client_new()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964479.938684:0:32606:0:(mdt_fs.c:50:mdt_export_stats_init()) Process entered 00000020:00000001:0.0:1790964479.938687:0:32606:0:(lprocfs_status_server.c:708:lprocfs_exp_setup()) Process entered 00000020:00000010:0.0:1790964479.938695:0:32606:0:(lprocfs_status_server.c:729:lprocfs_exp_setup()) kmalloced '(new_stat)': 96 at 0000000084ce130c. 00000020:00000040:0.0:1790964479.938700:0:32606:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats 0000000084ce130c for nid 0@lo - ref 2 00000020:00000001:0.0:1790964479.938750:0:32606:0:(lprocfs_status_server.c:781:lprocfs_exp_setup()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964479.938756:0:32606:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 0000000080366252. 00000020:00000010:0.0:1790964479.938759:0:32606:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 1728 at 00000000c535664a. 00000020:00000010:0.0:1790964479.938762:0:32606:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 1080 at 00000000fb9e2efe. 00000020:00000010:0.0:1790964479.938783:0:32606:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 00000000ec2f4425. 00000020:00000010:0.0:1790964479.938786:0:32606:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 448 at 000000006fb4628a. 00000020:00000010:0.0:1790964479.938788:0:32606:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 280 at 00000000b298c10d. 00000004:00000001:0.0:1790964479.938801:0:32606:0:(mdt_fs.c:75:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:0.0:1790964479.938803:0:32606:0:(mdt_handler.c:7562:mdt_obd_connect()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964479.938806:0:32606:0:(obd_class.h:875:obd_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964479.938809:0:32606:0:(genops.c:1264:class_new_import()) kmalloced '(imp)': 1720 at 0000000090019314. 00000020:00000040:0.0:1790964479.938811:0:32606:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000006894f514) now 6 - import 00000020:00000001:0.0:1790964479.938816:0:32606:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964479.938817:0:32606:0:(genops.c:1223:class_import_put()) import 0000000090019314 refcount=1 obd=lustre-MDT0000 00000020:00000001:0.0:1790964479.938819:0:32606:0:(genops.c:1230:class_import_put()) Process leaving 00000020:00000040:0.0:1790964479.938823:0:32606:0:(genops.c:868:class_export_get()) GET export 0000000045b721ce refcount=5 00000100:00000040:0.0:1790964479.938825:0:32606:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export 0000000045b721ce : new rpc_count 1 00000100:00000001:0.0:1790964479.938827:0:32606:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:0.0:1790964479.938830:0:32606:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964479.938832:0:32606:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 15 to 0@lo 00000100:00000001:0.0:1790964479.938833:0:32606:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000100:00000001:0.0:1790964479.938835:0:32606:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446626969270485312 : -117104439066304 : 0xffff957e7f820140) 00000100:00000040:0.0:1790964479.938838:0:32606:0:(connection.c:150:ptlrpc_connection_get()) conn=00000000f9c3b6a8 refcount 15 to 0@lo 00000020:00000040:0.0:1790964479.938841:0:32606:0:(genops.c:868:class_export_get()) GET export 0000000045b721ce refcount=6 00000100:00000001:0.0:1790964479.938845:0:32606:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964479.938846:0:32606:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 16 to 0@lo 00000100:00000001:0.0:1790964479.938848:0:32606:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 02000000:00000001:0.0:1790964479.938850:0:32606:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:0.0:1790964479.938853:0:32606:0:(sec.c:1444:sptlrpc_sec_create()) Process entered 02000000:08000000:0.0:1790964479.938855:0:32606:0:(sec.c:1452:sptlrpc_sec_create()) mdt lustre-MDT0000: reverse sec using flavor null 02000000:00000001:0.0:1790964479.938865:0:32606:0:(sec.c:1483:sptlrpc_sec_create()) Process leaving (rc=18446744072661730720 : -1047820896 : ffffffffc18b85a0) 02000000:00000001:0.0:1790964479.938868:0:32606:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.938870:0:32606:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000100:00000001:0.0:1790964479.938872:0:32606:0:(recover.c:149:ptlrpc_resend()) Process entered 00000100:00000001:0.0:1790964479.938874:0:32606:0:(recover.c:178:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:0.0:1790964479.938876:0:32606:0:(import.c:65:import_set_state_nolock()) 0000000090019314 : changing import state from RECOVER to FULL 00000100:00000001:0.0:1790964479.938879:0:32606:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:0.0:1790964479.938880:0:32606:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:0.0:1790964479.938882:0:32606:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1790964479.938885:0:32606:0:(genops.c:879:class_export_put()) PUTting export 0000000045b721ce : new refcount 5 00000020:00000040:0.0:1790964479.938887:0:32606:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (000000006894f514) now 6 - find 00010000:00000001:0.0:1790964479.938889:0:32606:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.938893:0:32606:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1790964479.938895:0:32606:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072671353808 : -1038197808 : ffffffffc21e5bd0) 00000020:00000001:0.0:1790964479.938898:0:32606:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1790964479.938900:0:32606:0:(tgt_handler.c:559:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1790964479.938902:0:32606:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1790964479.938904:0:32606:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1790964479.938906:0:32606:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.938909:0:32606:0:(tgt_handler.c:1061:tgt_connect()) Process entered 00000001:00000001:0.0:1790964479.938914:0:32606:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:0.0:1790964479.938916:0:32606:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:0.0:1790964479.938918:0:32606:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:0.0:1790964479.938918:0:32606:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.938920:0:32606:0:(tgt_handler.c:1130:tgt_connect()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964479.938923:0:32606:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962346466944 00010000:00000001:0.0:1790964479.938925:0:32606:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:0.0:1790964479.938929:0:32606:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000a9716208 x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964499 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964479.938936:0:32606:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964479.938938:0:32606:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964479.938941:0:32606:0:(import.c:2195:obd_at_measure()) add 1 to 00000000ca8153d4 time=1790964479 v=10 (0 0 0 0) 00000100:00001000:0.0:1790964479.938944:0:32606:0:(import.c:2261:obd_at_measure()) AT 00000000ca8153d4 change: old=10 new=5 delta=-5 (val=1) hist 1 0 0 0 00000100:00001000:0.0:1790964479.938976:0:32606:0:(niobuf.c:566:ptlrpc_at_set_reply()) @@@ svc mdt changed estimate from 10 to 5 req@00000000a9716208 x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964499 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00001000:0.0:1790964479.938994:0:32606:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x200 magic=bd00bd3/bd00bd3 len=416 00000100:00000001:0.0:1790964479.938997:0:32606:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964479.938998:0:32606:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 00000100:00000001:0.0:1790964479.939000:0:32606:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 02000000:00000001:0.0:1790964479.939002:0:32606:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964479.939004:0:32606:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.939007:0:32606:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964479.939009:0:32606:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964479.939011:0:32606:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000cfecf3a7. 00000100:00000200:0.0:1790964479.939015:0:32606:0:(niobuf.c:94:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1877962346466944, offset 0 00000400:00000200:0.0:1790964479.939018:0:32606:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964479.939025:0:32606:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964479.939031:0:32606:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 416 into portal 10 MB=0x6abff2e900e80 00000400:00000200:0.0:1790964479.939035:0:32606:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 416/416 into md 0xaa9 [1] + 0 00000400:00000200:0.0:1790964479.939041:0:32606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964479.939043:0:32606:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964479.939047:0:32606:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964479.939050:0:32606:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964479.939057:0:32606:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964489 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.939072:0:32606:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964479.939077:0:32606:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000cfecf3a7 00000400:00000010:0.0:1790964479.939079:0:32606:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000cfecf3a7. 00000100:00000001:0.0:1790964479.939082:0:32606:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964479.939084:0:32606:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964479.939087:0:32606:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.939089:0:32606:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 16 to 0@lo 00010000:00000001:0.0:1790964479.939091:0:32606:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:0.0:1790964479.939093:0:32606:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.939094:0:32606:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1790964479.939097:0:32606:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000a9716208 x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964499 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964479.939111:0:32606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9716208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:31768:x1877962346466944:12345-0@lo:38: Request processed in 668us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964479.939117:0:32606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000040:0.0:1790964479.939120:0:32606:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000045b721ce : new rpc_count 0 00000100:00000001:0.0:1790964479.939122:0:32606:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964479.939124:0:32606:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964479.939128:0:32606:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000ce45edb7. 00000020:00000010:0.0:1790964479.939131:0:32606:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000032d9e1b1. 00000020:00000010:0.0:1790964479.939134:0:32606:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000082adadc8. 00000020:00000040:0.0:1790964479.939136:0:32606:0:(genops.c:879:class_export_put()) PUTting export 0000000045b721ce : new refcount 4 00000100:00000001:0.0:1790964479.939138:0:32606:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.939168:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964479.939170:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1790964479.939175:0:31768:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964479.939176:0:31768:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964479.939178:0:31768:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000cc3997be. 00000400:00000200:0.0:1790964479.939181:0:31768:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000df649902 00000400:00000010:0.0:1790964479.939182:0:31768:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000df649902. 00000100:00000001:0.0:1790964479.939184:0:31768:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964479.939187:0:31768:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964489 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964479.939193:0:31768:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964489 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.939199:0:31768:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964479.939200:0:31768:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.939202:0:31768:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1790964479.939205:0:31768:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1790964479.939206:0:31768:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964479.939208:0:31768:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964479.939210:0:31768:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964479.939215:0:31768:0:(import.c:2195:obd_at_measure()) add 5 to 0000000062af308d time=1790964479 v=5 (0 0 0 0) 00000100:00001000:0.0:1790964479.939218:0:31768:0:(import.c:2195:obd_at_measure()) add 1 to 00000000231fb147 time=5 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964479.939222:0:31768:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1790964479.939230:0:31768:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964479.939232:0:31768:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1790964479.939236:0:31768:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964479.939242:0:31768:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.939245:0:31768:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1790964479.939247:0:31768:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:0.0:1790964479.939249:0:31768:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1790964479.939250:0:31768:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.939253:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.939259:0:31768:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964479.939263:0:31768:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964479.939264:0:31768:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.939267:0:31768:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00080000:0.0:1790964479.939271:0:31768:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000020:00000001:0.0:1790964479.939273:0:31768:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964479.939274:0:31768:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c669 00000020:00000001:0.0:1790964479.939275:0:31768:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964479.939277:0:31768:0:(lustre_handles.c:148:class_handle2object()) GET export 000000007ed70d12 refcount=7 00000020:00000001:0.0:1790964479.939279:0:31768:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964101132288 : -117109608419328 : ffff957d4b63f000) 00000020:00000001:0.0:1790964479.939281:0:31768:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626964101132288 : -117109608419328 : ffff957d4b63f000) 00000100:00001000:0.0:1790964479.939283:0:31768:0:(import.c:2195:obd_at_measure()) add 1 to 00000000231fb147 time=1790964479 v=0 (0 0 0 0) 00000100:00001000:0.0:1790964479.939286:0:31768:0:(import.c:2261:obd_at_measure()) AT 00000000231fb147 change: old=0 new=5 delta=5 (val=1) hist 1 0 0 0 00000100:00080000:0.0:1790964479.939290:0:31768:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000020:00000040:0.0:1790964479.939292:0:31768:0:(genops.c:879:class_export_put()) PUTting export 000000007ed70d12 : new refcount 6 00000100:00000001:0.0:1790964479.939294:0:31768:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:0.0:1790964479.939296:0:31768:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00080000:0.0:1790964479.939298:0:31768:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790964479.939300:0:31768:0:(import.c:65:import_set_state_nolock()) 000000000d56375e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000001:0.0:1790964479.939302:0:31768:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:0.0:1790964479.939303:0:31768:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:0.0:1790964479.939310:0:31768:0:(import.c:1285:ptlrpc_connect_interpret()) Process leaving via finish (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964479.939312:0:31768:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000100:00000001:0.0:1790964479.939314:0:31768:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.939316:0:31768:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.939319:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964489 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964479.939326:0:31768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4ade8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31768:1877962346466944:0@lo:38: 00000100:00000001:0.0:1790964479.939329:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.939331:0:31768:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964479.939333:0:31768:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000f4ade8bf x1877962346466944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964489 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.939338:0:31768:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964479.939340:0:31768:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964479.939342:0:31768:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000049372cfb. 02000000:00000001:0.0:1790964479.939345:0:31768:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964479.939347:0:31768:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964479.939348:0:31768:0:(genops.c:1223:class_import_put()) import 000000000d56375e refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:0.0:1790964479.939349:0:31768:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964479.939352:0:31768:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 00000000b6368214. 02000000:00000001:0.0:1790964479.939354:0:31768:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964479.939356:0:31768:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964479.939357:0:31768:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000f4ade8bf. 00000100:00000001:0.0:1790964479.939360:0:31768:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964479.939361:0:31768:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.939363:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.939365:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964479.939366:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964479.939367:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.939368:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964479.940035:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:1.0:1790964479.940044:0:31771:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 00000000f34fd19e. 00000020:00000010:1.0:1790964479.940051:0:31771:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 00000000b21770e1. 80000000:00000010:1.0:1790964479.940055:0:31771:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 00000000e3dfb0b8. 40000000:00000010:1.0:1790964479.940059:0:31771:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 00000000efd44c5d. 00000008:00000010:1.0:1790964479.940072:0:31771:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 00000000649c8bbb. 00020000:00000010:1.0:1790964479.940076:0:31771:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 00000000e7b3d313. 00008000:00000010:1.0:1790964479.940081:0:31771:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 00000000b7c2b158. 00100000:00000010:1.0:1790964479.940085:0:31771:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 00000000c8394f49. 00040000:00000010:1.0:1790964479.940089:0:31771:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 0000000085e46546. 00040000:00000010:1.0:1790964479.940094:0:31771:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 0000000042d2f4cf. 00040000:00000010:1.0:1790964479.940097:0:31771:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 000000004222cdab. 00080000:00000010:1.0:1790964479.940101:0:31771:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 00000000d51c6971. 00000004:00000010:1.0:1790964479.940105:0:31771:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 000000009ed4ad73. 00000004:00000010:1.0:1790964479.940110:0:31771:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 00000000b9c80f28. 00000004:00000010:1.0:1790964479.940115:0:31771:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 0000000055a333d1. 00002000:00000010:1.0:1790964479.940119:0:31771:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 00000000cdf9367d. 00000004:00000010:1.0:1790964479.940122:0:31771:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 000000003d156654. 00000080:00000010:1.0:1790964479.940127:0:31771:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 00000000c4380d98. 00000080:00000010:1.0:1790964479.940131:0:31771:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 0000000075f2dcd8. 00000008:00000010:1.0:1790964479.940137:0:31771:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 00000000b22cd4a1. 00020000:00000010:1.0:1790964479.940141:0:31771:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 00000000de3a358c. 00008000:00000010:1.0:1790964479.940144:0:31771:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 000000007686492f. 00000080:00000010:1.0:1790964479.940148:0:31771:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 0000000087711ad2. 00000100:00000001:1.0:1790964479.940150:0:31771:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964479.940152:0:31771:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964479.940156:0:31771:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964479.940163:0:31771:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964479.940165:0:31771:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964479.940168:0:31771:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964479.940171:0:31771:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964479.940174:0:31771:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964479.940176:0:31771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007574d221 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f924b2d8-958e-436c-995a-bd5c559444c6:31771:1877962346466816:0@lo:400: 00000100:00000001:1.0:1790964479.940180:0:31771:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964479.940186:0:31771:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964479.940187:0:31771:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964479.940190:0:31771:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964479.940199:0:31771:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 000000006a59944f. 02000000:00000001:1.0:1790964479.940201:0:31771:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964479.940205:0:31771:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000007c11e7e6. 00000400:00000010:1.0:1790964479.940212:0:31771:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000049f8b333. 00000100:00000200:1.0:1790964479.940216:0:31771:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877962346466816, portal 25 00000100:00000001:1.0:1790964479.940219:0:31771:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964479.940220:0:31771:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626969272734080 : -117104436817536 : ffff957e7fa45180) 00000100:00000040:1.0:1790964479.940226:0:31771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964479.940233:0:31771:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964479.940235:0:31771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964479.940238:0:31771:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000008bb7827a. 00000100:00000200:1.0:1790964479.940240:0:31771:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877962346466816, offset 0 00000400:00000200:1.0:1790964479.940245:0:31771:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964479.940255:0:31771:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964479.940264:0:31771:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff2e900e00 00000400:00000200:1.0:1790964479.940269:0:31771:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x161 [2] + 0 00000400:00000010:1.0:1790964479.940273:0:31771:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000ff8cade6. 00000400:00000200:1.0:1790964479.940277:0:31771:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000846c9264 00000400:00000200:1.0:1790964479.940284:0:31771:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964479.940287:0:31771:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964479.940291:0:31771:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000846c9264 00000400:00000010:1.0:1790964479.940293:0:31771:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000846c9264. 00000100:00000001:1.0:1790964479.940298:0:31771:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964479.940300:0:31771:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964479.940303:0:31771:0:(events.c:341:request_in_callback()) incoming req@000000009f0f8ff0 x1877962346466816 msgsize 224 00000100:00100000:1.0:1790964479.940306:0:31771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964479.940308:0:31771:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964479.940324:0:31771:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964479.940330:0:31771:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008bb7827a 00000400:00000010:1.0:1790964479.940331:0:31771:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000008bb7827a. 00000100:00000001:1.0:1790964479.940335:0:31771:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964479.940338:0:31771:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964479.940357:0:31771:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964479.940359:0:31771:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964479.940365:0:31771:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964479.940366:0:31771:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964479.940373:0:31771:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964479.940376:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 0 is 4295609352 00000100:00000001:1.0:1790964479.940382:0:31771:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4295609349 00000100:00000001:1.0:1790964479.940387:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 1 is 4295609352 00000100:00000001:1.0:1790964479.940389:0:31771:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295609349 00000100:00000001:1.0:1790964479.940392:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 2 is 4295609352 00000100:00000001:1.0:1790964479.940395:0:31771:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4295609349 00000100:00000001:1.0:1790964479.940397:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 3 is 4295609352 00000100:00000001:1.0:1790964479.940400:0:31771:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4295609349 00000100:00000001:1.0:1790964479.940403:0:31771:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964479.940405:0:31771:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964479.940407:0:31771:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964479.940419:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964479.940425:0:31771:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964479.940426:0:31771:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1790964479.940428:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964479.940429:0:31771:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964479.940430:0:31771:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964479.940433:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.942285:0:32600:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964479.942293:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346466816 02000000:00000001:0.0:1790964479.942297:0:32600:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964479.942299:0:32600:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964479.942302:0:32600:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964479.942307:0:32600:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964479.942325:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346466816 00000020:00000001:0.0:1790964479.942327:0:32600:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964479.942329:0:32600:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c597 00000020:00000001:0.0:1790964479.942331:0:32600:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964479.942334:0:32600:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000627856b7 refcount=11 00000020:00000001:0.0:1790964479.942338:0:32600:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000020:00000001:0.0:1790964479.942340:0:32600:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000100:00000001:0.0:1790964479.942345:0:32600:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964479.942350:0:32600:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000d9b2ef20. 00000100:00000001:0.0:1790964479.942353:0:32600:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964479.942355:0:32600:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000d9b2ef20. 00000020:00000010:0.0:1790964479.942361:0:32600:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000082adadc8. 00000020:00000010:0.0:1790964479.942366:0:32600:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000ce45edb7. 00000020:00000010:0.0:1790964479.942371:0:32600:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000032d9e1b1. 00000100:00000040:0.0:1790964479.942381:0:32600:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:0.0:1790964479.942384:0:32600:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964479.942386:0:32600:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964479.942388:0:32600:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.942398:0:32600:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.942408:0:32600:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.942428:0:32600:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964479.942430:0:32600:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964479.942436:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00000040:0.0:1790964479.942440:0:32600:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000627856b7 : new rpc_count 1 00000100:00000001:0.0:1790964479.942442:0:32600:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446626968321023056 : -117105388528560 : ffff957e46ea5c50) 00000100:00000040:0.0:1790964479.942448:0:32600:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000009f0f8ff0 x1877962346466816/t0(0) o400->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:300/0 lens 224/0 e 0 to 0 dl 1790964490 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.942457:0:32600:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964479.942460:0:32600:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000d9b2ef20. 00000100:00000001:0.0:1790964479.942462:0:32600:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964479.942463:0:32600:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000d9b2ef20. 00000100:00100000:0.0:1790964479.942467:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f0f8ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+11:31771:x1877962346466816:12345-0@lo:400: 00000100:00000200:0.0:1790964479.942478:0:32600:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962346466816 00000020:00000001:0.0:1790964479.942481:0:32600:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:0.0:1790964479.942485:0:32600:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:0.0:1790964479.942487:0:32600:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.942489:0:32600:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1790964479.942491:0:32600:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669370560 : -1040181056 : ffffffffc20018c0) 00000020:00000001:0.0:1790964479.942494:0:32600:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1790964479.942495:0:32600:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1790964479.942498:0:32600:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1790964479.942500:0:32600:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1790964479.942503:0:32600:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.942504:0:32600:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1790964479.942507:0:32600:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964479.942509:0:32600:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1790964479.942514:0:32600:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000b6368214. 02000000:00000001:0.0:1790964479.942516:0:32600:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.942518:0:32600:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.942520:0:32600:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964479.942523:0:32600:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962346466816 00010000:00000001:0.0:1790964479.942525:0:32600:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:0.0:1790964479.942529:0:32600:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000009f0f8ff0 x1877962346466816/t0(0) o400->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:300/0 lens 224/224 e 0 to 0 dl 1790964490 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964479.942537:0:32600:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964479.942539:0:32600:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964479.942542:0:32600:0:(import.c:2195:obd_at_measure()) add 1 to 000000008c4d0c38 time=5 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964479.942547:0:32600:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964479.942558:0:32600:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 00000100:00000001:0.0:1790964479.942560:0:32600:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 02000000:00000001:0.0:1790964479.942562:0:32600:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964479.942564:0:32600:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.942567:0:32600:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964479.942570:0:32600:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964479.942575:0:32600:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000df649902. 00000100:00000200:0.0:1790964479.942580:0:32600:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877962346466816, offset 224 00000400:00000200:0.0:1790964479.942587:0:32600:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964479.942609:0:32600:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964479.942619:0:32600:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff2e900e00 00000400:00000200:0.0:1790964479.942625:0:32600:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xab5 [1] + 224 00000400:00000200:0.0:1790964479.942635:0:32600:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964479.942639:0:32600:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964479.942645:0:32600:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964479.942650:0:32600:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964479.942658:0:32600:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.942672:0:32600:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964479.942680:0:32600:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000df649902 00000400:00000010:0.0:1790964479.942683:0:32600:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000df649902. 00000100:00000001:0.0:1790964479.942686:0:32600:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964479.942687:0:32600:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964479.942692:0:32600:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.942694:0:32600:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 16 to 0@lo 00010000:00000001:0.0:1790964479.942697:0:32600:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:0.0:1790964479.942698:0:32600:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964479.942700:0:32600:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1790964479.942703:0:32600:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000009f0f8ff0 x1877962346466816/t0(0) o400->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:300/0 lens 224/224 e 0 to 0 dl 1790964490 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964479.942711:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f0f8ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+11:31771:x1877962346466816:12345-0@lo:400: Request processed in 254us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964479.942718:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00000040:0.0:1790964479.942721:0:32600:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000627856b7 : new rpc_count 0 00000100:00000001:0.0:1790964479.942723:0:32600:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964479.942725:0:32600:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964479.942729:0:32600:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000ce45edb7. 00000020:00000010:0.0:1790964479.942732:0:32600:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000032d9e1b1. 00000020:00000010:0.0:1790964479.942735:0:32600:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000082adadc8. 00000020:00000040:0.0:1790964479.942738:0:32600:0:(genops.c:879:class_export_put()) PUTting export 00000000627856b7 : new refcount 10 02000000:00000001:0.0:1790964479.942748:0:32600:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:0.0:1790964479.942750:0:32600:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 00000000b6368214. 02000000:00000001:0.0:1790964479.942753:0:32600:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:0.0:1790964479.942755:0:32600:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1790964479.942758:0:32600:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:0.0:1790964479.942763:0:32600:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000cc3997be. 00000400:00000010:0.0:1790964479.942769:0:32600:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000938471a2. 00000100:00000001:2.0:1790964479.944991:0:31772:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:2.0:1790964479.945003:0:31772:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 000000005ddc1ff1. 00000020:00000010:2.0:1790964479.945011:0:31772:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 000000005ecf8d8e. 80000000:00000010:2.0:1790964479.945015:0:31772:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 00000000501e31a4. 40000000:00000010:2.0:1790964479.945019:0:31772:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 0000000072caf73b. 00000008:00000010:2.0:1790964479.945038:0:31772:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 00000000ce8a22f5. 00020000:00000010:2.0:1790964479.945044:0:31772:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 00000000c44f8eee. 00008000:00000010:2.0:1790964479.945058:0:31772:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 00000000849e06bc. 00100000:00000010:2.0:1790964479.945064:0:31772:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 000000008d5dbb16. 00040000:00000010:2.0:1790964479.945068:0:31772:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 00000000dfed3dc2. 00040000:00000010:2.0:1790964479.945078:0:31772:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 000000000e8372b1. 00040000:00000010:2.0:1790964479.945081:0:31772:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 00000000732c8ac4. 00080000:00000010:2.0:1790964479.945085:0:31772:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 00000000e96dd86c. 00000004:00000010:2.0:1790964479.945089:0:31772:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 00000000e584baf1. 00000004:00000010:2.0:1790964479.945094:0:31772:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 0000000050242965. 00000004:00000010:2.0:1790964479.945098:0:31772:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 000000006235da08. 00002000:00000010:2.0:1790964479.945102:0:31772:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 000000008458764f. 00000004:00000010:2.0:1790964479.945106:0:31772:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 0000000007406b51. 00000080:00000010:2.0:1790964479.945117:0:31772:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 00000000061fd9b4. 00000080:00000010:2.0:1790964479.945130:0:31772:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 000000001c89b3be. 00000008:00000010:2.0:1790964479.945135:0:31772:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 00000000dbc7da12. 00020000:00000010:2.0:1790964479.945139:0:31772:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 0000000045659486. 00008000:00000010:2.0:1790964479.945142:0:31772:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 0000000040a04a42. 00000080:00000010:2.0:1790964479.945145:0:31772:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 000000001bd3f60b. 00000100:00000001:2.0:1790964479.945149:0:31772:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.946096:0:415:0:(connection.c:75:cpu_latency_work()) work item of 00000000bf744d4f (cpu 0) has reached its deadline 4295609352, at 4295609356 00000100:00000010:0.0:1790964479.946109:0:415:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000009a20ba67. 00000100:00000040:2.0:1790964479.946999:0:761:0:(connection.c:75:cpu_latency_work()) work item of 000000005b676f3c (cpu 2) has reached its deadline 4295609352, at 4295609356 00000100:00000010:2.0:1790964479.947008:0:761:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000a20294c7. 00000100:00000001:0.0:1790964479.947702:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964479.947707:0:31771:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1790964479.947716:0:31771:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964479.947719:0:31771:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964479.947722:0:31771:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000007c11e7e6. 00000400:00000200:0.0:1790964479.947726:0:31771:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000049f8b333 00000400:00000010:0.0:1790964479.947728:0:31771:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000049f8b333. 00000100:00000001:0.0:1790964479.947733:0:31771:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964479.947744:0:31771:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964479.947754:0:31771:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.947761:0:31771:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964479.947762:0:31771:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.947765:0:31771:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1790964479.947768:0:31771:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1790964479.947771:0:31771:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964479.947773:0:31771:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964479.947777:0:31771:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964479.947783:0:31771:0:(import.c:2195:obd_at_measure()) add 5 to 000000002212e16a time=5 v=5 (5 0 0 0) 00000100:00001000:0.0:1790964479.947788:0:31771:0:(import.c:2195:obd_at_measure()) add 1 to 0000000029d7efcb time=5 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964479.947790:0:31771:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1790964479.947792:0:31771:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964479.947794:0:31771:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1790964479.947796:0:31771:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.947799:0:31771:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964479.947803:0:31771:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.947817:0:31771:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1790964479.947821:0:31771:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964479.947822:0:31771:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1790964479.947826:0:31771:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964479.947833:0:31771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007574d221 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f924b2d8-958e-436c-995a-bd5c559444c6:31771:1877962346466816:0@lo:400: 00000100:00000001:0.0:1790964479.947839:0:31771:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.947841:0:31771:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964479.947844:0:31771:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000007574d221 x1877962346466816/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964479.947850:0:31771:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964479.947853:0:31771:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964479.947855:0:31771:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 000000006a59944f. 02000000:00000001:0.0:1790964479.947859:0:31771:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964479.947861:0:31771:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964479.947863:0:31771:0:(genops.c:1223:class_import_put()) import 00000000e79a1a7f refcount=3 obd=MGC192.168.204.132@tcp 00000020:00000001:0.0:1790964479.947865:0:31771:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964479.947867:0:31771:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000edcdc347. 02000000:00000001:0.0:1790964479.947871:0:31771:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964479.947873:0:31771:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964479.947874:0:31771:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000007574d221. 00000100:00000001:0.0:1790964479.947878:0:31771:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964479.947879:0:31771:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.947881:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964479.947888:0:31771:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964479.947890:0:31771:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964479.947892:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964479.947908:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964479.948737:0:22071:0:(connection.c:75:cpu_latency_work()) work item of 0000000022c046dd (cpu 1) has reached its deadline 4295609352, at 4295609358 00000100:00000010:1.0:1790964479.948747:0:22071:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000009ae4acc6. 00000100:00000040:3.0:1790964479.951756:0:24982:0:(connection.c:75:cpu_latency_work()) work item of 000000009d5debbb (cpu 3) has reached its deadline 4295609352, at 4295609361 00000100:00000010:3.0:1790964479.951772:0:24982:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000f1a18421. 00010000:00000001:0.0:1790964480.254116:0:415:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964480.254126:0:415:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964480.254133:0:415:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964480.254134:0:415:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964480.255894:0:32592:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964480.255901:0:32592:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964480.255906:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:3.0:1790964480.487243:0:32948:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964480.487262:0:32948:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964480.487268:0:32948:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964480.958465:0:32587:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:1.0:1790964480.958472:0:32587:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964480.958522:0:32591:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000c762f783. 00000100:00000001:3.0:1790964480.958535:0:32591:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:3.0:1790964480.958536:0:32591:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964480.962736:0:32642:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964480.962745:0:32642:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964480.962747:0:32642:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964480.962760:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00000100:00000001:1.0:1790964480.962764:0:32642:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964480.962767:0:32642:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964480.962769:0:32642:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964480.962772:0:32642:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964480.962775:0:32642:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964480.962863:0:31768:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964480.962880:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964480.962881:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964480.962883:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964480.962886:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964480.962888:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964480.962890:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964481.281061:0:415:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964481.281140:0:415:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964481.281147:0:415:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964481.281149:0:415:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964481.282919:0:32593:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964481.282925:0:32593:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964481.282930:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:1.0:1790964481.982134:0:32642:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964481.982143:0:32642:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964481.982145:0:32642:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964481.982148:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00000100:00000001:1.0:1790964481.982153:0:32642:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964481.982156:0:32642:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964481.982158:0:32642:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964481.982160:0:32642:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964481.982162:0:32642:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964481.982367:0:31768:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964481.982387:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964481.982388:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964481.982391:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964481.982393:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964481.982395:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964481.982397:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964482.302083:0:415:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964482.302091:0:415:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964482.302099:0:415:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964482.302100:0:415:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964482.303885:0:32592:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964482.303893:0:32592:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964482.303925:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:1.0:1790964482.439661:0:32999:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964482.439677:0:32999:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964482.439683:0:32999:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:3.0:1790964482.799596:0:33035:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:3.0:1790964482.799603:0:33035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: conf-sanity test_167: @@@@@@ FAIL: mds1 mounted without a remote update llog 00000001:00000001:3.0:1790964482.809491:0:33035:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 10000000:00000001:1.0:1790964483.006198:0:32602:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:1.0:1790964483.006205:0:32602:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000fe25b1d6) refs 2 10000000:00000001:1.0:1790964483.006211:0:32602:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964483.006214:0:32602:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000001:1.0:1790964483.006215:0:32602:0:(mgc_request.c:120:config_log_put()) Process leaving 10000000:00000001:1.0:1790964483.006216:0:32602:0:(mgc_request.c:601:do_requeue()) Process entered 10000000:01000000:1.0:1790964483.006219:0:32602:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:00000001:1.0:1790964483.006221:0:32602:0:(mgc_request.c:1783:mgc_process_log()) Process entered 10000000:01000000:1.0:1790964483.006223:0:32602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff957e7ce43000 from 9 10000000:00000001:1.0:1790964483.006226:0:32602:0:(mgc_request.c:990:mgc_enqueue()) Process entered 10000000:01000000:1.0:1790964483.006227:0:32602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00000010:1.0:1790964483.006236:0:32602:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000065ff5e49. 00000020:00000040:1.0:1790964483.006240:0:32602:0:(genops.c:1210:class_import_get()) import 00000000e79a1a7f refcount=4 obd=MGC192.168.204.132@tcp 00000100:00000001:1.0:1790964483.006245:0:32602:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964483.006249:0:32602:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964483.006254:0:32602:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964483.006260:0:32602:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000c2299283. 00000100:00000001:1.0:1790964483.006267:0:32602:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964483.006271:0:32602:0:(ldlm_request.c:1064:ldlm_cli_enqueue()) Process entered 00010000:00000001:1.0:1790964483.006273:0:32602:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:1.0:1790964483.006286:0:32602:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 0000000008605f68. 00010000:00000001:1.0:1790964483.006291:0:32602:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:1.0:1790964483.006294:0:32602:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 00000000de5a3e6d. 00000020:00000001:1.0:1790964483.006298:0:32602:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:1.0:1790964483.006301:0:32602:0:(lustre_handles.c:93:class_handle_hash()) added object 00000000de5a3e6d with handle 0x461a674dcbd7c67e to hash 00000020:00000001:1.0:1790964483.006303:0:32602:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:1.0:1790964483.006304:0:32602:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000001:1.0:1790964483.006307:0:32602:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000001:1.0:1790964483.006310:0:32602:0:(ldlm_lock.c:261:ldlm_lock_remove_from_lru_check()) Process entered 00010000:00000001:1.0:1790964483.006313:0:32602:0:(ldlm_lock.c:280:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964483.006315:0:32602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000de5a3e6d/0x461a674dcbd7c67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964483.006324:0:32602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000de5a3e6d/0x461a674dcbd7c67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964483.006334:0:32602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000de5a3e6d/0x461a674dcbd7c67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000001:1.0:1790964483.006340:0:32602:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:1.0:1790964483.006342:0:32602:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:1.0:1790964483.006362:0:32602:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 000000008eeacf2b. 00000100:00000001:1.0:1790964483.006365:0:32602:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446626969253731712 : -117104455819904 : ffff957e7e825d80) 00000100:00000001:1.0:1790964483.006368:0:32602:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964483.006369:0:32602:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626964138938752 : -117109570612864 : ffff957d4da4d180) 00000100:00000001:1.0:1790964483.006374:0:32602:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964483.006376:0:32602:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.006378:0:32602:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:1.0:1790964483.006380:0:32602:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964483.006388:0:32602:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.006395:0:32602:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964483.006397:0:32602:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964483.006401:0:32602:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964483.006409:0:32602:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964483.006411:0:32602:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964483.006413:0:32602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f924b2d8-958e-436c-995a-bd5c559444c6:32602:1877962346467072:0@lo:101: 00000100:00000001:1.0:1790964483.006417:0:32602:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00000001:3.0:1790964483.006561:0:32642:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964483.006565:0:32642:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964483.006567:0:32642:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964483.006570:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00000100:00000001:3.0:1790964483.006572:0:32642:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964483.006575:0:32642:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964483.006577:0:32642:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964483.006579:0:32642:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964483.006581:0:32642:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.007101:0:31768:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964483.007112:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964483.007113:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964483.007116:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964483.007118:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964483.007120:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.007122:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964483.007236:0:32602:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964483.007240:0:32602:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964483.007243:0:32602:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964483.007249:0:32602:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000035b9078. 02000000:00000001:1.0:1790964483.007251:0:32602:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964483.007258:0:32602:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000ff8cade6. 00000400:00000010:1.0:1790964483.007266:0:32602:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000008bb7827a. 00000100:00000200:1.0:1790964483.007272:0:32602:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877962346467072, portal 25 00000100:00000001:1.0:1790964483.007275:0:32602:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964483.007276:0:32602:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626964138938752 : -117109570612864 : ffff957d4da4d180) 00000100:00000040:1.0:1790964483.007282:0:32602:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.007289:0:32602:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964483.007291:0:32602:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964483.007293:0:32602:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000006c9a5f37. 00000100:00000200:1.0:1790964483.007295:0:32602:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1877962346467072, offset 0 00000400:00000200:1.0:1790964483.007301:0:32602:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964483.007315:0:32602:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964483.007325:0:32602:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 328 into portal 26 MB=0x6abff2e900f00 00000400:00000200:1.0:1790964483.007331:0:32602:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 328/328 into md 0x165 [2] + 0 00000400:00000010:1.0:1790964483.007336:0:32602:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000004189e22c. 00000400:00000200:1.0:1790964483.007341:0:32602:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000001813ab2c 00000400:00000200:1.0:1790964483.007361:0:32602:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964483.007366:0:32602:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964483.007372:0:32602:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000001813ab2c 00000400:00000010:1.0:1790964483.007375:0:32602:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000001813ab2c. 00000100:00000001:1.0:1790964483.007380:0:32602:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964483.007382:0:32602:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964483.007386:0:32602:0:(events.c:341:request_in_callback()) incoming req@000000000e505ec4 x1877962346467072 msgsize 328 00000100:00100000:1.0:1790964483.007391:0:32602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964483.007401:0:32602:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964483.007421:0:32602:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964483.007431:0:32602:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000006c9a5f37 00000400:00000010:1.0:1790964483.007433:0:32602:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000006c9a5f37. 00000100:00000001:1.0:1790964483.007437:0:32602:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964483.007441:0:32602:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.007450:0:32602:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964483.007453:0:32602:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.007459:0:32602:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.007461:0:32602:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964483.007467:0:32602:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.007471:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 0 is 4295612420 00000100:00000010:1.0:1790964483.007476:0:32602:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000056c30fa4. 00000100:00000001:1.0:1790964483.007483:0:32602:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1790964483.007532:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 1 is 4295612420 00000100:00000010:1.0:1790964483.007536:0:32602:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000032da5e42. 00000100:00000001:1.0:1790964483.007540:0:32602:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 1 00000100:00000001:1.0:1790964483.007543:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 2 is 4295612420 00000100:00000010:1.0:1790964483.007545:0:32602:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000e44d9fbc. 00000100:00000001:1.0:1790964483.007548:0:32602:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1790964483.007550:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 3 is 4295612420 00000100:00000010:1.0:1790964483.007553:0:32602:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000001a55c799. 00000100:00000001:1.0:1790964483.007555:0:32602:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1790964483.007558:0:32602:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964483.007560:0:32602:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.007563:0:32602:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964483.007564:0:32602:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:1.0:1790964483.007565:0:32602:0:(client.c:2716:ptlrpc_set_wait()) set 000000008eeacf2b going to sleep for 11 seconds 00000100:00000001:1.0:1790964483.007567:0:32602:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964483.007569:0:32602:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964483.007711:0:32599:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964483.007715:0:32599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346467072 02000000:00000001:3.0:1790964483.007717:0:32599:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964483.007720:0:32599:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964483.007722:0:32599:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964483.007727:0:32599:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964483.007730:0:32599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346467072 00000020:00000001:3.0:1790964483.007733:0:32599:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964483.007735:0:32599:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c597 00000020:00000001:3.0:1790964483.007737:0:32599:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964483.007740:0:32599:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000627856b7 refcount=11 00000020:00000001:3.0:1790964483.007742:0:32599:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000020:00000001:3.0:1790964483.007744:0:32599:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000100:00000001:3.0:1790964483.007748:0:32599:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964483.007753:0:32599:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000062456154. 00000100:00000001:3.0:1790964483.007755:0:32599:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964483.007757:0:32599:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000062456154. 00000020:00000010:3.0:1790964483.007833:0:32599:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000051dc7313. 00000020:00000010:3.0:1790964483.007839:0:32599:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 0000000089b18570. 00000020:00000010:3.0:1790964483.007843:0:32599:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000060b9033d. 00000100:00000040:3.0:1790964483.008115:0:32599:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:3.0:1790964483.008126:0:32599:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964483.008127:0:32599:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1790964483.008129:0:32599:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964483.008137:0:32599:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964483.008143:0:32599:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964483.008153:0:32599:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964483.008155:0:32599:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964483.008159:0:32599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00000040:3.0:1790964483.008163:0:32599:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000627856b7 : new rpc_count 1 00000100:00000001:3.0:1790964483.008165:0:32599:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446626968321016912 : -117105388534704 : ffff957e46ea4450) 00000100:00000040:3.0:1790964483.008169:0:32599:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000000e505ec4 x1877962346467072/t0(0) o101->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:304/0 lens 328/0 e 0 to 0 dl 1790964494 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964483.008178:0:32599:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964483.008181:0:32599:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000062456154. 00000100:00000001:3.0:1790964483.008183:0:32599:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964483.008185:0:32599:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000062456154. 00000100:00100000:3.0:1790964483.008190:0:32599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e505ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+11:32602:x1877962346467072:12345-0@lo:101: 00000100:00000200:3.0:1790964483.008194:0:32599:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962346467072 00000020:00000001:3.0:1790964483.008198:0:32599:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1790964483.008202:0:32599:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1790964483.008205:0:32599:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964483.008208:0:32599:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1790964483.008210:0:32599:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669370496 : -1040181120 : ffffffffc2001880) 00000020:00000001:3.0:1790964483.008213:0:32599:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1790964483.008215:0:32599:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964483.008217:0:32599:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1790964483.008219:0:32599:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1790964483.008224:0:32599:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964483.008226:0:32599:0:(tgt_handler.c:1471:tgt_enqueue()) Process entered 00010000:00000001:3.0:1790964483.008228:0:32599:0:(ldlm_lockd.c:1263:ldlm_handle_enqueue()) Process entered 00010000:00010000:3.0:1790964483.008229:0:32599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000001:3.0:1790964483.008231:0:32599:0:(ldlm_lockd.c:1725:ldlm_request_cancel()) Process entered 00010000:00000001:3.0:1790964483.008234:0:32599:0:(ldlm_lockd.c:1734:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964483.008257:0:32599:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:3.0:1790964483.008265:0:32599:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000e0d23508. 00010000:00000001:3.0:1790964483.008270:0:32599:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:3.0:1790964483.008273:0:32599:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 00000000e5777a69. 00000020:00000001:3.0:1790964483.008276:0:32599:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:3.0:1790964483.008277:0:32599:0:(lustre_handles.c:93:class_handle_hash()) added object 00000000e5777a69 with handle 0x461a674dcbd7c685 to hash 00000020:00000001:3.0:1790964483.008279:0:32599:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:3.0:1790964483.008280:0:32599:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446626968205204992 : -117105504346624 : ffff957e40031e00) 00010000:00000001:3.0:1790964483.008283:0:32599:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446626968205204992 : -117105504346624 : ffff957e40031e00) 00010000:00010000:3.0:1790964483.008286:0:32599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5777a69/0x461a674dcbd7c685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x461a674dcbd7c67e expref: -99 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1790964483.008294:0:32599:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export 00000000627856b7 : new locks_count 6 00000020:00000040:3.0:1790964483.008296:0:32599:0:(genops.c:868:class_export_get()) GET export 00000000627856b7 refcount=12 00000100:00000001:3.0:1790964483.008306:0:32599:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964483.008309:0:32599:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1790964483.008312:0:32599:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 640 at 00000000abfeec60. 02000000:00000001:3.0:1790964483.008314:0:32599:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964483.008316:0:32599:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964483.008319:0:32599:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:3.0:1790964483.008322:0:32599:0:(ldlm_lock.c:1758:ldlm_lock_enqueue_helper()) Process entered 00010000:00000001:3.0:1790964483.008324:0:32599:0:(ldlm_plain.c:119:ldlm_process_plain_lock()) Process entered 00010000:00000001:3.0:1790964483.008326:0:32599:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:3.0:1790964483.008328:0:32599:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:3.0:1790964483.008330:0:32599:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:3.0:1790964483.008331:0:32599:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:3.0:1790964483.008333:0:32599:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:3.0:1790964483.008335:0:32599:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:3.0:1790964483.008337:0:32599:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:3.0:1790964483.008339:0:32599:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:3.0:1790964483.008341:0:32599:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000e0d23508) refcount = 1 00010000:00010000:3.0:1790964483.008345:0:32599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5777a69/0x461a674dcbd7c685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x461a674dcbd7c67e expref: 12 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964483.008364:0:32599:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:3.0:1790964483.008371:0:32599:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:3.0:1790964483.008372:0:32599:0:(ldlm_plain.c:146:ldlm_process_plain_lock()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:3.0:1790964483.008374:0:32599:0:(ldlm_lock.c:1769:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964483.008376:0:32599:0:(ldlm_lock.c:1928:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:3.0:1790964483.008382:0:32599:0:(ldlm_lockd.c:1494:ldlm_handle_enqueue()) Process leaving 00010000:00010000:3.0:1790964483.008385:0:32599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5777a69/0x461a674dcbd7c685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x461a674dcbd7c67e expref: 12 pid: 32599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964483.008392:0:32599:0:(ldlm_lock.c:2393:__ldlm_reprocess_all()) Process entered 00010000:00000001:3.0:1790964483.008394:0:32599:0:(ldlm_lock.c:1970:ldlm_reprocess_queue()) Process entered 00010000:00000001:3.0:1790964483.008396:0:32599:0:(ldlm_lock.c:2019:ldlm_reprocess_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:3.0:1790964483.008398:0:32599:0:(ldlm_lock.c:2323:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964483.008400:0:32599:0:(ldlm_lock.c:2427:__ldlm_reprocess_all()) Process leaving 00010000:00000001:3.0:1790964483.008401:0:32599:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964483.008403:0:32599:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:3.0:1790964483.008404:0:32599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5777a69, rc 0) 00000020:00000001:3.0:1790964483.008406:0:32599:0:(tgt_handler.c:1496:tgt_enqueue()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1790964483.008409:0:32599:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962346467072 00010000:00000001:3.0:1790964483.008411:0:32599:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:3.0:1790964483.008415:0:32599:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000000e505ec4 x1877962346467072/t0(0) o101->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:304/0 lens 328/344 e 0 to 0 dl 1790964494 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964483.009386:0:32599:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964483.009392:0:32599:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964483.009398:0:32599:0:(import.c:2195:obd_at_measure()) add 1 to 000000008c4d0c38 time=9 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964483.009403:0:32599:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964483.009406:0:32599:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 00000100:00000001:3.0:1790964483.009409:0:32599:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 02000000:00000001:3.0:1790964483.009412:0:32599:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964483.009414:0:32599:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964483.009417:0:32599:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964483.009419:0:32599:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964483.009563:0:32599:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000000901ebfd. 00000100:00000200:3.0:1790964483.009571:0:32599:0:(niobuf.c:94:ptl_send_buf()) Sending 344 bytes to portal 25, xid 1877962346467072, offset 224 00000400:00000200:3.0:1790964483.009578:0:32599:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964483.009590:0:32599:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964483.009608:0:32599:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 344 into portal 25 MB=0x6abff2e900f00 00000400:00000200:3.0:1790964483.009615:0:32599:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 344/344 into md 0xac5 [1] + 224 00000400:00000200:3.0:1790964483.009626:0:32599:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964483.009630:0:32599:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964483.009637:0:32599:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964483.009643:0:32599:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964483.009653:0:32599:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964483.009668:0:32599:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964483.009676:0:32599:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000901ebfd 00000400:00000010:3.0:1790964483.009678:0:32599:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000000901ebfd. 00000100:00000001:3.0:1790964483.009682:0:32599:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964483.009683:0:32599:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1790964483.009688:0:32599:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964483.009690:0:32599:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 16 to 0@lo 00010000:00000001:3.0:1790964483.009693:0:32599:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:3.0:1790964483.009694:0:32599:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964483.009696:0:32599:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1790964483.009701:0:32599:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000000e505ec4 x1877962346467072/t0(0) o101->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:304/0 lens 328/344 e 0 to 0 dl 1790964494 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964483.009710:0:32599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e505ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f924b2d8-958e-436c-995a-bd5c559444c6+12:32602:x1877962346467072:12345-0@lo:101: Request processed in 1531us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964483.009718:0:32599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00000040:3.0:1790964483.009721:0:32599:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000627856b7 : new rpc_count 0 00000100:00000001:3.0:1790964483.009724:0:32599:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964483.009725:0:32599:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1790964483.009731:0:32599:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 0000000089b18570. 00000020:00000010:3.0:1790964483.009736:0:32599:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000060b9033d. 00000020:00000010:3.0:1790964483.009740:0:32599:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000051dc7313. 00000020:00000040:3.0:1790964483.009744:0:32599:0:(genops.c:879:class_export_put()) PUTting export 00000000627856b7 : new refcount 11 02000000:00000001:3.0:1790964483.009748:0:32599:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:3.0:1790964483.009755:0:32599:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 640 at 00000000abfeec60. 02000000:00000001:3.0:1790964483.009757:0:32599:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:3.0:1790964483.009760:0:32599:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:3.0:1790964483.009766:0:32599:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:3.0:1790964483.009771:0:32599:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000054a49e3b. 00000400:00000010:3.0:1790964483.009777:0:32599:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000a6fc5be2. 00000100:00000001:1.0:1790964483.010783:0:32602:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964483.010792:0:32602:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964483.010794:0:32602:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964483.010798:0:32602:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000ff8cade6. 00000400:00000200:1.0:1790964483.010802:0:32602:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008bb7827a 00000400:00000010:1.0:1790964483.010804:0:32602:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000008bb7827a. 00000100:00000001:1.0:1790964483.010809:0:32602:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964483.010813:0:32602:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964483.010822:0:32602:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.010829:0:32602:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964483.010830:0:32602:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964483.010833:0:32602:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964483.010836:0:32602:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964483.010838:0:32602:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964483.010840:0:32602:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964483.010842:0:32602:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964483.010847:0:32602:0:(import.c:2195:obd_at_measure()) add 5 to 000000002212e16a time=9 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964483.010850:0:32602:0:(import.c:2195:obd_at_measure()) add 1 to 0000000029d7efcb time=9 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964483.010853:0:32602:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964483.010854:0:32602:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964483.010856:0:32602:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1790964483.010858:0:32602:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.010861:0:32602:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964483.010865:0:32602:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.010872:0:32602:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964483.010875:0:32602:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964483.010876:0:32602:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964483.010879:0:32602:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964483.010885:0:32602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f924b2d8-958e-436c-995a-bd5c559444c6:32602:1877962346467072:0@lo:101: 00000100:00000001:1.0:1790964483.010891:0:32602:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964483.010900:0:32602:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.010903:0:32602:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:1.0:1790964483.010904:0:32602:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964483.010907:0:32602:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.010913:0:32602:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:1.0:1790964483.010916:0:32602:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 000000008eeacf2b. 00000100:00000001:1.0:1790964483.010918:0:32602:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:1.0:1790964483.010920:0:32602:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964483.010923:0:32602:0:(ldlm_request.c:661:ldlm_cli_enqueue_fini()) Process entered 00010000:00000001:1.0:1790964483.010925:0:32602:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:1.0:1790964483.010927:0:32602:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964483.010930:0:32602:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000de5a3e6d refcount=4 00000020:00000001:1.0:1790964483.010932:0:32602:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000001:1.0:1790964483.010935:0:32602:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000040:1.0:1790964483.010941:0:32602:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: 00000000de5a3e6d, remote cookie: 0x461a674dcbd7c685, flags: 0x0 00010000:00000001:1.0:1790964483.010984:0:32602:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:1.0:1790964483.010988:0:32602:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:1.0:1790964483.010989:0:32602:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:1.0:1790964483.010992:0:32602:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:1.0:1790964483.010993:0:32602:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:1.0:1790964483.010995:0:32602:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (0000000008605f68) refcount = 1 00010000:00010000:1.0:1790964483.011000:0:32602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000de5a3e6d/0x461a674dcbd7c67e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c685 expref: -99 pid: 32602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964483.011007:0:32602:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:1.0:1790964483.011009:0:32602:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:1.0:1790964483.011010:0:32602:0:(ldlm_lock.c:1914:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:1.0:1790964483.011014:0:32602:0:(ldlm_request.c:286:ldlm_completion_ast()) Process entered 00010000:00000001:1.0:1790964483.011016:0:32602:0:(ldlm_request.c:295:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964483.011018:0:32602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000de5a3e6d/0x461a674dcbd7c67e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x461a674dcbd7c685 expref: -99 pid: 32602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964483.011023:0:32602:0:(ldlm_request.c:842:ldlm_cli_enqueue_fini()) Process leaving 00010000:00000001:1.0:1790964483.011031:0:32602:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964483.011033:0:32602:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1790964483.011034:0:32602:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964483.011035:0:32602:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1790964483.011037:0:32602:0:(ldlm_request.c:1218:ldlm_cli_enqueue()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.011040:0:32602:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964483.011043:0:32602:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000065ff5e49 x1877962346467072/t0(0) o101->MGC192.168.204.132@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964499 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.011050:0:32602:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964483.011053:0:32602:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964483.011056:0:32602:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000035b9078. 02000000:00000001:1.0:1790964483.011059:0:32602:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964483.011062:0:32602:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964483.011063:0:32602:0:(genops.c:1223:class_import_put()) import 00000000e79a1a7f refcount=3 obd=MGC192.168.204.132@tcp 00000020:00000001:1.0:1790964483.011065:0:32602:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964483.011067:0:32602:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000c2299283. 02000000:00000001:1.0:1790964483.011071:0:32602:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964483.011072:0:32602:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964483.011074:0:32602:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000065ff5e49. 00000100:00000001:1.0:1790964483.011077:0:32602:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964483.011078:0:32602:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000001:1.0:1790964483.011080:0:32602:0:(mgc_request.c:1023:mgc_enqueue()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964483.011083:0:32602:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:1.0:1790964483.011084:0:32602:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (00000000fe25b1d6) refs 3 10000000:00000001:1.0:1790964483.011086:0:32602:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964483.011088:0:32602:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:1.0:1790964483.011089:0:32602:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964483.011090:0:32602:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000de5a3e6d refcount=3 00000020:00000001:1.0:1790964483.011092:0:32602:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000001:1.0:1790964483.011093:0:32602:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000001:1.0:1790964483.011095:0:32602:0:(ldlm_lock.c:2547:ldlm_lock_set_data()) Process entered 00010000:00000001:1.0:1790964483.011096:0:32602:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964483.011097:0:32602:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1790964483.011098:0:32602:0:(ldlm_lock.c:2556:ldlm_lock_set_data()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964483.011100:0:32602:0:(mgc_request.c:1520:mgc_process_recover_log()) Process entered 10000000:00000010:1.0:1790964483.011104:0:32602:0:(mgc_request.c:1532:mgc_process_recover_log()) kmalloced '(folios)': 32 at 000000000c567c6a. 00000100:00000010:1.0:1790964483.011118:0:32602:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000065ff5e49. 00000020:00000040:1.0:1790964483.011125:0:32602:0:(genops.c:1210:class_import_get()) import 00000000e79a1a7f refcount=4 obd=MGC192.168.204.132@tcp 00000100:00000001:1.0:1790964483.011129:0:32602:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1790964483.011130:0:32602:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1790964483.011135:0:32602:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1790964483.011139:0:32602:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000c2299283. 00000100:00000001:1.0:1790964483.011144:0:32602:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.011148:0:32602:0:(client.c:227:ptlrpc_prep_bulk_imp()) Process entered 00000100:00000010:1.0:1790964483.011151:0:32602:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 00000000035b9078. 00000100:00000010:1.0:1790964483.011153:0:32602:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 64 at 00000000700dd65d. 00000020:00000040:1.0:1790964483.011155:0:32602:0:(genops.c:1210:class_import_get()) import 00000000e79a1a7f refcount=5 obd=MGC192.168.204.132@tcp 00000100:00000001:1.0:1790964483.011159:0:32602:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:1.0:1790964483.011160:0:32602:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:1.0:1790964483.011164:0:32602:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 000000008eeacf2b. 00000100:00000001:1.0:1790964483.011165:0:32602:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446626969253731712 : -117104455819904 : ffff957e7e825d80) 00000100:00000001:1.0:1790964483.011168:0:32602:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964483.011169:0:32602:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626964138938752 : -117109570612864 : ffff957d4da4d180) 00000100:00000001:1.0:1790964483.011173:0:32602:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1790964483.011176:0:32602:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.011177:0:32602:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:1.0:1790964483.011179:0:32602:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964483.011182:0:32602:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.011188:0:32602:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964483.011190:0:32602:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964483.011193:0:32602:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964483.011195:0:32602:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964483.011197:0:32602:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964483.011199:0:32602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f924b2d8-958e-436c-995a-bd5c559444c6:32602:1877962346467200:0@lo:256: 00000100:00000001:1.0:1790964483.011203:0:32602:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964483.011207:0:32602:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964483.011209:0:32602:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.011211:0:32602:0:(niobuf.c:346:ptlrpc_register_bulk()) Process entered 00000400:00000010:1.0:1790964483.011215:0:32602:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000ff8cade6. 00000100:00000040:2.0:1790964483.011397:0:761:0:(connection.c:75:cpu_latency_work()) work item of 000000005b676f3c (cpu 2) has reached its deadline 4295612420, at 4295612421 00000100:00000010:2.0:1790964483.011406:0:761:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000e44d9fbc. 00000100:00000040:0.0:1790964483.013837:0:415:0:(connection.c:75:cpu_latency_work()) work item of 00000000bf744d4f (cpu 0) has reached its deadline 4295612420, at 4295612423 00000100:00000010:0.0:1790964483.013857:0:415:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000056c30fa4. 00000100:00000040:3.0:1790964483.013991:0:24982:0:(connection.c:75:cpu_latency_work()) work item of 000000009d5debbb (cpu 3) has reached its deadline 4295612420, at 4295612423 00000100:00000010:3.0:1790964483.013998:0:24982:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000001a55c799. 00000400:00000010:1.0:1790964483.014842:0:32602:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at 00000000fd58da5b. 00000100:00000200:1.0:1790964483.014857:0:32602:0:(niobuf.c:453:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 4 pages 16384 bytes, mbits x0x6abff2e900f80-0x6abff2e900f80, portal 33 00000100:00000001:1.0:1790964483.014871:0:32602:0:(niobuf.c:455:ptlrpc_register_bulk()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964483.014874:0:32602:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964483.014880:0:32602:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000016b8082c. 02000000:00000001:1.0:1790964483.014883:0:32602:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964483.014889:0:32602:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000004189e22c. 00000400:00000010:1.0:1790964483.014895:0:32602:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000008bb7827a. 00000100:00000200:1.0:1790964483.014898:0:32602:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877962346467200, portal 25 00000100:00000001:1.0:1790964483.014901:0:32602:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964483.014903:0:32602:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626964138938752 : -117109570612864 : ffff957d4da4d180) 00000100:00000040:1.0:1790964483.014913:0:32602:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.014920:0:32602:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964483.014923:0:32602:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964483.014925:0:32602:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000006c9a5f37. 00000100:00000200:1.0:1790964483.014928:0:32602:0:(niobuf.c:94:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1877962346467200, offset 0 00000400:00000200:1.0:1790964483.014933:0:32602:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964483.014961:0:32602:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964483.014971:0:32602:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 304 into portal 26 MB=0x6abff2e900f80 00000400:00000200:1.0:1790964483.014976:0:32602:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 304/304 into md 0x169 [2] + 0 00000400:00000010:1.0:1790964483.014981:0:32602:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000002de6410c. 00000400:00000200:1.0:1790964483.014984:0:32602:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 0000000095349b43 00000400:00000200:1.0:1790964483.014990:0:32602:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964483.014995:0:32602:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964483.014999:0:32602:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000095349b43 00000400:00000010:1.0:1790964483.015002:0:32602:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 0000000095349b43. 00000100:00000001:1.0:1790964483.015006:0:32602:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964483.015008:0:32602:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964483.015011:0:32602:0:(events.c:341:request_in_callback()) incoming req@0000000061bd50c9 x1877962346467200 msgsize 304 00000100:00100000:1.0:1790964483.015015:0:32602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964483.015017:0:32602:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964483.015068:0:32602:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964483.015076:0:32602:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000006c9a5f37 00000400:00000010:1.0:1790964483.015077:0:32602:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000006c9a5f37. 00000100:00000001:1.0:1790964483.015081:0:32602:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964483.015089:0:32602:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.015099:0:32602:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964483.015101:0:32602:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.015108:0:32602:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.015110:0:32602:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964483.015117:0:32602:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.015121:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 0 is 4295612428 00000100:00000010:1.0:1790964483.015147:0:32602:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000068552d0a. 00000100:00000001:1.0:1790964483.015152:0:32602:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1790964483.015157:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 1 is 4295612428 00000100:00000001:1.0:1790964483.015162:0:32602:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295612420 00000100:00000001:1.0:1790964483.015165:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 2 is 4295612428 00000100:00000010:1.0:1790964483.015167:0:32602:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000000d725305. 00000100:00000001:1.0:1790964483.015170:0:32602:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1790964483.015173:0:32602:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 3 is 4295612428 00000100:00000010:1.0:1790964483.015175:0:32602:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000fd1dc97e. 00000100:00000001:1.0:1790964483.015177:0:32602:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1790964483.015183:0:32602:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964483.015186:0:32602:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.015188:0:32602:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964483.015190:0:32602:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:1.0:1790964483.015193:0:32602:0:(client.c:2716:ptlrpc_set_wait()) set 000000008eeacf2b going to sleep for 11 seconds 00000100:00000001:1.0:1790964483.015195:0:32602:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964483.015198:0:32602:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.015930:0:32598:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964483.015935:0:32598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346467200 02000000:00000001:0.0:1790964483.015937:0:32598:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964483.015939:0:32598:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964483.015941:0:32598:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964483.015988:0:32598:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964483.015994:0:32598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346467200 00000020:00000001:0.0:1790964483.015997:0:32598:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964483.016009:0:32598:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c597 00000020:00000001:0.0:1790964483.016011:0:32598:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964483.016014:0:32598:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000627856b7 refcount=12 00000020:00000001:0.0:1790964483.016017:0:32598:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000020:00000001:0.0:1790964483.016020:0:32598:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000100:00000001:0.0:1790964483.016025:0:32598:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964483.016029:0:32598:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000002f2c1e9f. 00000100:00000001:0.0:1790964483.016032:0:32598:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964483.016035:0:32598:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000002f2c1e9f. 00000020:00000010:0.0:1790964483.016042:0:32598:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000013cf431d. 00000020:00000010:0.0:1790964483.016048:0:32598:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000fc96090a. 00000020:00000010:0.0:1790964483.016053:0:32598:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000032d9e1b1. 00000100:00000040:0.0:1790964483.016062:0:32598:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:0.0:1790964483.016065:0:32598:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964483.016066:0:32598:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964483.016068:0:32598:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.016076:0:32598:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.016090:0:32598:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964483.016100:0:32598:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964483.016102:0:32598:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964483.016108:0:32598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00000040:0.0:1790964483.016111:0:32598:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000627856b7 : new rpc_count 1 00000100:00000001:0.0:1790964483.016113:0:32598:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446626968321018960 : -117105388532656 : ffff957e46ea4c50) 00000100:00000040:0.0:1790964483.016118:0:32598:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@0000000061bd50c9 x1877962346467200/t0(0) o256->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:304/0 lens 304/0 e 0 to 0 dl 1790964494 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964483.016128:0:32598:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964483.016131:0:32598:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000002f2c1e9f. 00000100:00000001:0.0:1790964483.016132:0:32598:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964483.016134:0:32598:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000002f2c1e9f. 00000100:00100000:0.0:1790964483.016138:0:32598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061bd50c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+12:32602:x1877962346467200:12345-0@lo:256: 00000100:00000200:0.0:1790964483.016142:0:32598:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962346467200 00000020:00000001:0.0:1790964483.016145:0:32598:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:0.0:1790964483.016155:0:32598:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:0.0:1790964483.016158:0:32598:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964483.016160:0:32598:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1790964483.016162:0:32598:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669370912 : -1040180704 : ffffffffc2001a20) 00000020:00000001:0.0:1790964483.016164:0:32598:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1790964483.016166:0:32598:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1790964483.016168:0:32598:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1790964483.016170:0:32598:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1790964483.016174:0:32598:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.016178:0:32598:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964483.016180:0:32598:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1790964483.016184:0:32598:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 536 at 0000000054e6537a. 02000000:00000001:0.0:1790964483.016187:0:32598:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.016189:0:32598:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 20000000:00000001:0.0:1790964483.016191:0:32598:0:(mgs_handler.c:690:mgs_config_read()) Process entered 20000000:00000001:0.0:1790964483.016196:0:32598:0:(mgs_nids.c:889:mgs_get_ir_logs()) Process entered 20000000:01000000:0.0:1790964483.016200:0:32598:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000010:0.0:1790964483.016202:0:32598:0:(mgs_nids.c:917:mgs_get_ir_logs()) kmalloced '(folios)': 32 at 00000000ddae3b65. 20000000:00000001:0.0:1790964483.016205:0:32598:0:(mgs_nids.c:188:mgs_nidtbl_read()) Process entered 20000000:00000040:0.0:1790964483.016212:0:32598:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:0.0:1790964483.016218:0:32598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790964483.016220:0:32598:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 20000000:00000001:0.0:1790964483.016222:0:32598:0:(mgs_nids.c:321:mgs_nidtbl_read()) Process leaving (rc=44 : 44 : 2c) 00000100:00000001:0.0:1790964483.016225:0:32598:0:(niobuf.c:145:ptlrpc_prep_bulk_exp()) Process entered 00000100:00000010:0.0:1790964483.016228:0:32598:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 000000005cf11bbf. 00000100:00000010:0.0:1790964483.016232:0:32598:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 16 at 00000000697d3f24. 00000020:00000040:0.0:1790964483.016234:0:32598:0:(genops.c:868:class_export_get()) GET export 00000000627856b7 refcount=13 00010000:00000001:0.0:1790964483.016239:0:32598:0:(ldlm_lib.c:3582:target_bulk_io()) Process entered 00000100:00000001:0.0:1790964483.016241:0:32598:0:(niobuf.c:184:ptlrpc_start_bulk_transfer()) Process entered 00000400:00000010:0.0:1790964483.016246:0:32598:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000df649902. 00000400:00000010:0.0:1790964483.016254:0:32598:0:(lib-lnet.h:449:lnet_rspt_alloc()) alloc 'rspt': 64 at 0000000058b0246d. 00000400:00000200:0.0:1790964483.016257:0:32598:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964483.016267:0:32598:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964483.016275:0:32598:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 44 into portal 33 MB=0x6abff2e900f80 00000400:00000200:0.0:1790964483.016281:0:32598:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 21 from 12345-0@lo of length 44/44 into md 0xad5 [4] + 0 00000400:00000010:0.0:1790964483.016285:0:32598:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000ff8cade6. 00000400:00000200:0.0:1790964483.016294:0:32598:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000fd58da5b 00000400:00000200:0.0:1790964483.016299:0:32598:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964483.016303:0:32598:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:0.0:1790964483.016307:0:32598:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000fd58da5b 00000400:00000010:0.0:1790964483.016309:0:32598:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 184 at 00000000fd58da5b. 00000100:00000001:0.0:1790964483.016313:0:32598:0:(events.c:177:client_bulk_callback()) Process entered 00000100:00000200:0.0:1790964483.016315:0:32598:0:(events.c:195:client_bulk_callback()) event type 2, status 0, req 0000000065ff5e49 desc 00000000035b9078 mbits 1877962346467200 00000100:00000001:0.0:1790964483.016325:0:32598:0:(events.c:220:client_bulk_callback()) Process leaving 00000400:00000200:0.0:1790964483.016330:0:32598:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md 0000000000000000 with offset 0 00000400:00000200:0.0:1790964483.016335:0:32598:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : ACK - for me 00000400:00000200:0.0:1790964483.016341:0:32598:0:(lib-move.c:4532:lnet_parse_ack()) 0@lo: ACK from 12345-0@lo into md 0xae1 00000400:00000200:0.0:1790964483.016344:0:32598:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964483.016347:0:32598:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: ACK: OK 00000100:00000001:0.0:1790964483.016361:0:32598:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:0.0:1790964483.016363:0:32598:0:(events.c:464:server_bulk_callback()) event type 4, status 0, desc 000000005cf11bbf 00000100:00000001:0.0:1790964483.016365:0:32598:0:(events.c:491:server_bulk_callback()) Process leaving 00000400:00000200:0.0:1790964483.016372:0:32598:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000df649902 00000400:00000010:0.0:1790964483.016374:0:32598:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000df649902. 00000100:00000001:0.0:1790964483.016376:0:32598:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:0.0:1790964483.016377:0:32598:0:(events.c:464:server_bulk_callback()) event type 5, status 0, desc 000000005cf11bbf 00000100:00000001:0.0:1790964483.016379:0:32598:0:(events.c:491:server_bulk_callback()) Process leaving 00000100:00000200:0.0:1790964483.016383:0:32598:0:(niobuf.c:279:ptlrpc_start_bulk_transfer()) Transferring 1 pages 44 bytes via portal 33 id 12345-0@lo mbits 0x6abff2e900f80-0x6abff2e900f80 00000100:00000001:0.0:1790964483.016387:0:32598:0:(niobuf.c:281:ptlrpc_start_bulk_transfer()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964483.016390:0:32598:0:(ldlm_lib.c:3674:target_bulk_io()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.016392:0:32598:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000040:0.0:1790964483.016395:0:32598:0:(genops.c:879:class_export_put()) PUTting export 00000000627856b7 : new refcount 12 00000100:00000010:0.0:1790964483.016398:0:32598:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 16 at 00000000697d3f24. 00000100:00000010:0.0:1790964483.016401:0:32598:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 000000005cf11bbf. 00000100:00000001:0.0:1790964483.016404:0:32598:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 20000000:00000001:0.0:1790964483.016405:0:32598:0:(mgs_nids.c:953:mgs_get_ir_logs()) Process leaving via out (rc=0 : 0 : 0x0) 20000000:00000010:0.0:1790964483.016414:0:32598:0:(mgs_nids.c:964:mgs_get_ir_logs()) kvfree 'folios': 32 at 00000000ddae3b65. 20000000:00000001:0.0:1790964483.016417:0:32598:0:(mgs_handler.c:713:mgs_config_read()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964483.016420:0:32598:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962346467200 00010000:00000001:0.0:1790964483.016423:0:32598:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:0.0:1790964483.016427:0:32598:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@0000000061bd50c9 x1877962346467200/t0(0) o256->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:304/0 lens 304/240 e 0 to 0 dl 1790964494 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964483.016439:0:32598:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964483.016441:0:32598:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964483.016445:0:32598:0:(import.c:2195:obd_at_measure()) add 1 to 000000008c4d0c38 time=9 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964483.016450:0:32598:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964483.016452:0:32598:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 00000100:00000001:0.0:1790964483.016454:0:32598:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 02000000:00000001:0.0:1790964483.016457:0:32598:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964483.016459:0:32598:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964483.016462:0:32598:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964483.016464:0:32598:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964483.016466:0:32598:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000df649902. 00000100:00000200:0.0:1790964483.016469:0:32598:0:(niobuf.c:94:ptl_send_buf()) Sending 240 bytes to portal 25, xid 1877962346467200, offset 224 00000400:00000200:0.0:1790964483.016472:0:32598:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964483.016477:0:32598:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964483.016482:0:32598:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 240 into portal 25 MB=0x6abff2e900f80 00000400:00000200:0.0:1790964483.016486:0:32598:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 240/240 into md 0xad9 [1] + 224 00000400:00000200:0.0:1790964483.016490:0:32598:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964483.016493:0:32598:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964483.016497:0:32598:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964483.016500:0:32598:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964483.016508:0:32598:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964483.016515:0:32598:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964483.016519:0:32598:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000df649902 00000400:00000010:0.0:1790964483.016520:0:32598:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000df649902. 00000100:00000001:0.0:1790964483.016523:0:32598:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964483.016524:0:32598:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964483.016526:0:32598:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964483.016528:0:32598:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 16 to 0@lo 00010000:00000001:0.0:1790964483.016531:0:32598:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:0.0:1790964483.016532:0:32598:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964483.016534:0:32598:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1790964483.016542:0:32598:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000061bd50c9 x1877962346467200/t0(0) o256->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:304/0 lens 304/240 e 0 to 0 dl 1790964494 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964483.016549:0:32598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061bd50c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f924b2d8-958e-436c-995a-bd5c559444c6+12:32602:x1877962346467200:12345-0@lo:256: Request processed in 421us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964483.016557:0:32598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00000040:0.0:1790964483.016560:0:32598:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000627856b7 : new rpc_count 0 00000100:00000001:0.0:1790964483.016562:0:32598:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964483.016563:0:32598:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964483.016567:0:32598:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000fc96090a. 00000020:00000010:0.0:1790964483.016571:0:32598:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000032d9e1b1. 00000020:00000010:0.0:1790964483.016574:0:32598:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000013cf431d. 00000020:00000040:0.0:1790964483.016578:0:32598:0:(genops.c:879:class_export_put()) PUTting export 00000000627856b7 : new refcount 11 02000000:00000001:0.0:1790964483.016580:0:32598:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:0.0:1790964483.016583:0:32598:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 536 at 0000000054e6537a. 02000000:00000001:0.0:1790964483.016585:0:32598:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:0.0:1790964483.016587:0:32598:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1790964483.016591:0:32598:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:0.0:1790964483.016595:0:32598:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000f4e1a7b4. 00000400:00000010:0.0:1790964483.016599:0:32598:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000e155c6c2. 00000100:00000001:1.0:1790964483.016692:0:32602:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964483.016698:0:32602:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964483.016700:0:32602:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964483.016701:0:32602:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000004189e22c. 00000400:00000200:1.0:1790964483.016704:0:32602:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008bb7827a 00000400:00000010:1.0:1790964483.016706:0:32602:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000008bb7827a. 00000100:00000001:1.0:1790964483.016708:0:32602:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964483.016717:0:32602:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964483.016724:0:32602:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.016730:0:32602:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964483.016732:0:32602:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964483.016734:0:32602:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964483.016737:0:32602:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964483.016738:0:32602:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964483.016740:0:32602:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964483.016742:0:32602:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964483.016747:0:32602:0:(import.c:2195:obd_at_measure()) add 5 to 000000002212e16a time=9 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964483.016750:0:32602:0:(import.c:2195:obd_at_measure()) add 1 to 0000000029d7efcb time=9 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964483.016752:0:32602:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964483.016754:0:32602:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964483.016756:0:32602:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1790964483.016758:0:32602:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.016762:0:32602:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964483.016764:0:32602:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964483.016787:0:32602:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.016793:0:32602:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964483.016796:0:32602:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964483.016798:0:32602:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964483.016804:0:32602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065ff5e49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f924b2d8-958e-436c-995a-bd5c559444c6:32602:1877962346467200:0@lo:256: 00000100:00000001:1.0:1790964483.016809:0:32602:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964483.016811:0:32602:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.016814:0:32602:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:1.0:1790964483.016815:0:32602:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964483.016817:0:32602:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.016834:0:32602:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:1.0:1790964483.016837:0:32602:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 000000008eeacf2b. 00000100:00000001:1.0:1790964483.016839:0:32602:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:1.0:1790964483.016840:0:32602:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 10000000:00000040:1.0:1790964483.016844:0:32602:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 9, more 0. 10000000:00000001:1.0:1790964483.016847:0:32602:0:(mgc_request.c:1308:mgc_apply_recover_logs()) Process entered 10000000:00000010:1.0:1790964483.016853:0:32602:0:(mgc_request.c:1331:mgc_apply_recover_logs()) kmalloced '(nidlist)': 640 at 000000000e1a1381. 10000000:00000010:1.0:1790964483.016856:0:32602:0:(mgc_request.c:1343:mgc_apply_recover_logs()) kmalloced '(obdname)': 128 at 000000007f67bc79. 10000000:00000200:1.0:1790964483.016860:0:32602:0:(mgc_request.c:1241:mgc_build_nidlist()) use 1 from 1 NIDs 10000000:00000040:1.0:1790964483.016863:0:32602:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-MDT0000-mdc-MDT0000 10000000:00000040:1.0:1790964483.016870:0:32602:0:(mgc_request.c:1445:mgc_apply_recover_logs()) MGC192.168.204.132@tcp: cannot find OBD lustre-MDT0000-mdc-MDT0000 10000000:00000010:1.0:1790964483.016872:0:32602:0:(mgc_request.c:1492:mgc_apply_recover_logs()) kfreed 'obdname': 128 at 000000007f67bc79. 10000000:00000010:1.0:1790964483.016874:0:32602:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'nidlist': 640 at 000000000e1a1381. 10000000:00000001:1.0:1790964483.016876:0:32602:0:(mgc_request.c:1496:mgc_apply_recover_logs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964483.016878:0:32602:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964483.016881:0:32602:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000065ff5e49 x1877962346467200/t0(0) o256->MGC192.168.204.132@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964499 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964483.016886:0:32602:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964483.016888:0:32602:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964483.016890:0:32602:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000016b8082c. 02000000:00000001:1.0:1790964483.016893:0:32602:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964483.016895:0:32602:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964483.016897:0:32602:0:(genops.c:1223:class_import_put()) import 00000000e79a1a7f refcount=4 obd=MGC192.168.204.132@tcp 00000020:00000001:1.0:1790964483.016899:0:32602:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000001:1.0:1790964483.016900:0:32602:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000001:1.0:1790964483.016902:0:32602:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964483.016903:0:32602:0:(genops.c:1223:class_import_put()) import 00000000e79a1a7f refcount=3 obd=MGC192.168.204.132@tcp 00000020:00000001:1.0:1790964483.016905:0:32602:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000010:1.0:1790964483.016907:0:32602:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 64 at 00000000700dd65d. 00000100:00000010:1.0:1790964483.016911:0:32602:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 00000000035b9078. 00000100:00000001:1.0:1790964483.016913:0:32602:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 02000000:00000010:1.0:1790964483.016914:0:32602:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 00000000c2299283. 02000000:00000001:1.0:1790964483.016917:0:32602:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964483.016919:0:32602:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964483.016926:0:32602:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000065ff5e49. 00000100:00000001:1.0:1790964483.016929:0:32602:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964483.016930:0:32602:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000010:1.0:1790964483.016944:0:32602:0:(mgc_request.c:1652:mgc_process_recover_log()) kvfree 'folios': 32 at 000000000c567c6a. 10000000:01000000:1.0:1790964483.016964:0:32602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 10000000:00000001:1.0:1790964483.016967:0:32602:0:(mgc_request.c:1029:mgc_cancel()) Process entered 00010000:00000001:1.0:1790964483.016971:0:32602:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:1.0:1790964483.016972:0:32602:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964483.016975:0:32602:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 00000000de5a3e6d refcount=3 00000020:00000001:1.0:1790964483.016977:0:32602:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000001:1.0:1790964483.016980:0:32602:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446626964085092864 : -117109624458752 : ffff957d4a6f3200) 00010000:00000001:1.0:1790964483.016983:0:32602:0:(ldlm_lock.c:854:ldlm_lock_decref_internal()) Process entered 00010000:00010000:1.0:1790964483.016986:0:32602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 00000000de5a3e6d/0x461a674dcbd7c67e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c685 expref: -99 pid: 32602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964483.016993:0:32602:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964483.016995:0:32602:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:1.0:1790964483.016997:0:32602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 00000000de5a3e6d/0x461a674dcbd7c67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x461a674dcbd7c685 expref: -99 pid: 32602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:1.0:1790964483.017002:0:32602:0:(ldlm_lock.c:923:ldlm_lock_decref_internal()) Process leaving 00010000:00000001:1.0:1790964483.017003:0:32602:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1790964483.017004:0:32602:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 10000000:00000001:1.0:1790964483.017005:0:32602:0:(mgc_request.c:1033:mgc_cancel()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964483.017006:0:32602:0:(mgc_request.c:1907:mgc_process_log()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:1.0:1790964483.017009:0:32602:0:(mgc_request.c:621:do_requeue()) Process leaving 10000000:00000001:1.0:1790964483.017012:0:32602:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000040:1.0:1790964483.017013:0:32602:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(00000000fe25b1d6) refs 3 10000000:00000001:1.0:1790964483.017015:0:32602:0:(mgc_request.c:147:config_log_put()) Process leaving 00000100:00000040:3.0:1790964483.019025:0:24982:0:(connection.c:75:cpu_latency_work()) work item of 000000009d5debbb (cpu 3) has reached its deadline 4295612428, at 4295612429 00000100:00000040:0.0:1790964483.019025:0:415:0:(connection.c:75:cpu_latency_work()) work item of 00000000bf744d4f (cpu 0) has reached its deadline 4295612428, at 4295612429 00000100:00000010:3.0:1790964483.019041:0:24982:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000fd1dc97e. 00000100:00000010:0.0:1790964483.019045:0:415:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000068552d0a. 00000100:00000040:1.0:1790964483.019188:0:22071:0:(connection.c:75:cpu_latency_work()) work item of 0000000022c046dd (cpu 1) has reached its deadline 4295612428, at 4295612429 00000100:00000010:1.0:1790964483.019194:0:22071:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000032da5e42. 00000100:00000040:2.0:1790964483.019418:0:761:0:(connection.c:75:cpu_latency_work()) work item of 000000005b676f3c (cpu 2) has reached its deadline 4295612428, at 4295612429 00000100:00000010:2.0:1790964483.019502:0:761:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000000d725305. 00010000:00000001:0.0:1790964483.326229:0:415:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964483.326238:0:415:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964483.326246:0:415:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964483.326248:0:415:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964483.326424:0:32593:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964483.326427:0:32593:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964483.326430:0:32593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:1.0:1790964484.032026:0:32642:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964484.032035:0:32642:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964484.032038:0:32642:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964484.032042:0:32642:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e30a966e going to sleep for 0 seconds 00000100:00000001:1.0:1790964484.032053:0:32642:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964484.032057:0:32642:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.032059:0:32642:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964484.032061:0:32642:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.032063:0:32642:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964484.033166:0:31768:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964484.033171:0:31768:0:(client.c:2486:ptlrpc_expire_one_request()) Process entered 00000100:00100000:3.0:1790964484.033182:0:31768:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790964474/real 1790964474] req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000400:00000001:3.0:1790964484.033199:0:31768:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964484.033201:0:31768:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964484.033204:0:31768:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000c31608e9. 00000400:00000200:3.0:1790964484.033209:0:31768:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000470564af 00000400:00000010:3.0:1790964484.033211:0:31768:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000470564af. 00000100:00000001:3.0:1790964484.033216:0:31768:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964484.033219:0:31768:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964484.033227:0:31768:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964484.033235:0:31768:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964484.033236:0:31768:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.033239:0:31768:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964484.033242:0:31768:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:3.0:1790964484.033244:0:31768:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964484.033265:0:31768:0:(client.c:2540:ptlrpc_expire_one_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.033273:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964484.033275:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964484.033277:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964484.033279:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964484.033281:0:31768:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964484.033284:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964484 ref 1 fl Rpc:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964484.033291:0:31768:0:(client.c:2143:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00000001:3.0:1790964484.033294:0:31768:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.033295:0:31768:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964484.033296:0:31768:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.033298:0:31768:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:3.0:1790964484.033301:0:31768:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00080000:3.0:1790964484.033304:0:31768:0:(import.c:65:import_set_state_nolock()) 00000000cceab2ac lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790964484.033339:0:31768:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00000001:3.0:1790964484.033342:0:31768:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551506 : -110 : ffffffffffffff92) 00000100:00000040:3.0:1790964484.033345:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964484 ref 1 fl Interpret:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964484.033352:0:31768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001db2de9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31768:1877962346464512:0@lo:8: 00000100:00000001:3.0:1790964484.033357:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.033360:0:31768:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964484.033362:0:31768:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000001db2de9c x1877962346464512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964484 ref 1 fl Complete:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964484.033367:0:31768:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964484.033371:0:31768:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964484.033374:0:31768:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b5f9c1ef. 02000000:00000001:3.0:1790964484.033379:0:31768:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964484.033382:0:31768:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964484.033384:0:31768:0:(genops.c:1223:class_import_put()) import 00000000cceab2ac refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000001:3.0:1790964484.033393:0:31768:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964484.033395:0:31768:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 00000000c532d131. 02000000:00000001:3.0:1790964484.033398:0:31768:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964484.033400:0:31768:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964484.033401:0:31768:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000001db2de9c. 00000100:00000001:3.0:1790964484.033404:0:31768:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964484.033405:0:31768:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.033407:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.033411:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964484.033413:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964484.033414:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964484.033416:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.033474:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f924b2d8-958e-436c-995a-bd5c559444c6->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1790964484.033480:0:36:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1790964484.033485:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000062c030b9. 00000020:00000040:2.0:1790964484.033489:0:36:0:(genops.c:1210:class_import_get()) import 00000000e79a1a7f refcount=4 obd=MGC192.168.204.132@tcp 00000100:00000001:2.0:1790964484.033492:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964484.033495:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964484.033499:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964484.033505:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003c9b664c. 00000100:00000001:2.0:1790964484.033511:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.033515:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f924b2d8-958e-436c-995a-bd5c559444c6->MGS req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964484.033537:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964484.033540:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.033545:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000062c030b9] to pc [ptlrpcd_00_03+3] req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.033577:0:36:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1790964484.033579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790964484.033582:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00000001:2.0:1790964484.033584:0:36:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:2.0:1790964484.033586:0:36:0:(import.c:65:import_set_state_nolock()) 00000000cceab2ac lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:2.0:1790964484.033589:0:36:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:2.0:1790964484.033592:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 936 00000100:00001000:2.0:1790964484.033596:0:36:0:(import.c:2195:obd_at_measure()) add 10 to 00000000d73481b2 time=1790964484 v=0 (0 0 0 0) 00000100:00001000:2.0:1790964484.033598:0:36:0:(import.c:2261:obd_at_measure()) AT 00000000d73481b2 change: old=0 new=10 delta=10 (val=10) hist 10 0 0 0 00000100:00080000:2.0:1790964484.033601:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1790964484.033603:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 15 to 0@lo 00000100:00000001:2.0:1790964484.033605:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964484.033607:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 16 to 0@lo 00000100:00000001:2.0:1790964484.033608:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000020:00000001:2.0:1790964484.033611:0:36:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964484.033613:0:36:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c61c 00000020:00000001:2.0:1790964484.033615:0:36:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964484.033618:0:36:0:(lustre_handles.c:148:class_handle2object()) GET export 000000009ae2cec3 refcount=4 00000020:00000001:2.0:1790964484.033620:0:36:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964133724160 : -117109575827456 : ffff957d4d554000) 00000020:00000001:2.0:1790964484.033623:0:36:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626964133724160 : -117109575827456 : ffff957d4d554000) 00000100:00000040:2.0:1790964484.033625:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 15 to 0@lo 00000100:00000001:2.0:1790964484.033627:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964484.033628:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 16 to 0@lo 00000100:00000001:2.0:1790964484.033630:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000020:00000040:2.0:1790964484.033632:0:36:0:(genops.c:879:class_export_put()) PUTting export 000000009ae2cec3 : new refcount 3 00000100:00080000:2.0:1790964484.033640:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000cceab2ac using connection 192.168.204.132@tcp/0@lo 00000100:00000001:2.0:1790964484.033643:0:36:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.033644:0:36:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:2.0:1790964484.033651:0:36:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964484.033653:0:36:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.033656:0:36:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:2.0:1790964484.033658:0:36:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964484.033662:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000729abbd6. 00000020:00000040:2.0:1790964484.033664:0:36:0:(genops.c:1210:class_import_get()) import 00000000cceab2ac refcount=3 obd=lustre-OST0000-osc-MDT0000 02000000:00000001:2.0:1790964484.033667:0:36:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:2.0:1790964484.033668:0:36:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.033671:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964484.033672:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964484.033674:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964484.033677:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 00000000d0230178. 00000100:00000001:2.0:1790964484.033681:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964484.033686:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000729abbd6 x1877962346467456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964484.033691:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964484.033693:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.033694:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000729abbd6] to pc [ptlrpcd_rcv+-1] req@00000000729abbd6 x1877962346467456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.033708:0:36:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1790964484.033710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790964484.033712:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00000001:2.0:1790964484.033714:0:36:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:2.0:1790964484.033715:0:36:0:(import.c:65:import_set_state_nolock()) 00000000efe04c75 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:2.0:1790964484.033717:0:36:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:2.0:1790964484.033719:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 936 00000100:00001000:2.0:1790964484.033722:0:36:0:(import.c:2195:obd_at_measure()) add 10 to 00000000c6034686 time=10 v=5 (1 0 0 0) 00000100:00001000:2.0:1790964484.033724:0:36:0:(import.c:2261:obd_at_measure()) AT 00000000c6034686 change: old=5 new=10 delta=5 (val=10) hist 10 0 0 0 00000100:00080000:2.0:1790964484.033726:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1790964484.033733:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 15 to 0@lo 00000100:00000001:2.0:1790964484.033735:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964484.033736:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 16 to 0@lo 00000100:00000001:2.0:1790964484.033738:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000020:00000001:2.0:1790964484.033740:0:36:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964484.033741:0:36:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c631 00000020:00000001:2.0:1790964484.033742:0:36:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964484.033744:0:36:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000671f9be6 refcount=4 00000020:00000001:2.0:1790964484.033745:0:36:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964133720064 : -117109575831552 : ffff957d4d553000) 00000020:00000001:2.0:1790964484.033747:0:36:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626964133720064 : -117109575831552 : ffff957d4d553000) 00000100:00000040:2.0:1790964484.033749:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 15 to 0@lo 00000100:00000001:2.0:1790964484.033751:0:36:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964484.033752:0:36:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 16 to 0@lo 00000100:00000001:2.0:1790964484.033754:0:36:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000020:00000040:2.0:1790964484.033755:0:36:0:(genops.c:879:class_export_put()) PUTting export 00000000671f9be6 : new refcount 3 00000100:00080000:2.0:1790964484.033757:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000efe04c75 using connection 192.168.204.132@tcp/0@lo 00000100:00000001:2.0:1790964484.033759:0:36:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.033760:0:36:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:2.0:1790964484.033762:0:36:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964484.033764:0:36:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.033766:0:36:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:2.0:1790964484.033767:0:36:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964484.033769:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000089c4f549. 00000020:00000040:2.0:1790964484.033771:0:36:0:(genops.c:1210:class_import_get()) import 00000000efe04c75 refcount=4 obd=lustre-MDT0001-osp-MDT0000 02000000:00000001:2.0:1790964484.033773:0:36:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:2.0:1790964484.033773:0:36:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.033775:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964484.033776:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964484.033777:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964484.033781:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 00000000325f50bb. 00000100:00000001:2.0:1790964484.033784:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964484.033787:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964484.033803:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964484.033804:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.033807:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089c4f549] to pc [ptlrpcd_rcv+-1] req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.033915:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:1.0:1790964484.033929:0:31771:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:1.0:1790964484.033930:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.033935:0:31771:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964484.033936:0:31771:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.033938:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.033939:0:31771:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964484.033940:0:31771:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964484.033944:0:31771:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.033976:0:31771:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964484.033978:0:31771:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964484.033981:0:31771:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964484.033983:0:31771:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964484.033985:0:31771:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964484.033987:0:31771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f924b2d8-958e-436c-995a-bd5c559444c6:31771:1877962346467328:0@lo:400: 00000100:00000001:1.0:1790964484.033991:0:31771:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964484.033996:0:31771:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964484.033998:0:31771:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964484.034001:0:31771:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964484.034006:0:31771:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000c2299283. 02000000:00000001:1.0:1790964484.034008:0:31771:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964484.034013:0:31771:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000004189e22c. 00000400:00000010:1.0:1790964484.034018:0:31771:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000008bb7827a. 00000100:00000200:1.0:1790964484.034024:0:31771:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877962346467328, portal 25 00000100:00000001:1.0:1790964484.034027:0:31771:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964484.034028:0:31771:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626968325795200 : -117105383756416 : ffff957e47332d80) 00000100:00000040:1.0:1790964484.034033:0:31771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034040:0:31771:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964484.034049:0:31771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964484.034052:0:31771:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000006c9a5f37. 00000100:00000200:1.0:1790964484.034055:0:31771:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877962346467328, offset 0 00000400:00000200:1.0:1790964484.034060:0:31771:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964484.034072:0:31771:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964484.034082:0:31771:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff2e901000 00000400:00000200:1.0:1790964484.034088:0:31771:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x16d [2] + 0 00000400:00000010:1.0:1790964484.034092:0:31771:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000005ec4e596. 00000400:00000200:1.0:1790964484.034095:0:31771:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000259b194b 00000400:00000200:1.0:1790964484.034103:0:31771:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964484.034107:0:31771:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964484.034112:0:31771:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000259b194b 00000400:00000010:1.0:1790964484.034114:0:31771:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000259b194b. 00000100:00000001:1.0:1790964484.034119:0:31771:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964484.034121:0:31771:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964484.034124:0:31771:0:(events.c:341:request_in_callback()) incoming req@00000000fee9361a x1877962346467328 msgsize 224 00000100:00100000:1.0:1790964484.034128:0:31771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964484.034130:0:31771:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964484.034140:0:31771:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964484.034146:0:31771:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000006c9a5f37 00000400:00000010:1.0:1790964484.034148:0:31771:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000006c9a5f37. 00000100:00000001:1.0:1790964484.034150:0:31771:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964484.034153:0:31771:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034161:0:31771:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964484.034163:0:31771:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034168:0:31771:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034170:0:31771:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964484.034176:0:31771:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034180:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 0 is 4295613446 00000100:00000010:1.0:1790964484.034183:0:31771:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000005b7a27c6. 00000100:00000001:1.0:1790964484.034189:0:31771:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1790964484.034195:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 1 is 4295613446 00000100:00000010:1.0:1790964484.034203:0:31771:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000003941c1b7. 00000100:00000001:1.0:1790964484.034206:0:31771:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 1 00000100:00000001:1.0:1790964484.034208:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 2 is 4295613446 00000100:00000010:1.0:1790964484.034210:0:31771:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000046c2b083. 00000100:00000001:1.0:1790964484.034212:0:31771:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1790964484.034215:0:31771:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS new deadline estimation for cpu 3 is 4295613446 00000100:00000010:1.0:1790964484.034217:0:31771:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000032da5e42. 00000100:00000001:1.0:1790964484.034220:0:31771:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.132@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1790964484.034227:0:31771:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964484.034229:0:31771:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034232:0:31771:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034234:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034251:0:32600:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964484.034253:0:32600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346467328 02000000:00000001:1.0:1790964484.034255:0:32600:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964484.034257:0:32600:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964484.034259:0:32600:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964484.034264:0:32600:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964484.034268:0:32600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346467328 00000020:00000001:1.0:1790964484.034270:0:32600:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964484.034271:0:32600:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c597 00000020:00000001:1.0:1790964484.034272:0:32600:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964484.034274:0:32600:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000627856b7 refcount=12 00000020:00000001:1.0:1790964484.034276:0:32600:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000020:00000001:1.0:1790964484.034277:0:32600:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626969231128576 : -117104478423040 : ffff957e7d297800) 00000100:00000001:1.0:1790964484.034280:0:32600:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964484.034284:0:32600:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000b58e69ec. 00000100:00000001:1.0:1790964484.034286:0:32600:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964484.034288:0:32600:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000b58e69ec. 00000020:00000010:1.0:1790964484.034294:0:32600:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fa984b5f. 00000020:00000010:1.0:1790964484.034299:0:32600:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000a4701c38. 00000020:00000010:1.0:1790964484.034303:0:32600:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000006386af44. 00000100:00000040:1.0:1790964484.034312:0:32600:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964484.034320:0:32600:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964484.034322:0:32600:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964484.034323:0:32600:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034342:0:32600:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034351:0:32600:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.034360:0:32600:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964484.034362:0:32600:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964484.034365:0:32600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00000040:1.0:1790964484.034368:0:32600:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000627856b7 : new rpc_count 1 00000100:00000001:1.0:1790964484.034370:0:32600:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446626968321022032 : -117105388529584 : ffff957e46ea5850) 00000100:00000040:1.0:1790964484.034374:0:32600:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000fee9361a x1877962346467328/t0(0) o400->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:305/0 lens 224/0 e 0 to 0 dl 1790964495 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034382:0:32600:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964484.034385:0:32600:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000b58e69ec. 00000100:00000001:1.0:1790964484.034386:0:32600:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964484.034388:0:32600:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000b58e69ec. 00000100:00100000:1.0:1790964484.034391:0:32600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee9361a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+12:31771:x1877962346467328:12345-0@lo:400: 00000100:00000200:1.0:1790964484.034394:0:32600:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962346467328 00000020:00000001:1.0:1790964484.034398:0:32600:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964484.034401:0:32600:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964484.034403:0:32600:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964484.034406:0:32600:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964484.034408:0:32600:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669370560 : -1040181056 : ffffffffc20018c0) 00000020:00000001:1.0:1790964484.034411:0:32600:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964484.034412:0:32600:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964484.034415:0:32600:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964484.034416:0:32600:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964484.034419:0:32600:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964484.034420:0:32600:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:1.0:1790964484.034423:0:32600:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964484.034425:0:32600:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964484.034428:0:32600:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 000000003dba7b63. 02000000:00000001:1.0:1790964484.034430:0:32600:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034431:0:32600:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964484.034438:0:32600:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964484.034441:0:32600:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962346467328 00010000:00000001:1.0:1790964484.034443:0:32600:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964484.034447:0:32600:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000fee9361a x1877962346467328/t0(0) o400->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:305/0 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964484.034453:0:32600:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964484.034455:0:32600:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964484.034458:0:32600:0:(import.c:2195:obd_at_measure()) add 1 to 000000008c4d0c38 time=10 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964484.034460:0:32600:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964484.034463:0:32600:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 00000100:00000001:1.0:1790964484.034464:0:32600:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 02000000:00000001:1.0:1790964484.034466:0:32600:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964484.034468:0:32600:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034470:0:32600:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964484.034472:0:32600:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964484.034474:0:32600:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000006c9a5f37. 00000100:00000200:1.0:1790964484.034477:0:32600:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877962346467328, offset 224 00000400:00000200:1.0:1790964484.034481:0:32600:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964484.034487:0:32600:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964484.034492:0:32600:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff2e901000 00000400:00000200:1.0:1790964484.034497:0:32600:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xaed [1] + 224 00000400:00000200:1.0:1790964484.034502:0:32600:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964484.034505:0:32600:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964484.034508:0:32600:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964484.034511:0:32600:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964484.034519:0:32600:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034531:0:32600:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964484.034536:0:32600:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000006c9a5f37 00000400:00000010:1.0:1790964484.034537:0:32600:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000006c9a5f37. 00000100:00000001:1.0:1790964484.034540:0:32600:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964484.034541:0:32600:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964484.034551:0:32600:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964484.034554:0:32600:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 16 to 0@lo 00010000:00000001:1.0:1790964484.034557:0:32600:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964484.034558:0:32600:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964484.034560:0:32600:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964484.034563:0:32600:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000fee9361a x1877962346467328/t0(0) o400->f924b2d8-958e-436c-995a-bd5c559444c6@0@lo:305/0 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964484.034570:0:32600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee9361a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f924b2d8-958e-436c-995a-bd5c559444c6+12:31771:x1877962346467328:12345-0@lo:400: Request processed in 187us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964484.034576:0:32600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00000040:1.0:1790964484.034579:0:32600:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000627856b7 : new rpc_count 0 00000100:00000001:1.0:1790964484.034581:0:32600:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964484.034582:0:32600:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964484.034587:0:32600:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000a4701c38. 00000020:00000010:1.0:1790964484.034590:0:32600:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000006386af44. 00000020:00000010:1.0:1790964484.034593:0:32600:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fa984b5f. 00000020:00000040:1.0:1790964484.034596:0:32600:0:(genops.c:879:class_export_put()) PUTting export 00000000627856b7 : new refcount 11 02000000:00000001:1.0:1790964484.034599:0:32600:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964484.034602:0:32600:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 000000003dba7b63. 02000000:00000001:1.0:1790964484.034604:0:32600:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964484.034606:0:32600:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964484.034610:0:32600:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964484.034614:0:32600:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000005ec4e596. 00000400:00000010:1.0:1790964484.034618:0:32600:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 000000008eeacf2b. 00000100:00000001:1.0:1790964484.034630:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.034632:0:31771:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964484.034635:0:31771:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964484.034636:0:31771:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964484.034637:0:31771:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000004189e22c. 00000400:00000200:1.0:1790964484.034640:0:31771:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008bb7827a 00000400:00000010:1.0:1790964484.034641:0:31771:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000008bb7827a. 00000100:00000001:1.0:1790964484.034644:0:31771:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964484.034646:0:31771:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964484.034653:0:31771:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034665:0:31771:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964484.034667:0:31771:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.034669:0:31771:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964484.034671:0:31771:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964484.034673:0:31771:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964484.034674:0:31771:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964484.034677:0:31771:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964484.034682:0:31771:0:(import.c:2195:obd_at_measure()) add 5 to 000000002212e16a time=10 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964484.034685:0:31771:0:(import.c:2195:obd_at_measure()) add 1 to 0000000029d7efcb time=10 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964484.034688:0:31771:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964484.034689:0:31771:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964484.034691:0:31771:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1790964484.034693:0:31771:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034696:0:31771:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964484.034699:0:31771:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034706:0:31771:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964484.034708:0:31771:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964484.034710:0:31771:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964484.034712:0:31771:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964484.034718:0:31771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062c030b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f924b2d8-958e-436c-995a-bd5c559444c6:31771:1877962346467328:0@lo:400: 00000100:00000001:1.0:1790964484.034722:0:31771:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.034723:0:31771:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964484.034725:0:31771:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000062c030b9 x1877962346467328/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.034731:0:31771:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964484.034733:0:31771:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964484.034735:0:31771:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000c2299283. 02000000:00000001:1.0:1790964484.034738:0:31771:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964484.034739:0:31771:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964484.034741:0:31771:0:(genops.c:1223:class_import_put()) import 00000000e79a1a7f refcount=3 obd=MGC192.168.204.132@tcp 00000020:00000001:1.0:1790964484.034743:0:31771:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964484.034750:0:31771:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 000000003c9b664c. 02000000:00000001:1.0:1790964484.034753:0:31771:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964484.034754:0:31771:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964484.034756:0:31771:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000062c030b9. 00000100:00000001:1.0:1790964484.034761:0:31771:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964484.034762:0:31771:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.034764:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.034768:0:31771:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964484.034770:0:31771:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.034772:0:31771:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.034773:0:31771:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035025:0:36:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.035029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1790964484.035033:0:36:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1790964484.035037:0:36:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000077d7f1de. 00000020:00000040:2.0:1790964484.035040:0:36:0:(genops.c:1210:class_import_get()) import 000000000d56375e refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000001:2.0:1790964484.035043:0:36:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964484.035044:0:36:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964484.035047:0:36:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964484.035051:0:36:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001a784716. 00000100:00000001:2.0:1790964484.035054:0:36:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.035058:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964484.035066:0:36:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964484.035067:0:36:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.035070:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000077d7f1de] to pc [ptlrpcd_00_00+0] req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035092:0:36:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.035097:0:36:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (951) 00000100:00000001:2.0:1790964484.035109:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964484.035111:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964484.035113:0:31768:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964484.035116:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000729abbd6 x1877962346467456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035123:0:31768:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964484.035124:0:31768:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.035127:0:31768:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1790964484.035129:0:31768:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964484.035138:0:31768:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964484.035141:0:31768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000729abbd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31768:1877962346467456:0@lo:8: 00000100:00000001:2.0:1790964484.035145:0:31768:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964484.035148:0:31768:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964484.035150:0:31768:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.035152:0:31768:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1790964484.035155:0:31768:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000004aa7214. 02000000:00000001:2.0:1790964484.035157:0:31768:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1790964484.035161:0:31768:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000edcd77b7. 00000400:00000010:2.0:1790964484.035165:0:31768:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000fbeffffb. 00000100:00000200:2.0:1790964484.035169:0:31768:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877962346467456, portal 4 00000100:00000001:2.0:1790964484.035171:0:31768:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964484.035172:0:31768:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626968325785344 : -117105383766272 : ffff957e47330700) 00000020:00000010:2.0:1790964484.035179:0:31768:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000d6f4bc60. 00000100:00000040:2.0:1790964484.035185:0:31768:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000729abbd6 x1877962346467456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964499 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035191:0:31768:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964484.035194:0:31768:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964484.035196:0:31768:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000a32d567b. 00000100:00000200:2.0:1790964484.035198:0:31768:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 28, xid 1877962346467456, offset 0 00000400:00000200:2.0:1790964484.035203:0:31768:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964484.035210:0:31768:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964484.035216:0:31768:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 28 MB=0x6abff2e901080 00000400:00000100:2.0:1790964484.035220:0:31768:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877962346467456 offset 0 length 520: 4 00000400:00000200:2.0:1790964484.035223:0:31768:0:(lib-msg.c:1116:lnet_is_health_check()) Msg 00000000ed3b921b is in inconsistent state, don't perform health checking (-2, 0) 00000400:00000200:2.0:1790964484.035225:0:31768:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 0, status = -2, hstatus = 0 00000400:00000200:2.0:1790964484.035230:0:31768:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000a32d567b 00000400:00000010:2.0:1790964484.035231:0:31768:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000a32d567b. 00000100:00000001:2.0:1790964484.035234:0:31768:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964484.035236:0:31768:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000729abbd6 x1877962346467456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964499 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035243:0:31768:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964484.035251:0:31768:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000729abbd6 x1877962346467456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964499 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035257:0:31768:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035259:0:31768:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964484.035264:0:31768:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.035268:0:31768:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000001:2.0:1790964484.035270:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295613446 00000100:00000001:2.0:1790964484.035273:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 0, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035274:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295613446 00000100:00000001:2.0:1790964484.035276:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 1, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035277:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295613446 00000100:00000001:2.0:1790964484.035279:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 2, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035281:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295613446 00000100:00000001:2.0:1790964484.035282:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 3, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035284:0:31768:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964484.035286:0:31768:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035288:0:31768:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964484.035290:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035297:0:31768:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964484.035298:0:31768:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.035300:0:31768:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1790964484.035301:0:31768:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964484.035303:0:31768:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964484.035305:0:31768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089c4f549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31768:1877962346467584:0@lo:38: 00000100:00000001:2.0:1790964484.035308:0:31768:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964484.035310:0:31768:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964484.035312:0:31768:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.035313:0:31768:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1790964484.035318:0:31768:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000afc16b95. 02000000:00000001:2.0:1790964484.035319:0:31768:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1790964484.035340:0:31768:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000b7c9932f. 00000400:00000010:2.0:1790964484.035345:0:31768:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000a32d567b. 00000100:00000200:2.0:1790964484.035347:0:31768:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877962346467584, portal 4 00000100:00000001:2.0:1790964484.035349:0:31768:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964484.035350:0:31768:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626968325783552 : -117105383768064 : ffff957e47330000) 00000020:00000010:2.0:1790964484.035355:0:31768:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 0000000093e8b654. 00000100:00000040:2.0:1790964484.035359:0:31768:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964499 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035365:0:31768:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964484.035367:0:31768:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964484.035369:0:31768:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000003735f4a1. 00000100:00000200:2.0:1790964484.035371:0:31768:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 24, xid 1877962346467584, offset 0 00000400:00000200:2.0:1790964484.035375:0:31768:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964484.035381:0:31768:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964484.035386:0:31768:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 24 MB=0x6abff2e901100 00000400:00000200:2.0:1790964484.035391:0:31768:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 520/520 into md 0x429 [256] + 520 00000400:00000200:2.0:1790964484.035396:0:31768:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964484.035399:0:31768:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964484.035403:0:31768:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1790964484.035405:0:31768:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 00000100:00000010:2.0:1790964484.035408:0:31768:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000002076da98. 00000100:00000040:2.0:1790964484.035410:0:31768:0:(events.c:341:request_in_callback()) incoming req@000000002076da98 x1877962346467584 msgsize 520 00000100:00100000:2.0:1790964484.035414:0:31768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:2.0:1790964484.035424:0:31768:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:2.0:1790964484.035427:0:31768:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000003735f4a1 00000400:00000010:2.0:1790964484.035429:0:31768:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000003735f4a1. 00000100:00000001:2.0:1790964484.035430:0:31768:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964484.035433:0:31768:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964499 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035439:0:31768:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964484.035441:0:31768:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964499 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.035446:0:31768:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035453:0:31768:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964484.035458:0:31768:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.035461:0:31768:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1525 usecs (2 jiffies) 00000100:00000001:2.0:1790964484.035464:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295613445 00000100:00000001:2.0:1790964484.035466:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 0, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035467:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295613445 00000100:00000001:2.0:1790964484.035469:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 1, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035471:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295613445 00000100:00000001:2.0:1790964484.035472:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 2, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035474:0:31768:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295613445 00000100:00000001:2.0:1790964484.035475:0:31768:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 3, keep current deadline 4295613446 00000100:00000001:2.0:1790964484.035477:0:31768:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964484.035479:0:31768:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035481:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035483:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964484.035487:0:31768:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964484.035489:0:31768:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:2.0:1790964484.035490:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964484.035492:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964484.035493:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035494:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1790964484.035529:0:32609:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000006ae31cde. 00000100:00000001:2.0:1790964484.035535:0:32609:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:2.0:1790964484.035537:0:32609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346467584 02000000:00000001:2.0:1790964484.035538:0:32609:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1790964484.035540:0:32609:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964484.035541:0:32609:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.035545:0:32609:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964484.035548:0:32609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346467584 00000020:00000001:2.0:1790964484.035549:0:32609:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964484.035550:0:32609:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:2.0:1790964484.035552:0:32609:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:2.0:1790964484.035554:0:32609:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964484.035560:0:32609:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1790964484.035563:0:32609:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d4483a15. 00000020:00000010:2.0:1790964484.035567:0:32609:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000f49bfa25. 00000020:00000010:2.0:1790964484.035570:0:32609:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000da957b6d. 00000100:00000001:2.0:1790964484.035574:0:32609:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1790964484.035575:0:32609:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1790964484.035577:0:32609:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035582:0:32609:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.035589:0:32609:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964484.035598:0:32609:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1790964484.035600:0:32609:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1790964484.035603:0:32609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:2.0:1790964484.035606:0:32609:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446626968325791616 : -117105383760000 : ffff957e47331f80) 00000100:00000040:2.0:1790964484.035609:0:32609:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000002076da98 x1877962346467584/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964504 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964484.035618:0:32609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002076da98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31768:x1877962346467584:12345-0@lo:38: 00000100:00000200:2.0:1790964484.035621:0:32609:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962346467584 00000020:00000001:2.0:1790964484.035623:0:32609:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:2.0:1790964484.035626:0:32609:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000001:2.0:1790964484.035637:0:32609:0:(genops.c:655:class_str2obd()) Process leaving (rc=0 : 0 : 0) 00010000:00020000:2.0:1790964484.035641:0:32609:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000001:1.0:1790964484.037065:0:31769:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.037071:0:31769:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964484.037072:0:31769:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964484.037081:0:31769:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.037090:0:31769:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964484.037092:0:31769:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964484.037095:0:31769:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964484.037097:0:31769:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964484.037100:0:31769:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964484.037102:0:31769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077d7f1de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:31769:1877962346467712:0@lo:400: 00000100:00000001:1.0:1790964484.037106:0:31769:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964484.037110:0:31769:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964484.037112:0:31769:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964484.037114:0:31769:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964484.037118:0:31769:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000c2299283. 02000000:00000001:1.0:1790964484.037120:0:31769:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964484.037126:0:31769:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000004189e22c. 00000400:00000010:1.0:1790964484.037131:0:31769:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000008bb7827a. 00000100:00000200:1.0:1790964484.037137:0:31769:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877962346467712, portal 10 00000100:00000001:1.0:1790964484.037139:0:31769:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964484.037140:0:31769:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446626968325784448 : -117105383767168 : ffff957e47330380) 00000020:00000010:1.0:1790964484.037147:0:31769:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000d271684f. 00000100:00000040:1.0:1790964484.037152:0:31769:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.037167:0:31769:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964484.037170:0:31769:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964484.037172:0:31769:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000006c9a5f37. 00000100:00000200:1.0:1790964484.037175:0:31769:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1877962346467712, offset 0 00000400:00000200:1.0:1790964484.037180:0:31769:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964484.037190:0:31769:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964484.037199:0:31769:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6abff2e901180 00000400:00000200:1.0:1790964484.037204:0:31769:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x229 [64] + 1040 00000400:00000200:1.0:1790964484.037212:0:31769:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964484.037215:0:31769:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964484.037220:0:31769:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964484.037222:0:31769:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:1.0:1790964484.037225:0:31769:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000065ff5e49. 00000100:00000040:1.0:1790964484.037227:0:31769:0:(events.c:341:request_in_callback()) incoming req@0000000065ff5e49 x1877962346467712 msgsize 224 00000100:00100000:1.0:1790964484.037231:0:31769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1790964484.037243:0:31769:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964484.037250:0:31769:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000006c9a5f37 00000400:00000010:1.0:1790964484.037251:0:31769:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000006c9a5f37. 00000100:00000001:1.0:1790964484.037255:0:31769:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964484.037258:0:31769:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.037267:0:31769:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964484.037269:0:31769:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.037275:0:31769:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.037277:0:31769:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964484.037281:0:31769:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964484.037284:0:31769:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 1415 usecs (2 jiffies) 00000100:00000001:1.0:1790964484.037287:0:31769:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295613449 00000100:00000001:1.0:1790964484.037292:0:31769:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295613446 00000100:00000001:1.0:1790964484.037296:0:31769:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295613449 00000100:00000001:1.0:1790964484.037299:0:31769:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295613446 00000100:00000001:1.0:1790964484.037308:0:31769:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295613449 00000100:00000001:1.0:1790964484.037311:0:31769:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295613446 00000100:00000001:1.0:1790964484.037314:0:31769:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295613449 00000100:00000001:1.0:1790964484.037316:0:31769:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295613446 00000100:00000001:1.0:1790964484.037319:0:31769:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964484.037320:0:31769:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.037323:0:31769:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.037325:0:31769:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.037345:0:31769:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964484.037348:0:31769:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1790964484.037350:0:31769:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.037351:0:31769:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964484.037352:0:31769:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.037354:0:31769:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.037365:0:31770:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.037366:0:31770:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964484.037446:0:31772:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964484.037449:0:31772:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964484.037484:0:32605:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000510395ed. 00000100:00000001:3.0:1790964484.037491:0:32605:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964484.037493:0:32605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877962346467712 02000000:00000001:3.0:1790964484.037495:0:32605:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964484.037497:0:32605:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964484.037498:0:32605:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964484.037503:0:32605:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964484.037506:0:32605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877962346467712 00000020:00000001:3.0:1790964484.037508:0:32605:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964484.037510:0:32605:0:(genops.c:804:class_conn2export()) looking for export cookie 0x461a674dcbd7c677 00000020:00000001:3.0:1790964484.037512:0:32605:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964484.037514:0:32605:0:(lustre_handles.c:148:class_handle2object()) GET export 0000000045b721ce refcount=5 00000020:00000001:3.0:1790964484.037516:0:32605:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446626964098510848 : -117109611040768 : ffff957d4b3bf000) 00000020:00000001:3.0:1790964484.037518:0:32605:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446626964098510848 : -117109611040768 : ffff957d4b3bf000) 00000100:00000001:3.0:1790964484.037522:0:32605:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964484.037526:0:32605:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000c216682a. 00000100:00000001:3.0:1790964484.037528:0:32605:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964484.037530:0:32605:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000c216682a. 00000020:00000010:3.0:1790964484.037536:0:32605:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001a6e57fa. 00000020:00000010:3.0:1790964484.037540:0:32605:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000091f9489. 00000020:00000010:3.0:1790964484.037544:0:32605:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000060b9033d. 00000100:00000040:3.0:1790964484.037552:0:32605:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000001:3.0:1790964484.037561:0:32605:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964484.037562:0:32605:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1790964484.037565:0:32605:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.037572:0:32605:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:3.0:1790964484.037574:0:32605:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:3.0:1790964484.037576:0:32605:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964484.037591:0:32605:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964484.037601:0:32605:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964484.037602:0:32605:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964484.037605:0:32605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00000040:3.0:1790964484.037609:0:32605:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 0000000045b721ce : new rpc_count 1 00000100:00000001:3.0:1790964484.037611:0:32605:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446626964138938752 : -117109570612864 : ffff957d4da4d180) 00000100:00000040:3.0:1790964484.037615:0:32605:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@0000000065ff5e49 x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:305/0 lens 224/0 e 0 to 0 dl 1790964495 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964484.037623:0:32605:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1790964484.037625:0:32605:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000c216682a. 00000100:00000001:3.0:1790964484.037627:0:32605:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1790964484.037629:0:32605:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000c216682a. 00000100:00100000:3.0:1790964484.037632:0:32605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065ff5e49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31769:x1877962346467712:12345-0@lo:400: 00000100:00000200:3.0:1790964484.037636:0:32605:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877962346467712 00000020:00000001:3.0:1790964484.037639:0:32605:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1790964484.037643:0:32605:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1790964484.037645:0:32605:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964484.037648:0:32605:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1790964484.037650:0:32605:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072661483200 : -1048068416 : ffffffffc187bec0) 00000020:00000001:3.0:1790964484.037654:0:32605:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1790964484.037656:0:32605:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964484.037658:0:32605:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1790964484.037660:0:32605:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1790964484.037663:0:32605:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964484.037665:0:32605:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:3.0:1790964484.037668:0:32605:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964484.037671:0:32605:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1790964484.037675:0:32605:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000abfeec60. 02000000:00000001:3.0:1790964484.037682:0:32605:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964484.037684:0:32605:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964484.037686:0:32605:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1790964484.037688:0:32605:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877962346467712 00010000:00000001:3.0:1790964484.037691:0:32605:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:3.0:1790964484.037695:0:32605:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@0000000065ff5e49 x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:305/0 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964484.037702:0:32605:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964484.037704:0:32605:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964484.037707:0:32605:0:(import.c:2195:obd_at_measure()) add 1 to 00000000ca8153d4 time=5 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964484.037712:0:32605:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964484.037714:0:32605:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 00000100:00000001:3.0:1790964484.037716:0:32605:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 02000000:00000001:3.0:1790964484.037718:0:32605:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964484.037720:0:32605:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964484.037722:0:32605:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964484.037724:0:32605:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964484.037727:0:32605:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000000901ebfd. 00000100:00000200:3.0:1790964484.037730:0:32605:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1877962346467712, offset 224 00000400:00000200:3.0:1790964484.037735:0:32605:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964484.037741:0:32605:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964484.037747:0:32605:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6abff2e901180 00000400:00000200:3.0:1790964484.037751:0:32605:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0xb0d [1] + 224 00000400:00000200:3.0:1790964484.037757:0:32605:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964484.037760:0:32605:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964484.037763:0:32605:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964484.037766:0:32605:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964484.037772:0:32605:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964484.037782:0:32605:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964484.037786:0:32605:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000000901ebfd 00000400:00000010:3.0:1790964484.037788:0:32605:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000000901ebfd. 00000100:00000001:3.0:1790964484.037797:0:32605:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964484.037799:0:32605:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1790964484.037803:0:32605:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964484.037806:0:32605:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 16 to 0@lo 00010000:00000001:3.0:1790964484.037808:0:32605:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:3.0:1790964484.037810:0:32605:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964484.037812:0:32605:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1790964484.037815:0:32605:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000065ff5e49 x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:305/0 lens 224/224 e 0 to 0 dl 1790964495 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964484.037823:0:32605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065ff5e49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31769:x1877962346467712:12345-0@lo:400: Request processed in 200us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964484.037830:0:32605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00000040:3.0:1790964484.037833:0:32605:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000045b721ce : new rpc_count 0 00000100:00000001:3.0:1790964484.037835:0:32605:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964484.037837:0:32605:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1790964484.037840:0:32605:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000091f9489. 00000020:00000010:3.0:1790964484.037844:0:32605:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000060b9033d. 00000020:00000010:3.0:1790964484.037847:0:32605:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001a6e57fa. 00000020:00000040:3.0:1790964484.037851:0:32605:0:(genops.c:879:class_export_put()) PUTting export 0000000045b721ce : new refcount 4 00000100:00000001:3.0:1790964484.037853:0:32605:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.038367:0:31769:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.038370:0:31769:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964484.038374:0:31769:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964484.038376:0:31769:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964484.038378:0:31769:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000004189e22c. 00000400:00000200:1.0:1790964484.038382:0:31769:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008bb7827a 00000400:00000010:1.0:1790964484.038384:0:31769:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000008bb7827a. 00000100:00000001:1.0:1790964484.038387:0:31769:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964484.038392:0:31769:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964484.038399:0:31769:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.038405:0:31769:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964484.038406:0:31769:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.038408:0:31769:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964484.038411:0:31769:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964484.038413:0:31769:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964484.038414:0:31769:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964484.038417:0:31769:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964484.038429:0:31769:0:(import.c:2195:obd_at_measure()) add 5 to 0000000062af308d time=5 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964484.038433:0:31769:0:(import.c:2195:obd_at_measure()) add 1 to 00000000231fb147 time=5 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964484.038435:0:31769:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964484.038436:0:31769:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964484.038439:0:31769:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:1.0:1790964484.038442:0:31769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964484.038449:0:31769:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.038451:0:31769:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1790964484.038453:0:31769:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:1.0:1790964484.038455:0:31769:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1790964484.038456:0:31769:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964484.038459:0:31769:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.038464:0:31769:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964484.038466:0:31769:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964484.038468:0:31769:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964484.038471:0:31769:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964484.038477:0:31769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077d7f1de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:31769:1877962346467712:0@lo:400: 00000100:00000001:1.0:1790964484.038481:0:31769:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.038483:0:31769:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964484.038484:0:31769:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000077d7f1de x1877962346467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964500 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964484.038490:0:31769:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964484.038492:0:31769:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964484.038494:0:31769:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000c2299283. 02000000:00000001:1.0:1790964484.038497:0:31769:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964484.038499:0:31769:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964484.038500:0:31769:0:(genops.c:1223:class_import_put()) import 000000000d56375e refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:1.0:1790964484.038502:0:31769:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964484.038505:0:31769:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 000000001a784716. 02000000:00000001:1.0:1790964484.038508:0:31769:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964484.038514:0:31769:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964484.038516:0:31769:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000077d7f1de. 00000100:00000001:1.0:1790964484.038519:0:31769:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964484.038520:0:31769:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.038522:0:31769:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964484.038527:0:31769:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964484.038528:0:31769:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964484.038530:0:31769:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964484.038531:0:31769:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964484.040048:0:24982:0:(connection.c:75:cpu_latency_work()) work item of 000000009d5debbb (cpu 3) has reached its deadline 4295613449, at 4295613450 00000100:00000010:3.0:1790964484.040061:0:24982:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000032da5e42. 00000100:00000040:0.0:1790964484.040936:0:415:0:(connection.c:75:cpu_latency_work()) work item of 00000000bf744d4f (cpu 0) has reached its deadline 4295613449, at 4295613450 00000100:00000010:0.0:1790964484.040970:0:415:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000005b7a27c6. 00000100:00000040:1.0:1790964484.042077:0:22071:0:(connection.c:75:cpu_latency_work()) work item of 0000000022c046dd (cpu 1) has reached its deadline 4295613449, at 4295613452 00000100:00000010:1.0:1790964484.042088:0:22071:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000003941c1b7. 00010000:00000001:2.0:1790964484.071936:0:32609:0:(ldlm_lib.c:1191:target_handle_connect()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00010000:00000001:2.0:1790964484.071963:0:32609:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:2.0:1790964484.071968:0:32609:0:(niobuf.c:816:ptlrpc_send_error()) Process entered 00000100:00000001:2.0:1790964484.071971:0:32609:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1790964484.071974:0:32609:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000040:2.0:1790964484.072013:0:761:0:(connection.c:75:cpu_latency_work()) work item of 000000005b676f3c (cpu 2) has reached its deadline 4295613449, at 4295613480 00000100:00000010:2.0:1790964484.072023:0:761:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000046c2b083. 02000000:00000010:2.0:1790964484.072050:0:32609:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000f1fb47ce. 02000000:00000001:2.0:1790964484.072054:0:32609:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.072057:0:32609:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964484.072063:0:32609:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:2.0:1790964484.072079:0:32609:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964484.072083:0:32609:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x0 req_flags=0x200 magic=bd00bd3/bd00bd3 len=224 00000100:00000001:2.0:1790964484.072087:0:32609:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:2.0:1790964484.072090:0:32609:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964484.072095:0:32609:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 00000100:00000001:2.0:1790964484.072097:0:32609:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446626969270485312 : -117104439066304 : ffff957e7f820140) 00000100:00000001:2.0:1790964484.072099:0:32609:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446626969270485312 : -117104439066304 : 0xffff957e7f820140) 00000100:00000040:2.0:1790964484.072102:0:32609:0:(connection.c:150:ptlrpc_connection_get()) conn=00000000f9c3b6a8 refcount 17 to 0@lo 02000000:00000001:2.0:1790964484.072104:0:32609:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:2.0:1790964484.072106:0:32609:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.072109:0:32609:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964484.072112:0:32609:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964484.072117:0:32609:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000003735f4a1. 00000100:00000200:2.0:1790964484.072125:0:32609:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1877962346467584, offset 0 00000400:00000200:2.0:1790964484.072131:0:32609:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964484.072145:0:32609:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964484.072157:0:32609:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6abff2e901100 00000400:00000200:2.0:1790964484.072164:0:32609:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0xb05 [1] + 0 00000400:00000200:2.0:1790964484.072174:0:32609:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964484.072178:0:32609:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964484.072186:0:32609:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964484.072194:0:32609:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964499 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1790964484.072203:0:32609:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964499 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.072219:0:32609:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1790964484.072228:0:32609:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000003735f4a1 00000400:00000010:2.0:1790964484.072231:0:32609:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000003735f4a1. 00000100:00000001:2.0:1790964484.072234:0:32609:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1790964484.072235:0:32609:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1790964484.072240:0:32609:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964484.072243:0:32609:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000f9c3b6a8 refcount 16 to 0@lo 00000100:00000001:2.0:1790964484.072245:0:32609:0:(niobuf.c:837:ptlrpc_send_error()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964484.072254:0:32609:0:(tgt_handler.c:789:tgt_request_handle()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000040:2.0:1790964484.072260:0:32609:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000002076da98 x1877962346467584/t0(0) o38->@:0/0 lens 520/224 e 0 to 0 dl 1790964504 ref 1 fl Interpret:/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964484.072270:0:32609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002076da98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31768:x1877962346467584:12345-0@lo:38: Request processed in 36651us (36857us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790964484.072280:0:32609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000001:2.0:1790964484.072284:0:32609:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1790964484.072285:0:32609:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1790964484.072291:0:32609:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000f49bfa25. 00000020:00000010:2.0:1790964484.072295:0:32609:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000da957b6d. 00000020:00000010:2.0:1790964484.072299:0:32609:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d4483a15. 00000100:00000001:2.0:1790964484.072303:0:32609:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964484.072325:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964484.072340:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1790964484.072347:0:31768:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964484.072349:0:31768:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964484.072351:0:31768:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000b7c9932f. 00000400:00000200:2.0:1790964484.072355:0:31768:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000a32d567b 00000400:00000010:2.0:1790964484.072357:0:31768:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000a32d567b. 00000100:00000001:2.0:1790964484.072359:0:31768:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964484.072362:0:31768:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964499 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964484.072370:0:31768:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964499 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.072376:0:31768:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964484.072378:0:31768:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964484.072380:0:31768:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964484.072383:0:31768:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964484.072385:0:31768:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964484.072387:0:31768:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964484.072390:0:31768:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964484.072399:0:31768:0:(import.c:2195:obd_at_measure()) add 0 to 00000000f6674b97 time=1790964484 v=5 (0 0 0 0) 00000100:00001000:2.0:1790964484.072402:0:31768:0:(import.c:2195:obd_at_measure()) add 1 to 00000000c6034686 time=10 v=10 (10 0 0 0) 00000100:00000001:2.0:1790964484.072405:0:31768:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964484.072413:0:31768:0:(client.c:1506:ptlrpc_check_status()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:2.0:1790964484.072415:0:31768:0:(client.c:1712:after_reply()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:2.0:1790964484.072419:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964499 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.072426:0:31768:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00000001:2.0:1790964484.072430:0:31768:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964484.072432:0:31768:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964484.072434:0:31768:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:2.0:1790964484.072436:0:31768:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00080000:2.0:1790964484.072439:0:31768:0:(import.c:65:import_set_state_nolock()) 00000000efe04c75 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964484.072443:0:31768:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00000001:2.0:1790964484.072445:0:31768:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:2.0:1790964484.072448:0:31768:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964499 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964484.072454:0:31768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089c4f549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31768:1877962346467584:0@lo:38: 00000100:00000001:2.0:1790964484.072460:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.072462:0:31768:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964484.072464:0:31768:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000089c4f549 x1877962346467584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964499 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964484.072471:0:31768:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964484.072473:0:31768:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964484.072476:0:31768:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000afc16b95. 02000000:00000001:2.0:1790964484.072479:0:31768:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964484.072481:0:31768:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964484.072483:0:31768:0:(genops.c:1223:class_import_put()) import 00000000efe04c75 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000020:00000001:2.0:1790964484.072485:0:31768:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964484.072487:0:31768:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 00000000325f50bb. 02000000:00000001:2.0:1790964484.072492:0:31768:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964484.072494:0:31768:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964484.072495:0:31768:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000089c4f549. 00000100:00000001:2.0:1790964484.072499:0:31768:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964484.072507:0:31768:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964484.072509:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.072511:0:31768:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964484.072512:0:31768:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964484.072514:0:31768:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964484.072515:0:31768:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:1.0:1790964484.140774:0:33047:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964484.140789:0:33047:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964484.140794:0:33047:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964484.351905:0:415:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1790964484.351926:0:415:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964484.351934:0:415:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1790964484.351936:0:415:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1790964484.351939:0:415:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1790964484.351942:0:415:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964484.352073:0:415:0:(ldlm_lockd.c:2241:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1790964484.352075:0:415:0:(ldlm_lockd.c:2244:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964484.352077:0:415:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964484.352080:0:415:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964484.352173:0:32592:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964484.352177:0:32592:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964484.352180:0:32592:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 3342 lines, 3342 kept, 0 dropped, 0 bad.